Jul 11 07:38:08.389595 ip-10-0-142-153 systemd[1]: Starting Kubernetes Kubelet...
Jul 11 07:38:08.828681 ip-10-0-142-153 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 11 07:38:08.828681 ip-10-0-142-153 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 11 07:38:08.828681 ip-10-0-142-153 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 11 07:38:08.828681 ip-10-0-142-153 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 11 07:38:08.828681 ip-10-0-142-153 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 11 07:38:08.828681 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.816043    2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 11 07:38:08.828681 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822149    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 07:38:08.828681 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822162    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 07:38:08.828681 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822167    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 07:38:08.828681 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822171    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 07:38:08.828681 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822174    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 07:38:08.828681 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822177    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 07:38:08.828681 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822186    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 07:38:08.831521 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822189    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 07:38:08.831521 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822192    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 07:38:08.831521 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822195    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 07:38:08.831521 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822197    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 07:38:08.831521 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822200    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 07:38:08.831521 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822202    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 07:38:08.831521 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822205    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 07:38:08.831521 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822207    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 07:38:08.831521 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822210    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 07:38:08.831521 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822212    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 07:38:08.831521 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822215    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 07:38:08.831521 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822218    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 07:38:08.831521 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822220    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 07:38:08.831521 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822222    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 07:38:08.831521 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822225    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 07:38:08.831521 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822229    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 07:38:08.831521 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822233    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 07:38:08.831521 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822237    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 07:38:08.831521 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822240    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 07:38:08.833541 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822242    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 07:38:08.833541 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822245    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 07:38:08.833541 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822248    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 07:38:08.833541 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822250    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 07:38:08.833541 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822253    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 07:38:08.833541 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822255    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 07:38:08.833541 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822258    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 07:38:08.833541 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822261    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 07:38:08.833541 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822264    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 07:38:08.833541 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822266    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 07:38:08.833541 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822270    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 07:38:08.833541 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822273    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 07:38:08.833541 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822276    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 07:38:08.833541 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822278    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 07:38:08.833541 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822281    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 07:38:08.833541 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822283    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 07:38:08.833541 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822286    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 07:38:08.833541 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822289    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 07:38:08.833541 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822293    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 07:38:08.833541 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822295    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 07:38:08.836351 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822298    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 07:38:08.836351 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822300    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 07:38:08.836351 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822304    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 07:38:08.836351 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822307    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 07:38:08.836351 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822309    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 07:38:08.836351 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822312    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 07:38:08.836351 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822314    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 07:38:08.836351 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822317    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 07:38:08.836351 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822319    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 07:38:08.836351 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822334    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 07:38:08.836351 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822336    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 07:38:08.836351 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822339    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 07:38:08.836351 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822341    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 07:38:08.836351 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822344    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 07:38:08.836351 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822347    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 07:38:08.836351 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822349    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 07:38:08.836351 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822351    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 07:38:08.836351 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822355    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 07:38:08.836351 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822358    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 07:38:08.838401 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822360    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 07:38:08.838401 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822363    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 07:38:08.838401 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822365    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 07:38:08.838401 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822368    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 07:38:08.838401 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822371    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 07:38:08.838401 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822373    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 07:38:08.838401 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822376    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 07:38:08.838401 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822378    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 07:38:08.838401 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822381    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 07:38:08.838401 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822383    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 07:38:08.838401 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822385    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 07:38:08.838401 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822388    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 07:38:08.838401 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822390    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 07:38:08.838401 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822393    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 07:38:08.838401 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822395    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 07:38:08.838401 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822398    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 07:38:08.838401 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822400    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 07:38:08.838401 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822403    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 07:38:08.838401 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822405    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 07:38:08.838401 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822408    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 07:38:08.841075 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822411    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 07:38:08.841075 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822413    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 07:38:08.841075 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822416    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 07:38:08.841075 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822418    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 07:38:08.841075 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822421    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 07:38:08.841075 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822423    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 07:38:08.841075 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822426    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 07:38:08.841075 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822428    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 07:38:08.841075 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822431    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 07:38:08.841075 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822434    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 07:38:08.841075 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822436    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 07:38:08.841075 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822439    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 07:38:08.841075 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822442    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 07:38:08.841075 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.822444    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 07:38:08.841075 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823145    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 07:38:08.841075 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823153    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 07:38:08.841075 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823156    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 07:38:08.841075 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823160    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 07:38:08.841075 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823163    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 07:38:08.841075 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823166    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 07:38:08.841075 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823168    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 07:38:08.856847 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823171    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 07:38:08.856847 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823173    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 07:38:08.856847 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823176    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 07:38:08.856847 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823178    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 07:38:08.856847 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823181    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 07:38:08.856847 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823183    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 07:38:08.856847 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823186    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 07:38:08.856847 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823189    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 07:38:08.856847 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823192    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 07:38:08.856847 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823196    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 07:38:08.856847 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823199    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 07:38:08.856847 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823201    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 07:38:08.856847 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823206    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 07:38:08.856847 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823209    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 07:38:08.856847 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823213    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 07:38:08.856847 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823215    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 07:38:08.856847 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823218    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 07:38:08.856847 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823221    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 07:38:08.856847 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823223    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 07:38:08.860021 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823226    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 07:38:08.860021 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823228    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 07:38:08.860021 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823231    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 07:38:08.860021 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823233    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 07:38:08.860021 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823237    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 07:38:08.860021 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823240    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 07:38:08.860021 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823243    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 07:38:08.860021 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823245    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 07:38:08.860021 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823248    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 07:38:08.860021 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823251    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 07:38:08.860021 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823255    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 07:38:08.860021 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823257    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 07:38:08.860021 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823261    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 07:38:08.860021 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823263    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 07:38:08.860021 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823266    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 07:38:08.860021 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823269    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 07:38:08.860021 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823271    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 07:38:08.860021 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823274    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 07:38:08.860021 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823276    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 07:38:08.860021 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823278    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 07:38:08.862402 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823283    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 07:38:08.862402 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823285    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 07:38:08.862402 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823288    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 07:38:08.862402 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823290    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 07:38:08.862402 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823293    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 07:38:08.862402 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823295    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 07:38:08.862402 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823298    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 07:38:08.862402 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823300    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 07:38:08.862402 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823303    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 07:38:08.862402 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823306    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 07:38:08.862402 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823308    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 07:38:08.862402 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823312    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 07:38:08.862402 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823315    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 07:38:08.862402 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823317    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 07:38:08.862402 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823320    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 07:38:08.862402 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823335    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 07:38:08.862402 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823338    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 07:38:08.862402 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823340    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 07:38:08.862402 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823343    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 07:38:08.862402 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823345    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 07:38:08.865641 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823348    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 07:38:08.865641 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823350    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 07:38:08.865641 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823352    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 07:38:08.865641 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823355    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 07:38:08.865641 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823358    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 07:38:08.865641 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823360    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 07:38:08.865641 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823363    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 07:38:08.865641 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823365    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 07:38:08.865641 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823369    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 07:38:08.865641 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823372    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 07:38:08.865641 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823375    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 07:38:08.865641 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823377    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 07:38:08.865641 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823381    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 07:38:08.865641 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823383    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 07:38:08.865641 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823386    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 07:38:08.865641 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823388    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 07:38:08.865641 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823391    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 07:38:08.865641 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823393    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 07:38:08.865641 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823396    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 07:38:08.868178 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823398    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 07:38:08.868178 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823401    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 07:38:08.868178 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823403    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 07:38:08.868178 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823406    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 07:38:08.868178 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823409    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 07:38:08.868178 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823412    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 07:38:08.868178 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823414    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 07:38:08.868178 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823417    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 07:38:08.868178 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823419    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 07:38:08.868178 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823422    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 07:38:08.868178 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823424    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 07:38:08.868178 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823427    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 07:38:08.868178 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823429    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 07:38:08.868178 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823431    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 07:38:08.868178 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823784    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 07:38:08.868178 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823788    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 07:38:08.868178 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823791    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 07:38:08.868178 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823794    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 07:38:08.868178 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823796    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 07:38:08.868178 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823799    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 07:38:08.871187 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823801    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 07:38:08.871187 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823804    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 07:38:08.871187 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823806    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 07:38:08.871187 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823809    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 07:38:08.871187 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823812    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 07:38:08.871187 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823816    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 07:38:08.871187 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823819    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 07:38:08.871187 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823821    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 07:38:08.871187 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823824    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 07:38:08.871187 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823826    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 07:38:08.871187 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823829    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 07:38:08.871187 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823831    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 07:38:08.871187 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823834    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 07:38:08.871187 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823836    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 07:38:08.871187 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823838    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 07:38:08.871187 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823841    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 07:38:08.871187 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823845    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 07:38:08.871187 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823847    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 07:38:08.871187 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823850    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 07:38:08.871187 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823852    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 07:38:08.873408 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823855    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 07:38:08.873408 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823857    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 07:38:08.873408 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823860    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 07:38:08.873408 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823862    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 07:38:08.873408 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823865    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 07:38:08.873408 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823867    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 07:38:08.873408 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823870    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 07:38:08.873408 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823872    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 07:38:08.873408 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823875    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 07:38:08.873408 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823878    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 07:38:08.873408 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823880    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 07:38:08.873408 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823883    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 07:38:08.873408 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823885    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 07:38:08.873408 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823888    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 07:38:08.873408 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823890    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 07:38:08.873408 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823893    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 07:38:08.873408 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823895    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 07:38:08.873408 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823899    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 07:38:08.873408 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823901    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 07:38:08.873408 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823904    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 07:38:08.876027 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823906    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 07:38:08.876027 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823910    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 07:38:08.876027 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823912    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 07:38:08.876027 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823914    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 07:38:08.876027 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823917    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 07:38:08.876027 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823919    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 07:38:08.876027 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823922    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 07:38:08.876027 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823924    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 07:38:08.876027 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823928    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 07:38:08.876027 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823930    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 07:38:08.876027 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823933    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 07:38:08.876027 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823935    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 07:38:08.876027 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823937    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 07:38:08.876027 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823940    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 07:38:08.876027 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823942    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 07:38:08.876027 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823944    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 07:38:08.876027 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823947    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 07:38:08.876027 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823949    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 07:38:08.876027 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823952    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 07:38:08.878096 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823954    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 07:38:08.878096 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823957    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 07:38:08.878096 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823959    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 07:38:08.878096 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823962    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 07:38:08.878096 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823964    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 07:38:08.878096 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823966    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 07:38:08.878096 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823970    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 07:38:08.878096 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823973    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 07:38:08.878096 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823977    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 07:38:08.878096 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823980    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 07:38:08.878096 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823984    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 07:38:08.878096 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823987    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 07:38:08.878096 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823990    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 07:38:08.878096 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823993    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 07:38:08.878096 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823995    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 07:38:08.878096 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.823998    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 07:38:08.878096 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.824000    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 07:38:08.878096 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.824003    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 07:38:08.878096 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.824005    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 07:38:08.878096 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.824008    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 07:38:08.880961 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.824010    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 07:38:08.880961 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.824014    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 07:38:08.880961 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.824017    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 07:38:08.880961 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.824020    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 07:38:08.880961 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.824023    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 07:38:08.880961 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.824025    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 07:38:08.880961 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.824027    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 07:38:08.880961 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.824030    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 07:38:08.880961 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.824032    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 07:38:08.880961 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.824035    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 07:38:08.880961 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.824037    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 07:38:08.880961 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.824039    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 07:38:08.880961 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.824043    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 07:38:08.880961 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.824046    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 07:38:08.880961 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824110    2568 flags.go:64] FLAG: --address="0.0.0.0"
Jul 11 07:38:08.880961 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824116    2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 11 07:38:08.880961 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824123    2568 flags.go:64] FLAG: --anonymous-auth="true"
Jul 11 07:38:08.880961 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824127    2568 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 11 07:38:08.880961 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824130    2568 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 11 07:38:08.880961 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824133    2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 11 07:38:08.941149 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824137    2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 11 07:38:08.941149 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824141    2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 11 07:38:08.941149 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824147    2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 11 07:38:08.941149 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824150    2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 11 07:38:08.941149 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824154    2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 11 07:38:08.941149 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824157    2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 11 07:38:08.941149 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824160    2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 11 07:38:08.941149 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824163    2568 flags.go:64] FLAG: --cgroup-root=""
Jul 11 07:38:08.941149 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824166    2568 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 11 07:38:08.941149 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824169    2568 flags.go:64] FLAG: --client-ca-file=""
Jul 11 07:38:08.941149 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824171    2568 flags.go:64] FLAG: --cloud-provider="external"
Jul 11 07:38:08.941149 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824174    2568 flags.go:64] FLAG: --cluster-dns="[]"
Jul 11 07:38:08.941149 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824178    2568 flags.go:64] FLAG: --cluster-domain=""
Jul 11 07:38:08.941149 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824182    2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 11 07:38:08.941149 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824186    2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 11 07:38:08.941149 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824189    2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 11 07:38:08.941149 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824192    2568 flags.go:64] FLAG: --container-log-max-files="5"
Jul 11 07:38:08.941149 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824195    2568 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 11 07:38:08.941149 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824198    2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 11 07:38:08.941149 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824201    2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 11 07:38:08.941149 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824204    2568 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 11 07:38:08.941149 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824207    2568 flags.go:64] FLAG: --contention-profiling="false"
Jul 11 07:38:08.941149 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824209    2568 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 11 07:38:08.941149 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824212    2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 11 07:38:08.894241 ip-10-0-142-153 systemd[1]: Started Kubernetes Kubelet.
Jul 11 07:38:08.983089 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824215    2568 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 11 07:38:08.983089 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824218    2568 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 11 07:38:08.983089 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824221    2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 11 07:38:08.983089 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824224    2568 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 11 07:38:08.983089 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824227    2568 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 11 07:38:08.983089 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824230    2568 flags.go:64] FLAG: --enable-load-reader="false"
Jul 11 07:38:08.983089 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824233    2568 flags.go:64] FLAG: --enable-server="true"
Jul 11 07:38:08.983089 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824236    2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 11 07:38:08.983089 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824240    2568 flags.go:64] FLAG: --event-burst="100"
Jul 11 07:38:08.983089 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824243    2568 flags.go:64] FLAG: --event-qps="50"
Jul 11 07:38:08.983089 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824247    2568 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 11 07:38:08.983089 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824250    2568 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 11 07:38:08.983089 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824253    2568 flags.go:64] FLAG: --eviction-hard=""
Jul 11 07:38:08.983089 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824256    2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 11 07:38:08.983089 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824259    2568 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 11 07:38:08.983089 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824262    2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 11 07:38:08.983089 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824265    2568 flags.go:64] FLAG: --eviction-soft=""
Jul 11 07:38:08.983089 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824268    2568 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 11 07:38:08.983089 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824270    2568 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 11 07:38:08.983089 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824273    2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 11 07:38:08.983089 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824276    2568 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 11 07:38:08.983089 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824280    2568 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 11 07:38:08.983089 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824284    2568 flags.go:64] FLAG: --fail-swap-on="true"
Jul 11 07:38:08.983089 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824287    2568 flags.go:64] FLAG: --feature-gates=""
Jul 11 07:38:08.983089 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824291    2568 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 11 07:38:09.203979 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824293    2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 11 07:38:09.203979 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824297    2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 11 07:38:09.203979 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824300    2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 11 07:38:09.203979 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824303    2568 flags.go:64] FLAG: --healthz-port="10248"
Jul 11 07:38:09.203979 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824305    2568 flags.go:64] FLAG: --help="false"
Jul 11 07:38:09.203979 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824308    2568 flags.go:64] FLAG: --hostname-override="ip-10-0-142-153.ec2.internal"
Jul 11 07:38:09.203979 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824311    2568 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 11 07:38:09.203979 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824314    2568 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 11 07:38:09.203979 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824317    2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 11 07:38:09.203979 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824334    2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 11 07:38:09.203979 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824338    2568 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 11 07:38:09.203979 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824341    2568 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 11 07:38:09.203979 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824343    2568 flags.go:64] FLAG: --image-service-endpoint=""
Jul 11 07:38:09.203979 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824346    2568 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 11 07:38:09.203979 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824349    2568 flags.go:64] FLAG: --kube-api-burst="100"
Jul 11 07:38:09.203979 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824352    2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 11 07:38:09.203979 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824355    2568 flags.go:64] FLAG: --kube-api-qps="50"
Jul 11 07:38:09.203979 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824359    2568 flags.go:64] FLAG: --kube-reserved=""
Jul 11 07:38:09.203979 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824362    2568 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 11 07:38:09.203979 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824365    2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 11 07:38:09.203979 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824368    2568 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 11 07:38:09.203979 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824371    2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 11 07:38:09.203979 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824373    2568 flags.go:64] FLAG: --lock-file=""
Jul 11 07:38:09.203979 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824376    2568 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 11 07:38:09.205294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824379    2568 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 11 07:38:09.205294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824382    2568 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 11 07:38:09.205294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824387    2568 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 11 07:38:09.205294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824390    2568 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 11 07:38:09.205294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824394    2568 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 11 07:38:09.205294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824397    2568 flags.go:64] FLAG: --logging-format="text"
Jul 11 07:38:09.205294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824400    2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 11 07:38:09.205294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824403    2568 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 11 07:38:09.205294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824405    2568 flags.go:64] FLAG: --manifest-url=""
Jul 11 07:38:09.205294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824408    2568 flags.go:64] FLAG: --manifest-url-header=""
Jul 11 07:38:09.205294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824412    2568 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 11 07:38:09.205294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824415    2568 flags.go:64] FLAG: --max-open-files="1000000"
Jul 11 07:38:09.205294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824423    2568 flags.go:64] FLAG: --max-pods="110"
Jul 11 07:38:09.205294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824426    2568 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 11 07:38:09.205294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824429    2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 11 07:38:09.205294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824432    2568 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 11 07:38:09.205294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824434    2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 11 07:38:09.205294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824437    2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 11 07:38:09.205294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824440    2568 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 11 07:38:09.205294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824443    2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 11 07:38:09.205294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824449    2568 flags.go:64] FLAG: --node-status-max-images="50"
Jul 11 07:38:09.205294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824452    2568 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 11 07:38:09.205294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824455    2568 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 11 07:38:09.205294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824458    2568 flags.go:64] FLAG: --pod-cidr=""
Jul 11 07:38:09.206456 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824461    2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 11 07:38:09.206456 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824466    2568 flags.go:64] FLAG: --pod-manifest-path=""
Jul 11 07:38:09.206456 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824470    2568 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 11 07:38:09.206456 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824473    2568 flags.go:64] FLAG: --pods-per-core="0"
Jul 11 07:38:09.206456 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824476    2568 flags.go:64] FLAG: --port="10250"
Jul 11 07:38:09.206456 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824479    2568 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 11 07:38:09.206456 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824482    2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0318e42c3c865e747"
Jul 11 07:38:09.206456 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824485    2568 flags.go:64] FLAG: --qos-reserved=""
Jul 11 07:38:09.206456 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824487    2568 flags.go:64] FLAG: --read-only-port="10255"
Jul 11 07:38:09.206456 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824491    2568 flags.go:64] FLAG: --register-node="true"
Jul 11 07:38:09.206456 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824493    2568 flags.go:64] FLAG: --register-with-taints=""
Jul 11 07:38:09.206456 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824497    2568 flags.go:64] FLAG: --registry-burst="10"
Jul 11 07:38:09.206456 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824501    2568 flags.go:64] FLAG: --registry-qps="5"
Jul 11 07:38:09.206456 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824503    2568 flags.go:64] FLAG: --reserved-cpus=""
Jul 11 07:38:09.206456 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824506    2568 flags.go:64] FLAG: --reserved-memory=""
Jul 11 07:38:09.206456 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824509    2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 11 07:38:09.206456 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824512    2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 11 07:38:09.206456 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824515    2568 flags.go:64] FLAG: --rotate-certificates="false"
Jul 11 07:38:09.206456 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824518    2568 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 11 07:38:09.206456 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824520    2568 flags.go:64] FLAG: --runonce="false"
Jul 11 07:38:09.206456 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824523    2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 11 07:38:09.206456 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824526    2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 11 07:38:09.206456 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824530    2568 flags.go:64] FLAG: --seccomp-default="false"
Jul 11 07:38:09.206456 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824532    2568 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 11 07:38:09.206456 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824535    2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 11 07:38:09.207742 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824538    2568 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 11 07:38:09.207742 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824540    2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 11 07:38:09.207742 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824543    2568 flags.go:64] FLAG: --storage-driver-password="root"
Jul 11 07:38:09.207742 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824546    2568 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 11 07:38:09.207742 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824549    2568 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 11 07:38:09.207742 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824552    2568 flags.go:64] FLAG: --storage-driver-user="root"
Jul 11 07:38:09.207742 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824555    2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 11 07:38:09.207742 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824558    2568 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 11 07:38:09.207742 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824561    2568 flags.go:64] FLAG: --system-cgroups=""
Jul 11 07:38:09.207742 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824565    2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 11 07:38:09.207742 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824570    2568 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 11 07:38:09.207742 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824572    2568 flags.go:64] FLAG: --tls-cert-file=""
Jul 11 07:38:09.207742 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824575    2568 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 11 07:38:09.207742 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824583    2568 flags.go:64] FLAG: --tls-min-version=""
Jul 11 07:38:09.207742 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824586    2568 flags.go:64] FLAG: --tls-private-key-file=""
Jul 11 07:38:09.207742 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824589    2568 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 11 07:38:09.207742 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824591    2568 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 11 07:38:09.207742 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824594    2568 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 11 07:38:09.207742 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824597    2568 flags.go:64] FLAG: --v="2"
Jul 11 07:38:09.207742 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824602    2568 flags.go:64] FLAG: --version="false"
Jul 11 07:38:09.207742 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824606    2568 flags.go:64] FLAG: --vmodule=""
Jul 11 07:38:09.207742 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824610    2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 11 07:38:09.207742 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.824613    2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 11 07:38:09.207742 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826139    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 07:38:09.207742 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826153    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 07:38:09.208855 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826157    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 07:38:09.208855 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826161    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 07:38:09.208855 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826164    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 07:38:09.208855 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826166    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 07:38:09.208855 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826169    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 07:38:09.208855 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826172    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 07:38:09.208855 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826176    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 07:38:09.208855 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826181    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 07:38:09.208855 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826185    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 07:38:09.208855 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826188    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 07:38:09.208855 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826191    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 07:38:09.208855 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826194    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 07:38:09.208855 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826197    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 07:38:09.208855 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826200    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 07:38:09.208855 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826203    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 07:38:09.208855 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826206    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 07:38:09.208855 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826209    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 07:38:09.208855 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826212    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 07:38:09.208855 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826214    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 07:38:09.209940 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826217    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 07:38:09.209940 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826219    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 07:38:09.209940 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826222    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 07:38:09.209940 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826225    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 07:38:09.209940 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826228    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 07:38:09.209940 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826230    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 07:38:09.209940 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826233    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 07:38:09.209940 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826236    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 07:38:09.209940 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826239    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 07:38:09.209940 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826241    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 07:38:09.209940 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826247    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 07:38:09.209940 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826250    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 07:38:09.209940 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826253    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 07:38:09.209940 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826255    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 07:38:09.209940 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826258    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 07:38:09.209940 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826261    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 07:38:09.209940 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826265    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 07:38:09.209940 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826269    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 07:38:09.209940 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826272    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 07:38:09.210782 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826275    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 07:38:09.210782 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826277    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 07:38:09.210782 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826280    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 07:38:09.210782 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826283    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 07:38:09.210782 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826286    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 07:38:09.210782 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826288    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 07:38:09.210782 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826291    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 07:38:09.210782 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826293    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 07:38:09.210782 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826296    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 07:38:09.210782 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826298    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 07:38:09.210782 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826301    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 07:38:09.210782 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826304    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 07:38:09.210782 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826306    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 07:38:09.210782 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826309    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 07:38:09.210782 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826312    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 07:38:09.210782 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826315    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 07:38:09.210782 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826317    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 07:38:09.210782 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826320    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 07:38:09.210782 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826342    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 07:38:09.211859 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826345    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 07:38:09.211859 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826348    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 07:38:09.211859 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826351    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 07:38:09.211859 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826353    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 07:38:09.211859 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826356    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 07:38:09.211859 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826359    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 07:38:09.211859 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826362    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 07:38:09.211859 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826365    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 07:38:09.211859 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826368    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 07:38:09.211859 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826370    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 07:38:09.211859 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826373    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 07:38:09.211859 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826376    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 07:38:09.211859 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826379    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 07:38:09.211859 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826384    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 07:38:09.211859 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826386    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 07:38:09.211859 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826389    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 07:38:09.211859 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826391    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 07:38:09.211859 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826394    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 07:38:09.211859 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826396    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 07:38:09.211859 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826399    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 07:38:09.212732 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826402    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 07:38:09.212732 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826404    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 07:38:09.212732 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826407    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 07:38:09.212732 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826409    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 07:38:09.212732 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826413    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 07:38:09.212732 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826416    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 07:38:09.212732 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826418    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 07:38:09.212732 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826421    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 07:38:09.212732 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826423    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 07:38:09.212732 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826426    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 07:38:09.212732 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826429    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 07:38:09.212732 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826431    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 07:38:09.212732 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826433    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 07:38:09.212732 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826436    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 07:38:09.212732 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826438    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 07:38:09.212732 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826441    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 07:38:09.212732 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826443    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 07:38:09.212732 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826445    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 07:38:09.212732 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826450    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 07:38:09.212732 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.826452    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 07:38:09.213820 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.827193    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 11 07:38:09.213820 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.834851    2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 11 07:38:09.213820 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.834876    2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 11 07:38:09.213820 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.834903    2568 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 11 07:38:09.213820 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.834910    2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 11 07:38:09.213820 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.834990    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 07:38:09.213820 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.834998    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 07:38:09.213820 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835003    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 07:38:09.213820 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835008    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 07:38:09.213820 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835012    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 07:38:09.213820 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835017    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 07:38:09.213820 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835020    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 07:38:09.213820 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835026    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 07:38:09.213820 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835032    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 07:38:09.214646 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835036    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 07:38:09.214646 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835040    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 07:38:09.214646 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835045    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 07:38:09.214646 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835049    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 07:38:09.214646 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835054    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 07:38:09.214646 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835058    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 07:38:09.214646 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835062    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 07:38:09.214646 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835065    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 07:38:09.214646 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835069    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 07:38:09.214646 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835074    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 07:38:09.214646 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835078    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 07:38:09.214646 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835082    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 07:38:09.214646 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835086    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 07:38:09.214646 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835090    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 07:38:09.214646 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835100    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 07:38:09.214646 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835104    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 07:38:09.214646 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835108    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 07:38:09.214646 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835112    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 07:38:09.214646 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835116    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 07:38:09.214646 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835120    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 07:38:09.215757 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835124    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 07:38:09.215757 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835127    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 07:38:09.215757 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835131    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 07:38:09.215757 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835135    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 07:38:09.215757 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835138    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 07:38:09.215757 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835142    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 07:38:09.215757 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835146    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 07:38:09.215757 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835150    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 07:38:09.215757 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835153    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 07:38:09.215757 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835157    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 07:38:09.215757 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835160    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 07:38:09.215757 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835168    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 07:38:09.215757 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835172    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 07:38:09.215757 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835175    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 07:38:09.215757 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835179    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 07:38:09.215757 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835184    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 07:38:09.215757 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835188    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 07:38:09.215757 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835191    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 07:38:09.215757 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835195    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 07:38:09.215757 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835198    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 07:38:09.216590 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835202    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 07:38:09.216590 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835206    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 07:38:09.216590 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835209    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 07:38:09.216590 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835213    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 07:38:09.216590 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835218    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 07:38:09.216590 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835223    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 07:38:09.216590 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835227    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 07:38:09.216590 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835231    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 07:38:09.216590 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835235    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 07:38:09.216590 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835238    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 07:38:09.216590 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835242    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 07:38:09.216590 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835247    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 07:38:09.216590 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835250    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 07:38:09.216590 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835255    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 07:38:09.216590 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835259    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 07:38:09.216590 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835263    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 07:38:09.216590 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835267    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 07:38:09.216590 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835271    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 07:38:09.216590 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835275    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 07:38:09.217675 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835280    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 07:38:09.217675 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835284    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 07:38:09.217675 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835288    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 07:38:09.217675 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835292    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 07:38:09.217675 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835297    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 07:38:09.217675 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835300    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 07:38:09.217675 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835304    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 07:38:09.217675 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835308    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 07:38:09.217675 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835312    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 07:38:09.217675 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835316    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 07:38:09.217675 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835336    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 07:38:09.217675 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835340    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 07:38:09.217675 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835344    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 07:38:09.217675 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835348    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 07:38:09.217675 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835352    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 07:38:09.217675 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835356    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 07:38:09.217675 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835359    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 07:38:09.217675 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835362    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 07:38:09.217675 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835366    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 07:38:09.218446 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835370    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 07:38:09.218446 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835374    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 07:38:09.218446 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835377    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 07:38:09.218446 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835381    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 07:38:09.218446 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835385    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 07:38:09.218446 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835388    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 07:38:09.218446 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835392    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 07:38:09.218446 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835395    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 07:38:09.218446 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835398    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 07:38:09.218446 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835402    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 07:38:09.218446 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835406    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 07:38:09.218446 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835409    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 07:38:09.218446 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.835416    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 11 07:38:09.218446 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835602    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 07:38:09.218446 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835610    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 07:38:09.219283 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835614    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 07:38:09.219283 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835618    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 07:38:09.219283 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835622    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 07:38:09.219283 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835627    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 07:38:09.219283 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835632    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 07:38:09.219283 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835637    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 07:38:09.219283 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835640    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 07:38:09.219283 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835645    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 07:38:09.219283 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835649    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 07:38:09.219283 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835656    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 07:38:09.219283 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835660    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 07:38:09.219283 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835663    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 07:38:09.219283 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835666    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 07:38:09.219283 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835670    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 07:38:09.219283 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835674    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 07:38:09.219283 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835678    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 07:38:09.219283 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835683    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 07:38:09.219283 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835686    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 07:38:09.219283 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835690    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 07:38:09.220116 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835694    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 07:38:09.220116 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835698    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 07:38:09.220116 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835701    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 07:38:09.220116 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835705    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 07:38:09.220116 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835709    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 07:38:09.220116 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835712    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 07:38:09.220116 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835716    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 07:38:09.220116 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835720    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 07:38:09.220116 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835724    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 07:38:09.220116 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835727    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 07:38:09.220116 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835731    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 07:38:09.220116 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835736    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 07:38:09.220116 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835742    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 07:38:09.220116 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835746    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 07:38:09.220116 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835749    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 07:38:09.220116 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835753    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 07:38:09.220116 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835757    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 07:38:09.220116 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835760    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 07:38:09.220116 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835764    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 07:38:09.220942 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835767    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 07:38:09.220942 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835771    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 07:38:09.220942 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835774    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 07:38:09.220942 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835780    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 07:38:09.220942 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835784    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 07:38:09.220942 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835788    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 07:38:09.220942 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835791    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 07:38:09.220942 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835795    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 07:38:09.220942 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835799    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 07:38:09.220942 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835802    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 07:38:09.220942 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835806    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 07:38:09.220942 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835809    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 07:38:09.220942 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835813    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 07:38:09.220942 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835817    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 07:38:09.220942 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835820    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 07:38:09.220942 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835824    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 07:38:09.220942 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835829    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 07:38:09.220942 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835834    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 07:38:09.220942 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835837    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 07:38:09.220942 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835841    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 07:38:09.221761 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835845    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 07:38:09.221761 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835849    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 07:38:09.221761 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835853    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 07:38:09.221761 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835856    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 07:38:09.221761 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835860    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 07:38:09.221761 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835865    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 07:38:09.221761 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835868    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 07:38:09.221761 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835872    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 07:38:09.221761 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835876    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 07:38:09.221761 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835880    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 07:38:09.221761 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835883    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 07:38:09.221761 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835887    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 07:38:09.221761 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835890    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 07:38:09.221761 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835894    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 07:38:09.221761 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835897    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 07:38:09.221761 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835902    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 07:38:09.221761 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835907    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 07:38:09.221761 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835911    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 07:38:09.221761 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835914    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 07:38:09.221761 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835917    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 07:38:09.222583 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835921    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 07:38:09.222583 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835925    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 07:38:09.222583 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835928    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 07:38:09.222583 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835932    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 07:38:09.222583 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835936    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 07:38:09.222583 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835939    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 07:38:09.222583 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835943    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 07:38:09.222583 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835946    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 07:38:09.222583 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835950    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 07:38:09.222583 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835954    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 07:38:09.222583 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835957    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 07:38:09.222583 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835961    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 07:38:09.222583 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835964    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 07:38:09.222583 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835968    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 07:38:09.222583 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835972    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 07:38:09.222583 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835976    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 07:38:09.222583 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835979    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 07:38:09.222583 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835984    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 07:38:09.222583 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:08.835988    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 07:38:09.227560 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.835994    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 11 07:38:09.227560 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.836121    2568 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 11 07:38:09.227560 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.838477    2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 11 07:38:09.227560 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.840228    2568 server.go:1019] "Starting client certificate rotation"
Jul 11 07:38:09.227560 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.841136    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 11 07:38:09.227560 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.841166    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 11 07:38:09.227560 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.842866    2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 11 07:38:09.227560 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.844348    2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 11 07:38:09.227560 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.854913    2568 log.go:25] "Validated CRI v1 runtime API"
Jul 11 07:38:09.227560 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.858136    2568 log.go:25] "Validated CRI v1 image API"
Jul 11 07:38:09.227560 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.859253    2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 11 07:38:09.227560 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.861653    2568 fs.go:135] Filesystem UUIDs: map[44e0ac23-2455-4e4e-9a09-71f1e47cfc3e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 cbbdbe91-890f-4000-a51d-1faeb5e46d67:/dev/nvme0n1p4]
Jul 11 07:38:09.292598 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.861670    2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 11 07:38:09.299562 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.869045    2568 manager.go:216] Machine: {Timestamp:2026-07-11 07:38:08.86758226 +0000 UTC m=+0.352332385 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3220266 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b21f706fccbd87a1a598c5354e164 SystemUUID:ec2b21f7-06fc-cbd8-7a1a-598c5354e164 BootID:83c9647e-75fc-4f43-b0f7-13632b58cb1f Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:30:f3:e1:aa:b3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:30:f3:e1:aa:b3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:94:3e:dd:dd:4f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 11 07:38:09.299562 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.869179    2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 11 07:38:09.299562 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.869277    2568 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 11 07:38:09.299562 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.871352    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 11 07:38:09.299562 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.872728    2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 11 07:38:09.299562 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.872758    2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-153.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 11 07:38:09.299562 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.873967    2568 topology_manager.go:138] "Creating topology manager with none policy"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.873978    2568 container_manager_linux.go:309] "Creating device plugin manager"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.873986    2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.875464    2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.876763    2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.879659    2568 state_mem.go:36] "Initialized new in-memory state store"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.879784    2568 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.879812    2568 kubelet.go:486] "Attempting to sync node with API server"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.879825    2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.879839    2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.879848    2568 kubelet.go:398] "Adding apiserver pod source"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.879855    2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.880205    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.880222    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.883044    2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.885165    2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.885191    2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.885367    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.885381    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.885386    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.885397    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.885404    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.885410    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.885965    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.885975    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.885984    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.886004    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.886016    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.886025    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.887538    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.887546    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.890931    2568 server.go:1268] "Started kubelet"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.891015    2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.891057    2568 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.891033    2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.894093    2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.894629    2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-153.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:08.894850    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-153.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:08.894988    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 11 07:38:09.300112 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:08.895659    2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.896308    2568 server.go:310] "Adding debug handlers to kubelet server"
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:08.900059    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-153.ec2.internal.18c12c2a997bf574  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-153.ec2.internal,UID:ip-10-0-142-153.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-153.ec2.internal,},FirstTimestamp:2026-07-11 07:38:08.89071346 +0000 UTC m=+0.375463585,LastTimestamp:2026-07-11 07:38:08.89071346 +0000 UTC m=+0.375463585,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-153.ec2.internal,}"
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.904846    2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.904844    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:08.904918    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-153.ec2.internal\" not found"
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.905475    2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.905523    2568 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.905540    2568 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.905638    2568 reconstruct.go:97] "Volume reconstruction finished"
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.905645    2568 reconciler.go:29] "Reconciler: start to sync state"
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.905863    2568 factory.go:153] Registering CRI-O factory
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.905875    2568 factory.go:223] Registration of the crio container factory successfully
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.905913    2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.905922    2568 factory.go:55] Registering systemd factory
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.905930    2568 factory.go:223] Registration of the systemd container factory successfully
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.905951    2568 factory.go:103] Registering Raw factory
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.905964    2568 manager.go:1196] Started watching for new ooms in manager
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.906405    2568 manager.go:349] Starting recovery of all containers
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:08.908667    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:08.908721    2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-153.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.915807    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v7bhf"
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.916338    2568 manager.go:354] Recovery completed
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.920228    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v7bhf"
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.920341    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.922846    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.922889    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.922910    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-153.ec2.internal" event="NodeHasSufficientPID"
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.924871    2568 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.924881    2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.924896    2568 state_mem.go:36] "Initialized new in-memory state store"
Jul 11 07:38:09.301783 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.924931    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:08.924947    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-153.ec2.internal.18c12c2a9b669a0c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-153.ec2.internal,UID:ip-10-0-142-153.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-153.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-153.ec2.internal,},FirstTimestamp:2026-07-11 07:38:08.922868236 +0000 UTC m=+0.407618445,LastTimestamp:2026-07-11 07:38:08.922868236 +0000 UTC m=+0.407618445,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-153.ec2.internal,}"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.925698    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.925728    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.925740    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-153.ec2.internal" event="NodeHasSufficientPID"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.925944    2568 policy_none.go:49] "None policy: Start"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.925958    2568 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.925967    2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.927203    2568 policy_none.go:47] "Start"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.996824    2568 manager.go:337] "Starting Device Plugin manager"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:08.996886    2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.996895    2568 server.go:87] "Starting device plugin registration server"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.997142    2568 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.997155    2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.997268    2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.997357    2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:08.997367    2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:08.997843    2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:08.997890    2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-153.ec2.internal\" not found"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:09.064223    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:09.065301    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:09.065360    2568 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:09.065386    2568 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:09.065428    2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:09.067433    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:09.098195    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:09.098960    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:09.098985    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:09.098996    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-153.ec2.internal" event="NodeHasSufficientPID"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:09.099015    2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-153.ec2.internal"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:09.110304    2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-153.ec2.internal"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:09.110333    2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-153.ec2.internal\": node \"ip-10-0-142-153.ec2.internal\" not found"
Jul 11 07:38:09.303142 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:09.135798    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-153.ec2.internal\" not found"
Jul 11 07:38:09.304550 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:09.165825    2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-153.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-153.ec2.internal"]
Jul 11 07:38:09.304550 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:09.165880    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 07:38:09.304550 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:09.167165    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 07:38:09.304550 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:09.167192    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 07:38:09.304550 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:09.167201    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-153.ec2.internal" event="NodeHasSufficientPID"
Jul 11 07:38:09.304550 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:09.168444    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 07:38:09.304550 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:09.168607    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-153.ec2.internal"
Jul 11 07:38:09.304550 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:09.168648    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 07:38:09.304550 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:09.169090    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 07:38:09.304550 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:09.169117    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 07:38:09.304550 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:09.169126    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-153.ec2.internal" event="NodeHasSufficientPID"
Jul 11 07:38:09.304550 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:09.169094    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 07:38:09.304550 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:09.169155    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 07:38:09.304550 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:09.169171    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-153.ec2.internal" event="NodeHasSufficientPID"
Jul 11 07:38:09.304550 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:09.170235    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-153.ec2.internal"
Jul 11 07:38:09.304550 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:09.170262    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 07:38:09.304550 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:09.170868    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 07:38:09.304550 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:09.170892    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 07:38:09.304550 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:09.170905    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-153.ec2.internal" event="NodeHasSufficientPID"
Jul 11 07:38:09.304550 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:09.194878    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-153.ec2.internal\" not found" node="ip-10-0-142-153.ec2.internal"
Jul 11 07:38:10.353564 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:10.353261    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-153.ec2.internal\" not found"
Jul 11 07:38:10.353564 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:10.353299    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-10 07:33:09 +0000 UTC" deadline="2028-03-29 20:47:05.805062098 +0000 UTC"
Jul 11 07:38:10.354093 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:10.353570    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15061h8m55.451499694s"
Jul 11 07:38:10.354093 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:10.353374    2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 11 07:38:10.354093 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:10.353706    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection force closed via ClientConn.Close\") has prevented the request from succeeding"
Jul 11 07:38:10.354093 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:10.353793    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: Get \"https://a6048030159874df8bfe39bca8c64f89-fbaee16ea3b0a0f4.elb.us-east-1.amazonaws.com:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": http2: client connection force closed via ClientConn.Close" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 11 07:38:10.354093 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:10.353804    2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: Get "https://a6048030159874df8bfe39bca8c64f89-fbaee16ea3b0a0f4.elb.us-east-1.amazonaws.com:6443/apis/storage.k8s.io/v1/csinodes/ip-10-0-142-153.ec2.internal?resourceVersion=0": http2: client connection force closed via ClientConn.Close
Jul 11 07:38:10.355648 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:10.355633    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-153.ec2.internal\" not found" node="ip-10-0-142-153.ec2.internal"
Jul 11 07:38:10.368252 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:10.368231    2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 07:38:10.456748 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:10.456716    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-153.ec2.internal\" not found"
Jul 11 07:38:10.456810 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:10.456786    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1bf3b6260bfeb2590dd7397919f42858-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-153.ec2.internal\" (UID: \"1bf3b6260bfeb2590dd7397919f42858\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-153.ec2.internal"
Jul 11 07:38:10.456841 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:10.456809    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e3125c49de272370fc2d31148f0eaee6-config\") pod \"kube-apiserver-proxy-ip-10-0-142-153.ec2.internal\" (UID: \"e3125c49de272370fc2d31148f0eaee6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-153.ec2.internal"
Jul 11 07:38:10.456841 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:10.456825    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1bf3b6260bfeb2590dd7397919f42858-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-153.ec2.internal\" (UID: \"1bf3b6260bfeb2590dd7397919f42858\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-153.ec2.internal"
Jul 11 07:38:10.559916 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:10.559836    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-153.ec2.internal\" not found"
Jul 11 07:38:10.559916 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:10.559870    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1bf3b6260bfeb2590dd7397919f42858-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-153.ec2.internal\" (UID: \"1bf3b6260bfeb2590dd7397919f42858\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-153.ec2.internal"
Jul 11 07:38:10.559916 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:10.559900    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1bf3b6260bfeb2590dd7397919f42858-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-153.ec2.internal\" (UID: \"1bf3b6260bfeb2590dd7397919f42858\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-153.ec2.internal"
Jul 11 07:38:10.559916 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:10.559920    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e3125c49de272370fc2d31148f0eaee6-config\") pod \"kube-apiserver-proxy-ip-10-0-142-153.ec2.internal\" (UID: \"e3125c49de272370fc2d31148f0eaee6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-153.ec2.internal"
Jul 11 07:38:10.561677 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:10.560199    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e3125c49de272370fc2d31148f0eaee6-config\") pod \"kube-apiserver-proxy-ip-10-0-142-153.ec2.internal\" (UID: \"e3125c49de272370fc2d31148f0eaee6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-153.ec2.internal"
Jul 11 07:38:10.561677 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:10.560257    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1bf3b6260bfeb2590dd7397919f42858-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-153.ec2.internal\" (UID: \"1bf3b6260bfeb2590dd7397919f42858\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-153.ec2.internal"
Jul 11 07:38:10.561677 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:10.560277    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1bf3b6260bfeb2590dd7397919f42858-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-153.ec2.internal\" (UID: \"1bf3b6260bfeb2590dd7397919f42858\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-153.ec2.internal"
Jul 11 07:38:10.662830 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:10.662787    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-153.ec2.internal\" not found"
Jul 11 07:38:10.662930 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:10.662862    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-153.ec2.internal"
Jul 11 07:38:10.696264 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:10.696234    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-153.ec2.internal"
Jul 11 07:38:10.765179 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:10.765149    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-153.ec2.internal\" not found"
Jul 11 07:38:10.866179 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:10.866106    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-153.ec2.internal\" not found"
Jul 11 07:38:10.966439 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:10.966406    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-153.ec2.internal\" not found"
Jul 11 07:38:11.067084 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:11.067047    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-153.ec2.internal\" not found"
Jul 11 07:38:11.167669 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:11.167638    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-153.ec2.internal\" not found"
Jul 11 07:38:11.237694 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:11.237664    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 07:38:11.265293 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:11.265257    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bf3b6260bfeb2590dd7397919f42858.slice/crio-f15fcc9bc7292b98d6597179ae5d543a4aaaed26bf4aaf54c2e36d9908772f45 WatchSource:0}: Error finding container f15fcc9bc7292b98d6597179ae5d543a4aaaed26bf4aaf54c2e36d9908772f45: Status 404 returned error can't find the container with id f15fcc9bc7292b98d6597179ae5d543a4aaaed26bf4aaf54c2e36d9908772f45
Jul 11 07:38:11.267755 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:11.267736    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-153.ec2.internal\" not found"
Jul 11 07:38:11.269710 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:11.269692    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 07:38:11.275374 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:11.275352    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3125c49de272370fc2d31148f0eaee6.slice/crio-06842fecd5ed8518b2d3e1df0cc8722cb197dc320685264db9da2d226bd1ca15 WatchSource:0}: Error finding container 06842fecd5ed8518b2d3e1df0cc8722cb197dc320685264db9da2d226bd1ca15: Status 404 returned error can't find the container with id 06842fecd5ed8518b2d3e1df0cc8722cb197dc320685264db9da2d226bd1ca15
Jul 11 07:38:11.356416 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:11.356392    2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 07:38:11.358027 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:11.357983    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-153.ec2.internal" event={"ID":"1bf3b6260bfeb2590dd7397919f42858","Type":"ContainerStarted","Data":"f15fcc9bc7292b98d6597179ae5d543a4aaaed26bf4aaf54c2e36d9908772f45"}
Jul 11 07:38:11.359162 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:11.359140    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-153.ec2.internal" event={"ID":"e3125c49de272370fc2d31148f0eaee6","Type":"ContainerStarted","Data":"06842fecd5ed8518b2d3e1df0cc8722cb197dc320685264db9da2d226bd1ca15"}
Jul 11 07:38:11.405719 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:11.405665    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-153.ec2.internal"
Jul 11 07:38:11.418386 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:11.418370    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 11 07:38:11.419361 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:11.419349    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-153.ec2.internal"
Jul 11 07:38:11.427125 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:11.427110    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 11 07:38:12.353909 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.353862    2568 apiserver.go:52] "Watching apiserver"
Jul 11 07:38:12.353909 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.353896    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 11 07:38:12.362373 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.362338    2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 11 07:38:12.362797 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.362769    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-153.ec2.internal","openshift-multus/multus-zbgln","openshift-multus/network-metrics-daemon-kwbd7","openshift-network-operator/iptables-alerter-d2rwb","kube-system/konnectivity-agent-wz8dm","kube-system/kube-apiserver-proxy-ip-10-0-142-153.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wls88","openshift-cluster-node-tuning-operator/tuned-qs4rr","openshift-image-registry/node-ca-ftfqb","openshift-multus/multus-additional-cni-plugins-8vvmz","openshift-network-diagnostics/network-check-target-9pqz5","openshift-ovn-kubernetes/ovnkube-node-qczqf","kube-system/global-pull-secret-syncer-rw4gk","openshift-dns/node-resolver-mm52k"]
Jul 11 07:38:12.365728 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.365684    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wls88"
Jul 11 07:38:12.367519 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.367495    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 11 07:38:12.367766 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.367725    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zt2cg\""
Jul 11 07:38:12.367766 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.367718    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 11 07:38:12.367887 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.367850    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 11 07:38:12.368207 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.368191    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 11 07:38:12.369140 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.369119    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:12.369292 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:12.369187    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw4gk" podUID="b500f11c-abb4-4699-a581-bceb7b49a3fc"
Jul 11 07:38:12.371507 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.371487    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:38:12.371603 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:12.371557    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwbd7" podUID="91da412b-e856-41ed-b4de-78d3eaf95930"
Jul 11 07:38:12.373811 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.373794    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d2rwb"
Jul 11 07:38:12.376245 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.376220    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wz8dm"
Jul 11 07:38:12.376732 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.376582    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 11 07:38:12.376732 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.376616    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 11 07:38:12.376732 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.376645    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pbs5g\""
Jul 11 07:38:12.376950 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.376826    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 11 07:38:12.378405 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.378381    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 11 07:38:12.379287 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.379109    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mm52k"
Jul 11 07:38:12.379287 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.379137    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 11 07:38:12.379762 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.379744    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tm652\""
Jul 11 07:38:12.381314 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.381295    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-962mn\""
Jul 11 07:38:12.381435 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.381320    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 11 07:38:12.381633 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.381618    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 11 07:38:12.382291 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.382094    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ftfqb"
Jul 11 07:38:12.384490 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.384441    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hpnmg"
Jul 11 07:38:12.385897 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.384736    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 11 07:38:12.385897 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.384773    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 11 07:38:12.385897 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.385082    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 11 07:38:12.385897 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.385150    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pzd94\""
Jul 11 07:38:12.386179 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.386157    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.388689 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.388667    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 11 07:38:12.389145 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.389123    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7h2x7\""
Jul 11 07:38:12.389722 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.389702    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.389722 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.389722    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 11 07:38:12.392034 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.392013    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 11 07:38:12.392151 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.392056    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hpnmg"
Jul 11 07:38:12.392151 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.392023    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 11 07:38:12.392272 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.392178    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 11 07:38:12.392272 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.392241    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-g7r2d\""
Jul 11 07:38:12.392404 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.392335    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 11 07:38:12.392771 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.392753    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8vvmz"
Jul 11 07:38:12.394817 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.394794    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bmrdz\""
Jul 11 07:38:12.394924 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.394818    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 11 07:38:12.394989 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.394937    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 11 07:38:12.395631 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.395615    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:38:12.395732 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:12.395674    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pqz5" podUID="13113aaf-2564-4a4a-9849-5caf85291035"
Jul 11 07:38:12.398251 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.398232    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.402694 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.402589    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 11 07:38:12.402789 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.402729    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 11 07:38:12.402851 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.402800    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 11 07:38:12.402851 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.402829    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-r68tw\""
Jul 11 07:38:12.403054 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.402976    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 11 07:38:12.403054 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.403007    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 11 07:38:12.403054 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.403033    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 11 07:38:12.406707 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.406687    2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 11 07:38:12.487647 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.487617    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d784a88f-047a-4e1b-9a08-4ff5cdccf048-serviceca\") pod \"node-ca-ftfqb\" (UID: \"d784a88f-047a-4e1b-9a08-4ff5cdccf048\") " pod="openshift-image-registry/node-ca-ftfqb"
Jul 11 07:38:12.487756 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.487653    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-host-var-lib-kubelet\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.487756 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.487694    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-host-slash\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.487756 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.487718    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-ovn-node-metrics-cert\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.487916 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.487763    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-etc-kubernetes\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.487916 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.487791    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/be3e9436-265e-4691-9af3-64a911b78b8f-iptables-alerter-script\") pod \"iptables-alerter-d2rwb\" (UID: \"be3e9436-265e-4691-9af3-64a911b78b8f\") " pod="openshift-network-operator/iptables-alerter-d2rwb"
Jul 11 07:38:12.487916 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.487837    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f2f61be-02eb-4215-ab69-c6dde01a5aa7-tmp-dir\") pod \"node-resolver-mm52k\" (UID: \"3f2f61be-02eb-4215-ab69-c6dde01a5aa7\") " pod="openshift-dns/node-resolver-mm52k"
Jul 11 07:38:12.487916 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.487862    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-etc-systemd\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.487916 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.487886    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-run\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.487916 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.487910    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-host-run-netns\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.488208 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.487936    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d70f837c-1485-4db0-ac77-81c13470f6d1-system-cni-dir\") pod \"multus-additional-cni-plugins-8vvmz\" (UID: \"d70f837c-1485-4db0-ac77-81c13470f6d1\") " pod="openshift-multus/multus-additional-cni-plugins-8vvmz"
Jul 11 07:38:12.488208 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.487982    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be3e9436-265e-4691-9af3-64a911b78b8f-host-slash\") pod \"iptables-alerter-d2rwb\" (UID: \"be3e9436-265e-4691-9af3-64a911b78b8f\") " pod="openshift-network-operator/iptables-alerter-d2rwb"
Jul 11 07:38:12.488208 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488006    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-multus-cni-dir\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.488208 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488029    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-cni-binary-copy\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.488208 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488053    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b500f11c-abb4-4699-a581-bceb7b49a3fc-dbus\") pod \"global-pull-secret-syncer-rw4gk\" (UID: \"b500f11c-abb4-4699-a581-bceb7b49a3fc\") " pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:12.488208 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488076    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/96fc09f9-3d14-499b-a562-b79587638c6d-agent-certs\") pod \"konnectivity-agent-wz8dm\" (UID: \"96fc09f9-3d14-499b-a562-b79587638c6d\") " pod="kube-system/konnectivity-agent-wz8dm"
Jul 11 07:38:12.488208 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488113    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-node-log\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.488208 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488147    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-host-cni-netd\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.488208 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488172    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d70f837c-1485-4db0-ac77-81c13470f6d1-cni-binary-copy\") pod \"multus-additional-cni-plugins-8vvmz\" (UID: \"d70f837c-1485-4db0-ac77-81c13470f6d1\") " pod="openshift-multus/multus-additional-cni-plugins-8vvmz"
Jul 11 07:38:12.488611 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488215    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d70f837c-1485-4db0-ac77-81c13470f6d1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8vvmz\" (UID: \"d70f837c-1485-4db0-ac77-81c13470f6d1\") " pod="openshift-multus/multus-additional-cni-plugins-8vvmz"
Jul 11 07:38:12.488611 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488242    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d70f837c-1485-4db0-ac77-81c13470f6d1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8vvmz\" (UID: \"d70f837c-1485-4db0-ac77-81c13470f6d1\") " pod="openshift-multus/multus-additional-cni-plugins-8vvmz"
Jul 11 07:38:12.488611 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488267    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdl27\" (UniqueName: \"kubernetes.io/projected/13113aaf-2564-4a4a-9849-5caf85291035-kube-api-access-tdl27\") pod \"network-check-target-9pqz5\" (UID: \"13113aaf-2564-4a4a-9849-5caf85291035\") " pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:38:12.488611 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488291    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/48df072b-6c66-4b4a-89f6-2d3485e509ea-registration-dir\") pod \"aws-ebs-csi-driver-node-wls88\" (UID: \"48df072b-6c66-4b4a-89f6-2d3485e509ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wls88"
Jul 11 07:38:12.488611 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488316    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-var-lib-kubelet\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.488611 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488362    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-run-ovn\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.488611 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488391    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b500f11c-abb4-4699-a581-bceb7b49a3fc-kubelet-config\") pod \"global-pull-secret-syncer-rw4gk\" (UID: \"b500f11c-abb4-4699-a581-bceb7b49a3fc\") " pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:12.488611 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488414    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3f2f61be-02eb-4215-ab69-c6dde01a5aa7-hosts-file\") pod \"node-resolver-mm52k\" (UID: \"3f2f61be-02eb-4215-ab69-c6dde01a5aa7\") " pod="openshift-dns/node-resolver-mm52k"
Jul 11 07:38:12.488611 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488428    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-etc-sysconfig\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.488611 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488448    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-host\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.488611 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488465    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-etc-tuned\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.488611 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488481    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-etc-openvswitch\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.488611 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488524    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkl9b\" (UniqueName: \"kubernetes.io/projected/d784a88f-047a-4e1b-9a08-4ff5cdccf048-kube-api-access-wkl9b\") pod \"node-ca-ftfqb\" (UID: \"d784a88f-047a-4e1b-9a08-4ff5cdccf048\") " pod="openshift-image-registry/node-ca-ftfqb"
Jul 11 07:38:12.489084 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488552    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d70f837c-1485-4db0-ac77-81c13470f6d1-os-release\") pod \"multus-additional-cni-plugins-8vvmz\" (UID: \"d70f837c-1485-4db0-ac77-81c13470f6d1\") " pod="openshift-multus/multus-additional-cni-plugins-8vvmz"
Jul 11 07:38:12.489084 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488584    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-run-openvswitch\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.489084 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488611    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs\") pod \"network-metrics-daemon-kwbd7\" (UID: \"91da412b-e856-41ed-b4de-78d3eaf95930\") " pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:38:12.489084 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488645    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/48df072b-6c66-4b4a-89f6-2d3485e509ea-etc-selinux\") pod \"aws-ebs-csi-driver-node-wls88\" (UID: \"48df072b-6c66-4b4a-89f6-2d3485e509ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wls88"
Jul 11 07:38:12.489084 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488696    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/48df072b-6c66-4b4a-89f6-2d3485e509ea-sys-fs\") pod \"aws-ebs-csi-driver-node-wls88\" (UID: \"48df072b-6c66-4b4a-89f6-2d3485e509ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wls88"
Jul 11 07:38:12.489084 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488713    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rdgw\" (UniqueName: \"kubernetes.io/projected/48df072b-6c66-4b4a-89f6-2d3485e509ea-kube-api-access-7rdgw\") pod \"aws-ebs-csi-driver-node-wls88\" (UID: \"48df072b-6c66-4b4a-89f6-2d3485e509ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wls88"
Jul 11 07:38:12.489084 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488744    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b500f11c-abb4-4699-a581-bceb7b49a3fc-original-pull-secret\") pod \"global-pull-secret-syncer-rw4gk\" (UID: \"b500f11c-abb4-4699-a581-bceb7b49a3fc\") " pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:12.489084 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488768    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-ovnkube-script-lib\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.489084 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488789    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-cnibin\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.489084 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488810    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-host-var-lib-cni-multus\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.489084 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488828    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s64jg\" (UniqueName: \"kubernetes.io/projected/91da412b-e856-41ed-b4de-78d3eaf95930-kube-api-access-s64jg\") pod \"network-metrics-daemon-kwbd7\" (UID: \"91da412b-e856-41ed-b4de-78d3eaf95930\") " pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:38:12.489084 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488859    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/96fc09f9-3d14-499b-a562-b79587638c6d-konnectivity-ca\") pod \"konnectivity-agent-wz8dm\" (UID: \"96fc09f9-3d14-499b-a562-b79587638c6d\") " pod="kube-system/konnectivity-agent-wz8dm"
Jul 11 07:38:12.489084 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488877    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkvj6\" (UniqueName: \"kubernetes.io/projected/3f2f61be-02eb-4215-ab69-c6dde01a5aa7-kube-api-access-lkvj6\") pod \"node-resolver-mm52k\" (UID: \"3f2f61be-02eb-4215-ab69-c6dde01a5aa7\") " pod="openshift-dns/node-resolver-mm52k"
Jul 11 07:38:12.489670 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488891    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-etc-sysctl-d\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.489670 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488930    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-hostroot\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.489670 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488960    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-multus-daemon-config\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.489670 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488979    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/48df072b-6c66-4b4a-89f6-2d3485e509ea-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wls88\" (UID: \"48df072b-6c66-4b4a-89f6-2d3485e509ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wls88"
Jul 11 07:38:12.489670 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.488998    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/48df072b-6c66-4b4a-89f6-2d3485e509ea-socket-dir\") pod \"aws-ebs-csi-driver-node-wls88\" (UID: \"48df072b-6c66-4b4a-89f6-2d3485e509ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wls88"
Jul 11 07:38:12.489670 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489012    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-lib-modules\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.489670 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489035    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-systemd-units\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.489670 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489068    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-log-socket\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.489670 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489103    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.489670 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489152    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kcd4\" (UniqueName: \"kubernetes.io/projected/be3e9436-265e-4691-9af3-64a911b78b8f-kube-api-access-7kcd4\") pod \"iptables-alerter-d2rwb\" (UID: \"be3e9436-265e-4691-9af3-64a911b78b8f\") " pod="openshift-network-operator/iptables-alerter-d2rwb"
Jul 11 07:38:12.489670 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489171    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-var-lib-openvswitch\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.489670 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489193    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-host-cni-bin\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.489670 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489237    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-ovnkube-config\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.489670 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489284    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-host-run-netns\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.490291 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489314    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-host-kubelet\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.490291 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489354    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-env-overrides\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.490291 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489414    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hcv2\" (UniqueName: \"kubernetes.io/projected/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-kube-api-access-9hcv2\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.490291 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489463    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d70f837c-1485-4db0-ac77-81c13470f6d1-cnibin\") pod \"multus-additional-cni-plugins-8vvmz\" (UID: \"d70f837c-1485-4db0-ac77-81c13470f6d1\") " pod="openshift-multus/multus-additional-cni-plugins-8vvmz"
Jul 11 07:38:12.490291 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489514    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d70f837c-1485-4db0-ac77-81c13470f6d1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8vvmz\" (UID: \"d70f837c-1485-4db0-ac77-81c13470f6d1\") " pod="openshift-multus/multus-additional-cni-plugins-8vvmz"
Jul 11 07:38:12.490291 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489550    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/48df072b-6c66-4b4a-89f6-2d3485e509ea-device-dir\") pod \"aws-ebs-csi-driver-node-wls88\" (UID: \"48df072b-6c66-4b4a-89f6-2d3485e509ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wls88"
Jul 11 07:38:12.490291 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489575    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-etc-kubernetes\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.490291 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489599    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-sys\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.490291 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489617    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-run-systemd\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.490291 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489636    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zkgx\" (UniqueName: \"kubernetes.io/projected/d70f837c-1485-4db0-ac77-81c13470f6d1-kube-api-access-8zkgx\") pod \"multus-additional-cni-plugins-8vvmz\" (UID: \"d70f837c-1485-4db0-ac77-81c13470f6d1\") " pod="openshift-multus/multus-additional-cni-plugins-8vvmz"
Jul 11 07:38:12.490291 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489671    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-etc-modprobe-d\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.490291 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489694    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skv7h\" (UniqueName: \"kubernetes.io/projected/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-kube-api-access-skv7h\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.490291 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489719    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vskqc\" (UniqueName: \"kubernetes.io/projected/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-kube-api-access-vskqc\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.490826 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489733    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d784a88f-047a-4e1b-9a08-4ff5cdccf048-host\") pod \"node-ca-ftfqb\" (UID: \"d784a88f-047a-4e1b-9a08-4ff5cdccf048\") " pod="openshift-image-registry/node-ca-ftfqb"
Jul 11 07:38:12.490826 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489757    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-system-cni-dir\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.490826 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489783    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-host-run-k8s-cni-cncf-io\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.490826 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489804    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-multus-conf-dir\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.490826 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489822    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-host-run-multus-certs\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.490826 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489866    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-os-release\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.490826 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489892    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-multus-socket-dir-parent\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.490826 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489916    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-host-var-lib-cni-bin\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.490826 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489938    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-etc-sysctl-conf\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.490826 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489952    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-tmp\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.490826 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.489968    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-host-run-ovn-kubernetes\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.591165 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591137    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-host-var-lib-cni-bin\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.591324 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591170    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-etc-sysctl-conf\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.591324 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591187    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-tmp\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.591324 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591210    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-host-run-ovn-kubernetes\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.591324 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591260    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-host-run-ovn-kubernetes\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.591324 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591298    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d784a88f-047a-4e1b-9a08-4ff5cdccf048-serviceca\") pod \"node-ca-ftfqb\" (UID: \"d784a88f-047a-4e1b-9a08-4ff5cdccf048\") " pod="openshift-image-registry/node-ca-ftfqb"
Jul 11 07:38:12.591669 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591351    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-host-var-lib-kubelet\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.591669 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591306    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-host-var-lib-cni-bin\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.591669 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591381    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-host-slash\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.591669 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591378    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-etc-sysctl-conf\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.591669 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591424    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-host-var-lib-kubelet\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.591669 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591437    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-host-slash\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.591669 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591462    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-ovn-node-metrics-cert\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.591669 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591493    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-etc-kubernetes\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.591669 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591518    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/be3e9436-265e-4691-9af3-64a911b78b8f-iptables-alerter-script\") pod \"iptables-alerter-d2rwb\" (UID: \"be3e9436-265e-4691-9af3-64a911b78b8f\") " pod="openshift-network-operator/iptables-alerter-d2rwb"
Jul 11 07:38:12.591669 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591543    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f2f61be-02eb-4215-ab69-c6dde01a5aa7-tmp-dir\") pod \"node-resolver-mm52k\" (UID: \"3f2f61be-02eb-4215-ab69-c6dde01a5aa7\") " pod="openshift-dns/node-resolver-mm52k"
Jul 11 07:38:12.591669 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591558    2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 11 07:38:12.591669 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591566    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-etc-kubernetes\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.591669 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591623    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-etc-systemd\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.591669 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591569    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-etc-systemd\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.591669 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591659    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-run\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.592450 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591682    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-host-run-netns\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.592450 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591709    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d70f837c-1485-4db0-ac77-81c13470f6d1-system-cni-dir\") pod \"multus-additional-cni-plugins-8vvmz\" (UID: \"d70f837c-1485-4db0-ac77-81c13470f6d1\") " pod="openshift-multus/multus-additional-cni-plugins-8vvmz"
Jul 11 07:38:12.592450 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591734    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be3e9436-265e-4691-9af3-64a911b78b8f-host-slash\") pod \"iptables-alerter-d2rwb\" (UID: \"be3e9436-265e-4691-9af3-64a911b78b8f\") " pod="openshift-network-operator/iptables-alerter-d2rwb"
Jul 11 07:38:12.592450 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591756    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-multus-cni-dir\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.592450 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591778    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-cni-binary-copy\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.592450 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591799    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b500f11c-abb4-4699-a581-bceb7b49a3fc-dbus\") pod \"global-pull-secret-syncer-rw4gk\" (UID: \"b500f11c-abb4-4699-a581-bceb7b49a3fc\") " pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:12.592450 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591824    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/96fc09f9-3d14-499b-a562-b79587638c6d-agent-certs\") pod \"konnectivity-agent-wz8dm\" (UID: \"96fc09f9-3d14-499b-a562-b79587638c6d\") " pod="kube-system/konnectivity-agent-wz8dm"
Jul 11 07:38:12.592450 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591850    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-node-log\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.592450 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591860    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be3e9436-265e-4691-9af3-64a911b78b8f-host-slash\") pod \"iptables-alerter-d2rwb\" (UID: \"be3e9436-265e-4691-9af3-64a911b78b8f\") " pod="openshift-network-operator/iptables-alerter-d2rwb"
Jul 11 07:38:12.592450 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591903    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f2f61be-02eb-4215-ab69-c6dde01a5aa7-tmp-dir\") pod \"node-resolver-mm52k\" (UID: \"3f2f61be-02eb-4215-ab69-c6dde01a5aa7\") " pod="openshift-dns/node-resolver-mm52k"
Jul 11 07:38:12.592450 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591896    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-host-cni-netd\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.592450 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591941    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d70f837c-1485-4db0-ac77-81c13470f6d1-cni-binary-copy\") pod \"multus-additional-cni-plugins-8vvmz\" (UID: \"d70f837c-1485-4db0-ac77-81c13470f6d1\") " pod="openshift-multus/multus-additional-cni-plugins-8vvmz"
Jul 11 07:38:12.592450 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591820    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d784a88f-047a-4e1b-9a08-4ff5cdccf048-serviceca\") pod \"node-ca-ftfqb\" (UID: \"d784a88f-047a-4e1b-9a08-4ff5cdccf048\") " pod="openshift-image-registry/node-ca-ftfqb"
Jul 11 07:38:12.592450 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591969    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d70f837c-1485-4db0-ac77-81c13470f6d1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8vvmz\" (UID: \"d70f837c-1485-4db0-ac77-81c13470f6d1\") " pod="openshift-multus/multus-additional-cni-plugins-8vvmz"
Jul 11 07:38:12.593150 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.591996    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d70f837c-1485-4db0-ac77-81c13470f6d1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8vvmz\" (UID: \"d70f837c-1485-4db0-ac77-81c13470f6d1\") " pod="openshift-multus/multus-additional-cni-plugins-8vvmz"
Jul 11 07:38:12.593150 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592019    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b500f11c-abb4-4699-a581-bceb7b49a3fc-dbus\") pod \"global-pull-secret-syncer-rw4gk\" (UID: \"b500f11c-abb4-4699-a581-bceb7b49a3fc\") " pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:12.593150 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592026    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdl27\" (UniqueName: \"kubernetes.io/projected/13113aaf-2564-4a4a-9849-5caf85291035-kube-api-access-tdl27\") pod \"network-check-target-9pqz5\" (UID: \"13113aaf-2564-4a4a-9849-5caf85291035\") " pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:38:12.593150 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592068    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d70f837c-1485-4db0-ac77-81c13470f6d1-system-cni-dir\") pod \"multus-additional-cni-plugins-8vvmz\" (UID: \"d70f837c-1485-4db0-ac77-81c13470f6d1\") " pod="openshift-multus/multus-additional-cni-plugins-8vvmz"
Jul 11 07:38:12.593150 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592073    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/48df072b-6c66-4b4a-89f6-2d3485e509ea-registration-dir\") pod \"aws-ebs-csi-driver-node-wls88\" (UID: \"48df072b-6c66-4b4a-89f6-2d3485e509ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wls88"
Jul 11 07:38:12.593150 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592082    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-multus-cni-dir\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.593150 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592118    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-var-lib-kubelet\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.593150 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592127    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/48df072b-6c66-4b4a-89f6-2d3485e509ea-registration-dir\") pod \"aws-ebs-csi-driver-node-wls88\" (UID: \"48df072b-6c66-4b4a-89f6-2d3485e509ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wls88"
Jul 11 07:38:12.593150 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592129    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/be3e9436-265e-4691-9af3-64a911b78b8f-iptables-alerter-script\") pod \"iptables-alerter-d2rwb\" (UID: \"be3e9436-265e-4691-9af3-64a911b78b8f\") " pod="openshift-network-operator/iptables-alerter-d2rwb"
Jul 11 07:38:12.593150 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592146    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-run-ovn\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.593150 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592183    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-run-ovn\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.593150 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592239    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-var-lib-kubelet\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.593150 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592283    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d70f837c-1485-4db0-ac77-81c13470f6d1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8vvmz\" (UID: \"d70f837c-1485-4db0-ac77-81c13470f6d1\") " pod="openshift-multus/multus-additional-cni-plugins-8vvmz"
Jul 11 07:38:12.593150 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592286    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-host-cni-netd\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.593839 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592323    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-node-log\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.593839 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592034    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-host-run-netns\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.593839 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592002    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-run\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.593839 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592383    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b500f11c-abb4-4699-a581-bceb7b49a3fc-kubelet-config\") pod \"global-pull-secret-syncer-rw4gk\" (UID: \"b500f11c-abb4-4699-a581-bceb7b49a3fc\") " pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:12.593839 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592425    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3f2f61be-02eb-4215-ab69-c6dde01a5aa7-hosts-file\") pod \"node-resolver-mm52k\" (UID: \"3f2f61be-02eb-4215-ab69-c6dde01a5aa7\") " pod="openshift-dns/node-resolver-mm52k"
Jul 11 07:38:12.593839 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592422    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-cni-binary-copy\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.593839 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592450    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-etc-sysconfig\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.593839 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592458    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b500f11c-abb4-4699-a581-bceb7b49a3fc-kubelet-config\") pod \"global-pull-secret-syncer-rw4gk\" (UID: \"b500f11c-abb4-4699-a581-bceb7b49a3fc\") " pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:12.593839 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592487    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-host\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.593839 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592502    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-etc-sysconfig\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.593839 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592511    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-etc-tuned\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.593839 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592513    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3f2f61be-02eb-4215-ab69-c6dde01a5aa7-hosts-file\") pod \"node-resolver-mm52k\" (UID: \"3f2f61be-02eb-4215-ab69-c6dde01a5aa7\") " pod="openshift-dns/node-resolver-mm52k"
Jul 11 07:38:12.593839 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592535    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-etc-openvswitch\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.593839 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592553    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-host\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.593839 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592557    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkl9b\" (UniqueName: \"kubernetes.io/projected/d784a88f-047a-4e1b-9a08-4ff5cdccf048-kube-api-access-wkl9b\") pod \"node-ca-ftfqb\" (UID: \"d784a88f-047a-4e1b-9a08-4ff5cdccf048\") " pod="openshift-image-registry/node-ca-ftfqb"
Jul 11 07:38:12.594642 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592577    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d70f837c-1485-4db0-ac77-81c13470f6d1-os-release\") pod \"multus-additional-cni-plugins-8vvmz\" (UID: \"d70f837c-1485-4db0-ac77-81c13470f6d1\") " pod="openshift-multus/multus-additional-cni-plugins-8vvmz"
Jul 11 07:38:12.594642 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592595    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-etc-openvswitch\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.594642 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592597    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-run-openvswitch\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.594642 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592629    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs\") pod \"network-metrics-daemon-kwbd7\" (UID: \"91da412b-e856-41ed-b4de-78d3eaf95930\") " pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:38:12.594642 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592635    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-run-openvswitch\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.594642 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592653    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/48df072b-6c66-4b4a-89f6-2d3485e509ea-etc-selinux\") pod \"aws-ebs-csi-driver-node-wls88\" (UID: \"48df072b-6c66-4b4a-89f6-2d3485e509ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wls88"
Jul 11 07:38:12.594642 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592674    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/48df072b-6c66-4b4a-89f6-2d3485e509ea-sys-fs\") pod \"aws-ebs-csi-driver-node-wls88\" (UID: \"48df072b-6c66-4b4a-89f6-2d3485e509ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wls88"
Jul 11 07:38:12.594642 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592691    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d70f837c-1485-4db0-ac77-81c13470f6d1-os-release\") pod \"multus-additional-cni-plugins-8vvmz\" (UID: \"d70f837c-1485-4db0-ac77-81c13470f6d1\") " pod="openshift-multus/multus-additional-cni-plugins-8vvmz"
Jul 11 07:38:12.594642 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592695    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rdgw\" (UniqueName: \"kubernetes.io/projected/48df072b-6c66-4b4a-89f6-2d3485e509ea-kube-api-access-7rdgw\") pod \"aws-ebs-csi-driver-node-wls88\" (UID: \"48df072b-6c66-4b4a-89f6-2d3485e509ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wls88"
Jul 11 07:38:12.594642 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592718    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b500f11c-abb4-4699-a581-bceb7b49a3fc-original-pull-secret\") pod \"global-pull-secret-syncer-rw4gk\" (UID: \"b500f11c-abb4-4699-a581-bceb7b49a3fc\") " pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:12.594642 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592738    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-ovnkube-script-lib\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.594642 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592760    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-cnibin\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.594642 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592781    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-host-var-lib-cni-multus\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.594642 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592803    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s64jg\" (UniqueName: \"kubernetes.io/projected/91da412b-e856-41ed-b4de-78d3eaf95930-kube-api-access-s64jg\") pod \"network-metrics-daemon-kwbd7\" (UID: \"91da412b-e856-41ed-b4de-78d3eaf95930\") " pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:38:12.595343 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592831    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/96fc09f9-3d14-499b-a562-b79587638c6d-konnectivity-ca\") pod \"konnectivity-agent-wz8dm\" (UID: \"96fc09f9-3d14-499b-a562-b79587638c6d\") " pod="kube-system/konnectivity-agent-wz8dm"
Jul 11 07:38:12.595343 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592855    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkvj6\" (UniqueName: \"kubernetes.io/projected/3f2f61be-02eb-4215-ab69-c6dde01a5aa7-kube-api-access-lkvj6\") pod \"node-resolver-mm52k\" (UID: \"3f2f61be-02eb-4215-ab69-c6dde01a5aa7\") " pod="openshift-dns/node-resolver-mm52k"
Jul 11 07:38:12.595343 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592884    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-etc-sysctl-d\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.595343 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592922    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-hostroot\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.595343 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592947    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-multus-daemon-config\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.595343 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.592986    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/48df072b-6c66-4b4a-89f6-2d3485e509ea-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wls88\" (UID: \"48df072b-6c66-4b4a-89f6-2d3485e509ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wls88"
Jul 11 07:38:12.595343 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.593024    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/48df072b-6c66-4b4a-89f6-2d3485e509ea-socket-dir\") pod \"aws-ebs-csi-driver-node-wls88\" (UID: \"48df072b-6c66-4b4a-89f6-2d3485e509ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wls88"
Jul 11 07:38:12.595343 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.593068    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-lib-modules\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.595343 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.593096    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-systemd-units\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.595343 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:12.593109    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 07:38:12.595343 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.593119    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-log-socket\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.595343 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.593158    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.595343 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.593163    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d70f837c-1485-4db0-ac77-81c13470f6d1-cni-binary-copy\") pod \"multus-additional-cni-plugins-8vvmz\" (UID: \"d70f837c-1485-4db0-ac77-81c13470f6d1\") " pod="openshift-multus/multus-additional-cni-plugins-8vvmz"
Jul 11 07:38:12.595343 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:12.593193    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs podName:91da412b-e856-41ed-b4de-78d3eaf95930 nodeName:}" failed. No retries permitted until 2026-07-11 07:38:13.093170919 +0000 UTC m=+4.577921051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs") pod "network-metrics-daemon-kwbd7" (UID: "91da412b-e856-41ed-b4de-78d3eaf95930") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 07:38:12.596052 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.593214    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.596052 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.593216    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kcd4\" (UniqueName: \"kubernetes.io/projected/be3e9436-265e-4691-9af3-64a911b78b8f-kube-api-access-7kcd4\") pod \"iptables-alerter-d2rwb\" (UID: \"be3e9436-265e-4691-9af3-64a911b78b8f\") " pod="openshift-network-operator/iptables-alerter-d2rwb"
Jul 11 07:38:12.596052 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.593240    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/48df072b-6c66-4b4a-89f6-2d3485e509ea-etc-selinux\") pod \"aws-ebs-csi-driver-node-wls88\" (UID: \"48df072b-6c66-4b4a-89f6-2d3485e509ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wls88"
Jul 11 07:38:12.596052 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.593257    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-var-lib-openvswitch\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.596052 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.593269    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/48df072b-6c66-4b4a-89f6-2d3485e509ea-sys-fs\") pod \"aws-ebs-csi-driver-node-wls88\" (UID: \"48df072b-6c66-4b4a-89f6-2d3485e509ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wls88"
Jul 11 07:38:12.596052 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.593283    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-host-cni-bin\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.596052 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.593308    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-ovnkube-config\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.596052 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.593495    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-host-cni-bin\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.596052 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.593509    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-log-socket\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.596052 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.593543    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-var-lib-openvswitch\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.596052 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.593584    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/48df072b-6c66-4b4a-89f6-2d3485e509ea-socket-dir\") pod \"aws-ebs-csi-driver-node-wls88\" (UID: \"48df072b-6c66-4b4a-89f6-2d3485e509ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wls88"
Jul 11 07:38:12.596052 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.593636    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-systemd-units\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.596052 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.593649    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-lib-modules\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.596052 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:12.593730    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 07:38:12.596734 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:12.593777    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b500f11c-abb4-4699-a581-bceb7b49a3fc-original-pull-secret podName:b500f11c-abb4-4699-a581-bceb7b49a3fc nodeName:}" failed. No retries permitted until 2026-07-11 07:38:13.093759953 +0000 UTC m=+4.578510071 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b500f11c-abb4-4699-a581-bceb7b49a3fc-original-pull-secret") pod "global-pull-secret-syncer-rw4gk" (UID: "b500f11c-abb4-4699-a581-bceb7b49a3fc") : object "kube-system"/"original-pull-secret" not registered
Jul 11 07:38:12.596734 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.593812    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-host-run-netns\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.596734 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.593839    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-host-kubelet\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.596734 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.593840    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d70f837c-1485-4db0-ac77-81c13470f6d1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8vvmz\" (UID: \"d70f837c-1485-4db0-ac77-81c13470f6d1\") " pod="openshift-multus/multus-additional-cni-plugins-8vvmz"
Jul 11 07:38:12.596734 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.593862    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-env-overrides\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.596734 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.593893    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hcv2\" (UniqueName: \"kubernetes.io/projected/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-kube-api-access-9hcv2\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.596734 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.593942    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d70f837c-1485-4db0-ac77-81c13470f6d1-cnibin\") pod \"multus-additional-cni-plugins-8vvmz\" (UID: \"d70f837c-1485-4db0-ac77-81c13470f6d1\") " pod="openshift-multus/multus-additional-cni-plugins-8vvmz"
Jul 11 07:38:12.596734 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.593968    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d70f837c-1485-4db0-ac77-81c13470f6d1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8vvmz\" (UID: \"d70f837c-1485-4db0-ac77-81c13470f6d1\") " pod="openshift-multus/multus-additional-cni-plugins-8vvmz"
Jul 11 07:38:12.596734 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.593995    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/48df072b-6c66-4b4a-89f6-2d3485e509ea-device-dir\") pod \"aws-ebs-csi-driver-node-wls88\" (UID: \"48df072b-6c66-4b4a-89f6-2d3485e509ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wls88"
Jul 11 07:38:12.596734 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.594025    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-etc-kubernetes\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.596734 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.594049    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-sys\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.596734 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.594074    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-run-systemd\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.596734 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.594101    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zkgx\" (UniqueName: \"kubernetes.io/projected/d70f837c-1485-4db0-ac77-81c13470f6d1-kube-api-access-8zkgx\") pod \"multus-additional-cni-plugins-8vvmz\" (UID: \"d70f837c-1485-4db0-ac77-81c13470f6d1\") " pod="openshift-multus/multus-additional-cni-plugins-8vvmz"
Jul 11 07:38:12.597294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.594134    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-etc-modprobe-d\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.597294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.594160    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skv7h\" (UniqueName: \"kubernetes.io/projected/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-kube-api-access-skv7h\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.597294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.594188    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vskqc\" (UniqueName: \"kubernetes.io/projected/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-kube-api-access-vskqc\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.597294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.594204    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-multus-daemon-config\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.597294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.594211    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d784a88f-047a-4e1b-9a08-4ff5cdccf048-host\") pod \"node-ca-ftfqb\" (UID: \"d784a88f-047a-4e1b-9a08-4ff5cdccf048\") " pod="openshift-image-registry/node-ca-ftfqb"
Jul 11 07:38:12.597294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.594292    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d784a88f-047a-4e1b-9a08-4ff5cdccf048-host\") pod \"node-ca-ftfqb\" (UID: \"d784a88f-047a-4e1b-9a08-4ff5cdccf048\") " pod="openshift-image-registry/node-ca-ftfqb"
Jul 11 07:38:12.597294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.594475    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-hostroot\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.597294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.594510    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-host-run-netns\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.597294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.594538    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-host-kubelet\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.597294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.594738    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/96fc09f9-3d14-499b-a562-b79587638c6d-konnectivity-ca\") pod \"konnectivity-agent-wz8dm\" (UID: \"96fc09f9-3d14-499b-a562-b79587638c6d\") " pod="kube-system/konnectivity-agent-wz8dm"
Jul 11 07:38:12.597294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.594840    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-etc-kubernetes\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.597294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.594874    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-ovnkube-script-lib\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.597294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.594885    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-host-var-lib-cni-multus\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.597294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.594946    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/48df072b-6c66-4b4a-89f6-2d3485e509ea-device-dir\") pod \"aws-ebs-csi-driver-node-wls88\" (UID: \"48df072b-6c66-4b4a-89f6-2d3485e509ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wls88"
Jul 11 07:38:12.597294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.594968    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-etc-sysctl-d\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.597971 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.594996    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/48df072b-6c66-4b4a-89f6-2d3485e509ea-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wls88\" (UID: \"48df072b-6c66-4b4a-89f6-2d3485e509ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wls88"
Jul 11 07:38:12.597971 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.595006    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-ovnkube-config\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.597971 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.595030    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d70f837c-1485-4db0-ac77-81c13470f6d1-cnibin\") pod \"multus-additional-cni-plugins-8vvmz\" (UID: \"d70f837c-1485-4db0-ac77-81c13470f6d1\") " pod="openshift-multus/multus-additional-cni-plugins-8vvmz"
Jul 11 07:38:12.597971 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.595040    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-cnibin\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.597971 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.595063    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-run-systemd\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.597971 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.595111    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-sys\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.597971 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.595135    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-etc-modprobe-d\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.597971 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.595151    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-system-cni-dir\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.597971 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.595422    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-system-cni-dir\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.597971 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.595454    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-host-run-k8s-cni-cncf-io\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.597971 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.595513    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-multus-conf-dir\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.597971 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.595541    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-host-run-multus-certs\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.597971 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.595601    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-os-release\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.597971 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.595646    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-env-overrides\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.597971 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.595652    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-multus-socket-dir-parent\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.598623 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.595704    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-multus-socket-dir-parent\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.598623 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.595740    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-host-run-multus-certs\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.598623 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.595759    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-multus-conf-dir\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.598623 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.595800    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-os-release\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.598623 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.595804    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d70f837c-1485-4db0-ac77-81c13470f6d1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8vvmz\" (UID: \"d70f837c-1485-4db0-ac77-81c13470f6d1\") " pod="openshift-multus/multus-additional-cni-plugins-8vvmz"
Jul 11 07:38:12.598623 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.595839    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-host-run-k8s-cni-cncf-io\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.598623 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.595952    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-etc-tuned\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.598623 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.596504    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/96fc09f9-3d14-499b-a562-b79587638c6d-agent-certs\") pod \"konnectivity-agent-wz8dm\" (UID: \"96fc09f9-3d14-499b-a562-b79587638c6d\") " pod="kube-system/konnectivity-agent-wz8dm"
Jul 11 07:38:12.598623 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.596920    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-tmp\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.598623 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.597893    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-ovn-node-metrics-cert\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.599309 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:12.599289    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 07:38:12.599514 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:12.599313    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 07:38:12.599514 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:12.599328    2568 projected.go:196] Error preparing data for projected volume kube-api-access-tdl27 for pod openshift-network-diagnostics/network-check-target-9pqz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 07:38:12.599514 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:12.599424    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13113aaf-2564-4a4a-9849-5caf85291035-kube-api-access-tdl27 podName:13113aaf-2564-4a4a-9849-5caf85291035 nodeName:}" failed. No retries permitted until 2026-07-11 07:38:13.099404249 +0000 UTC m=+4.584154382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tdl27" (UniqueName: "kubernetes.io/projected/13113aaf-2564-4a4a-9849-5caf85291035-kube-api-access-tdl27") pod "network-check-target-9pqz5" (UID: "13113aaf-2564-4a4a-9849-5caf85291035") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 07:38:12.602109 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.602051    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkl9b\" (UniqueName: \"kubernetes.io/projected/d784a88f-047a-4e1b-9a08-4ff5cdccf048-kube-api-access-wkl9b\") pod \"node-ca-ftfqb\" (UID: \"d784a88f-047a-4e1b-9a08-4ff5cdccf048\") " pod="openshift-image-registry/node-ca-ftfqb"
Jul 11 07:38:12.602658 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.602255    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kcd4\" (UniqueName: \"kubernetes.io/projected/be3e9436-265e-4691-9af3-64a911b78b8f-kube-api-access-7kcd4\") pod \"iptables-alerter-d2rwb\" (UID: \"be3e9436-265e-4691-9af3-64a911b78b8f\") " pod="openshift-network-operator/iptables-alerter-d2rwb"
Jul 11 07:38:12.602658 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.602620    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rdgw\" (UniqueName: \"kubernetes.io/projected/48df072b-6c66-4b4a-89f6-2d3485e509ea-kube-api-access-7rdgw\") pod \"aws-ebs-csi-driver-node-wls88\" (UID: \"48df072b-6c66-4b4a-89f6-2d3485e509ea\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wls88"
Jul 11 07:38:12.604623 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.604568    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skv7h\" (UniqueName: \"kubernetes.io/projected/e1c486be-7224-4e40-a3e1-423aa7d5dc6c-kube-api-access-skv7h\") pod \"tuned-qs4rr\" (UID: \"e1c486be-7224-4e40-a3e1-423aa7d5dc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.604623 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.604578    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zkgx\" (UniqueName: \"kubernetes.io/projected/d70f837c-1485-4db0-ac77-81c13470f6d1-kube-api-access-8zkgx\") pod \"multus-additional-cni-plugins-8vvmz\" (UID: \"d70f837c-1485-4db0-ac77-81c13470f6d1\") " pod="openshift-multus/multus-additional-cni-plugins-8vvmz"
Jul 11 07:38:12.604777 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.604687    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s64jg\" (UniqueName: \"kubernetes.io/projected/91da412b-e856-41ed-b4de-78d3eaf95930-kube-api-access-s64jg\") pod \"network-metrics-daemon-kwbd7\" (UID: \"91da412b-e856-41ed-b4de-78d3eaf95930\") " pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:38:12.605483 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.605396    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkvj6\" (UniqueName: \"kubernetes.io/projected/3f2f61be-02eb-4215-ab69-c6dde01a5aa7-kube-api-access-lkvj6\") pod \"node-resolver-mm52k\" (UID: \"3f2f61be-02eb-4215-ab69-c6dde01a5aa7\") " pod="openshift-dns/node-resolver-mm52k"
Jul 11 07:38:12.606558 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.606528    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hcv2\" (UniqueName: \"kubernetes.io/projected/fc4cb970-b721-43bb-b7e3-4b4cfc971cab-kube-api-access-9hcv2\") pod \"multus-zbgln\" (UID: \"fc4cb970-b721-43bb-b7e3-4b4cfc971cab\") " pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.606663 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.606580    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vskqc\" (UniqueName: \"kubernetes.io/projected/f1cdf779-e8f1-4798-af6c-13c2bcdb5c27-kube-api-access-vskqc\") pod \"ovnkube-node-qczqf\" (UID: \"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27\") " pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:12.676581 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.676550    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wls88"
Jul 11 07:38:12.688673 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.688652    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d2rwb"
Jul 11 07:38:12.696626 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.696603    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wz8dm"
Jul 11 07:38:12.702513 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.702495    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mm52k"
Jul 11 07:38:12.708592 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.708569    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ftfqb"
Jul 11 07:38:12.716375 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.716355    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qs4rr"
Jul 11 07:38:12.723203 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.723182    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zbgln"
Jul 11 07:38:12.729909 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.729893    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8vvmz"
Jul 11 07:38:12.736768 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:12.736744    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:13.100605 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:13.100527    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdl27\" (UniqueName: \"kubernetes.io/projected/13113aaf-2564-4a4a-9849-5caf85291035-kube-api-access-tdl27\") pod \"network-check-target-9pqz5\" (UID: \"13113aaf-2564-4a4a-9849-5caf85291035\") " pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:38:13.100605 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:13.100586    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs\") pod \"network-metrics-daemon-kwbd7\" (UID: \"91da412b-e856-41ed-b4de-78d3eaf95930\") " pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:38:13.100835 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:13.100624    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b500f11c-abb4-4699-a581-bceb7b49a3fc-original-pull-secret\") pod \"global-pull-secret-syncer-rw4gk\" (UID: \"b500f11c-abb4-4699-a581-bceb7b49a3fc\") " pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:13.100835 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:13.100671    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 07:38:13.100835 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:13.100698    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 07:38:13.100835 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:13.100711    2568 projected.go:196] Error preparing data for projected volume kube-api-access-tdl27 for pod openshift-network-diagnostics/network-check-target-9pqz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 07:38:13.100835 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:13.100740    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 07:38:13.100835 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:13.100758    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 07:38:13.100835 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:13.100779    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13113aaf-2564-4a4a-9849-5caf85291035-kube-api-access-tdl27 podName:13113aaf-2564-4a4a-9849-5caf85291035 nodeName:}" failed. No retries permitted until 2026-07-11 07:38:14.100760663 +0000 UTC m=+5.585510791 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tdl27" (UniqueName: "kubernetes.io/projected/13113aaf-2564-4a4a-9849-5caf85291035-kube-api-access-tdl27") pod "network-check-target-9pqz5" (UID: "13113aaf-2564-4a4a-9849-5caf85291035") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 07:38:13.100835 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:13.100800    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs podName:91da412b-e856-41ed-b4de-78d3eaf95930 nodeName:}" failed. No retries permitted until 2026-07-11 07:38:14.100790019 +0000 UTC m=+5.585540146 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs") pod "network-metrics-daemon-kwbd7" (UID: "91da412b-e856-41ed-b4de-78d3eaf95930") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 07:38:13.100835 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:13.100829    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b500f11c-abb4-4699-a581-bceb7b49a3fc-original-pull-secret podName:b500f11c-abb4-4699-a581-bceb7b49a3fc nodeName:}" failed. No retries permitted until 2026-07-11 07:38:14.10081005 +0000 UTC m=+5.585560167 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b500f11c-abb4-4699-a581-bceb7b49a3fc-original-pull-secret") pod "global-pull-secret-syncer-rw4gk" (UID: "b500f11c-abb4-4699-a581-bceb7b49a3fc") : object "kube-system"/"original-pull-secret" not registered
Jul 11 07:38:13.251560 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:13.251530    2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 07:38:13.366959 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:13.366938    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48df072b_6c66_4b4a_89f6_2d3485e509ea.slice/crio-864497789abc48b6e15bae27ad5633f3ee81b2b71812f39b53f9f04f229a1715 WatchSource:0}: Error finding container 864497789abc48b6e15bae27ad5633f3ee81b2b71812f39b53f9f04f229a1715: Status 404 returned error can't find the container with id 864497789abc48b6e15bae27ad5633f3ee81b2b71812f39b53f9f04f229a1715
Jul 11 07:38:13.367620 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:13.367135    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f2f61be_02eb_4215_ab69_c6dde01a5aa7.slice/crio-8912a9c9331a89ebdf885cc66fd22c1a99b122153958098fe6572a33a275e170 WatchSource:0}: Error finding container 8912a9c9331a89ebdf885cc66fd22c1a99b122153958098fe6572a33a275e170: Status 404 returned error can't find the container with id 8912a9c9331a89ebdf885cc66fd22c1a99b122153958098fe6572a33a275e170
Jul 11 07:38:13.367620 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:13.367368    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qczqf" event={"ID":"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27","Type":"ContainerStarted","Data":"031ac12a8412a4bbb9c4fd3d4726a9e1710171d1472073c440abce1e66ea18df"}
Jul 11 07:38:13.368759 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:13.368733    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wz8dm" event={"ID":"96fc09f9-3d14-499b-a562-b79587638c6d","Type":"ContainerStarted","Data":"a3c7460da32c12476b80fdd13289d18e7d12b77d7f06a14c80704428e2a7f57b"}
Jul 11 07:38:13.389167 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:13.389142    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd784a88f_047a_4e1b_9a08_4ff5cdccf048.slice/crio-7c88b9054f8fb18d21e2c36272c831fb34e6102f6f90b80d97a8b6c7aad0a556 WatchSource:0}: Error finding container 7c88b9054f8fb18d21e2c36272c831fb34e6102f6f90b80d97a8b6c7aad0a556: Status 404 returned error can't find the container with id 7c88b9054f8fb18d21e2c36272c831fb34e6102f6f90b80d97a8b6c7aad0a556
Jul 11 07:38:13.390437 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:13.390376    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1c486be_7224_4e40_a3e1_423aa7d5dc6c.slice/crio-289e1b3796f7e9e12ef9a4088000449766319ddda4ff68d0b783c784a21a5f75 WatchSource:0}: Error finding container 289e1b3796f7e9e12ef9a4088000449766319ddda4ff68d0b783c784a21a5f75: Status 404 returned error can't find the container with id 289e1b3796f7e9e12ef9a4088000449766319ddda4ff68d0b783c784a21a5f75
Jul 11 07:38:13.392516 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:13.392406    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe3e9436_265e_4691_9af3_64a911b78b8f.slice/crio-13ed0a64d015c28fe1dbc42309cf78cd847c3e3181d2df6c9efe1e80a2cc4c7b WatchSource:0}: Error finding container 13ed0a64d015c28fe1dbc42309cf78cd847c3e3181d2df6c9efe1e80a2cc4c7b: Status 404 returned error can't find the container with id 13ed0a64d015c28fe1dbc42309cf78cd847c3e3181d2df6c9efe1e80a2cc4c7b
Jul 11 07:38:13.393268 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:13.393241    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc4cb970_b721_43bb_b7e3_4b4cfc971cab.slice/crio-12406126ab812ae5879b2acfc62e3647fedbe9dfa69f2501bea4d8a4cc2ada3e WatchSource:0}: Error finding container 12406126ab812ae5879b2acfc62e3647fedbe9dfa69f2501bea4d8a4cc2ada3e: Status 404 returned error can't find the container with id 12406126ab812ae5879b2acfc62e3647fedbe9dfa69f2501bea4d8a4cc2ada3e
Jul 11 07:38:13.395835 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:13.395797    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-10 07:33:13 +0000 UTC" deadline="2028-02-09 13:08:15.692216521 +0000 UTC"
Jul 11 07:38:13.395894 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:13.395835    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13877h30m2.296384429s"
Jul 11 07:38:14.065911 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:14.065876    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:38:14.066072 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:14.066025    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwbd7" podUID="91da412b-e856-41ed-b4de-78d3eaf95930"
Jul 11 07:38:14.066527 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:14.066480    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:38:14.066633 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:14.066575    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pqz5" podUID="13113aaf-2564-4a4a-9849-5caf85291035"
Jul 11 07:38:14.066700 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:14.066644    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:14.066751 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:14.066717    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw4gk" podUID="b500f11c-abb4-4699-a581-bceb7b49a3fc"
Jul 11 07:38:14.111161 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:14.111128    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdl27\" (UniqueName: \"kubernetes.io/projected/13113aaf-2564-4a4a-9849-5caf85291035-kube-api-access-tdl27\") pod \"network-check-target-9pqz5\" (UID: \"13113aaf-2564-4a4a-9849-5caf85291035\") " pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:38:14.111328 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:14.111183    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs\") pod \"network-metrics-daemon-kwbd7\" (UID: \"91da412b-e856-41ed-b4de-78d3eaf95930\") " pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:38:14.111328 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:14.111214    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b500f11c-abb4-4699-a581-bceb7b49a3fc-original-pull-secret\") pod \"global-pull-secret-syncer-rw4gk\" (UID: \"b500f11c-abb4-4699-a581-bceb7b49a3fc\") " pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:14.111480 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:14.111368    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 07:38:14.111480 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:14.111425    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b500f11c-abb4-4699-a581-bceb7b49a3fc-original-pull-secret podName:b500f11c-abb4-4699-a581-bceb7b49a3fc nodeName:}" failed. No retries permitted until 2026-07-11 07:38:16.111405541 +0000 UTC m=+7.596155655 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b500f11c-abb4-4699-a581-bceb7b49a3fc-original-pull-secret") pod "global-pull-secret-syncer-rw4gk" (UID: "b500f11c-abb4-4699-a581-bceb7b49a3fc") : object "kube-system"/"original-pull-secret" not registered
Jul 11 07:38:14.111813 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:14.111795    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 07:38:14.111884 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:14.111824    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 07:38:14.111884 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:14.111838    2568 projected.go:196] Error preparing data for projected volume kube-api-access-tdl27 for pod openshift-network-diagnostics/network-check-target-9pqz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 07:38:14.111884 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:14.111884    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13113aaf-2564-4a4a-9849-5caf85291035-kube-api-access-tdl27 podName:13113aaf-2564-4a4a-9849-5caf85291035 nodeName:}" failed. No retries permitted until 2026-07-11 07:38:16.111868678 +0000 UTC m=+7.596618795 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tdl27" (UniqueName: "kubernetes.io/projected/13113aaf-2564-4a4a-9849-5caf85291035-kube-api-access-tdl27") pod "network-check-target-9pqz5" (UID: "13113aaf-2564-4a4a-9849-5caf85291035") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 07:38:14.112043 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:14.111952    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 07:38:14.112043 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:14.111985    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs podName:91da412b-e856-41ed-b4de-78d3eaf95930 nodeName:}" failed. No retries permitted until 2026-07-11 07:38:16.111973094 +0000 UTC m=+7.596723211 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs") pod "network-metrics-daemon-kwbd7" (UID: "91da412b-e856-41ed-b4de-78d3eaf95930") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 07:38:14.379190 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:14.379105    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-153.ec2.internal" event={"ID":"e3125c49de272370fc2d31148f0eaee6","Type":"ContainerStarted","Data":"ca5ab3fb90a687a96ae9094bf709bd54ad7b15759794e6c8ae5fffadbf8dff8e"}
Jul 11 07:38:14.390782 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:14.390748    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d2rwb" event={"ID":"be3e9436-265e-4691-9af3-64a911b78b8f","Type":"ContainerStarted","Data":"13ed0a64d015c28fe1dbc42309cf78cd847c3e3181d2df6c9efe1e80a2cc4c7b"}
Jul 11 07:38:14.394708 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:14.394659    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-153.ec2.internal" podStartSLOduration=2.394637212 podStartE2EDuration="2.394637212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 07:38:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:38:14.393684129 +0000 UTC m=+5.878434266" watchObservedRunningTime="2026-07-11 07:38:14.394637212 +0000 UTC m=+5.879387350"
Jul 11 07:38:14.396391 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:14.396332    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-10 07:33:13 +0000 UTC" deadline="2028-01-05 05:34:35.87364137 +0000 UTC"
Jul 11 07:38:14.396391 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:14.396364    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13029h56m21.477281791s"
Jul 11 07:38:14.400073 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:14.399987    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qs4rr" event={"ID":"e1c486be-7224-4e40-a3e1-423aa7d5dc6c","Type":"ContainerStarted","Data":"289e1b3796f7e9e12ef9a4088000449766319ddda4ff68d0b783c784a21a5f75"}
Jul 11 07:38:14.414721 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:14.414667    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mm52k" event={"ID":"3f2f61be-02eb-4215-ab69-c6dde01a5aa7","Type":"ContainerStarted","Data":"8912a9c9331a89ebdf885cc66fd22c1a99b122153958098fe6572a33a275e170"}
Jul 11 07:38:14.418976 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:14.418946    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vvmz" event={"ID":"d70f837c-1485-4db0-ac77-81c13470f6d1","Type":"ContainerStarted","Data":"bc66892822b975cea196d2be289d9345a2c21050b945d91d5238aed57ef0a510"}
Jul 11 07:38:14.424715 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:14.424689    2568 generic.go:356] "Generic (PLEG): container finished" podID="1bf3b6260bfeb2590dd7397919f42858" containerID="8900871cf8e9b745abbd8035eea846201167c7be041ac1d69d29103f3b155930" exitCode=0
Jul 11 07:38:14.424821 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:14.424765    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-153.ec2.internal" event={"ID":"1bf3b6260bfeb2590dd7397919f42858","Type":"ContainerDied","Data":"8900871cf8e9b745abbd8035eea846201167c7be041ac1d69d29103f3b155930"}
Jul 11 07:38:14.435950 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:14.435872    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zbgln" event={"ID":"fc4cb970-b721-43bb-b7e3-4b4cfc971cab","Type":"ContainerStarted","Data":"12406126ab812ae5879b2acfc62e3647fedbe9dfa69f2501bea4d8a4cc2ada3e"}
Jul 11 07:38:14.456250 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:14.456207    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wls88" event={"ID":"48df072b-6c66-4b4a-89f6-2d3485e509ea","Type":"ContainerStarted","Data":"864497789abc48b6e15bae27ad5633f3ee81b2b71812f39b53f9f04f229a1715"}
Jul 11 07:38:14.466950 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:14.466922    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ftfqb" event={"ID":"d784a88f-047a-4e1b-9a08-4ff5cdccf048","Type":"ContainerStarted","Data":"7c88b9054f8fb18d21e2c36272c831fb34e6102f6f90b80d97a8b6c7aad0a556"}
Jul 11 07:38:15.486683 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:15.486465    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-153.ec2.internal" event={"ID":"1bf3b6260bfeb2590dd7397919f42858","Type":"ContainerStarted","Data":"515a44cbe0ae6601dc27d423d338416145b22ffc622fa764947f6dfb692dff10"}
Jul 11 07:38:16.065850 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:16.065737    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:38:16.065850 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:16.065771    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:38:16.066121 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:16.065894    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwbd7" podUID="91da412b-e856-41ed-b4de-78d3eaf95930"
Jul 11 07:38:16.066706 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:16.066214    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:16.066706 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:16.066480    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pqz5" podUID="13113aaf-2564-4a4a-9849-5caf85291035"
Jul 11 07:38:16.066706 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:16.066351    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw4gk" podUID="b500f11c-abb4-4699-a581-bceb7b49a3fc"
Jul 11 07:38:16.130110 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:16.129207    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdl27\" (UniqueName: \"kubernetes.io/projected/13113aaf-2564-4a4a-9849-5caf85291035-kube-api-access-tdl27\") pod \"network-check-target-9pqz5\" (UID: \"13113aaf-2564-4a4a-9849-5caf85291035\") " pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:38:16.130110 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:16.129260    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs\") pod \"network-metrics-daemon-kwbd7\" (UID: \"91da412b-e856-41ed-b4de-78d3eaf95930\") " pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:38:16.130110 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:16.129291    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b500f11c-abb4-4699-a581-bceb7b49a3fc-original-pull-secret\") pod \"global-pull-secret-syncer-rw4gk\" (UID: \"b500f11c-abb4-4699-a581-bceb7b49a3fc\") " pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:16.130110 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:16.129465    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 07:38:16.130110 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:16.129531    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b500f11c-abb4-4699-a581-bceb7b49a3fc-original-pull-secret podName:b500f11c-abb4-4699-a581-bceb7b49a3fc nodeName:}" failed. No retries permitted until 2026-07-11 07:38:20.12951148 +0000 UTC m=+11.614261599 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b500f11c-abb4-4699-a581-bceb7b49a3fc-original-pull-secret") pod "global-pull-secret-syncer-rw4gk" (UID: "b500f11c-abb4-4699-a581-bceb7b49a3fc") : object "kube-system"/"original-pull-secret" not registered
Jul 11 07:38:16.130110 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:16.129622    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 07:38:16.130110 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:16.129639    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 07:38:16.130110 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:16.129653    2568 projected.go:196] Error preparing data for projected volume kube-api-access-tdl27 for pod openshift-network-diagnostics/network-check-target-9pqz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 07:38:16.130110 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:16.129690    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13113aaf-2564-4a4a-9849-5caf85291035-kube-api-access-tdl27 podName:13113aaf-2564-4a4a-9849-5caf85291035 nodeName:}" failed. No retries permitted until 2026-07-11 07:38:20.129677392 +0000 UTC m=+11.614427523 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tdl27" (UniqueName: "kubernetes.io/projected/13113aaf-2564-4a4a-9849-5caf85291035-kube-api-access-tdl27") pod "network-check-target-9pqz5" (UID: "13113aaf-2564-4a4a-9849-5caf85291035") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 07:38:16.130110 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:16.129755    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 07:38:16.130110 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:16.129787    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs podName:91da412b-e856-41ed-b4de-78d3eaf95930 nodeName:}" failed. No retries permitted until 2026-07-11 07:38:20.129775524 +0000 UTC m=+11.614525640 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs") pod "network-metrics-daemon-kwbd7" (UID: "91da412b-e856-41ed-b4de-78d3eaf95930") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 07:38:18.066061 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:18.065957    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:18.066061 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:18.066030    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:38:18.066602 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:18.066141    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw4gk" podUID="b500f11c-abb4-4699-a581-bceb7b49a3fc"
Jul 11 07:38:18.066602 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:18.066178    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:38:18.066602 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:18.066301    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pqz5" podUID="13113aaf-2564-4a4a-9849-5caf85291035"
Jul 11 07:38:18.066602 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:18.066416    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwbd7" podUID="91da412b-e856-41ed-b4de-78d3eaf95930"
Jul 11 07:38:20.066770 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:20.065945    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:38:20.066770 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:20.066098    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwbd7" podUID="91da412b-e856-41ed-b4de-78d3eaf95930"
Jul 11 07:38:20.066770 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:20.066510    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:38:20.066770 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:20.066603    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pqz5" podUID="13113aaf-2564-4a4a-9849-5caf85291035"
Jul 11 07:38:20.066770 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:20.066649    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:20.066770 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:20.066719    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw4gk" podUID="b500f11c-abb4-4699-a581-bceb7b49a3fc"
Jul 11 07:38:20.164566 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:20.164489    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdl27\" (UniqueName: \"kubernetes.io/projected/13113aaf-2564-4a4a-9849-5caf85291035-kube-api-access-tdl27\") pod \"network-check-target-9pqz5\" (UID: \"13113aaf-2564-4a4a-9849-5caf85291035\") " pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:38:20.164566 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:20.164551    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs\") pod \"network-metrics-daemon-kwbd7\" (UID: \"91da412b-e856-41ed-b4de-78d3eaf95930\") " pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:38:20.164809 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:20.164581    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b500f11c-abb4-4699-a581-bceb7b49a3fc-original-pull-secret\") pod \"global-pull-secret-syncer-rw4gk\" (UID: \"b500f11c-abb4-4699-a581-bceb7b49a3fc\") " pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:20.164809 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:20.164730    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 07:38:20.164809 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:20.164796    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b500f11c-abb4-4699-a581-bceb7b49a3fc-original-pull-secret podName:b500f11c-abb4-4699-a581-bceb7b49a3fc nodeName:}" failed. No retries permitted until 2026-07-11 07:38:28.164777624 +0000 UTC m=+19.649527743 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b500f11c-abb4-4699-a581-bceb7b49a3fc-original-pull-secret") pod "global-pull-secret-syncer-rw4gk" (UID: "b500f11c-abb4-4699-a581-bceb7b49a3fc") : object "kube-system"/"original-pull-secret" not registered
Jul 11 07:38:20.165169 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:20.165080    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 07:38:20.165169 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:20.165136    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs podName:91da412b-e856-41ed-b4de-78d3eaf95930 nodeName:}" failed. No retries permitted until 2026-07-11 07:38:28.165120177 +0000 UTC m=+19.649870307 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs") pod "network-metrics-daemon-kwbd7" (UID: "91da412b-e856-41ed-b4de-78d3eaf95930") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 07:38:20.165371 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:20.165207    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 07:38:20.165371 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:20.165223    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 07:38:20.165371 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:20.165236    2568 projected.go:196] Error preparing data for projected volume kube-api-access-tdl27 for pod openshift-network-diagnostics/network-check-target-9pqz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 07:38:20.165371 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:20.165276    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13113aaf-2564-4a4a-9849-5caf85291035-kube-api-access-tdl27 podName:13113aaf-2564-4a4a-9849-5caf85291035 nodeName:}" failed. No retries permitted until 2026-07-11 07:38:28.165263896 +0000 UTC m=+19.650014030 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tdl27" (UniqueName: "kubernetes.io/projected/13113aaf-2564-4a4a-9849-5caf85291035-kube-api-access-tdl27") pod "network-check-target-9pqz5" (UID: "13113aaf-2564-4a4a-9849-5caf85291035") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 07:38:22.066115 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:22.065981    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:38:22.066115 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:22.066007    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:38:22.066115 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:22.066016    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:22.066691 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:22.066134    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwbd7" podUID="91da412b-e856-41ed-b4de-78d3eaf95930"
Jul 11 07:38:22.066691 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:22.066529    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw4gk" podUID="b500f11c-abb4-4699-a581-bceb7b49a3fc"
Jul 11 07:38:22.066691 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:22.066627    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pqz5" podUID="13113aaf-2564-4a4a-9849-5caf85291035"
Jul 11 07:38:24.066203 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:24.066167    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:24.066203 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:24.066201    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:38:24.066718 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:24.066168    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:38:24.066718 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:24.066288    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw4gk" podUID="b500f11c-abb4-4699-a581-bceb7b49a3fc"
Jul 11 07:38:24.066718 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:24.066394    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pqz5" podUID="13113aaf-2564-4a4a-9849-5caf85291035"
Jul 11 07:38:24.066718 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:24.066471    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwbd7" podUID="91da412b-e856-41ed-b4de-78d3eaf95930"
Jul 11 07:38:26.066561 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:26.066520    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:38:26.066561 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:26.066552    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:38:26.067027 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:26.066520    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:26.067027 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:26.066660    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwbd7" podUID="91da412b-e856-41ed-b4de-78d3eaf95930"
Jul 11 07:38:26.067027 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:26.066734    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw4gk" podUID="b500f11c-abb4-4699-a581-bceb7b49a3fc"
Jul 11 07:38:26.067027 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:26.066770    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pqz5" podUID="13113aaf-2564-4a4a-9849-5caf85291035"
Jul 11 07:38:28.066129 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:28.066092    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:38:28.066664 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:28.066092    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:38:28.066664 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:28.066209    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwbd7" podUID="91da412b-e856-41ed-b4de-78d3eaf95930"
Jul 11 07:38:28.066664 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:28.066301    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pqz5" podUID="13113aaf-2564-4a4a-9849-5caf85291035"
Jul 11 07:38:28.066664 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:28.066096    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:28.066664 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:28.066424    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw4gk" podUID="b500f11c-abb4-4699-a581-bceb7b49a3fc"
Jul 11 07:38:28.229500 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:28.229467    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdl27\" (UniqueName: \"kubernetes.io/projected/13113aaf-2564-4a4a-9849-5caf85291035-kube-api-access-tdl27\") pod \"network-check-target-9pqz5\" (UID: \"13113aaf-2564-4a4a-9849-5caf85291035\") " pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:38:28.229500 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:28.229504    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs\") pod \"network-metrics-daemon-kwbd7\" (UID: \"91da412b-e856-41ed-b4de-78d3eaf95930\") " pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:38:28.229693 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:28.229523    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b500f11c-abb4-4699-a581-bceb7b49a3fc-original-pull-secret\") pod \"global-pull-secret-syncer-rw4gk\" (UID: \"b500f11c-abb4-4699-a581-bceb7b49a3fc\") " pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:28.229693 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:28.229624    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 07:38:28.229693 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:28.229627    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 07:38:28.229693 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:28.229643    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 07:38:28.229693 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:28.229652    2568 projected.go:196] Error preparing data for projected volume kube-api-access-tdl27 for pod openshift-network-diagnostics/network-check-target-9pqz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 07:38:28.229693 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:28.229671    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b500f11c-abb4-4699-a581-bceb7b49a3fc-original-pull-secret podName:b500f11c-abb4-4699-a581-bceb7b49a3fc nodeName:}" failed. No retries permitted until 2026-07-11 07:38:44.229656876 +0000 UTC m=+35.714407007 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b500f11c-abb4-4699-a581-bceb7b49a3fc-original-pull-secret") pod "global-pull-secret-syncer-rw4gk" (UID: "b500f11c-abb4-4699-a581-bceb7b49a3fc") : object "kube-system"/"original-pull-secret" not registered
Jul 11 07:38:28.229693 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:28.229675    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 07:38:28.229693 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:28.229692    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13113aaf-2564-4a4a-9849-5caf85291035-kube-api-access-tdl27 podName:13113aaf-2564-4a4a-9849-5caf85291035 nodeName:}" failed. No retries permitted until 2026-07-11 07:38:44.229681057 +0000 UTC m=+35.714431182 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tdl27" (UniqueName: "kubernetes.io/projected/13113aaf-2564-4a4a-9849-5caf85291035-kube-api-access-tdl27") pod "network-check-target-9pqz5" (UID: "13113aaf-2564-4a4a-9849-5caf85291035") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 07:38:28.229913 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:28.229714    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs podName:91da412b-e856-41ed-b4de-78d3eaf95930 nodeName:}" failed. No retries permitted until 2026-07-11 07:38:44.229702262 +0000 UTC m=+35.714452373 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs") pod "network-metrics-daemon-kwbd7" (UID: "91da412b-e856-41ed-b4de-78d3eaf95930") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 07:38:30.065605 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:30.065566    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:38:30.066066 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:30.065566    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:30.066066 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:30.065671    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pqz5" podUID="13113aaf-2564-4a4a-9849-5caf85291035"
Jul 11 07:38:30.066066 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:30.065692    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:38:30.066066 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:30.065790    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw4gk" podUID="b500f11c-abb4-4699-a581-bceb7b49a3fc"
Jul 11 07:38:30.066066 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:30.065848    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwbd7" podUID="91da412b-e856-41ed-b4de-78d3eaf95930"
Jul 11 07:38:32.066375 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:32.066340    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:38:32.066890 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:32.066340    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:38:32.066890 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:32.066476    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pqz5" podUID="13113aaf-2564-4a4a-9849-5caf85291035"
Jul 11 07:38:32.066890 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:32.066340    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:32.066890 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:32.066596    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwbd7" podUID="91da412b-e856-41ed-b4de-78d3eaf95930"
Jul 11 07:38:32.066890 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:32.066685    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw4gk" podUID="b500f11c-abb4-4699-a581-bceb7b49a3fc"
Jul 11 07:38:32.521507 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:32.520995    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wz8dm" event={"ID":"96fc09f9-3d14-499b-a562-b79587638c6d","Type":"ContainerStarted","Data":"ea3da7eec0e8845e86feb02ad201aad8e585ad2301ab8d9956775a49d079c043"}
Jul 11 07:38:32.523117 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:32.523083    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qs4rr" event={"ID":"e1c486be-7224-4e40-a3e1-423aa7d5dc6c","Type":"ContainerStarted","Data":"052af5e7663de938b713d6c77efbb25bfb80b30f5b0b93b8bcbec3fe94ad01d8"}
Jul 11 07:38:32.524513 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:32.524463    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mm52k" event={"ID":"3f2f61be-02eb-4215-ab69-c6dde01a5aa7","Type":"ContainerStarted","Data":"d61e5bb4880740172bad561e3cb77a1a38a9a2b739b38c2f99c8cd6ac12e9a21"}
Jul 11 07:38:32.526050 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:32.525985    2568 generic.go:356] "Generic (PLEG): container finished" podID="d70f837c-1485-4db0-ac77-81c13470f6d1" containerID="bd6f23e6c1c4a05288450fa7a7fad2ec1c5c36856bfde7a90afc2613428874ee" exitCode=0
Jul 11 07:38:32.526156 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:32.526068    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vvmz" event={"ID":"d70f837c-1485-4db0-ac77-81c13470f6d1","Type":"ContainerDied","Data":"bd6f23e6c1c4a05288450fa7a7fad2ec1c5c36856bfde7a90afc2613428874ee"}
Jul 11 07:38:32.527918 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:32.527738    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zbgln" event={"ID":"fc4cb970-b721-43bb-b7e3-4b4cfc971cab","Type":"ContainerStarted","Data":"4661d6a6177394586d94b17010bac281387eeacc3eaa2d75285ce9d5cfc6047b"}
Jul 11 07:38:32.529317 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:32.529294    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wls88" event={"ID":"48df072b-6c66-4b4a-89f6-2d3485e509ea","Type":"ContainerStarted","Data":"4828255ba5594733b2f31749f612a2fd4e6129e941356c5ed05b3639315121ea"}
Jul 11 07:38:32.530714 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:32.530695    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ftfqb" event={"ID":"d784a88f-047a-4e1b-9a08-4ff5cdccf048","Type":"ContainerStarted","Data":"73722f31cefdc2bd09d2ba06ede8f4269f30ec7a5d78264109f7018114dc848f"}
Jul 11 07:38:32.532360 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:32.532314    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qczqf" event={"ID":"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27","Type":"ContainerStarted","Data":"3f1567ec5f1d10469db8287c05417fefdebe72fc38c1f4bfaf3f866adf426f50"}
Jul 11 07:38:32.532450 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:32.532392    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qczqf" event={"ID":"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27","Type":"ContainerStarted","Data":"75b10eb03dd74e1e5ade31396eb19ae5db52c9a9fc0266ef865f6e5fd6cc2f03"}
Jul 11 07:38:32.537915 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:32.537877    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-153.ec2.internal" podStartSLOduration=20.537865833 podStartE2EDuration="20.537865833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 07:38:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:38:15.504013807 +0000 UTC m=+6.988763943" watchObservedRunningTime="2026-07-11 07:38:32.537865833 +0000 UTC m=+24.022615965"
Jul 11 07:38:32.538071 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:32.538053    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wz8dm" podStartSLOduration=3.746918099 podStartE2EDuration="22.538048492s" totalImagesPullingTime="18.791130393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:38:32.537502385 +0000 UTC m=+24.022252517" watchObservedRunningTime="2026-07-11 07:38:32.538048492 +0000 UTC m=+24.022798624"
Jul 11 07:38:32.551927 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:32.551892    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qs4rr" podStartSLOduration=3.750343039 podStartE2EDuration="22.551879504s" totalImagesPullingTime="18.801536465s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 07:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:38:32.551676718 +0000 UTC m=+24.036426851" watchObservedRunningTime="2026-07-11 07:38:32.551879504 +0000 UTC m=+24.036629636"
Jul 11 07:38:32.598587 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:32.598533    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mm52k" podStartSLOduration=3.832258465 podStartE2EDuration="22.598511119s" totalImagesPullingTime="18.766252654s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 07:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:38:32.597595095 +0000 UTC m=+24.082345227" watchObservedRunningTime="2026-07-11 07:38:32.598511119 +0000 UTC m=+24.083261253"
Jul 11 07:38:32.625972 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:32.625923    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ftfqb" podStartSLOduration=3.835064296 podStartE2EDuration="22.625906959s" totalImagesPullingTime="18.790842663s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 07:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:38:32.610413275 +0000 UTC m=+24.095163408" watchObservedRunningTime="2026-07-11 07:38:32.625906959 +0000 UTC m=+24.110657090"
Jul 11 07:38:32.626350 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:32.626310    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zbgln" podStartSLOduration=3.70394888 podStartE2EDuration="22.626301793s" totalImagesPullingTime="18.922352913s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 07:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:38:32.62586896 +0000 UTC m=+24.110619095" watchObservedRunningTime="2026-07-11 07:38:32.626301793 +0000 UTC m=+24.111051925"
Jul 11 07:38:33.537913 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:33.537866    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qczqf" event={"ID":"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27","Type":"ContainerStarted","Data":"688fa7bd3aa1a885a08d1e8b553535948021ffcba71dc99d1158f122d2c1a17f"}
Jul 11 07:38:33.538679 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:33.537979    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qczqf" event={"ID":"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27","Type":"ContainerStarted","Data":"49f76ccc67394eca91c8e760eade3308fd14194e64ef2a05b08b7e1dc7afb9a3"}
Jul 11 07:38:33.538679 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:33.538027    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qczqf" event={"ID":"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27","Type":"ContainerStarted","Data":"68594f28d672137dd85f9d9a4eb366dced5627f94068c3283504d9e38a624290"}
Jul 11 07:38:33.538679 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:33.538056    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qczqf" event={"ID":"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27","Type":"ContainerStarted","Data":"9327cbe7729e2b24108aad32bfcd9dc4f2bf4668563369d377e9cf156da4ce1d"}
Jul 11 07:38:33.539499 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:33.539469    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d2rwb" event={"ID":"be3e9436-265e-4691-9af3-64a911b78b8f","Type":"ContainerStarted","Data":"0a8e1174ff7aff5f48e3c7148b818ac9fc2b224ba9f614941d3912d2bc561ece"}
Jul 11 07:38:33.555398 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:33.555359    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-d2rwb" podStartSLOduration=4.753813447 podStartE2EDuration="23.555346264s" totalImagesPullingTime="18.801532817s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 07:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:38:33.55477237 +0000 UTC m=+25.039522503" watchObservedRunningTime="2026-07-11 07:38:33.555346264 +0000 UTC m=+25.040096410"
Jul 11 07:38:33.683647 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:33.683622    2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 11 07:38:34.066387 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:34.066356    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:38:34.066664 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:34.066501    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwbd7" podUID="91da412b-e856-41ed-b4de-78d3eaf95930"
Jul 11 07:38:34.066664 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:34.066356    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:34.066664 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:34.066632    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw4gk" podUID="b500f11c-abb4-4699-a581-bceb7b49a3fc"
Jul 11 07:38:34.066664 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:34.066356    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:38:34.066870 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:34.066744    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pqz5" podUID="13113aaf-2564-4a4a-9849-5caf85291035"
Jul 11 07:38:34.366768 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:34.366575    2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-11T07:38:33.683641519Z","UUID":"16adb1fa-42c4-4857-af10-5347d42dbdb7","Handler":null,"Name":"","Endpoint":""}
Jul 11 07:38:34.368283 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:34.368259    2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 11 07:38:34.368414 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:34.368307    2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 11 07:38:34.543074 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:34.543039    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wls88" event={"ID":"48df072b-6c66-4b4a-89f6-2d3485e509ea","Type":"ContainerStarted","Data":"5571fa99c1afea1e5570b3bbc8bbdae2fdda6400d2fda1e1896fd53cb6e5aa11"}
Jul 11 07:38:35.549397 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:35.549156    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qczqf" event={"ID":"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27","Type":"ContainerStarted","Data":"547211b35ab9de8dd71abf63f260c7f89506307e971e869931913e0bd22fda21"}
Jul 11 07:38:35.551237 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:35.551211    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wls88" event={"ID":"48df072b-6c66-4b4a-89f6-2d3485e509ea","Type":"ContainerStarted","Data":"41109150262ebedb24025a575effa847abdd4c38068d652b44f4ef4ca62c0670"}
Jul 11 07:38:35.566960 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:35.566905    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wls88" podStartSLOduration=4.639788468 podStartE2EDuration="25.56688856s" totalImagesPullingTime="20.927100092s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 07:38:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:38:35.566574357 +0000 UTC m=+27.051324501" watchObservedRunningTime="2026-07-11 07:38:35.56688856 +0000 UTC m=+27.051638722"
Jul 11 07:38:36.066142 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:36.066105    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:38:36.066142 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:36.066139    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:36.066428 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:36.066153    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:38:36.066428 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:36.066247    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwbd7" podUID="91da412b-e856-41ed-b4de-78d3eaf95930"
Jul 11 07:38:36.066428 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:36.066393    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw4gk" podUID="b500f11c-abb4-4699-a581-bceb7b49a3fc"
Jul 11 07:38:36.066569 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:36.066501    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pqz5" podUID="13113aaf-2564-4a4a-9849-5caf85291035"
Jul 11 07:38:37.233562 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:37.233544    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wz8dm"
Jul 11 07:38:37.234296 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:37.234281    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wz8dm"
Jul 11 07:38:37.560086 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:37.559824    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qczqf" event={"ID":"f1cdf779-e8f1-4798-af6c-13c2bcdb5c27","Type":"ContainerStarted","Data":"a1415559147bc9bb486952daaabb7d1589eae1939532be168e2585045e363039"}
Jul 11 07:38:37.560272 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:37.560141    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:37.561592 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:37.561566    2568 generic.go:356] "Generic (PLEG): container finished" podID="d70f837c-1485-4db0-ac77-81c13470f6d1" containerID="fb27825a067cacb4d3bca20b52d424fcfeb6799254b061e756c41428bafe1c84" exitCode=0
Jul 11 07:38:37.561712 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:37.561655    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vvmz" event={"ID":"d70f837c-1485-4db0-ac77-81c13470f6d1","Type":"ContainerDied","Data":"fb27825a067cacb4d3bca20b52d424fcfeb6799254b061e756c41428bafe1c84"}
Jul 11 07:38:37.561869 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:37.561853    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wz8dm"
Jul 11 07:38:37.562477 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:37.562398    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wz8dm"
Jul 11 07:38:37.576609 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:37.576588    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:37.590973 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:37.590926    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qczqf" podStartSLOduration=8.651339466 podStartE2EDuration="27.590911606s" totalImagesPullingTime="18.93957214s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 07:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:38:37.589421642 +0000 UTC m=+29.074171773" watchObservedRunningTime="2026-07-11 07:38:37.590911606 +0000 UTC m=+29.075661738"
Jul 11 07:38:38.065590 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:38.065564    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:38:38.065764 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:38.065634    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:38.065764 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:38.065714    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:38:38.065764 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:38.065734    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwbd7" podUID="91da412b-e856-41ed-b4de-78d3eaf95930"
Jul 11 07:38:38.065856 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:38.065780    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pqz5" podUID="13113aaf-2564-4a4a-9849-5caf85291035"
Jul 11 07:38:38.065856 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:38.065822    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw4gk" podUID="b500f11c-abb4-4699-a581-bceb7b49a3fc"
Jul 11 07:38:38.566947 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:38.566416    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:38.567870 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:38.567790    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:38.596832 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:38.596569    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:38:39.233520 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:39.233448    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rw4gk"]
Jul 11 07:38:39.233844 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:39.233544    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:39.233844 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:39.233634    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw4gk" podUID="b500f11c-abb4-4699-a581-bceb7b49a3fc"
Jul 11 07:38:39.239491 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:39.239458    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kwbd7"]
Jul 11 07:38:39.239622 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:39.239558    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:38:39.239686 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:39.239649    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwbd7" podUID="91da412b-e856-41ed-b4de-78d3eaf95930"
Jul 11 07:38:39.240084 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:39.240054    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9pqz5"]
Jul 11 07:38:39.240150 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:39.240133    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:38:39.240210 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:39.240195    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pqz5" podUID="13113aaf-2564-4a4a-9849-5caf85291035"
Jul 11 07:38:39.570139 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:39.570103    2568 generic.go:356] "Generic (PLEG): container finished" podID="d70f837c-1485-4db0-ac77-81c13470f6d1" containerID="ad4e37699ed0cfcfcacf7d6551040953717a928ec8c3544b25a537e65641d219" exitCode=0
Jul 11 07:38:39.570682 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:39.570171    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vvmz" event={"ID":"d70f837c-1485-4db0-ac77-81c13470f6d1","Type":"ContainerDied","Data":"ad4e37699ed0cfcfcacf7d6551040953717a928ec8c3544b25a537e65641d219"}
Jul 11 07:38:41.066545 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:41.066264    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:38:41.066918 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:41.066280    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:38:41.066918 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:41.066632    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pqz5" podUID="13113aaf-2564-4a4a-9849-5caf85291035"
Jul 11 07:38:41.066918 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:41.066312    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:41.066918 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:41.066719    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwbd7" podUID="91da412b-e856-41ed-b4de-78d3eaf95930"
Jul 11 07:38:41.066918 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:41.066816    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw4gk" podUID="b500f11c-abb4-4699-a581-bceb7b49a3fc"
Jul 11 07:38:41.577572 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:41.577539    2568 generic.go:356] "Generic (PLEG): container finished" podID="d70f837c-1485-4db0-ac77-81c13470f6d1" containerID="27793128c7e7e2b44d5dde05b3567e51128ff864feecc833d34e4120d94cea8a" exitCode=0
Jul 11 07:38:41.577750 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:41.577598    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vvmz" event={"ID":"d70f837c-1485-4db0-ac77-81c13470f6d1","Type":"ContainerDied","Data":"27793128c7e7e2b44d5dde05b3567e51128ff864feecc833d34e4120d94cea8a"}
Jul 11 07:38:43.070077 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:43.070043    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:43.070748 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:43.070042    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:38:43.070748 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:43.070169    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:38:43.070748 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:43.070174    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rw4gk" podUID="b500f11c-abb4-4699-a581-bceb7b49a3fc"
Jul 11 07:38:43.070748 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:43.070243    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pqz5" podUID="13113aaf-2564-4a4a-9849-5caf85291035"
Jul 11 07:38:43.070748 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:43.070312    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwbd7" podUID="91da412b-e856-41ed-b4de-78d3eaf95930"
Jul 11 07:38:44.254094 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.254061    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdl27\" (UniqueName: \"kubernetes.io/projected/13113aaf-2564-4a4a-9849-5caf85291035-kube-api-access-tdl27\") pod \"network-check-target-9pqz5\" (UID: \"13113aaf-2564-4a4a-9849-5caf85291035\") " pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:38:44.254461 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.254101    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs\") pod \"network-metrics-daemon-kwbd7\" (UID: \"91da412b-e856-41ed-b4de-78d3eaf95930\") " pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:38:44.254461 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.254120    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b500f11c-abb4-4699-a581-bceb7b49a3fc-original-pull-secret\") pod \"global-pull-secret-syncer-rw4gk\" (UID: \"b500f11c-abb4-4699-a581-bceb7b49a3fc\") " pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:44.254461 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:44.254211    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 07:38:44.254461 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:44.254214    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 07:38:44.254461 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:44.254223    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 07:38:44.254461 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:44.254240    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 07:38:44.254461 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:44.254250    2568 projected.go:196] Error preparing data for projected volume kube-api-access-tdl27 for pod openshift-network-diagnostics/network-check-target-9pqz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 07:38:44.254461 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:44.254261    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b500f11c-abb4-4699-a581-bceb7b49a3fc-original-pull-secret podName:b500f11c-abb4-4699-a581-bceb7b49a3fc nodeName:}" failed. No retries permitted until 2026-07-11 07:39:16.254247842 +0000 UTC m=+67.738997954 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b500f11c-abb4-4699-a581-bceb7b49a3fc-original-pull-secret") pod "global-pull-secret-syncer-rw4gk" (UID: "b500f11c-abb4-4699-a581-bceb7b49a3fc") : object "kube-system"/"original-pull-secret" not registered
Jul 11 07:38:44.254461 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:44.254274    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs podName:91da412b-e856-41ed-b4de-78d3eaf95930 nodeName:}" failed. No retries permitted until 2026-07-11 07:39:16.254267876 +0000 UTC m=+67.739017987 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs") pod "network-metrics-daemon-kwbd7" (UID: "91da412b-e856-41ed-b4de-78d3eaf95930") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 07:38:44.254461 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:44.254284    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13113aaf-2564-4a4a-9849-5caf85291035-kube-api-access-tdl27 podName:13113aaf-2564-4a4a-9849-5caf85291035 nodeName:}" failed. No retries permitted until 2026-07-11 07:39:16.254278771 +0000 UTC m=+67.739028882 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tdl27" (UniqueName: "kubernetes.io/projected/13113aaf-2564-4a4a-9849-5caf85291035-kube-api-access-tdl27") pod "network-check-target-9pqz5" (UID: "13113aaf-2564-4a4a-9849-5caf85291035") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 07:38:44.766103 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.766073    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-153.ec2.internal" event="NodeReady"
Jul 11 07:38:44.766230 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.766206    2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 11 07:38:44.802537 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.802356    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-rk2t2"]
Jul 11 07:38:44.824833 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.824577    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c64959f6f-krrjs"]
Jul 11 07:38:44.824833 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.824696    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-rk2t2"
Jul 11 07:38:44.827837 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.827810    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 11 07:38:44.828124 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.828105    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 11 07:38:44.829173 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.828839    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-g8tz4\""
Jul 11 07:38:44.840163 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.840144    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94978456-hwh2g"]
Jul 11 07:38:44.840306 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.840289    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:38:44.842838 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.842817    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 11 07:38:44.842935 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.842838    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 11 07:38:44.843001 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.842950    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 11 07:38:44.843091 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.843073    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4gzdp\""
Jul 11 07:38:44.848042 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.848021    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 11 07:38:44.852305 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.852283    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz"]
Jul 11 07:38:44.852443 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.852422    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94978456-hwh2g"
Jul 11 07:38:44.854711 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.854560    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-d9fr6\""
Jul 11 07:38:44.854711 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.854588    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 11 07:38:44.854711 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.854562    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 11 07:38:44.854911 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.854770    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 11 07:38:44.854911 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.854880    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 11 07:38:44.866334 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.866291    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc"]
Jul 11 07:38:44.866426 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.866413    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz"
Jul 11 07:38:44.868624 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.868607    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 11 07:38:44.878428 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.878402    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rtqvv"]
Jul 11 07:38:44.878526 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.878513    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc"
Jul 11 07:38:44.880737 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.880721    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 11 07:38:44.880835 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.880806    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 11 07:38:44.880893 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.880869    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 11 07:38:44.880950 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.880883    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 11 07:38:44.890674 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.890655    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-rk2t2"]
Jul 11 07:38:44.890769 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.890687    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94978456-hwh2g"]
Jul 11 07:38:44.890769 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.890704    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz"]
Jul 11 07:38:44.890769 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.890720    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc"]
Jul 11 07:38:44.890769 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.890733    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c64959f6f-krrjs"]
Jul 11 07:38:44.890769 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.890747    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-r97bl"]
Jul 11 07:38:44.890769 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.890768    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rtqvv"
Jul 11 07:38:44.893139 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.893113    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 11 07:38:44.893237 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.893171    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-57t4x\""
Jul 11 07:38:44.893237 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.893214    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 11 07:38:44.893237 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.893215    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 11 07:38:44.910547 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.910527    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rtqvv"]
Jul 11 07:38:44.910638 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.910554    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r97bl"]
Jul 11 07:38:44.910702 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.910656    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r97bl"
Jul 11 07:38:44.912828 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.912664    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 11 07:38:44.912828 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.912697    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 11 07:38:44.912828 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.912754    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mbf8m\""
Jul 11 07:38:44.959279 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.959245    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/15eb0db2-c37f-4fda-89f3-d095ea19934c-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f485b48dc-vgxzz\" (UID: \"15eb0db2-c37f-4fda-89f3-d095ea19934c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz"
Jul 11 07:38:44.959279 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.959276    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7371967-9e18-4db2-b83f-bc7ff6660bf2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bd6d6f4-rq2tc\" (UID: \"f7371967-9e18-4db2-b83f-bc7ff6660bf2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc"
Jul 11 07:38:44.959530 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.959296    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f7371967-9e18-4db2-b83f-bc7ff6660bf2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bd6d6f4-rq2tc\" (UID: \"f7371967-9e18-4db2-b83f-bc7ff6660bf2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc"
Jul 11 07:38:44.959530 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.959414    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f7371967-9e18-4db2-b83f-bc7ff6660bf2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bd6d6f4-rq2tc\" (UID: \"f7371967-9e18-4db2-b83f-bc7ff6660bf2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc"
Jul 11 07:38:44.959530 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.959452    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15eb0db2-c37f-4fda-89f3-d095ea19934c-tmp\") pod \"klusterlet-addon-workmgr-6f485b48dc-vgxzz\" (UID: \"15eb0db2-c37f-4fda-89f3-d095ea19934c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz"
Jul 11 07:38:44.959530 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.959481    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e25b4feb-7fb7-44fb-8813-05b08cf87d42-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rk2t2\" (UID: \"e25b4feb-7fb7-44fb-8813-05b08cf87d42\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rk2t2"
Jul 11 07:38:44.959729 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.959532    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-image-registry-private-configuration\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:38:44.959729 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.959580    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-trusted-ca\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:38:44.959729 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.959606    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lklzx\" (UniqueName: \"kubernetes.io/projected/f7371967-9e18-4db2-b83f-bc7ff6660bf2-kube-api-access-lklzx\") pod \"cluster-proxy-proxy-agent-5bd6d6f4-rq2tc\" (UID: \"f7371967-9e18-4db2-b83f-bc7ff6660bf2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc"
Jul 11 07:38:44.959729 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.959631    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-certificates\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:38:44.959729 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.959709    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f7371967-9e18-4db2-b83f-bc7ff6660bf2-hub\") pod \"cluster-proxy-proxy-agent-5bd6d6f4-rq2tc\" (UID: \"f7371967-9e18-4db2-b83f-bc7ff6660bf2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc"
Jul 11 07:38:44.959963 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.959741    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e25b4feb-7fb7-44fb-8813-05b08cf87d42-nginx-conf\") pod \"networking-console-plugin-6cf856758c-rk2t2\" (UID: \"e25b4feb-7fb7-44fb-8813-05b08cf87d42\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rk2t2"
Jul 11 07:38:44.959963 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.959766    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/72bc3283-11ab-4e8e-be96-a0335d8e4126-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f94978456-hwh2g\" (UID: \"72bc3283-11ab-4e8e-be96-a0335d8e4126\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94978456-hwh2g"
Jul 11 07:38:44.959963 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.959790    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-ca-trust-extracted\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:38:44.959963 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.959853    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98fkt\" (UniqueName: \"kubernetes.io/projected/15eb0db2-c37f-4fda-89f3-d095ea19934c-kube-api-access-98fkt\") pod \"klusterlet-addon-workmgr-6f485b48dc-vgxzz\" (UID: \"15eb0db2-c37f-4fda-89f3-d095ea19934c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz"
Jul 11 07:38:44.959963 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.959875    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f7371967-9e18-4db2-b83f-bc7ff6660bf2-ca\") pod \"cluster-proxy-proxy-agent-5bd6d6f4-rq2tc\" (UID: \"f7371967-9e18-4db2-b83f-bc7ff6660bf2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc"
Jul 11 07:38:44.959963 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.959910    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs7n9\" (UniqueName: \"kubernetes.io/projected/72bc3283-11ab-4e8e-be96-a0335d8e4126-kube-api-access-cs7n9\") pod \"managed-serviceaccount-addon-agent-f94978456-hwh2g\" (UID: \"72bc3283-11ab-4e8e-be96-a0335d8e4126\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94978456-hwh2g"
Jul 11 07:38:44.959963 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.959946    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt7mx\" (UniqueName: \"kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-kube-api-access-mt7mx\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:38:44.960291 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.959970    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c199c8aa-2e6e-47f2-b99e-c31bfd6aa25a-cert\") pod \"ingress-canary-rtqvv\" (UID: \"c199c8aa-2e6e-47f2-b99e-c31bfd6aa25a\") " pod="openshift-ingress-canary/ingress-canary-rtqvv"
Jul 11 07:38:44.960291 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.959988    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-installation-pull-secrets\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:38:44.960291 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.960014    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:38:44.960291 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.960054    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-bound-sa-token\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:38:44.960291 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:44.960086    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h9qn\" (UniqueName: \"kubernetes.io/projected/c199c8aa-2e6e-47f2-b99e-c31bfd6aa25a-kube-api-access-7h9qn\") pod \"ingress-canary-rtqvv\" (UID: \"c199c8aa-2e6e-47f2-b99e-c31bfd6aa25a\") " pod="openshift-ingress-canary/ingress-canary-rtqvv"
Jul 11 07:38:45.060667 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.060633    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f7371967-9e18-4db2-b83f-bc7ff6660bf2-ca\") pod \"cluster-proxy-proxy-agent-5bd6d6f4-rq2tc\" (UID: \"f7371967-9e18-4db2-b83f-bc7ff6660bf2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc"
Jul 11 07:38:45.060667 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.060672    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs7n9\" (UniqueName: \"kubernetes.io/projected/72bc3283-11ab-4e8e-be96-a0335d8e4126-kube-api-access-cs7n9\") pod \"managed-serviceaccount-addon-agent-f94978456-hwh2g\" (UID: \"72bc3283-11ab-4e8e-be96-a0335d8e4126\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94978456-hwh2g"
Jul 11 07:38:45.060881 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.060695    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-installation-pull-secrets\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:38:45.060881 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.060722    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-bound-sa-token\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:38:45.060881 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.060745    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h9qn\" (UniqueName: \"kubernetes.io/projected/c199c8aa-2e6e-47f2-b99e-c31bfd6aa25a-kube-api-access-7h9qn\") pod \"ingress-canary-rtqvv\" (UID: \"c199c8aa-2e6e-47f2-b99e-c31bfd6aa25a\") " pod="openshift-ingress-canary/ingress-canary-rtqvv"
Jul 11 07:38:45.060881 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.060782    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/15eb0db2-c37f-4fda-89f3-d095ea19934c-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f485b48dc-vgxzz\" (UID: \"15eb0db2-c37f-4fda-89f3-d095ea19934c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz"
Jul 11 07:38:45.060881 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.060806    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f7371967-9e18-4db2-b83f-bc7ff6660bf2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bd6d6f4-rq2tc\" (UID: \"f7371967-9e18-4db2-b83f-bc7ff6660bf2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc"
Jul 11 07:38:45.060881 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.060833    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e25b4feb-7fb7-44fb-8813-05b08cf87d42-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rk2t2\" (UID: \"e25b4feb-7fb7-44fb-8813-05b08cf87d42\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rk2t2"
Jul 11 07:38:45.060881 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.060858    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c199c8aa-2e6e-47f2-b99e-c31bfd6aa25a-cert\") pod \"ingress-canary-rtqvv\" (UID: \"c199c8aa-2e6e-47f2-b99e-c31bfd6aa25a\") " pod="openshift-ingress-canary/ingress-canary-rtqvv"
Jul 11 07:38:45.061140 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.060903    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lklzx\" (UniqueName: \"kubernetes.io/projected/f7371967-9e18-4db2-b83f-bc7ff6660bf2-kube-api-access-lklzx\") pod \"cluster-proxy-proxy-agent-5bd6d6f4-rq2tc\" (UID: \"f7371967-9e18-4db2-b83f-bc7ff6660bf2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc"
Jul 11 07:38:45.061140 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.060930    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr85t\" (UniqueName: \"kubernetes.io/projected/740d2467-7c72-4de8-a6dd-28fb00ee23e4-kube-api-access-qr85t\") pod \"dns-default-r97bl\" (UID: \"740d2467-7c72-4de8-a6dd-28fb00ee23e4\") " pod="openshift-dns/dns-default-r97bl"
Jul 11 07:38:45.061140 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.060958    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-ca-trust-extracted\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:38:45.061140 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.060981    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/72bc3283-11ab-4e8e-be96-a0335d8e4126-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f94978456-hwh2g\" (UID: \"72bc3283-11ab-4e8e-be96-a0335d8e4126\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94978456-hwh2g"
Jul 11 07:38:45.061140 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.061008    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98fkt\" (UniqueName: \"kubernetes.io/projected/15eb0db2-c37f-4fda-89f3-d095ea19934c-kube-api-access-98fkt\") pod \"klusterlet-addon-workmgr-6f485b48dc-vgxzz\" (UID: \"15eb0db2-c37f-4fda-89f3-d095ea19934c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz"
Jul 11 07:38:45.061140 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.061033    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/740d2467-7c72-4de8-a6dd-28fb00ee23e4-config-volume\") pod \"dns-default-r97bl\" (UID: \"740d2467-7c72-4de8-a6dd-28fb00ee23e4\") " pod="openshift-dns/dns-default-r97bl"
Jul 11 07:38:45.061140 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.061055    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:38:45.061140 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.061075    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/740d2467-7c72-4de8-a6dd-28fb00ee23e4-tmp-dir\") pod \"dns-default-r97bl\" (UID: \"740d2467-7c72-4de8-a6dd-28fb00ee23e4\") " pod="openshift-dns/dns-default-r97bl"
Jul 11 07:38:45.061140 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.061096    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7371967-9e18-4db2-b83f-bc7ff6660bf2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bd6d6f4-rq2tc\" (UID: \"f7371967-9e18-4db2-b83f-bc7ff6660bf2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc"
Jul 11 07:38:45.061140 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.061116    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f7371967-9e18-4db2-b83f-bc7ff6660bf2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bd6d6f4-rq2tc\" (UID: \"f7371967-9e18-4db2-b83f-bc7ff6660bf2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc"
Jul 11 07:38:45.061140 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.061136    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-certificates\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:38:45.061590 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.061163    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/740d2467-7c72-4de8-a6dd-28fb00ee23e4-metrics-tls\") pod \"dns-default-r97bl\" (UID: \"740d2467-7c72-4de8-a6dd-28fb00ee23e4\") " pod="openshift-dns/dns-default-r97bl"
Jul 11 07:38:45.061590 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.061197    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-trusted-ca\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:38:45.061590 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.061217    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt7mx\" (UniqueName: \"kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-kube-api-access-mt7mx\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:38:45.061590 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.061242    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15eb0db2-c37f-4fda-89f3-d095ea19934c-tmp\") pod \"klusterlet-addon-workmgr-6f485b48dc-vgxzz\" (UID: \"15eb0db2-c37f-4fda-89f3-d095ea19934c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz"
Jul 11 07:38:45.061590 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.061266    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-image-registry-private-configuration\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:38:45.061590 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.061305    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f7371967-9e18-4db2-b83f-bc7ff6660bf2-hub\") pod \"cluster-proxy-proxy-agent-5bd6d6f4-rq2tc\" (UID: \"f7371967-9e18-4db2-b83f-bc7ff6660bf2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc"
Jul 11 07:38:45.061590 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.061352    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e25b4feb-7fb7-44fb-8813-05b08cf87d42-nginx-conf\") pod \"networking-console-plugin-6cf856758c-rk2t2\" (UID: \"e25b4feb-7fb7-44fb-8813-05b08cf87d42\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rk2t2"
Jul 11 07:38:45.063527 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.062061    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e25b4feb-7fb7-44fb-8813-05b08cf87d42-nginx-conf\") pod \"networking-console-plugin-6cf856758c-rk2t2\" (UID: \"e25b4feb-7fb7-44fb-8813-05b08cf87d42\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rk2t2"
Jul 11 07:38:45.063527 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.062080    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7371967-9e18-4db2-b83f-bc7ff6660bf2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bd6d6f4-rq2tc\" (UID: \"f7371967-9e18-4db2-b83f-bc7ff6660bf2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc"
Jul 11 07:38:45.063527 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.062554    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-ca-trust-extracted\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:38:45.063527 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.062605    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15eb0db2-c37f-4fda-89f3-d095ea19934c-tmp\") pod \"klusterlet-addon-workmgr-6f485b48dc-vgxzz\" (UID: \"15eb0db2-c37f-4fda-89f3-d095ea19934c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz"
Jul 11 07:38:45.063527 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.062830    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-trusted-ca\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:38:45.063527 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.063476    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-certificates\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:38:45.063527 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:45.063501    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 07:38:45.063527 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:45.063519    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c64959f6f-krrjs: secret "image-registry-tls" not found
Jul 11 07:38:45.063983 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:45.063585    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls podName:c220f3c9-1a0e-40ef-9648-20a3d8db5d6b nodeName:}" failed. No retries permitted until 2026-07-11 07:38:45.563568059 +0000 UTC m=+37.048318187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls") pod "image-registry-5c64959f6f-krrjs" (UID: "c220f3c9-1a0e-40ef-9648-20a3d8db5d6b") : secret "image-registry-tls" not found
Jul 11 07:38:45.063983 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:45.063854    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 07:38:45.063983 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:45.063902    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e25b4feb-7fb7-44fb-8813-05b08cf87d42-networking-console-plugin-cert podName:e25b4feb-7fb7-44fb-8813-05b08cf87d42 nodeName:}" failed. No retries permitted until 2026-07-11 07:38:45.563886953 +0000 UTC m=+37.048637065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e25b4feb-7fb7-44fb-8813-05b08cf87d42-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rk2t2" (UID: "e25b4feb-7fb7-44fb-8813-05b08cf87d42") : secret "networking-console-plugin-cert" not found
Jul 11 07:38:45.067009 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.066935    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-image-registry-private-configuration\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:38:45.067009 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.066969    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f7371967-9e18-4db2-b83f-bc7ff6660bf2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bd6d6f4-rq2tc\" (UID: \"f7371967-9e18-4db2-b83f-bc7ff6660bf2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc"
Jul 11 07:38:45.067009 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.066966    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c199c8aa-2e6e-47f2-b99e-c31bfd6aa25a-cert\") pod \"ingress-canary-rtqvv\" (UID: \"c199c8aa-2e6e-47f2-b99e-c31bfd6aa25a\") " pod="openshift-ingress-canary/ingress-canary-rtqvv"
Jul 11 07:38:45.067235 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.067039    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/72bc3283-11ab-4e8e-be96-a0335d8e4126-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f94978456-hwh2g\" (UID: \"72bc3283-11ab-4e8e-be96-a0335d8e4126\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94978456-hwh2g"
Jul 11 07:38:45.067532 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.067508    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f7371967-9e18-4db2-b83f-bc7ff6660bf2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bd6d6f4-rq2tc\" (UID: \"f7371967-9e18-4db2-b83f-bc7ff6660bf2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc"
Jul 11 07:38:45.068889 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.068866    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-installation-pull-secrets\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:38:45.069262 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.069213    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f7371967-9e18-4db2-b83f-bc7ff6660bf2-hub\") pod \"cluster-proxy-proxy-agent-5bd6d6f4-rq2tc\" (UID: \"f7371967-9e18-4db2-b83f-bc7ff6660bf2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc"
Jul 11 07:38:45.069262 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.069227    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f7371967-9e18-4db2-b83f-bc7ff6660bf2-ca\") pod \"cluster-proxy-proxy-agent-5bd6d6f4-rq2tc\" (UID: \"f7371967-9e18-4db2-b83f-bc7ff6660bf2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc"
Jul 11 07:38:45.069442 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.069403    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/15eb0db2-c37f-4fda-89f3-d095ea19934c-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f485b48dc-vgxzz\" (UID: \"15eb0db2-c37f-4fda-89f3-d095ea19934c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz"
Jul 11 07:38:45.070189 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.070142    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs7n9\" (UniqueName: \"kubernetes.io/projected/72bc3283-11ab-4e8e-be96-a0335d8e4126-kube-api-access-cs7n9\") pod \"managed-serviceaccount-addon-agent-f94978456-hwh2g\" (UID: \"72bc3283-11ab-4e8e-be96-a0335d8e4126\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94978456-hwh2g"
Jul 11 07:38:45.070541 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.070498    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h9qn\" (UniqueName: \"kubernetes.io/projected/c199c8aa-2e6e-47f2-b99e-c31bfd6aa25a-kube-api-access-7h9qn\") pod \"ingress-canary-rtqvv\" (UID: \"c199c8aa-2e6e-47f2-b99e-c31bfd6aa25a\") " pod="openshift-ingress-canary/ingress-canary-rtqvv"
Jul 11 07:38:45.070686 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.070645    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98fkt\" (UniqueName: \"kubernetes.io/projected/15eb0db2-c37f-4fda-89f3-d095ea19934c-kube-api-access-98fkt\") pod \"klusterlet-addon-workmgr-6f485b48dc-vgxzz\" (UID: \"15eb0db2-c37f-4fda-89f3-d095ea19934c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz"
Jul 11 07:38:45.071287 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.070832    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lklzx\" (UniqueName: \"kubernetes.io/projected/f7371967-9e18-4db2-b83f-bc7ff6660bf2-kube-api-access-lklzx\") pod \"cluster-proxy-proxy-agent-5bd6d6f4-rq2tc\" (UID: \"f7371967-9e18-4db2-b83f-bc7ff6660bf2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc"
Jul 11 07:38:45.071595 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.071557    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-bound-sa-token\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:38:45.071595 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.071577    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt7mx\" (UniqueName: \"kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-kube-api-access-mt7mx\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:38:45.071765 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.071601    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:38:45.071765 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.071561    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:38:45.071765 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.071701    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:38:45.073909 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.073882    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 11 07:38:45.073909 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.073892    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xs4vf\""
Jul 11 07:38:45.074218 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.074195    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 11 07:38:45.074298 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.074240    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 11 07:38:45.074524 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.074199    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 11 07:38:45.074524 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.074428    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-92q58\""
Jul 11 07:38:45.162193 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.162152    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/740d2467-7c72-4de8-a6dd-28fb00ee23e4-config-volume\") pod \"dns-default-r97bl\" (UID: \"740d2467-7c72-4de8-a6dd-28fb00ee23e4\") " pod="openshift-dns/dns-default-r97bl"
Jul 11 07:38:45.162382 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.162214    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/740d2467-7c72-4de8-a6dd-28fb00ee23e4-tmp-dir\") pod \"dns-default-r97bl\" (UID: \"740d2467-7c72-4de8-a6dd-28fb00ee23e4\") " pod="openshift-dns/dns-default-r97bl"
Jul 11 07:38:45.162382 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.162254    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/740d2467-7c72-4de8-a6dd-28fb00ee23e4-metrics-tls\") pod \"dns-default-r97bl\" (UID: \"740d2467-7c72-4de8-a6dd-28fb00ee23e4\") " pod="openshift-dns/dns-default-r97bl"
Jul 11 07:38:45.162382 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.162380    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr85t\" (UniqueName: \"kubernetes.io/projected/740d2467-7c72-4de8-a6dd-28fb00ee23e4-kube-api-access-qr85t\") pod \"dns-default-r97bl\" (UID: \"740d2467-7c72-4de8-a6dd-28fb00ee23e4\") " pod="openshift-dns/dns-default-r97bl"
Jul 11 07:38:45.162562 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:45.162426    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 07:38:45.162562 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:45.162509    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/740d2467-7c72-4de8-a6dd-28fb00ee23e4-metrics-tls podName:740d2467-7c72-4de8-a6dd-28fb00ee23e4 nodeName:}" failed. No retries permitted until 2026-07-11 07:38:45.662488793 +0000 UTC m=+37.147238927 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/740d2467-7c72-4de8-a6dd-28fb00ee23e4-metrics-tls") pod "dns-default-r97bl" (UID: "740d2467-7c72-4de8-a6dd-28fb00ee23e4") : secret "dns-default-metrics-tls" not found
Jul 11 07:38:45.162657 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.162592    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/740d2467-7c72-4de8-a6dd-28fb00ee23e4-tmp-dir\") pod \"dns-default-r97bl\" (UID: \"740d2467-7c72-4de8-a6dd-28fb00ee23e4\") " pod="openshift-dns/dns-default-r97bl"
Jul 11 07:38:45.162930 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.162907    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/740d2467-7c72-4de8-a6dd-28fb00ee23e4-config-volume\") pod \"dns-default-r97bl\" (UID: \"740d2467-7c72-4de8-a6dd-28fb00ee23e4\") " pod="openshift-dns/dns-default-r97bl"
Jul 11 07:38:45.170576 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.170557    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94978456-hwh2g"
Jul 11 07:38:45.173292 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.173267    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr85t\" (UniqueName: \"kubernetes.io/projected/740d2467-7c72-4de8-a6dd-28fb00ee23e4-kube-api-access-qr85t\") pod \"dns-default-r97bl\" (UID: \"740d2467-7c72-4de8-a6dd-28fb00ee23e4\") " pod="openshift-dns/dns-default-r97bl"
Jul 11 07:38:45.179115 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.179093    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz"
Jul 11 07:38:45.188256 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.188231    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc"
Jul 11 07:38:45.210335 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.210310    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rtqvv"
Jul 11 07:38:45.566722 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.566692    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:38:45.567238 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.566801    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e25b4feb-7fb7-44fb-8813-05b08cf87d42-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rk2t2\" (UID: \"e25b4feb-7fb7-44fb-8813-05b08cf87d42\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rk2t2"
Jul 11 07:38:45.567238 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:45.566884    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 07:38:45.567238 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:45.566904    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c64959f6f-krrjs: secret "image-registry-tls" not found
Jul 11 07:38:45.567238 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:45.566941    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 07:38:45.567238 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:45.566977    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls podName:c220f3c9-1a0e-40ef-9648-20a3d8db5d6b nodeName:}" failed. No retries permitted until 2026-07-11 07:38:46.566954027 +0000 UTC m=+38.051704144 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls") pod "image-registry-5c64959f6f-krrjs" (UID: "c220f3c9-1a0e-40ef-9648-20a3d8db5d6b") : secret "image-registry-tls" not found
Jul 11 07:38:45.567238 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:45.566994    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e25b4feb-7fb7-44fb-8813-05b08cf87d42-networking-console-plugin-cert podName:e25b4feb-7fb7-44fb-8813-05b08cf87d42 nodeName:}" failed. No retries permitted until 2026-07-11 07:38:46.566986601 +0000 UTC m=+38.051736712 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e25b4feb-7fb7-44fb-8813-05b08cf87d42-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rk2t2" (UID: "e25b4feb-7fb7-44fb-8813-05b08cf87d42") : secret "networking-console-plugin-cert" not found
Jul 11 07:38:45.667792 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:45.667761    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/740d2467-7c72-4de8-a6dd-28fb00ee23e4-metrics-tls\") pod \"dns-default-r97bl\" (UID: \"740d2467-7c72-4de8-a6dd-28fb00ee23e4\") " pod="openshift-dns/dns-default-r97bl"
Jul 11 07:38:45.667949 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:45.667919    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 07:38:45.667991 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:45.667981    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/740d2467-7c72-4de8-a6dd-28fb00ee23e4-metrics-tls podName:740d2467-7c72-4de8-a6dd-28fb00ee23e4 nodeName:}" failed. No retries permitted until 2026-07-11 07:38:46.667966782 +0000 UTC m=+38.152716893 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/740d2467-7c72-4de8-a6dd-28fb00ee23e4-metrics-tls") pod "dns-default-r97bl" (UID: "740d2467-7c72-4de8-a6dd-28fb00ee23e4") : secret "dns-default-metrics-tls" not found
Jul 11 07:38:46.075186 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:46.075009    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc"]
Jul 11 07:38:46.078112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:46.078093    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rtqvv"]
Jul 11 07:38:46.086872 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:46.086851    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz"]
Jul 11 07:38:46.089275 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:46.089241    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94978456-hwh2g"]
Jul 11 07:38:46.213449 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:46.213378    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7371967_9e18_4db2_b83f_bc7ff6660bf2.slice/crio-0f1a362be0b2e164275ec373389617f0ccc908209449e4b6f4ed694eeaebfa0f WatchSource:0}: Error finding container 0f1a362be0b2e164275ec373389617f0ccc908209449e4b6f4ed694eeaebfa0f: Status 404 returned error can't find the container with id 0f1a362be0b2e164275ec373389617f0ccc908209449e4b6f4ed694eeaebfa0f
Jul 11 07:38:46.213941 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:46.213914    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc199c8aa_2e6e_47f2_b99e_c31bfd6aa25a.slice/crio-036991ead7d1d36232d8300dea9d224197eae66349571ab35e34b17a3e3779fd WatchSource:0}: Error finding container 036991ead7d1d36232d8300dea9d224197eae66349571ab35e34b17a3e3779fd: Status 404 returned error can't find the container with id 036991ead7d1d36232d8300dea9d224197eae66349571ab35e34b17a3e3779fd
Jul 11 07:38:46.214860 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:46.214837    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15eb0db2_c37f_4fda_89f3_d095ea19934c.slice/crio-d5788876e1f42f9b1a7a3c06f9e8c7e384d9bb847379b80bc518ddb5deef502f WatchSource:0}: Error finding container d5788876e1f42f9b1a7a3c06f9e8c7e384d9bb847379b80bc518ddb5deef502f: Status 404 returned error can't find the container with id d5788876e1f42f9b1a7a3c06f9e8c7e384d9bb847379b80bc518ddb5deef502f
Jul 11 07:38:46.215818 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:38:46.215733    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72bc3283_11ab_4e8e_be96_a0335d8e4126.slice/crio-ad69f6c654d1dfa7aa67d22e6d3532abe17f71d12b31177714af801963aea0c2 WatchSource:0}: Error finding container ad69f6c654d1dfa7aa67d22e6d3532abe17f71d12b31177714af801963aea0c2: Status 404 returned error can't find the container with id ad69f6c654d1dfa7aa67d22e6d3532abe17f71d12b31177714af801963aea0c2
Jul 11 07:38:46.577319 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:46.577287    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:38:46.577827 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:46.577383    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e25b4feb-7fb7-44fb-8813-05b08cf87d42-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rk2t2\" (UID: \"e25b4feb-7fb7-44fb-8813-05b08cf87d42\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rk2t2"
Jul 11 07:38:46.577827 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:46.577462    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 07:38:46.577827 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:46.577485    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c64959f6f-krrjs: secret "image-registry-tls" not found
Jul 11 07:38:46.577827 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:46.577489    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 07:38:46.577827 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:46.577555    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls podName:c220f3c9-1a0e-40ef-9648-20a3d8db5d6b nodeName:}" failed. No retries permitted until 2026-07-11 07:38:48.577535683 +0000 UTC m=+40.062285814 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls") pod "image-registry-5c64959f6f-krrjs" (UID: "c220f3c9-1a0e-40ef-9648-20a3d8db5d6b") : secret "image-registry-tls" not found
Jul 11 07:38:46.577827 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:46.577575    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e25b4feb-7fb7-44fb-8813-05b08cf87d42-networking-console-plugin-cert podName:e25b4feb-7fb7-44fb-8813-05b08cf87d42 nodeName:}" failed. No retries permitted until 2026-07-11 07:38:48.577566367 +0000 UTC m=+40.062316483 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e25b4feb-7fb7-44fb-8813-05b08cf87d42-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rk2t2" (UID: "e25b4feb-7fb7-44fb-8813-05b08cf87d42") : secret "networking-console-plugin-cert" not found
Jul 11 07:38:46.589377 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:46.589352    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc" event={"ID":"f7371967-9e18-4db2-b83f-bc7ff6660bf2","Type":"ContainerStarted","Data":"0f1a362be0b2e164275ec373389617f0ccc908209449e4b6f4ed694eeaebfa0f"}
Jul 11 07:38:46.591904 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:46.591883    2568 generic.go:356] "Generic (PLEG): container finished" podID="d70f837c-1485-4db0-ac77-81c13470f6d1" containerID="7d787a2f19c3b7d66fb95d9d6d5bcdedbbc81ece97aef79ace90ce92210780d7" exitCode=0
Jul 11 07:38:46.591993 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:46.591951    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vvmz" event={"ID":"d70f837c-1485-4db0-ac77-81c13470f6d1","Type":"ContainerDied","Data":"7d787a2f19c3b7d66fb95d9d6d5bcdedbbc81ece97aef79ace90ce92210780d7"}
Jul 11 07:38:46.593017 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:46.592992    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz" event={"ID":"15eb0db2-c37f-4fda-89f3-d095ea19934c","Type":"ContainerStarted","Data":"d5788876e1f42f9b1a7a3c06f9e8c7e384d9bb847379b80bc518ddb5deef502f"}
Jul 11 07:38:46.594042 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:46.594023    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rtqvv" event={"ID":"c199c8aa-2e6e-47f2-b99e-c31bfd6aa25a","Type":"ContainerStarted","Data":"036991ead7d1d36232d8300dea9d224197eae66349571ab35e34b17a3e3779fd"}
Jul 11 07:38:46.595080 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:46.595053    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94978456-hwh2g" event={"ID":"72bc3283-11ab-4e8e-be96-a0335d8e4126","Type":"ContainerStarted","Data":"ad69f6c654d1dfa7aa67d22e6d3532abe17f71d12b31177714af801963aea0c2"}
Jul 11 07:38:46.678673 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:46.678638    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/740d2467-7c72-4de8-a6dd-28fb00ee23e4-metrics-tls\") pod \"dns-default-r97bl\" (UID: \"740d2467-7c72-4de8-a6dd-28fb00ee23e4\") " pod="openshift-dns/dns-default-r97bl"
Jul 11 07:38:46.678800 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:46.678742    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 07:38:46.678860 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:46.678809    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/740d2467-7c72-4de8-a6dd-28fb00ee23e4-metrics-tls podName:740d2467-7c72-4de8-a6dd-28fb00ee23e4 nodeName:}" failed. No retries permitted until 2026-07-11 07:38:48.678791889 +0000 UTC m=+40.163542018 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/740d2467-7c72-4de8-a6dd-28fb00ee23e4-metrics-tls") pod "dns-default-r97bl" (UID: "740d2467-7c72-4de8-a6dd-28fb00ee23e4") : secret "dns-default-metrics-tls" not found
Jul 11 07:38:47.610204 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:47.610155    2568 generic.go:356] "Generic (PLEG): container finished" podID="d70f837c-1485-4db0-ac77-81c13470f6d1" containerID="e18e088162b0c87584a70f8d04e1fdbb6c2e14d31d3ae6d2d778b71b81fe5546" exitCode=0
Jul 11 07:38:47.610670 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:47.610231    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vvmz" event={"ID":"d70f837c-1485-4db0-ac77-81c13470f6d1","Type":"ContainerDied","Data":"e18e088162b0c87584a70f8d04e1fdbb6c2e14d31d3ae6d2d778b71b81fe5546"}
Jul 11 07:38:48.597784 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:48.597416    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e25b4feb-7fb7-44fb-8813-05b08cf87d42-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rk2t2\" (UID: \"e25b4feb-7fb7-44fb-8813-05b08cf87d42\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rk2t2"
Jul 11 07:38:48.597784 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:48.597761    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:38:48.598070 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:48.597587    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 07:38:48.598070 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:48.597995    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e25b4feb-7fb7-44fb-8813-05b08cf87d42-networking-console-plugin-cert podName:e25b4feb-7fb7-44fb-8813-05b08cf87d42 nodeName:}" failed. No retries permitted until 2026-07-11 07:38:52.597977457 +0000 UTC m=+44.082727572 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e25b4feb-7fb7-44fb-8813-05b08cf87d42-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rk2t2" (UID: "e25b4feb-7fb7-44fb-8813-05b08cf87d42") : secret "networking-console-plugin-cert" not found
Jul 11 07:38:48.598382 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:48.597931    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 07:38:48.598504 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:48.598319    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c64959f6f-krrjs: secret "image-registry-tls" not found
Jul 11 07:38:48.598570 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:48.598557    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls podName:c220f3c9-1a0e-40ef-9648-20a3d8db5d6b nodeName:}" failed. No retries permitted until 2026-07-11 07:38:52.59853861 +0000 UTC m=+44.083288738 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls") pod "image-registry-5c64959f6f-krrjs" (UID: "c220f3c9-1a0e-40ef-9648-20a3d8db5d6b") : secret "image-registry-tls" not found
Jul 11 07:38:48.619666 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:48.619628    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8vvmz" event={"ID":"d70f837c-1485-4db0-ac77-81c13470f6d1","Type":"ContainerStarted","Data":"1ac43b440bdfb733b7ae475edfaaefbbf5ce184674559a5d18b29af1b6b139a3"}
Jul 11 07:38:48.642257 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:48.642168    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8vvmz" podStartSLOduration=8.160182477 podStartE2EDuration="38.642142409s" totalImagesPullingTime="30.481959932s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 07:38:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:38:48.640577335 +0000 UTC m=+40.125327459" watchObservedRunningTime="2026-07-11 07:38:48.642142409 +0000 UTC m=+40.126892544"
Jul 11 07:38:48.699942 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:48.699300    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/740d2467-7c72-4de8-a6dd-28fb00ee23e4-metrics-tls\") pod \"dns-default-r97bl\" (UID: \"740d2467-7c72-4de8-a6dd-28fb00ee23e4\") " pod="openshift-dns/dns-default-r97bl"
Jul 11 07:38:48.699942 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:48.699768    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 07:38:48.699942 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:48.699829    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/740d2467-7c72-4de8-a6dd-28fb00ee23e4-metrics-tls podName:740d2467-7c72-4de8-a6dd-28fb00ee23e4 nodeName:}" failed. No retries permitted until 2026-07-11 07:38:52.699809237 +0000 UTC m=+44.184559352 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/740d2467-7c72-4de8-a6dd-28fb00ee23e4-metrics-tls") pod "dns-default-r97bl" (UID: "740d2467-7c72-4de8-a6dd-28fb00ee23e4") : secret "dns-default-metrics-tls" not found
Jul 11 07:38:52.635040 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:52.634997    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:38:52.635670 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:52.635112    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e25b4feb-7fb7-44fb-8813-05b08cf87d42-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rk2t2\" (UID: \"e25b4feb-7fb7-44fb-8813-05b08cf87d42\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rk2t2"
Jul 11 07:38:52.635670 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:52.635170    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 07:38:52.635670 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:52.635190    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c64959f6f-krrjs: secret "image-registry-tls" not found
Jul 11 07:38:52.635670 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:52.635240    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 07:38:52.635670 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:52.635261    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls podName:c220f3c9-1a0e-40ef-9648-20a3d8db5d6b nodeName:}" failed. No retries permitted until 2026-07-11 07:39:00.635241795 +0000 UTC m=+52.119991906 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls") pod "image-registry-5c64959f6f-krrjs" (UID: "c220f3c9-1a0e-40ef-9648-20a3d8db5d6b") : secret "image-registry-tls" not found
Jul 11 07:38:52.635670 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:52.635284    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e25b4feb-7fb7-44fb-8813-05b08cf87d42-networking-console-plugin-cert podName:e25b4feb-7fb7-44fb-8813-05b08cf87d42 nodeName:}" failed. No retries permitted until 2026-07-11 07:39:00.635270714 +0000 UTC m=+52.120020842 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e25b4feb-7fb7-44fb-8813-05b08cf87d42-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rk2t2" (UID: "e25b4feb-7fb7-44fb-8813-05b08cf87d42") : secret "networking-console-plugin-cert" not found
Jul 11 07:38:52.736632 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:52.736587    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/740d2467-7c72-4de8-a6dd-28fb00ee23e4-metrics-tls\") pod \"dns-default-r97bl\" (UID: \"740d2467-7c72-4de8-a6dd-28fb00ee23e4\") " pod="openshift-dns/dns-default-r97bl"
Jul 11 07:38:52.736822 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:52.736762    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 07:38:52.736884 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:38:52.736839    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/740d2467-7c72-4de8-a6dd-28fb00ee23e4-metrics-tls podName:740d2467-7c72-4de8-a6dd-28fb00ee23e4 nodeName:}" failed. No retries permitted until 2026-07-11 07:39:00.736821845 +0000 UTC m=+52.221571979 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/740d2467-7c72-4de8-a6dd-28fb00ee23e4-metrics-tls") pod "dns-default-r97bl" (UID: "740d2467-7c72-4de8-a6dd-28fb00ee23e4") : secret "dns-default-metrics-tls" not found
Jul 11 07:38:54.637593 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:54.637555    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rtqvv" event={"ID":"c199c8aa-2e6e-47f2-b99e-c31bfd6aa25a","Type":"ContainerStarted","Data":"39f75fa64d9f6432b362ffa07dfc8834442ccf6a45e2e284e74bbc8cee626827"}
Jul 11 07:38:54.639026 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:54.639000    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94978456-hwh2g" event={"ID":"72bc3283-11ab-4e8e-be96-a0335d8e4126","Type":"ContainerStarted","Data":"71ffa285b15aaab9b8c5d1e3086516cdd25ff005e5d3ee83246ee91ade5a75fd"}
Jul 11 07:38:54.641034 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:54.641010    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc" event={"ID":"f7371967-9e18-4db2-b83f-bc7ff6660bf2","Type":"ContainerStarted","Data":"6c32647cf2fdc22eb4ea02ec4769a216d4f7f12898733211e688f89ea3c8f1f3"}
Jul 11 07:38:54.641127 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:54.641042    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc" event={"ID":"f7371967-9e18-4db2-b83f-bc7ff6660bf2","Type":"ContainerStarted","Data":"3c8f1a83fd5d4d3784420dbbdf7b2790591cd6d39eaad649e4bb122a8e36c46c"}
Jul 11 07:38:54.641127 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:54.641055    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc" event={"ID":"f7371967-9e18-4db2-b83f-bc7ff6660bf2","Type":"ContainerStarted","Data":"1a7a7434ffb956f46c3377003dc47b4f706350dd3b5d2d8e6617a4d65dec293d"}
Jul 11 07:38:54.642422 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:54.642401    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz" event={"ID":"15eb0db2-c37f-4fda-89f3-d095ea19934c","Type":"ContainerStarted","Data":"c13ebfe4a35fa5bc9cda986d53507666f44cfd659e15bfc914f6d5cd4f0fbb5e"}
Jul 11 07:38:54.642603 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:54.642592    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz"
Jul 11 07:38:54.644226 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:54.644207    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz"
Jul 11 07:38:54.651962 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:54.651922    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rtqvv" podStartSLOduration=2.848906693 podStartE2EDuration="10.651909544s" totalImagesPullingTime="7.803002851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:38:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:38:54.651190435 +0000 UTC m=+46.135940568" watchObservedRunningTime="2026-07-11 07:38:54.651909544 +0000 UTC m=+46.136659715"
Jul 11 07:38:54.665626 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:54.665585    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz" podStartSLOduration=36.862385492 podStartE2EDuration="44.665572398s" totalImagesPullingTime="7.803186906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:38:54.664772176 +0000 UTC m=+46.149522309" watchObservedRunningTime="2026-07-11 07:38:54.665572398 +0000 UTC m=+46.150322534"
Jul 11 07:38:54.686793 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:38:54.686753    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc" podStartSLOduration=36.868394335 podStartE2EDuration="44.686738263s" totalImagesPullingTime="7.818343928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:38:54.685808713 +0000 UTC m=+46.170558846" watchObservedRunningTime="2026-07-11 07:38:54.686738263 +0000 UTC m=+46.171488395"
Jul 11 07:39:00.696798 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:00.696759    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e25b4feb-7fb7-44fb-8813-05b08cf87d42-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rk2t2\" (UID: \"e25b4feb-7fb7-44fb-8813-05b08cf87d42\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rk2t2"
Jul 11 07:39:00.697272 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:39:00.696899    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 07:39:00.697272 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:00.696916    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:39:00.697272 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:39:00.696951    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e25b4feb-7fb7-44fb-8813-05b08cf87d42-networking-console-plugin-cert podName:e25b4feb-7fb7-44fb-8813-05b08cf87d42 nodeName:}" failed. No retries permitted until 2026-07-11 07:39:16.69693653 +0000 UTC m=+68.181686641 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e25b4feb-7fb7-44fb-8813-05b08cf87d42-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rk2t2" (UID: "e25b4feb-7fb7-44fb-8813-05b08cf87d42") : secret "networking-console-plugin-cert" not found
Jul 11 07:39:00.697272 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:39:00.696995    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 07:39:00.697272 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:39:00.697005    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c64959f6f-krrjs: secret "image-registry-tls" not found
Jul 11 07:39:00.697272 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:39:00.697045    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls podName:c220f3c9-1a0e-40ef-9648-20a3d8db5d6b nodeName:}" failed. No retries permitted until 2026-07-11 07:39:16.697033564 +0000 UTC m=+68.181783676 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls") pod "image-registry-5c64959f6f-krrjs" (UID: "c220f3c9-1a0e-40ef-9648-20a3d8db5d6b") : secret "image-registry-tls" not found
Jul 11 07:39:00.798027 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:00.797999    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/740d2467-7c72-4de8-a6dd-28fb00ee23e4-metrics-tls\") pod \"dns-default-r97bl\" (UID: \"740d2467-7c72-4de8-a6dd-28fb00ee23e4\") " pod="openshift-dns/dns-default-r97bl"
Jul 11 07:39:00.798152 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:39:00.798129    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 07:39:00.798199 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:39:00.798184    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/740d2467-7c72-4de8-a6dd-28fb00ee23e4-metrics-tls podName:740d2467-7c72-4de8-a6dd-28fb00ee23e4 nodeName:}" failed. No retries permitted until 2026-07-11 07:39:16.798171905 +0000 UTC m=+68.282922019 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/740d2467-7c72-4de8-a6dd-28fb00ee23e4-metrics-tls") pod "dns-default-r97bl" (UID: "740d2467-7c72-4de8-a6dd-28fb00ee23e4") : secret "dns-default-metrics-tls" not found
Jul 11 07:39:10.586466 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:10.586432    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qczqf"
Jul 11 07:39:10.609271 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:10.609222    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94978456-hwh2g" podStartSLOduration=52.806697666 podStartE2EDuration="1m0.609207157s" totalImagesPullingTime="7.802509491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:38:54.698805607 +0000 UTC m=+46.183555740" watchObservedRunningTime="2026-07-11 07:39:10.609207157 +0000 UTC m=+62.093957313"
Jul 11 07:39:16.308158 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:16.308124    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdl27\" (UniqueName: \"kubernetes.io/projected/13113aaf-2564-4a4a-9849-5caf85291035-kube-api-access-tdl27\") pod \"network-check-target-9pqz5\" (UID: \"13113aaf-2564-4a4a-9849-5caf85291035\") " pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:39:16.308603 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:16.308167    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b500f11c-abb4-4699-a581-bceb7b49a3fc-original-pull-secret\") pod \"global-pull-secret-syncer-rw4gk\" (UID: \"b500f11c-abb4-4699-a581-bceb7b49a3fc\") " pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:39:16.308603 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:16.308291    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs\") pod \"network-metrics-daemon-kwbd7\" (UID: \"91da412b-e856-41ed-b4de-78d3eaf95930\") " pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:39:16.310656 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:16.310636    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 11 07:39:16.310656 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:16.310645    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 11 07:39:16.310805 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:16.310652    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 11 07:39:16.318501 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:39:16.318486    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 11 07:39:16.318582 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:39:16.318533    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs podName:91da412b-e856-41ed-b4de-78d3eaf95930 nodeName:}" failed. No retries permitted until 2026-07-11 07:40:20.31851992 +0000 UTC m=+131.803270031 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs") pod "network-metrics-daemon-kwbd7" (UID: "91da412b-e856-41ed-b4de-78d3eaf95930") : secret "metrics-daemon-secret" not found
Jul 11 07:39:16.320173 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:16.320159    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 11 07:39:16.321950 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:16.321933    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b500f11c-abb4-4699-a581-bceb7b49a3fc-original-pull-secret\") pod \"global-pull-secret-syncer-rw4gk\" (UID: \"b500f11c-abb4-4699-a581-bceb7b49a3fc\") " pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:39:16.330757 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:16.330739    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdl27\" (UniqueName: \"kubernetes.io/projected/13113aaf-2564-4a4a-9849-5caf85291035-kube-api-access-tdl27\") pod \"network-check-target-9pqz5\" (UID: \"13113aaf-2564-4a4a-9849-5caf85291035\") " pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:39:16.598700 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:16.598648    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rw4gk"
Jul 11 07:39:16.612483 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:16.612464    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-92q58\""
Jul 11 07:39:16.620120 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:16.620105    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:39:16.710581 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:16.710550    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e25b4feb-7fb7-44fb-8813-05b08cf87d42-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rk2t2\" (UID: \"e25b4feb-7fb7-44fb-8813-05b08cf87d42\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rk2t2"
Jul 11 07:39:16.710707 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:16.710637    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:39:16.710794 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:39:16.710765    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 07:39:16.710859 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:39:16.710791    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 07:39:16.710859 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:39:16.710806    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c64959f6f-krrjs: secret "image-registry-tls" not found
Jul 11 07:39:16.710859 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:39:16.710844    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e25b4feb-7fb7-44fb-8813-05b08cf87d42-networking-console-plugin-cert podName:e25b4feb-7fb7-44fb-8813-05b08cf87d42 nodeName:}" failed. No retries permitted until 2026-07-11 07:39:48.710822476 +0000 UTC m=+100.195572589 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e25b4feb-7fb7-44fb-8813-05b08cf87d42-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rk2t2" (UID: "e25b4feb-7fb7-44fb-8813-05b08cf87d42") : secret "networking-console-plugin-cert" not found
Jul 11 07:39:16.711019 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:39:16.710863    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls podName:c220f3c9-1a0e-40ef-9648-20a3d8db5d6b nodeName:}" failed. No retries permitted until 2026-07-11 07:39:48.710853702 +0000 UTC m=+100.195603818 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls") pod "image-registry-5c64959f6f-krrjs" (UID: "c220f3c9-1a0e-40ef-9648-20a3d8db5d6b") : secret "image-registry-tls" not found
Jul 11 07:39:16.748010 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:16.747985    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rw4gk"]
Jul 11 07:39:16.751068 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:39:16.751043    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb500f11c_abb4_4699_a581_bceb7b49a3fc.slice/crio-fb78607c41125eeab2b826cdeb240e3ee874275b5eee36e55138edb367632d1b WatchSource:0}: Error finding container fb78607c41125eeab2b826cdeb240e3ee874275b5eee36e55138edb367632d1b: Status 404 returned error can't find the container with id fb78607c41125eeab2b826cdeb240e3ee874275b5eee36e55138edb367632d1b
Jul 11 07:39:16.769913 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:16.769893    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9pqz5"]
Jul 11 07:39:16.772318 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:39:16.772295    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13113aaf_2564_4a4a_9849_5caf85291035.slice/crio-8ce7c29a0a195766d5466b2c90a1800652cd587e6da2989db32ac28b28310d00 WatchSource:0}: Error finding container 8ce7c29a0a195766d5466b2c90a1800652cd587e6da2989db32ac28b28310d00: Status 404 returned error can't find the container with id 8ce7c29a0a195766d5466b2c90a1800652cd587e6da2989db32ac28b28310d00
Jul 11 07:39:16.811632 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:16.811611    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/740d2467-7c72-4de8-a6dd-28fb00ee23e4-metrics-tls\") pod \"dns-default-r97bl\" (UID: \"740d2467-7c72-4de8-a6dd-28fb00ee23e4\") " pod="openshift-dns/dns-default-r97bl"
Jul 11 07:39:16.811738 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:39:16.811726    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 07:39:16.811791 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:39:16.811772    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/740d2467-7c72-4de8-a6dd-28fb00ee23e4-metrics-tls podName:740d2467-7c72-4de8-a6dd-28fb00ee23e4 nodeName:}" failed. No retries permitted until 2026-07-11 07:39:48.811758034 +0000 UTC m=+100.296508145 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/740d2467-7c72-4de8-a6dd-28fb00ee23e4-metrics-tls") pod "dns-default-r97bl" (UID: "740d2467-7c72-4de8-a6dd-28fb00ee23e4") : secret "dns-default-metrics-tls" not found
Jul 11 07:39:17.710603 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:17.710554    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9pqz5" event={"ID":"13113aaf-2564-4a4a-9849-5caf85291035","Type":"ContainerStarted","Data":"8ce7c29a0a195766d5466b2c90a1800652cd587e6da2989db32ac28b28310d00"}
Jul 11 07:39:17.712203 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:17.712172    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rw4gk" event={"ID":"b500f11c-abb4-4699-a581-bceb7b49a3fc","Type":"ContainerStarted","Data":"fb78607c41125eeab2b826cdeb240e3ee874275b5eee36e55138edb367632d1b"}
Jul 11 07:39:20.725060 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:20.725019    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9pqz5" event={"ID":"13113aaf-2564-4a4a-9849-5caf85291035","Type":"ContainerStarted","Data":"1761da7c67b777cd25fbfd6cf47dc302d10609106e866bfcd53862d9f3f44412"}
Jul 11 07:39:20.725515 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:20.725196    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:39:20.738868 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:20.738818    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9pqz5" podStartSLOduration=67.709781839 podStartE2EDuration="1m10.738802417s" totalImagesPullingTime="3.029020578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:39:20.738537355 +0000 UTC m=+72.223287505" watchObservedRunningTime="2026-07-11 07:39:20.738802417 +0000 UTC m=+72.223552554"
Jul 11 07:39:21.729198 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:21.729161    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rw4gk" event={"ID":"b500f11c-abb4-4699-a581-bceb7b49a3fc","Type":"ContainerStarted","Data":"c88f9b93a0d7299bc35d98596748e5e05b30ee5c1c2fb948263cda51131f7004"}
Jul 11 07:39:21.743493 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:21.743442    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rw4gk" podStartSLOduration=67.33620182 podStartE2EDuration="1m11.743423433s" totalImagesPullingTime="4.407221613s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 07:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:39:21.743386598 +0000 UTC m=+73.228136734" watchObservedRunningTime="2026-07-11 07:39:21.743423433 +0000 UTC m=+73.228173560"
Jul 11 07:39:48.740624 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:48.740579    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:39:48.741182 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:48.740675    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e25b4feb-7fb7-44fb-8813-05b08cf87d42-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rk2t2\" (UID: \"e25b4feb-7fb7-44fb-8813-05b08cf87d42\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rk2t2"
Jul 11 07:39:48.741182 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:39:48.740708    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 07:39:48.741182 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:39:48.740730    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c64959f6f-krrjs: secret "image-registry-tls" not found
Jul 11 07:39:48.741182 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:39:48.740797    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls podName:c220f3c9-1a0e-40ef-9648-20a3d8db5d6b nodeName:}" failed. No retries permitted until 2026-07-11 07:40:52.740781312 +0000 UTC m=+164.225531423 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls") pod "image-registry-5c64959f6f-krrjs" (UID: "c220f3c9-1a0e-40ef-9648-20a3d8db5d6b") : secret "image-registry-tls" not found
Jul 11 07:39:48.741182 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:39:48.740797    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 07:39:48.741182 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:39:48.740884    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e25b4feb-7fb7-44fb-8813-05b08cf87d42-networking-console-plugin-cert podName:e25b4feb-7fb7-44fb-8813-05b08cf87d42 nodeName:}" failed. No retries permitted until 2026-07-11 07:40:52.740867229 +0000 UTC m=+164.225617341 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e25b4feb-7fb7-44fb-8813-05b08cf87d42-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rk2t2" (UID: "e25b4feb-7fb7-44fb-8813-05b08cf87d42") : secret "networking-console-plugin-cert" not found
Jul 11 07:39:48.841715 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:48.841676    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/740d2467-7c72-4de8-a6dd-28fb00ee23e4-metrics-tls\") pod \"dns-default-r97bl\" (UID: \"740d2467-7c72-4de8-a6dd-28fb00ee23e4\") " pod="openshift-dns/dns-default-r97bl"
Jul 11 07:39:48.841865 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:39:48.841786    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 07:39:48.841865 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:39:48.841834    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/740d2467-7c72-4de8-a6dd-28fb00ee23e4-metrics-tls podName:740d2467-7c72-4de8-a6dd-28fb00ee23e4 nodeName:}" failed. No retries permitted until 2026-07-11 07:40:52.841821615 +0000 UTC m=+164.326571726 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/740d2467-7c72-4de8-a6dd-28fb00ee23e4-metrics-tls") pod "dns-default-r97bl" (UID: "740d2467-7c72-4de8-a6dd-28fb00ee23e4") : secret "dns-default-metrics-tls" not found
Jul 11 07:39:51.731628 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:39:51.731595    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9pqz5"
Jul 11 07:40:20.383906 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:40:20.383856    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs\") pod \"network-metrics-daemon-kwbd7\" (UID: \"91da412b-e856-41ed-b4de-78d3eaf95930\") " pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:40:20.384419 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:40:20.383986    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 11 07:40:20.384419 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:40:20.384053    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs podName:91da412b-e856-41ed-b4de-78d3eaf95930 nodeName:}" failed. No retries permitted until 2026-07-11 07:42:22.384036522 +0000 UTC m=+253.868786636 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs") pod "network-metrics-daemon-kwbd7" (UID: "91da412b-e856-41ed-b4de-78d3eaf95930") : secret "metrics-daemon-secret" not found
Jul 11 07:40:47.839561 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:40:47.839518    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cf856758c-rk2t2" podUID="e25b4feb-7fb7-44fb-8813-05b08cf87d42"
Jul 11 07:40:47.850799 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:40:47.850760    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5c64959f6f-krrjs" podUID="c220f3c9-1a0e-40ef-9648-20a3d8db5d6b"
Jul 11 07:40:47.921315 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:40:47.921278    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-r97bl" podUID="740d2467-7c72-4de8-a6dd-28fb00ee23e4"
Jul 11 07:40:47.975756 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:40:47.975731    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:40:47.975756 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:40:47.975741    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-rk2t2"
Jul 11 07:40:48.105159 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:40:48.105084    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-kwbd7" podUID="91da412b-e856-41ed-b4de-78d3eaf95930"
Jul 11 07:40:52.821609 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:40:52.821551    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e25b4feb-7fb7-44fb-8813-05b08cf87d42-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rk2t2\" (UID: \"e25b4feb-7fb7-44fb-8813-05b08cf87d42\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rk2t2"
Jul 11 07:40:52.822022 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:40:52.821629    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:40:52.822022 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:40:52.821713    2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 11 07:40:52.822022 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:40:52.821739    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 07:40:52.822022 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:40:52.821751    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c64959f6f-krrjs: secret "image-registry-tls" not found
Jul 11 07:40:52.822022 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:40:52.821784    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e25b4feb-7fb7-44fb-8813-05b08cf87d42-networking-console-plugin-cert podName:e25b4feb-7fb7-44fb-8813-05b08cf87d42 nodeName:}" failed. No retries permitted until 2026-07-11 07:42:54.821765665 +0000 UTC m=+286.306515777 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e25b4feb-7fb7-44fb-8813-05b08cf87d42-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rk2t2" (UID: "e25b4feb-7fb7-44fb-8813-05b08cf87d42") : secret "networking-console-plugin-cert" not found
Jul 11 07:40:52.822022 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:40:52.821800    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls podName:c220f3c9-1a0e-40ef-9648-20a3d8db5d6b nodeName:}" failed. No retries permitted until 2026-07-11 07:42:54.821792912 +0000 UTC m=+286.306543023 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls") pod "image-registry-5c64959f6f-krrjs" (UID: "c220f3c9-1a0e-40ef-9648-20a3d8db5d6b") : secret "image-registry-tls" not found
Jul 11 07:40:52.922809 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:40:52.922747    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/740d2467-7c72-4de8-a6dd-28fb00ee23e4-metrics-tls\") pod \"dns-default-r97bl\" (UID: \"740d2467-7c72-4de8-a6dd-28fb00ee23e4\") " pod="openshift-dns/dns-default-r97bl"
Jul 11 07:40:52.922994 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:40:52.922890    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 07:40:52.922994 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:40:52.922952    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/740d2467-7c72-4de8-a6dd-28fb00ee23e4-metrics-tls podName:740d2467-7c72-4de8-a6dd-28fb00ee23e4 nodeName:}" failed. No retries permitted until 2026-07-11 07:42:54.922938307 +0000 UTC m=+286.407688419 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/740d2467-7c72-4de8-a6dd-28fb00ee23e4-metrics-tls") pod "dns-default-r97bl" (UID: "740d2467-7c72-4de8-a6dd-28fb00ee23e4") : secret "dns-default-metrics-tls" not found
Jul 11 07:40:54.643905 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:40:54.643850    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz" podUID="15eb0db2-c37f-4fda-89f3-d095ea19934c" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/readyz\": dial tcp 10.132.0.9:8000: connect: connection refused"
Jul 11 07:40:54.996294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:40:54.996209    2568 generic.go:356] "Generic (PLEG): container finished" podID="15eb0db2-c37f-4fda-89f3-d095ea19934c" containerID="c13ebfe4a35fa5bc9cda986d53507666f44cfd659e15bfc914f6d5cd4f0fbb5e" exitCode=1
Jul 11 07:40:54.996455 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:40:54.996285    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz" event={"ID":"15eb0db2-c37f-4fda-89f3-d095ea19934c","Type":"ContainerDied","Data":"c13ebfe4a35fa5bc9cda986d53507666f44cfd659e15bfc914f6d5cd4f0fbb5e"}
Jul 11 07:40:54.996667 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:40:54.996650    2568 scope.go:117] "RemoveContainer" containerID="c13ebfe4a35fa5bc9cda986d53507666f44cfd659e15bfc914f6d5cd4f0fbb5e"
Jul 11 07:40:54.997894 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:40:54.997819    2568 generic.go:356] "Generic (PLEG): container finished" podID="72bc3283-11ab-4e8e-be96-a0335d8e4126" containerID="71ffa285b15aaab9b8c5d1e3086516cdd25ff005e5d3ee83246ee91ade5a75fd" exitCode=255
Jul 11 07:40:54.997894 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:40:54.997859    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94978456-hwh2g" event={"ID":"72bc3283-11ab-4e8e-be96-a0335d8e4126","Type":"ContainerDied","Data":"71ffa285b15aaab9b8c5d1e3086516cdd25ff005e5d3ee83246ee91ade5a75fd"}
Jul 11 07:40:54.998120 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:40:54.998102    2568 scope.go:117] "RemoveContainer" containerID="71ffa285b15aaab9b8c5d1e3086516cdd25ff005e5d3ee83246ee91ade5a75fd"
Jul 11 07:40:55.171291 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:40:55.171254    2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94978456-hwh2g"
Jul 11 07:40:55.179544 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:40:55.179528    2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz"
Jul 11 07:40:56.002411 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:40:56.002374    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz" event={"ID":"15eb0db2-c37f-4fda-89f3-d095ea19934c","Type":"ContainerStarted","Data":"8497affe523302216b8276a93e199327317cc8edb88236c9dbea54db383c0f0b"}
Jul 11 07:40:56.002870 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:40:56.002595    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz"
Jul 11 07:40:56.003578 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:40:56.003555    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz"
Jul 11 07:40:56.004278 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:40:56.004257    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94978456-hwh2g" event={"ID":"72bc3283-11ab-4e8e-be96-a0335d8e4126","Type":"ContainerStarted","Data":"205c272b2edf29d6e954d710489b0650101d97f98f4f5fec5e73612dfb6265e2"}
Jul 11 07:41:03.066581 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:41:03.066490    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:41:03.066581 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:41:03.066538    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r97bl"
Jul 11 07:42:17.211029 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:17.210993    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vf4tj"]
Jul 11 07:42:17.213135 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:17.213115    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vf4tj"
Jul 11 07:42:17.215585 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:17.215564    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mjxk7\""
Jul 11 07:42:17.215700 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:17.215601    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 11 07:42:17.215700 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:17.215643    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 11 07:42:17.215700 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:17.215665    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 11 07:42:17.216663 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:17.216644    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 11 07:42:17.224061 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:17.224039    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vf4tj"]
Jul 11 07:42:17.334855 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:17.334818    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47a5f2c1-314e-4eaf-9914-391133562126-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vf4tj\" (UID: \"47a5f2c1-314e-4eaf-9914-391133562126\") " pod="openshift-insights/insights-runtime-extractor-vf4tj"
Jul 11 07:42:17.335047 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:17.334889    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47a5f2c1-314e-4eaf-9914-391133562126-crio-socket\") pod \"insights-runtime-extractor-vf4tj\" (UID: \"47a5f2c1-314e-4eaf-9914-391133562126\") " pod="openshift-insights/insights-runtime-extractor-vf4tj"
Jul 11 07:42:17.335047 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:17.334920    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47a5f2c1-314e-4eaf-9914-391133562126-data-volume\") pod \"insights-runtime-extractor-vf4tj\" (UID: \"47a5f2c1-314e-4eaf-9914-391133562126\") " pod="openshift-insights/insights-runtime-extractor-vf4tj"
Jul 11 07:42:17.335047 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:17.334998    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47a5f2c1-314e-4eaf-9914-391133562126-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vf4tj\" (UID: \"47a5f2c1-314e-4eaf-9914-391133562126\") " pod="openshift-insights/insights-runtime-extractor-vf4tj"
Jul 11 07:42:17.335164 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:17.335052    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxmwg\" (UniqueName: \"kubernetes.io/projected/47a5f2c1-314e-4eaf-9914-391133562126-kube-api-access-kxmwg\") pod \"insights-runtime-extractor-vf4tj\" (UID: \"47a5f2c1-314e-4eaf-9914-391133562126\") " pod="openshift-insights/insights-runtime-extractor-vf4tj"
Jul 11 07:42:17.435587 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:17.435541    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47a5f2c1-314e-4eaf-9914-391133562126-data-volume\") pod \"insights-runtime-extractor-vf4tj\" (UID: \"47a5f2c1-314e-4eaf-9914-391133562126\") " pod="openshift-insights/insights-runtime-extractor-vf4tj"
Jul 11 07:42:17.435748 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:17.435620    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47a5f2c1-314e-4eaf-9914-391133562126-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vf4tj\" (UID: \"47a5f2c1-314e-4eaf-9914-391133562126\") " pod="openshift-insights/insights-runtime-extractor-vf4tj"
Jul 11 07:42:17.435748 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:17.435666    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxmwg\" (UniqueName: \"kubernetes.io/projected/47a5f2c1-314e-4eaf-9914-391133562126-kube-api-access-kxmwg\") pod \"insights-runtime-extractor-vf4tj\" (UID: \"47a5f2c1-314e-4eaf-9914-391133562126\") " pod="openshift-insights/insights-runtime-extractor-vf4tj"
Jul 11 07:42:17.435748 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:17.435710    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47a5f2c1-314e-4eaf-9914-391133562126-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vf4tj\" (UID: \"47a5f2c1-314e-4eaf-9914-391133562126\") " pod="openshift-insights/insights-runtime-extractor-vf4tj"
Jul 11 07:42:17.435891 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:42:17.435741    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 11 07:42:17.435891 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:17.435759    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47a5f2c1-314e-4eaf-9914-391133562126-crio-socket\") pod \"insights-runtime-extractor-vf4tj\" (UID: \"47a5f2c1-314e-4eaf-9914-391133562126\") " pod="openshift-insights/insights-runtime-extractor-vf4tj"
Jul 11 07:42:17.435891 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:42:17.435840    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47a5f2c1-314e-4eaf-9914-391133562126-kube-rbac-proxy-cm podName:47a5f2c1-314e-4eaf-9914-391133562126 nodeName:}" failed. No retries permitted until 2026-07-11 07:42:17.935819835 +0000 UTC m=+249.420569969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47a5f2c1-314e-4eaf-9914-391133562126-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vf4tj" (UID: "47a5f2c1-314e-4eaf-9914-391133562126") : configmap "kube-rbac-proxy" not found
Jul 11 07:42:17.435891 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:17.435842    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47a5f2c1-314e-4eaf-9914-391133562126-crio-socket\") pod \"insights-runtime-extractor-vf4tj\" (UID: \"47a5f2c1-314e-4eaf-9914-391133562126\") " pod="openshift-insights/insights-runtime-extractor-vf4tj"
Jul 11 07:42:17.435891 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:42:17.435858    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 07:42:17.435891 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:17.435861    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47a5f2c1-314e-4eaf-9914-391133562126-data-volume\") pod \"insights-runtime-extractor-vf4tj\" (UID: \"47a5f2c1-314e-4eaf-9914-391133562126\") " pod="openshift-insights/insights-runtime-extractor-vf4tj"
Jul 11 07:42:17.436085 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:42:17.435913    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47a5f2c1-314e-4eaf-9914-391133562126-insights-runtime-extractor-tls podName:47a5f2c1-314e-4eaf-9914-391133562126 nodeName:}" failed. No retries permitted until 2026-07-11 07:42:17.935899239 +0000 UTC m=+249.420649357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47a5f2c1-314e-4eaf-9914-391133562126-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vf4tj" (UID: "47a5f2c1-314e-4eaf-9914-391133562126") : secret "insights-runtime-extractor-tls" not found
Jul 11 07:42:17.442918 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:17.442899    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxmwg\" (UniqueName: \"kubernetes.io/projected/47a5f2c1-314e-4eaf-9914-391133562126-kube-api-access-kxmwg\") pod \"insights-runtime-extractor-vf4tj\" (UID: \"47a5f2c1-314e-4eaf-9914-391133562126\") " pod="openshift-insights/insights-runtime-extractor-vf4tj"
Jul 11 07:42:17.939507 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:17.939463    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47a5f2c1-314e-4eaf-9914-391133562126-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vf4tj\" (UID: \"47a5f2c1-314e-4eaf-9914-391133562126\") " pod="openshift-insights/insights-runtime-extractor-vf4tj"
Jul 11 07:42:17.939694 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:42:17.939635    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 07:42:17.939694 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:17.939658    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47a5f2c1-314e-4eaf-9914-391133562126-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vf4tj\" (UID: \"47a5f2c1-314e-4eaf-9914-391133562126\") " pod="openshift-insights/insights-runtime-extractor-vf4tj"
Jul 11 07:42:17.939771 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:42:17.939720    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47a5f2c1-314e-4eaf-9914-391133562126-insights-runtime-extractor-tls podName:47a5f2c1-314e-4eaf-9914-391133562126 nodeName:}" failed. No retries permitted until 2026-07-11 07:42:18.939700344 +0000 UTC m=+250.424450460 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47a5f2c1-314e-4eaf-9914-391133562126-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vf4tj" (UID: "47a5f2c1-314e-4eaf-9914-391133562126") : secret "insights-runtime-extractor-tls" not found
Jul 11 07:42:17.939771 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:42:17.939738    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 11 07:42:17.939771 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:42:17.939770    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47a5f2c1-314e-4eaf-9914-391133562126-kube-rbac-proxy-cm podName:47a5f2c1-314e-4eaf-9914-391133562126 nodeName:}" failed. No retries permitted until 2026-07-11 07:42:18.939760478 +0000 UTC m=+250.424510599 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47a5f2c1-314e-4eaf-9914-391133562126-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vf4tj" (UID: "47a5f2c1-314e-4eaf-9914-391133562126") : configmap "kube-rbac-proxy" not found
Jul 11 07:42:18.947339 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:18.947277    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47a5f2c1-314e-4eaf-9914-391133562126-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vf4tj\" (UID: \"47a5f2c1-314e-4eaf-9914-391133562126\") " pod="openshift-insights/insights-runtime-extractor-vf4tj"
Jul 11 07:42:18.947733 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:18.947402    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47a5f2c1-314e-4eaf-9914-391133562126-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vf4tj\" (UID: \"47a5f2c1-314e-4eaf-9914-391133562126\") " pod="openshift-insights/insights-runtime-extractor-vf4tj"
Jul 11 07:42:18.947733 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:42:18.947442    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 07:42:18.947733 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:42:18.947477    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 11 07:42:18.947733 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:42:18.947535    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47a5f2c1-314e-4eaf-9914-391133562126-insights-runtime-extractor-tls podName:47a5f2c1-314e-4eaf-9914-391133562126 nodeName:}" failed. No retries permitted until 2026-07-11 07:42:20.947514762 +0000 UTC m=+252.432264886 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47a5f2c1-314e-4eaf-9914-391133562126-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vf4tj" (UID: "47a5f2c1-314e-4eaf-9914-391133562126") : secret "insights-runtime-extractor-tls" not found
Jul 11 07:42:18.947733 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:42:18.947557    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47a5f2c1-314e-4eaf-9914-391133562126-kube-rbac-proxy-cm podName:47a5f2c1-314e-4eaf-9914-391133562126 nodeName:}" failed. No retries permitted until 2026-07-11 07:42:20.94754695 +0000 UTC m=+252.432297062 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47a5f2c1-314e-4eaf-9914-391133562126-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vf4tj" (UID: "47a5f2c1-314e-4eaf-9914-391133562126") : configmap "kube-rbac-proxy" not found
Jul 11 07:42:20.204418 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:20.204393    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mm52k_3f2f61be-02eb-4215-ab69-c6dde01a5aa7/dns-node-resolver/0.log"
Jul 11 07:42:20.804455 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:20.804428    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ftfqb_d784a88f-047a-4e1b-9a08-4ff5cdccf048/node-ca/0.log"
Jul 11 07:42:20.965124 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:20.965089    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47a5f2c1-314e-4eaf-9914-391133562126-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vf4tj\" (UID: \"47a5f2c1-314e-4eaf-9914-391133562126\") " pod="openshift-insights/insights-runtime-extractor-vf4tj"
Jul 11 07:42:20.965272 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:20.965179    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47a5f2c1-314e-4eaf-9914-391133562126-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vf4tj\" (UID: \"47a5f2c1-314e-4eaf-9914-391133562126\") " pod="openshift-insights/insights-runtime-extractor-vf4tj"
Jul 11 07:42:20.965272 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:42:20.965233    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 07:42:20.965360 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:42:20.965288    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47a5f2c1-314e-4eaf-9914-391133562126-insights-runtime-extractor-tls podName:47a5f2c1-314e-4eaf-9914-391133562126 nodeName:}" failed. No retries permitted until 2026-07-11 07:42:24.965273461 +0000 UTC m=+256.450023573 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47a5f2c1-314e-4eaf-9914-391133562126-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vf4tj" (UID: "47a5f2c1-314e-4eaf-9914-391133562126") : secret "insights-runtime-extractor-tls" not found
Jul 11 07:42:20.965360 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:42:20.965239    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 11 07:42:20.965440 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:42:20.965398    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47a5f2c1-314e-4eaf-9914-391133562126-kube-rbac-proxy-cm podName:47a5f2c1-314e-4eaf-9914-391133562126 nodeName:}" failed. No retries permitted until 2026-07-11 07:42:24.965384614 +0000 UTC m=+256.450134725 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47a5f2c1-314e-4eaf-9914-391133562126-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vf4tj" (UID: "47a5f2c1-314e-4eaf-9914-391133562126") : configmap "kube-rbac-proxy" not found
Jul 11 07:42:22.005169 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:22.005134    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rtqvv_c199c8aa-2e6e-47f2-b99e-c31bfd6aa25a/serve-healthcheck-canary/0.log"
Jul 11 07:42:22.475656 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:22.475619    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs\") pod \"network-metrics-daemon-kwbd7\" (UID: \"91da412b-e856-41ed-b4de-78d3eaf95930\") " pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:42:22.475852 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:42:22.475759    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 11 07:42:22.475852 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:42:22.475825    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs podName:91da412b-e856-41ed-b4de-78d3eaf95930 nodeName:}" failed. No retries permitted until 2026-07-11 07:44:24.475808628 +0000 UTC m=+375.960558742 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs") pod "network-metrics-daemon-kwbd7" (UID: "91da412b-e856-41ed-b4de-78d3eaf95930") : secret "metrics-daemon-secret" not found
Jul 11 07:42:24.995261 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:24.995232    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47a5f2c1-314e-4eaf-9914-391133562126-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vf4tj\" (UID: \"47a5f2c1-314e-4eaf-9914-391133562126\") " pod="openshift-insights/insights-runtime-extractor-vf4tj"
Jul 11 07:42:24.995664 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:24.995306    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47a5f2c1-314e-4eaf-9914-391133562126-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vf4tj\" (UID: \"47a5f2c1-314e-4eaf-9914-391133562126\") " pod="openshift-insights/insights-runtime-extractor-vf4tj"
Jul 11 07:42:24.995664 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:42:24.995402    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 07:42:24.995664 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:42:24.995412    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 11 07:42:24.995664 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:42:24.995469    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47a5f2c1-314e-4eaf-9914-391133562126-insights-runtime-extractor-tls podName:47a5f2c1-314e-4eaf-9914-391133562126 nodeName:}" failed. No retries permitted until 2026-07-11 07:42:32.995452556 +0000 UTC m=+264.480202667 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47a5f2c1-314e-4eaf-9914-391133562126-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vf4tj" (UID: "47a5f2c1-314e-4eaf-9914-391133562126") : secret "insights-runtime-extractor-tls" not found
Jul 11 07:42:24.995664 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:42:24.995484    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47a5f2c1-314e-4eaf-9914-391133562126-kube-rbac-proxy-cm podName:47a5f2c1-314e-4eaf-9914-391133562126 nodeName:}" failed. No retries permitted until 2026-07-11 07:42:32.995478067 +0000 UTC m=+264.480228178 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47a5f2c1-314e-4eaf-9914-391133562126-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vf4tj" (UID: "47a5f2c1-314e-4eaf-9914-391133562126") : configmap "kube-rbac-proxy" not found
Jul 11 07:42:33.063624 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:33.063520    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47a5f2c1-314e-4eaf-9914-391133562126-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vf4tj\" (UID: \"47a5f2c1-314e-4eaf-9914-391133562126\") " pod="openshift-insights/insights-runtime-extractor-vf4tj"
Jul 11 07:42:33.063624 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:33.063617    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47a5f2c1-314e-4eaf-9914-391133562126-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vf4tj\" (UID: \"47a5f2c1-314e-4eaf-9914-391133562126\") " pod="openshift-insights/insights-runtime-extractor-vf4tj"
Jul 11 07:42:33.064088 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:33.064058    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47a5f2c1-314e-4eaf-9914-391133562126-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vf4tj\" (UID: \"47a5f2c1-314e-4eaf-9914-391133562126\") " pod="openshift-insights/insights-runtime-extractor-vf4tj"
Jul 11 07:42:33.065882 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:33.065857    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47a5f2c1-314e-4eaf-9914-391133562126-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vf4tj\" (UID: \"47a5f2c1-314e-4eaf-9914-391133562126\") " pod="openshift-insights/insights-runtime-extractor-vf4tj"
Jul 11 07:42:33.122335 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:33.122299    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vf4tj"
Jul 11 07:42:33.248237 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:33.248193    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vf4tj"]
Jul 11 07:42:33.252526 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:42:33.252502    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47a5f2c1_314e_4eaf_9914_391133562126.slice/crio-1dc58a8dc8fc5cdf7208c069b721c91295d8d4f8d9d1f90762a4186213388b4d WatchSource:0}: Error finding container 1dc58a8dc8fc5cdf7208c069b721c91295d8d4f8d9d1f90762a4186213388b4d: Status 404 returned error can't find the container with id 1dc58a8dc8fc5cdf7208c069b721c91295d8d4f8d9d1f90762a4186213388b4d
Jul 11 07:42:33.278922 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:33.278891    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vf4tj" event={"ID":"47a5f2c1-314e-4eaf-9914-391133562126","Type":"ContainerStarted","Data":"1dc58a8dc8fc5cdf7208c069b721c91295d8d4f8d9d1f90762a4186213388b4d"}
Jul 11 07:42:35.189609 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:35.189550    2568 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc" podUID="f7371967-9e18-4db2-b83f-bc7ff6660bf2" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 11 07:42:37.294668 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:37.294632    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vf4tj" event={"ID":"47a5f2c1-314e-4eaf-9914-391133562126","Type":"ContainerStarted","Data":"9e5314f4e20947fa014ff8666eded725aea0979579628821e1e1aa950db06d94"}
Jul 11 07:42:38.300364 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:38.300306    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vf4tj" event={"ID":"47a5f2c1-314e-4eaf-9914-391133562126","Type":"ContainerStarted","Data":"a0cc0ba72f8858e0a991b0565caefb86c1b067a1117b43c1174f067750ffc727"}
Jul 11 07:42:40.308520 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:40.308486    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vf4tj" event={"ID":"47a5f2c1-314e-4eaf-9914-391133562126","Type":"ContainerStarted","Data":"37b7667d07dfb63fd3448fb95534e9750b6c3519f285925bc0b5859274325caf"}
Jul 11 07:42:40.326251 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:40.326203    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vf4tj" podStartSLOduration=16.663576357 podStartE2EDuration="23.326189462s" totalImagesPullingTime="6.662613105s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 07:42:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:42:40.325668489 +0000 UTC m=+271.810418623" watchObservedRunningTime="2026-07-11 07:42:40.326189462 +0000 UTC m=+271.810939594"
Jul 11 07:42:45.190050 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:45.189994    2568 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc" podUID="f7371967-9e18-4db2-b83f-bc7ff6660bf2" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 11 07:42:48.103153 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.103119    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-v5s95"]
Jul 11 07:42:48.106416 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.106398    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v5s95"
Jul 11 07:42:48.108316 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.108271    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 11 07:42:48.108630 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.108612    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-876tw\""
Jul 11 07:42:48.108707 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.108685    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 11 07:42:48.109298 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.109273    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 11 07:42:48.109436 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.109367    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 11 07:42:48.109436 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.109382    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 11 07:42:48.109436 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.109373    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 11 07:42:48.281470 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.281438    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a07d014d-e577-4299-9cd6-41308503680e-node-exporter-tls\") pod \"node-exporter-v5s95\" (UID: \"a07d014d-e577-4299-9cd6-41308503680e\") " pod="openshift-monitoring/node-exporter-v5s95"
Jul 11 07:42:48.281642 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.281480    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a07d014d-e577-4299-9cd6-41308503680e-sys\") pod \"node-exporter-v5s95\" (UID: \"a07d014d-e577-4299-9cd6-41308503680e\") " pod="openshift-monitoring/node-exporter-v5s95"
Jul 11 07:42:48.281642 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.281547    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a07d014d-e577-4299-9cd6-41308503680e-metrics-client-ca\") pod \"node-exporter-v5s95\" (UID: \"a07d014d-e577-4299-9cd6-41308503680e\") " pod="openshift-monitoring/node-exporter-v5s95"
Jul 11 07:42:48.281642 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.281583    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a07d014d-e577-4299-9cd6-41308503680e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v5s95\" (UID: \"a07d014d-e577-4299-9cd6-41308503680e\") " pod="openshift-monitoring/node-exporter-v5s95"
Jul 11 07:42:48.281741 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.281661    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a07d014d-e577-4299-9cd6-41308503680e-node-exporter-accelerators-collector-config\") pod \"node-exporter-v5s95\" (UID: \"a07d014d-e577-4299-9cd6-41308503680e\") " pod="openshift-monitoring/node-exporter-v5s95"
Jul 11 07:42:48.281741 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.281689    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfnjj\" (UniqueName: \"kubernetes.io/projected/a07d014d-e577-4299-9cd6-41308503680e-kube-api-access-sfnjj\") pod \"node-exporter-v5s95\" (UID: \"a07d014d-e577-4299-9cd6-41308503680e\") " pod="openshift-monitoring/node-exporter-v5s95"
Jul 11 07:42:48.281741 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.281712    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a07d014d-e577-4299-9cd6-41308503680e-node-exporter-wtmp\") pod \"node-exporter-v5s95\" (UID: \"a07d014d-e577-4299-9cd6-41308503680e\") " pod="openshift-monitoring/node-exporter-v5s95"
Jul 11 07:42:48.281829 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.281747    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a07d014d-e577-4299-9cd6-41308503680e-node-exporter-textfile\") pod \"node-exporter-v5s95\" (UID: \"a07d014d-e577-4299-9cd6-41308503680e\") " pod="openshift-monitoring/node-exporter-v5s95"
Jul 11 07:42:48.281829 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.281763    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a07d014d-e577-4299-9cd6-41308503680e-root\") pod \"node-exporter-v5s95\" (UID: \"a07d014d-e577-4299-9cd6-41308503680e\") " pod="openshift-monitoring/node-exporter-v5s95"
Jul 11 07:42:48.382943 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.382850    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a07d014d-e577-4299-9cd6-41308503680e-node-exporter-wtmp\") pod \"node-exporter-v5s95\" (UID: \"a07d014d-e577-4299-9cd6-41308503680e\") " pod="openshift-monitoring/node-exporter-v5s95"
Jul 11 07:42:48.382943 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.382892    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a07d014d-e577-4299-9cd6-41308503680e-node-exporter-textfile\") pod \"node-exporter-v5s95\" (UID: \"a07d014d-e577-4299-9cd6-41308503680e\") " pod="openshift-monitoring/node-exporter-v5s95"
Jul 11 07:42:48.382943 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.382921    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a07d014d-e577-4299-9cd6-41308503680e-root\") pod \"node-exporter-v5s95\" (UID: \"a07d014d-e577-4299-9cd6-41308503680e\") " pod="openshift-monitoring/node-exporter-v5s95"
Jul 11 07:42:48.383174 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.382967    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a07d014d-e577-4299-9cd6-41308503680e-node-exporter-tls\") pod \"node-exporter-v5s95\" (UID: \"a07d014d-e577-4299-9cd6-41308503680e\") " pod="openshift-monitoring/node-exporter-v5s95"
Jul 11 07:42:48.383174 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.383005    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a07d014d-e577-4299-9cd6-41308503680e-sys\") pod \"node-exporter-v5s95\" (UID: \"a07d014d-e577-4299-9cd6-41308503680e\") " pod="openshift-monitoring/node-exporter-v5s95"
Jul 11 07:42:48.383174 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.383038    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a07d014d-e577-4299-9cd6-41308503680e-metrics-client-ca\") pod \"node-exporter-v5s95\" (UID: \"a07d014d-e577-4299-9cd6-41308503680e\") " pod="openshift-monitoring/node-exporter-v5s95"
Jul 11 07:42:48.383174 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.383050    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a07d014d-e577-4299-9cd6-41308503680e-node-exporter-wtmp\") pod \"node-exporter-v5s95\" (UID: \"a07d014d-e577-4299-9cd6-41308503680e\") " pod="openshift-monitoring/node-exporter-v5s95"
Jul 11 07:42:48.383174 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.383052    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a07d014d-e577-4299-9cd6-41308503680e-root\") pod \"node-exporter-v5s95\" (UID: \"a07d014d-e577-4299-9cd6-41308503680e\") " pod="openshift-monitoring/node-exporter-v5s95"
Jul 11 07:42:48.383174 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.383064    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a07d014d-e577-4299-9cd6-41308503680e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v5s95\" (UID: \"a07d014d-e577-4299-9cd6-41308503680e\") " pod="openshift-monitoring/node-exporter-v5s95"
Jul 11 07:42:48.383174 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.383111    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a07d014d-e577-4299-9cd6-41308503680e-sys\") pod \"node-exporter-v5s95\" (UID: \"a07d014d-e577-4299-9cd6-41308503680e\") " pod="openshift-monitoring/node-exporter-v5s95"
Jul 11 07:42:48.383174 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.383173    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a07d014d-e577-4299-9cd6-41308503680e-node-exporter-accelerators-collector-config\") pod \"node-exporter-v5s95\" (UID: \"a07d014d-e577-4299-9cd6-41308503680e\") " pod="openshift-monitoring/node-exporter-v5s95"
Jul 11 07:42:48.383489 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.383203    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfnjj\" (UniqueName: \"kubernetes.io/projected/a07d014d-e577-4299-9cd6-41308503680e-kube-api-access-sfnjj\") pod \"node-exporter-v5s95\" (UID: \"a07d014d-e577-4299-9cd6-41308503680e\") " pod="openshift-monitoring/node-exporter-v5s95"
Jul 11 07:42:48.383489 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.383245    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a07d014d-e577-4299-9cd6-41308503680e-node-exporter-textfile\") pod \"node-exporter-v5s95\" (UID: \"a07d014d-e577-4299-9cd6-41308503680e\") " pod="openshift-monitoring/node-exporter-v5s95"
Jul 11 07:42:48.383676 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.383654    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a07d014d-e577-4299-9cd6-41308503680e-metrics-client-ca\") pod \"node-exporter-v5s95\" (UID: \"a07d014d-e577-4299-9cd6-41308503680e\") " pod="openshift-monitoring/node-exporter-v5s95"
Jul 11 07:42:48.383723 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.383663    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a07d014d-e577-4299-9cd6-41308503680e-node-exporter-accelerators-collector-config\") pod \"node-exporter-v5s95\" (UID: \"a07d014d-e577-4299-9cd6-41308503680e\") " pod="openshift-monitoring/node-exporter-v5s95"
Jul 11 07:42:48.385319 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.385300    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a07d014d-e577-4299-9cd6-41308503680e-node-exporter-tls\") pod \"node-exporter-v5s95\" (UID: \"a07d014d-e577-4299-9cd6-41308503680e\") " pod="openshift-monitoring/node-exporter-v5s95"
Jul 11 07:42:48.385391 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.385357    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a07d014d-e577-4299-9cd6-41308503680e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v5s95\" (UID: \"a07d014d-e577-4299-9cd6-41308503680e\") " pod="openshift-monitoring/node-exporter-v5s95"
Jul 11 07:42:48.391444 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.391426    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfnjj\" (UniqueName: \"kubernetes.io/projected/a07d014d-e577-4299-9cd6-41308503680e-kube-api-access-sfnjj\") pod \"node-exporter-v5s95\" (UID: \"a07d014d-e577-4299-9cd6-41308503680e\") " pod="openshift-monitoring/node-exporter-v5s95"
Jul 11 07:42:48.415528 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:48.415503    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v5s95"
Jul 11 07:42:48.426124 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:42:48.426095    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda07d014d_e577_4299_9cd6_41308503680e.slice/crio-469917d56a354ccf3f4d83beacfd7b37d2bc0a610dd15e7e2ad0eabe4d0bb878 WatchSource:0}: Error finding container 469917d56a354ccf3f4d83beacfd7b37d2bc0a610dd15e7e2ad0eabe4d0bb878: Status 404 returned error can't find the container with id 469917d56a354ccf3f4d83beacfd7b37d2bc0a610dd15e7e2ad0eabe4d0bb878
Jul 11 07:42:49.342279 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:49.342079    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v5s95" event={"ID":"a07d014d-e577-4299-9cd6-41308503680e","Type":"ContainerStarted","Data":"469917d56a354ccf3f4d83beacfd7b37d2bc0a610dd15e7e2ad0eabe4d0bb878"}
Jul 11 07:42:50.346617 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:50.346581    2568 generic.go:356] "Generic (PLEG): container finished" podID="a07d014d-e577-4299-9cd6-41308503680e" containerID="77ad070078d94f2df70b09e29a4910ea0d5d5f5eefba73430587473a70c13466" exitCode=0
Jul 11 07:42:50.347100 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:50.346651    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v5s95" event={"ID":"a07d014d-e577-4299-9cd6-41308503680e","Type":"ContainerDied","Data":"77ad070078d94f2df70b09e29a4910ea0d5d5f5eefba73430587473a70c13466"}
Jul 11 07:42:50.976522 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:42:50.976473    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5c64959f6f-krrjs" podUID="c220f3c9-1a0e-40ef-9648-20a3d8db5d6b"
Jul 11 07:42:50.976522 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:42:50.976473    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cf856758c-rk2t2" podUID="e25b4feb-7fb7-44fb-8813-05b08cf87d42"
Jul 11 07:42:51.352087 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:51.352052    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-rk2t2"
Jul 11 07:42:51.352087 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:51.352080    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v5s95" event={"ID":"a07d014d-e577-4299-9cd6-41308503680e","Type":"ContainerStarted","Data":"09aeb28d9f0e3025dd3d40b6cfc0ae4f3e86d5372b53a484b0da6bbe352e44de"}
Jul 11 07:42:51.352641 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:51.352139    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v5s95" event={"ID":"a07d014d-e577-4299-9cd6-41308503680e","Type":"ContainerStarted","Data":"3d9ce4f0b8a68eaaad893027d79938c4193258529c1bfea147525f8e6aa0f5d8"}
Jul 11 07:42:51.352641 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:51.352195    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:42:51.370300 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:51.370246    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-v5s95" podStartSLOduration=2.352142171 podStartE2EDuration="3.370228158s" totalImagesPullingTime="954.845971ms" totalInitContainerRuntime="63.240016ms" isStatefulPod=true podCreationTimestamp="2026-07-11 07:42:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:42:51.368628063 +0000 UTC m=+282.853378193" watchObservedRunningTime="2026-07-11 07:42:51.370228158 +0000 UTC m=+282.854978291"
Jul 11 07:42:54.838375 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:54.838310    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:42:54.838919 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:54.838427    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e25b4feb-7fb7-44fb-8813-05b08cf87d42-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rk2t2\" (UID: \"e25b4feb-7fb7-44fb-8813-05b08cf87d42\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rk2t2"
Jul 11 07:42:54.840857 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:54.840830    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls\") pod \"image-registry-5c64959f6f-krrjs\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") " pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:42:54.840972 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:54.840832    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e25b4feb-7fb7-44fb-8813-05b08cf87d42-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rk2t2\" (UID: \"e25b4feb-7fb7-44fb-8813-05b08cf87d42\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rk2t2"
Jul 11 07:42:54.939229 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:54.939173    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/740d2467-7c72-4de8-a6dd-28fb00ee23e4-metrics-tls\") pod \"dns-default-r97bl\" (UID: \"740d2467-7c72-4de8-a6dd-28fb00ee23e4\") " pod="openshift-dns/dns-default-r97bl"
Jul 11 07:42:54.941460 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:54.941432    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/740d2467-7c72-4de8-a6dd-28fb00ee23e4-metrics-tls\") pod \"dns-default-r97bl\" (UID: \"740d2467-7c72-4de8-a6dd-28fb00ee23e4\") " pod="openshift-dns/dns-default-r97bl"
Jul 11 07:42:54.955832 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:54.955808    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-g8tz4\""
Jul 11 07:42:54.955986 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:54.955808    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4gzdp\""
Jul 11 07:42:54.963019 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:54.962996    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-rk2t2"
Jul 11 07:42:54.963132 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:54.963099    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:42:54.969525 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:54.969508    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mbf8m\""
Jul 11 07:42:54.978451 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:54.978429    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r97bl"
Jul 11 07:42:55.102234 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:55.102207    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-rk2t2"]
Jul 11 07:42:55.125488 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:55.125414    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c64959f6f-krrjs"]
Jul 11 07:42:55.141733 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:42:55.141699    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode25b4feb_7fb7_44fb_8813_05b08cf87d42.slice/crio-1f72d73d64e454bdaf245dd7aed2b942e14a1d29d6a95e61f1ce488fc8c433b9 WatchSource:0}: Error finding container 1f72d73d64e454bdaf245dd7aed2b942e14a1d29d6a95e61f1ce488fc8c433b9: Status 404 returned error can't find the container with id 1f72d73d64e454bdaf245dd7aed2b942e14a1d29d6a95e61f1ce488fc8c433b9
Jul 11 07:42:55.142122 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:42:55.142099    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc220f3c9_1a0e_40ef_9648_20a3d8db5d6b.slice/crio-0d2e8b375215b79b4c3a65bbd674aab428f4a3ab0316f3dc7a7cb657e3f816f4 WatchSource:0}: Error finding container 0d2e8b375215b79b4c3a65bbd674aab428f4a3ab0316f3dc7a7cb657e3f816f4: Status 404 returned error can't find the container with id 0d2e8b375215b79b4c3a65bbd674aab428f4a3ab0316f3dc7a7cb657e3f816f4
Jul 11 07:42:55.142613 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:55.142578    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r97bl"]
Jul 11 07:42:55.171417 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:55.171381    2568 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94978456-hwh2g" podUID="72bc3283-11ab-4e8e-be96-a0335d8e4126" containerName="addon-agent" probeResult="failure" output="Get \"http://10.132.0.8:8000/healthz\": dial tcp 10.132.0.8:8000: connect: connection refused"
Jul 11 07:42:55.179710 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:55.179679    2568 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz" podUID="15eb0db2-c37f-4fda-89f3-d095ea19934c" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/healthz\": dial tcp 10.132.0.9:8000: connect: connection refused"
Jul 11 07:42:55.189442 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:55.189406    2568 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc" podUID="f7371967-9e18-4db2-b83f-bc7ff6660bf2" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 11 07:42:55.189555 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:55.189479    2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc"
Jul 11 07:42:55.190092 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:55.190053    2568 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"6c32647cf2fdc22eb4ea02ec4769a216d4f7f12898733211e688f89ea3c8f1f3"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 11 07:42:55.190263 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:55.190119    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc" podUID="f7371967-9e18-4db2-b83f-bc7ff6660bf2" containerName="service-proxy" containerID="cri-o://6c32647cf2fdc22eb4ea02ec4769a216d4f7f12898733211e688f89ea3c8f1f3" gracePeriod=30
Jul 11 07:42:55.190803 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:42:55.190682    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod740d2467_7c72_4de8_a6dd_28fb00ee23e4.slice/crio-60eec8402a5038f7896510a78b58b46e208bf266b9e8c2ebc8544168b1ccf464 WatchSource:0}: Error finding container 60eec8402a5038f7896510a78b58b46e208bf266b9e8c2ebc8544168b1ccf464: Status 404 returned error can't find the container with id 60eec8402a5038f7896510a78b58b46e208bf266b9e8c2ebc8544168b1ccf464
Jul 11 07:42:55.366460 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:55.366421    2568 generic.go:356] "Generic (PLEG): container finished" podID="f7371967-9e18-4db2-b83f-bc7ff6660bf2" containerID="6c32647cf2fdc22eb4ea02ec4769a216d4f7f12898733211e688f89ea3c8f1f3" exitCode=2
Jul 11 07:42:55.366585 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:55.366493    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc" event={"ID":"f7371967-9e18-4db2-b83f-bc7ff6660bf2","Type":"ContainerDied","Data":"6c32647cf2fdc22eb4ea02ec4769a216d4f7f12898733211e688f89ea3c8f1f3"}
Jul 11 07:42:55.366585 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:55.366538    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bd6d6f4-rq2tc" event={"ID":"f7371967-9e18-4db2-b83f-bc7ff6660bf2","Type":"ContainerStarted","Data":"230f6c29cc76cf6f7565a3c25cc3b1ddb46b9fae896b069774141869023d90fc"}
Jul 11 07:42:55.368370 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:55.368348    2568 generic.go:356] "Generic (PLEG): container finished" podID="15eb0db2-c37f-4fda-89f3-d095ea19934c" containerID="8497affe523302216b8276a93e199327317cc8edb88236c9dbea54db383c0f0b" exitCode=1
Jul 11 07:42:55.368470 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:55.368416    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz" event={"ID":"15eb0db2-c37f-4fda-89f3-d095ea19934c","Type":"ContainerDied","Data":"8497affe523302216b8276a93e199327317cc8edb88236c9dbea54db383c0f0b"}
Jul 11 07:42:55.368527 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:55.368470    2568 scope.go:117] "RemoveContainer" containerID="c13ebfe4a35fa5bc9cda986d53507666f44cfd659e15bfc914f6d5cd4f0fbb5e"
Jul 11 07:42:55.368855 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:55.368829    2568 scope.go:117] "RemoveContainer" containerID="8497affe523302216b8276a93e199327317cc8edb88236c9dbea54db383c0f0b"
Jul 11 07:42:55.369083 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:42:55.369052    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6f485b48dc-vgxzz_open-cluster-management-agent-addon(15eb0db2-c37f-4fda-89f3-d095ea19934c)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz" podUID="15eb0db2-c37f-4fda-89f3-d095ea19934c"
Jul 11 07:42:55.370413 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:55.370395    2568 generic.go:356] "Generic (PLEG): container finished" podID="72bc3283-11ab-4e8e-be96-a0335d8e4126" containerID="205c272b2edf29d6e954d710489b0650101d97f98f4f5fec5e73612dfb6265e2" exitCode=255
Jul 11 07:42:55.370504 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:55.370463    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94978456-hwh2g" event={"ID":"72bc3283-11ab-4e8e-be96-a0335d8e4126","Type":"ContainerDied","Data":"205c272b2edf29d6e954d710489b0650101d97f98f4f5fec5e73612dfb6265e2"}
Jul 11 07:42:55.370740 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:55.370723    2568 scope.go:117] "RemoveContainer" containerID="205c272b2edf29d6e954d710489b0650101d97f98f4f5fec5e73612dfb6265e2"
Jul 11 07:42:55.370899 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:42:55.370882    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-f94978456-hwh2g_open-cluster-management-agent-addon(72bc3283-11ab-4e8e-be96-a0335d8e4126)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94978456-hwh2g" podUID="72bc3283-11ab-4e8e-be96-a0335d8e4126"
Jul 11 07:42:55.371666 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:55.371643    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r97bl" event={"ID":"740d2467-7c72-4de8-a6dd-28fb00ee23e4","Type":"ContainerStarted","Data":"60eec8402a5038f7896510a78b58b46e208bf266b9e8c2ebc8544168b1ccf464"}
Jul 11 07:42:55.373143 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:55.373122    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c64959f6f-krrjs" event={"ID":"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b","Type":"ContainerStarted","Data":"c5c3e2a84bf261080b7d0f44f666014a0ef42ee3a5ed00db9672e082aaa4e2cd"}
Jul 11 07:42:55.373228 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:55.373159    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c64959f6f-krrjs" event={"ID":"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b","Type":"ContainerStarted","Data":"0d2e8b375215b79b4c3a65bbd674aab428f4a3ab0316f3dc7a7cb657e3f816f4"}
Jul 11 07:42:55.373228 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:55.373204    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:42:55.374315 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:55.374294    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-rk2t2" event={"ID":"e25b4feb-7fb7-44fb-8813-05b08cf87d42","Type":"ContainerStarted","Data":"1f72d73d64e454bdaf245dd7aed2b942e14a1d29d6a95e61f1ce488fc8c433b9"}
Jul 11 07:42:55.379206 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:55.379188    2568 scope.go:117] "RemoveContainer" containerID="71ffa285b15aaab9b8c5d1e3086516cdd25ff005e5d3ee83246ee91ade5a75fd"
Jul 11 07:42:55.413768 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:55.413706    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5c64959f6f-krrjs" podStartSLOduration=285.413688383 podStartE2EDuration="4m45.413688383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:38:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:42:55.413237355 +0000 UTC m=+286.897987488" watchObservedRunningTime="2026-07-11 07:42:55.413688383 +0000 UTC m=+286.898438515"
Jul 11 07:42:56.003309 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:56.003275    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz"
Jul 11 07:42:56.385681 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:56.385652    2568 scope.go:117] "RemoveContainer" containerID="8497affe523302216b8276a93e199327317cc8edb88236c9dbea54db383c0f0b"
Jul 11 07:42:56.385891 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:42:56.385864    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6f485b48dc-vgxzz_open-cluster-management-agent-addon(15eb0db2-c37f-4fda-89f3-d095ea19934c)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz" podUID="15eb0db2-c37f-4fda-89f3-d095ea19934c"
Jul 11 07:42:57.390344 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:57.390295    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r97bl" event={"ID":"740d2467-7c72-4de8-a6dd-28fb00ee23e4","Type":"ContainerStarted","Data":"8a73fed24cc22eb901d4e8029061b565b7bc26298a2a1cc253668a0a48200310"}
Jul 11 07:42:57.390765 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:57.390374    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r97bl" event={"ID":"740d2467-7c72-4de8-a6dd-28fb00ee23e4","Type":"ContainerStarted","Data":"e4599960d4e251f6ad91c31539e883067fe28f407a5ae5c969ae953a6832fa64"}
Jul 11 07:42:57.390765 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:57.390403    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-r97bl"
Jul 11 07:42:57.391888 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:57.391861    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-rk2t2" event={"ID":"e25b4feb-7fb7-44fb-8813-05b08cf87d42","Type":"ContainerStarted","Data":"6051e8e21d98b1984d34300af57fa50c54cd2d7187ab5c45a3e926efcff58431"}
Jul 11 07:42:57.405008 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:57.404956    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-r97bl" podStartSLOduration=251.378080494 podStartE2EDuration="4m13.404939683s" totalImagesPullingTime="2.026859189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:38:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:42:57.404115734 +0000 UTC m=+288.888865866" watchObservedRunningTime="2026-07-11 07:42:57.404939683 +0000 UTC m=+288.889689814"
Jul 11 07:42:57.417956 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:42:57.417904    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-rk2t2" podStartSLOduration=286.132942326 podStartE2EDuration="4m47.417887105s" totalImagesPullingTime="1.284944779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:42:57.417002381 +0000 UTC m=+288.901752516" watchObservedRunningTime="2026-07-11 07:42:57.417887105 +0000 UTC m=+288.902637237"
Jul 11 07:43:05.171072 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:05.171022    2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94978456-hwh2g"
Jul 11 07:43:05.171496 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:05.171379    2568 scope.go:117] "RemoveContainer" containerID="205c272b2edf29d6e954d710489b0650101d97f98f4f5fec5e73612dfb6265e2"
Jul 11 07:43:05.180148 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:05.180123    2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz"
Jul 11 07:43:05.180510 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:05.180496    2568 scope.go:117] "RemoveContainer" containerID="8497affe523302216b8276a93e199327317cc8edb88236c9dbea54db383c0f0b"
Jul 11 07:43:05.418618 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:05.418584    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz" event={"ID":"15eb0db2-c37f-4fda-89f3-d095ea19934c","Type":"ContainerStarted","Data":"4dc6eb561bd56a1c9bdb4d98d4beb279f8e06b4cd2d3df467aa8dc9810b57cb2"}
Jul 11 07:43:05.418950 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:05.418893    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz"
Jul 11 07:43:05.420393 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:05.420372    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f485b48dc-vgxzz"
Jul 11 07:43:05.420511 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:05.420493    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94978456-hwh2g" event={"ID":"72bc3283-11ab-4e8e-be96-a0335d8e4126","Type":"ContainerStarted","Data":"f0339026cffacb6f9915d58febba1a63c840c836166d7c9a0031049b50388042"}
Jul 11 07:43:06.068054 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:43:06.068013    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-kwbd7" podUID="91da412b-e856-41ed-b4de-78d3eaf95930"
Jul 11 07:43:07.397345 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:07.397295    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-r97bl"
Jul 11 07:43:08.917634 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:08.917609    2568 kubelet.go:1648] "Image garbage collection succeeded"
Jul 11 07:43:11.617970 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:11.617941    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c64959f6f-krrjs"]
Jul 11 07:43:11.622777 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:11.622741    2568 patch_prober.go:28] interesting pod/image-registry-5c64959f6f-krrjs container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 11 07:43:11.622929 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:11.622792    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5c64959f6f-krrjs" podUID="c220f3c9-1a0e-40ef-9648-20a3d8db5d6b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 11 07:43:18.065821 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:18.065788    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:43:21.622914 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:21.622887    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:43:36.637377 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:36.637317    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5c64959f6f-krrjs" podUID="c220f3c9-1a0e-40ef-9648-20a3d8db5d6b" containerName="registry" containerID="cri-o://c5c3e2a84bf261080b7d0f44f666014a0ef42ee3a5ed00db9672e082aaa4e2cd" gracePeriod=30
Jul 11 07:43:36.875704 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:36.875679    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:43:36.949661 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:36.949587    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-installation-pull-secrets\") pod \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") "
Jul 11 07:43:36.949661 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:36.949630    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls\") pod \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") "
Jul 11 07:43:36.949881 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:36.949670    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-trusted-ca\") pod \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") "
Jul 11 07:43:36.949881 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:36.949689    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-ca-trust-extracted\") pod \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") "
Jul 11 07:43:36.949881 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:36.949704    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mt7mx\" (UniqueName: \"kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-kube-api-access-mt7mx\") pod \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") "
Jul 11 07:43:36.949881 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:36.949720    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-image-registry-private-configuration\") pod \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") "
Jul 11 07:43:36.949881 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:36.949740    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-certificates\") pod \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") "
Jul 11 07:43:36.949881 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:36.949816    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-bound-sa-token\") pod \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\" (UID: \"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b\") "
Jul 11 07:43:36.950237 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:36.950210    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c220f3c9-1a0e-40ef-9648-20a3d8db5d6b" (UID: "c220f3c9-1a0e-40ef-9648-20a3d8db5d6b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 07:43:36.950767 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:36.950427    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c220f3c9-1a0e-40ef-9648-20a3d8db5d6b" (UID: "c220f3c9-1a0e-40ef-9648-20a3d8db5d6b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 07:43:36.952243 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:36.952214    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-kube-api-access-mt7mx" (OuterVolumeSpecName: "kube-api-access-mt7mx") pod "c220f3c9-1a0e-40ef-9648-20a3d8db5d6b" (UID: "c220f3c9-1a0e-40ef-9648-20a3d8db5d6b"). InnerVolumeSpecName "kube-api-access-mt7mx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 07:43:36.952379 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:36.952270    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c220f3c9-1a0e-40ef-9648-20a3d8db5d6b" (UID: "c220f3c9-1a0e-40ef-9648-20a3d8db5d6b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 07:43:36.952379 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:36.952274    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c220f3c9-1a0e-40ef-9648-20a3d8db5d6b" (UID: "c220f3c9-1a0e-40ef-9648-20a3d8db5d6b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 07:43:36.952379 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:36.952307    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c220f3c9-1a0e-40ef-9648-20a3d8db5d6b" (UID: "c220f3c9-1a0e-40ef-9648-20a3d8db5d6b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 07:43:36.952538 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:36.952379    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c220f3c9-1a0e-40ef-9648-20a3d8db5d6b" (UID: "c220f3c9-1a0e-40ef-9648-20a3d8db5d6b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 07:43:36.959221 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:36.959196    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c220f3c9-1a0e-40ef-9648-20a3d8db5d6b" (UID: "c220f3c9-1a0e-40ef-9648-20a3d8db5d6b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 07:43:37.051080 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:37.051039    2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-bound-sa-token\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:43:37.051080 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:37.051075    2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-installation-pull-secrets\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:43:37.051080 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:37.051086    2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-tls\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:43:37.051080 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:37.051094    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-trusted-ca\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:43:37.051316 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:37.051102    2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-ca-trust-extracted\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:43:37.051316 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:37.051110    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mt7mx\" (UniqueName: \"kubernetes.io/projected/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-kube-api-access-mt7mx\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:43:37.051316 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:37.051118    2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-image-registry-private-configuration\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:43:37.051316 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:37.051127    2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b-registry-certificates\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:43:37.524533 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:37.524500    2568 generic.go:356] "Generic (PLEG): container finished" podID="c220f3c9-1a0e-40ef-9648-20a3d8db5d6b" containerID="c5c3e2a84bf261080b7d0f44f666014a0ef42ee3a5ed00db9672e082aaa4e2cd" exitCode=0
Jul 11 07:43:37.524700 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:37.524547    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c64959f6f-krrjs"
Jul 11 07:43:37.524700 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:37.524580    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c64959f6f-krrjs" event={"ID":"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b","Type":"ContainerDied","Data":"c5c3e2a84bf261080b7d0f44f666014a0ef42ee3a5ed00db9672e082aaa4e2cd"}
Jul 11 07:43:37.524700 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:37.524635    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c64959f6f-krrjs" event={"ID":"c220f3c9-1a0e-40ef-9648-20a3d8db5d6b","Type":"ContainerDied","Data":"0d2e8b375215b79b4c3a65bbd674aab428f4a3ab0316f3dc7a7cb657e3f816f4"}
Jul 11 07:43:37.524700 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:37.524656    2568 scope.go:117] "RemoveContainer" containerID="c5c3e2a84bf261080b7d0f44f666014a0ef42ee3a5ed00db9672e082aaa4e2cd"
Jul 11 07:43:37.531983 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:37.531965    2568 scope.go:117] "RemoveContainer" containerID="c5c3e2a84bf261080b7d0f44f666014a0ef42ee3a5ed00db9672e082aaa4e2cd"
Jul 11 07:43:37.532211 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:43:37.532192    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5c3e2a84bf261080b7d0f44f666014a0ef42ee3a5ed00db9672e082aaa4e2cd\": container with ID starting with c5c3e2a84bf261080b7d0f44f666014a0ef42ee3a5ed00db9672e082aaa4e2cd not found: ID does not exist" containerID="c5c3e2a84bf261080b7d0f44f666014a0ef42ee3a5ed00db9672e082aaa4e2cd"
Jul 11 07:43:37.532258 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:37.532220    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5c3e2a84bf261080b7d0f44f666014a0ef42ee3a5ed00db9672e082aaa4e2cd"} err="failed to get container status \"c5c3e2a84bf261080b7d0f44f666014a0ef42ee3a5ed00db9672e082aaa4e2cd\": rpc error: code = NotFound desc = could not find container \"c5c3e2a84bf261080b7d0f44f666014a0ef42ee3a5ed00db9672e082aaa4e2cd\": container with ID starting with c5c3e2a84bf261080b7d0f44f666014a0ef42ee3a5ed00db9672e082aaa4e2cd not found: ID does not exist"
Jul 11 07:43:37.539995 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:37.539974    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c64959f6f-krrjs"]
Jul 11 07:43:37.543514 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:37.543495    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5c64959f6f-krrjs"]
Jul 11 07:43:39.074225 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:43:39.074190    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c220f3c9-1a0e-40ef-9648-20a3d8db5d6b" path="/var/lib/kubelet/pods/c220f3c9-1a0e-40ef-9648-20a3d8db5d6b/volumes"
Jul 11 07:44:24.501246 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:44:24.501209    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs\") pod \"network-metrics-daemon-kwbd7\" (UID: \"91da412b-e856-41ed-b4de-78d3eaf95930\") " pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:44:24.503516 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:44:24.503486    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91da412b-e856-41ed-b4de-78d3eaf95930-metrics-certs\") pod \"network-metrics-daemon-kwbd7\" (UID: \"91da412b-e856-41ed-b4de-78d3eaf95930\") " pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:44:24.669221 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:44:24.669187    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xs4vf\""
Jul 11 07:44:24.677974 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:44:24.677941    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwbd7"
Jul 11 07:44:24.805835 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:44:24.805803    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kwbd7"]
Jul 11 07:44:24.809350 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:44:24.809305    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91da412b_e856_41ed_b4de_78d3eaf95930.slice/crio-079ba112b37cf8d756334515be0c2eb5779b19975204610ac8ed1dc0825f8f22 WatchSource:0}: Error finding container 079ba112b37cf8d756334515be0c2eb5779b19975204610ac8ed1dc0825f8f22: Status 404 returned error can't find the container with id 079ba112b37cf8d756334515be0c2eb5779b19975204610ac8ed1dc0825f8f22
Jul 11 07:44:24.811151 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:44:24.811131    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 07:44:25.685457 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:44:25.685414    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kwbd7" event={"ID":"91da412b-e856-41ed-b4de-78d3eaf95930","Type":"ContainerStarted","Data":"079ba112b37cf8d756334515be0c2eb5779b19975204610ac8ed1dc0825f8f22"}
Jul 11 07:44:26.690631 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:44:26.690592    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kwbd7" event={"ID":"91da412b-e856-41ed-b4de-78d3eaf95930","Type":"ContainerStarted","Data":"c05c47497ee8e742a0478a3691716c15955d2295e2309a37f64adc7536b3abf6"}
Jul 11 07:44:26.691003 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:44:26.690674    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kwbd7" event={"ID":"91da412b-e856-41ed-b4de-78d3eaf95930","Type":"ContainerStarted","Data":"7d498924ee849e676eb26fcf6cb19a50eca1bb844428a18987bdec55a94e02a7"}
Jul 11 07:44:26.706055 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:44:26.706005    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kwbd7" podStartSLOduration=375.751186217 podStartE2EDuration="6m16.705990382s" totalImagesPullingTime="954.804165ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:44:26.704193813 +0000 UTC m=+378.188943956" watchObservedRunningTime="2026-07-11 07:44:26.705990382 +0000 UTC m=+378.190740564"
Jul 11 07:45:35.845096 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:35.845021    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-p8frb"]
Jul 11 07:45:35.845536 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:35.845248    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c220f3c9-1a0e-40ef-9648-20a3d8db5d6b" containerName="registry"
Jul 11 07:45:35.845536 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:35.845257    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c220f3c9-1a0e-40ef-9648-20a3d8db5d6b" containerName="registry"
Jul 11 07:45:35.845536 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:35.845300    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c220f3c9-1a0e-40ef-9648-20a3d8db5d6b" containerName="registry"
Jul 11 07:45:35.848000 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:35.847984    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-p8frb"
Jul 11 07:45:35.850370 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:35.850344    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 11 07:45:35.851195 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:35.851180    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 11 07:45:35.851292 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:35.851276    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-fdcc6\""
Jul 11 07:45:35.860796 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:35.860773    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-p8frb"]
Jul 11 07:45:35.980441 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:35.980408    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d0b739b-0e50-4467-a458-7e2e5d3982df-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-p8frb\" (UID: \"9d0b739b-0e50-4467-a458-7e2e5d3982df\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p8frb"
Jul 11 07:45:35.980441 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:35.980444    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgrxp\" (UniqueName: \"kubernetes.io/projected/9d0b739b-0e50-4467-a458-7e2e5d3982df-kube-api-access-xgrxp\") pod \"cert-manager-cainjector-559cdd8c87-p8frb\" (UID: \"9d0b739b-0e50-4467-a458-7e2e5d3982df\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p8frb"
Jul 11 07:45:36.081689 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:36.081643    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d0b739b-0e50-4467-a458-7e2e5d3982df-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-p8frb\" (UID: \"9d0b739b-0e50-4467-a458-7e2e5d3982df\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p8frb"
Jul 11 07:45:36.081780 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:36.081700    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgrxp\" (UniqueName: \"kubernetes.io/projected/9d0b739b-0e50-4467-a458-7e2e5d3982df-kube-api-access-xgrxp\") pod \"cert-manager-cainjector-559cdd8c87-p8frb\" (UID: \"9d0b739b-0e50-4467-a458-7e2e5d3982df\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p8frb"
Jul 11 07:45:36.088999 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:36.088962    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d0b739b-0e50-4467-a458-7e2e5d3982df-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-p8frb\" (UID: \"9d0b739b-0e50-4467-a458-7e2e5d3982df\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p8frb"
Jul 11 07:45:36.089112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:36.089096    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgrxp\" (UniqueName: \"kubernetes.io/projected/9d0b739b-0e50-4467-a458-7e2e5d3982df-kube-api-access-xgrxp\") pod \"cert-manager-cainjector-559cdd8c87-p8frb\" (UID: \"9d0b739b-0e50-4467-a458-7e2e5d3982df\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p8frb"
Jul 11 07:45:36.160985 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:36.160900    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-p8frb"
Jul 11 07:45:36.286833 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:36.286801    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-p8frb"]
Jul 11 07:45:36.290090 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:45:36.290064    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d0b739b_0e50_4467_a458_7e2e5d3982df.slice/crio-f81f483a8df5b9c220134841b16d20fef7f800ca50a1acccb3ce048138ce70d1 WatchSource:0}: Error finding container f81f483a8df5b9c220134841b16d20fef7f800ca50a1acccb3ce048138ce70d1: Status 404 returned error can't find the container with id f81f483a8df5b9c220134841b16d20fef7f800ca50a1acccb3ce048138ce70d1
Jul 11 07:45:36.912840 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:36.912799    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-p8frb" event={"ID":"9d0b739b-0e50-4467-a458-7e2e5d3982df","Type":"ContainerStarted","Data":"f81f483a8df5b9c220134841b16d20fef7f800ca50a1acccb3ce048138ce70d1"}
Jul 11 07:45:39.925050 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:39.925013    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-p8frb" event={"ID":"9d0b739b-0e50-4467-a458-7e2e5d3982df","Type":"ContainerStarted","Data":"f589e134c6c4ba9c913b633a838e602e2d2f83c5a76568278321a79b96b3cc4e"}
Jul 11 07:45:39.939460 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:39.939416    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-p8frb" podStartSLOduration=2.008377014 podStartE2EDuration="4.939400601s" totalImagesPullingTime="2.931023587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:45:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:45:39.938687416 +0000 UTC m=+451.423437551" watchObservedRunningTime="2026-07-11 07:45:39.939400601 +0000 UTC m=+451.424150733"
Jul 11 07:45:54.062657 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:54.062620    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8jfxl"]
Jul 11 07:45:54.068550 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:54.068522    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-8jfxl"
Jul 11 07:45:54.070918 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:54.070899    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-kgt97\""
Jul 11 07:45:54.072473 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:54.072451    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8jfxl"]
Jul 11 07:45:54.213853 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:54.213818    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92de705d-ad2f-47e6-bbdb-d1775ea4efe7-bound-sa-token\") pod \"cert-manager-55b4d954d5-8jfxl\" (UID: \"92de705d-ad2f-47e6-bbdb-d1775ea4efe7\") " pod="cert-manager/cert-manager-55b4d954d5-8jfxl"
Jul 11 07:45:54.213853 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:54.213856    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhnh4\" (UniqueName: \"kubernetes.io/projected/92de705d-ad2f-47e6-bbdb-d1775ea4efe7-kube-api-access-qhnh4\") pod \"cert-manager-55b4d954d5-8jfxl\" (UID: \"92de705d-ad2f-47e6-bbdb-d1775ea4efe7\") " pod="cert-manager/cert-manager-55b4d954d5-8jfxl"
Jul 11 07:45:54.314317 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:54.314239    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92de705d-ad2f-47e6-bbdb-d1775ea4efe7-bound-sa-token\") pod \"cert-manager-55b4d954d5-8jfxl\" (UID: \"92de705d-ad2f-47e6-bbdb-d1775ea4efe7\") " pod="cert-manager/cert-manager-55b4d954d5-8jfxl"
Jul 11 07:45:54.314317 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:54.314273    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhnh4\" (UniqueName: \"kubernetes.io/projected/92de705d-ad2f-47e6-bbdb-d1775ea4efe7-kube-api-access-qhnh4\") pod \"cert-manager-55b4d954d5-8jfxl\" (UID: \"92de705d-ad2f-47e6-bbdb-d1775ea4efe7\") " pod="cert-manager/cert-manager-55b4d954d5-8jfxl"
Jul 11 07:45:54.321447 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:54.321419    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92de705d-ad2f-47e6-bbdb-d1775ea4efe7-bound-sa-token\") pod \"cert-manager-55b4d954d5-8jfxl\" (UID: \"92de705d-ad2f-47e6-bbdb-d1775ea4efe7\") " pod="cert-manager/cert-manager-55b4d954d5-8jfxl"
Jul 11 07:45:54.321652 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:54.321634    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhnh4\" (UniqueName: \"kubernetes.io/projected/92de705d-ad2f-47e6-bbdb-d1775ea4efe7-kube-api-access-qhnh4\") pod \"cert-manager-55b4d954d5-8jfxl\" (UID: \"92de705d-ad2f-47e6-bbdb-d1775ea4efe7\") " pod="cert-manager/cert-manager-55b4d954d5-8jfxl"
Jul 11 07:45:54.378248 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:54.378221    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-8jfxl"
Jul 11 07:45:54.502600 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:54.502566    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8jfxl"]
Jul 11 07:45:54.506020 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:45:54.505987    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92de705d_ad2f_47e6_bbdb_d1775ea4efe7.slice/crio-d60d34f5f7895eae5516d3b3d3892db45e82052cd4157e4beb2e7b3b8f08dc06 WatchSource:0}: Error finding container d60d34f5f7895eae5516d3b3d3892db45e82052cd4157e4beb2e7b3b8f08dc06: Status 404 returned error can't find the container with id d60d34f5f7895eae5516d3b3d3892db45e82052cd4157e4beb2e7b3b8f08dc06
Jul 11 07:45:54.975479 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:54.975439    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-8jfxl" event={"ID":"92de705d-ad2f-47e6-bbdb-d1775ea4efe7","Type":"ContainerStarted","Data":"3066ea939a9288123589f499ff11977ce8f1529bd883e59704bd342089db6aca"}
Jul 11 07:45:54.975479 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:54.975480    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-8jfxl" event={"ID":"92de705d-ad2f-47e6-bbdb-d1775ea4efe7","Type":"ContainerStarted","Data":"d60d34f5f7895eae5516d3b3d3892db45e82052cd4157e4beb2e7b3b8f08dc06"}
Jul 11 07:45:54.994396 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:45:54.994351    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-8jfxl" podStartSLOduration=0.994314271 podStartE2EDuration="994.314271ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:45:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:45:54.99280482 +0000 UTC m=+466.477554952" watchObservedRunningTime="2026-07-11 07:45:54.994314271 +0000 UTC m=+466.479064403"
Jul 11 07:46:08.089591 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:08.089554    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78d8b67ddd-b82c9"]
Jul 11 07:46:08.092713 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:08.092697    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78d8b67ddd-b82c9"
Jul 11 07:46:08.095566 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:08.095543    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 11 07:46:08.096039 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:08.096023    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 11 07:46:08.096337 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:08.096312    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 11 07:46:08.096762 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:08.096749    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-n26xj\""
Jul 11 07:46:08.097130 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:08.097117    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 11 07:46:08.113105 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:08.113077    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78d8b67ddd-b82c9"]
Jul 11 07:46:08.209590 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:08.209556    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20ed54a2-e2e0-4935-b812-f41120e4ea00-webhook-cert\") pod \"opendatahub-operator-controller-manager-78d8b67ddd-b82c9\" (UID: \"20ed54a2-e2e0-4935-b812-f41120e4ea00\") " pod="opendatahub/opendatahub-operator-controller-manager-78d8b67ddd-b82c9"
Jul 11 07:46:08.209754 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:08.209599    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzt9d\" (UniqueName: \"kubernetes.io/projected/20ed54a2-e2e0-4935-b812-f41120e4ea00-kube-api-access-kzt9d\") pod \"opendatahub-operator-controller-manager-78d8b67ddd-b82c9\" (UID: \"20ed54a2-e2e0-4935-b812-f41120e4ea00\") " pod="opendatahub/opendatahub-operator-controller-manager-78d8b67ddd-b82c9"
Jul 11 07:46:08.209754 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:08.209624    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/20ed54a2-e2e0-4935-b812-f41120e4ea00-manifests\") pod \"opendatahub-operator-controller-manager-78d8b67ddd-b82c9\" (UID: \"20ed54a2-e2e0-4935-b812-f41120e4ea00\") " pod="opendatahub/opendatahub-operator-controller-manager-78d8b67ddd-b82c9"
Jul 11 07:46:08.209754 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:08.209693    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/20ed54a2-e2e0-4935-b812-f41120e4ea00-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78d8b67ddd-b82c9\" (UID: \"20ed54a2-e2e0-4935-b812-f41120e4ea00\") " pod="opendatahub/opendatahub-operator-controller-manager-78d8b67ddd-b82c9"
Jul 11 07:46:08.209754 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:08.209727    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20ed54a2-e2e0-4935-b812-f41120e4ea00-tmp\") pod \"opendatahub-operator-controller-manager-78d8b67ddd-b82c9\" (UID: \"20ed54a2-e2e0-4935-b812-f41120e4ea00\") " pod="opendatahub/opendatahub-operator-controller-manager-78d8b67ddd-b82c9"
Jul 11 07:46:08.310934 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:08.310891    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20ed54a2-e2e0-4935-b812-f41120e4ea00-webhook-cert\") pod \"opendatahub-operator-controller-manager-78d8b67ddd-b82c9\" (UID: \"20ed54a2-e2e0-4935-b812-f41120e4ea00\") " pod="opendatahub/opendatahub-operator-controller-manager-78d8b67ddd-b82c9"
Jul 11 07:46:08.311105 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:08.310953    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzt9d\" (UniqueName: \"kubernetes.io/projected/20ed54a2-e2e0-4935-b812-f41120e4ea00-kube-api-access-kzt9d\") pod \"opendatahub-operator-controller-manager-78d8b67ddd-b82c9\" (UID: \"20ed54a2-e2e0-4935-b812-f41120e4ea00\") " pod="opendatahub/opendatahub-operator-controller-manager-78d8b67ddd-b82c9"
Jul 11 07:46:08.311105 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:08.310979    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/20ed54a2-e2e0-4935-b812-f41120e4ea00-manifests\") pod \"opendatahub-operator-controller-manager-78d8b67ddd-b82c9\" (UID: \"20ed54a2-e2e0-4935-b812-f41120e4ea00\") " pod="opendatahub/opendatahub-operator-controller-manager-78d8b67ddd-b82c9"
Jul 11 07:46:08.311105 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:08.311016    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/20ed54a2-e2e0-4935-b812-f41120e4ea00-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78d8b67ddd-b82c9\" (UID: \"20ed54a2-e2e0-4935-b812-f41120e4ea00\") " pod="opendatahub/opendatahub-operator-controller-manager-78d8b67ddd-b82c9"
Jul 11 07:46:08.311215 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:08.311033    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20ed54a2-e2e0-4935-b812-f41120e4ea00-tmp\") pod \"opendatahub-operator-controller-manager-78d8b67ddd-b82c9\" (UID: \"20ed54a2-e2e0-4935-b812-f41120e4ea00\") " pod="opendatahub/opendatahub-operator-controller-manager-78d8b67ddd-b82c9"
Jul 11 07:46:08.314216 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:08.311832    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/20ed54a2-e2e0-4935-b812-f41120e4ea00-manifests\") pod \"opendatahub-operator-controller-manager-78d8b67ddd-b82c9\" (UID: \"20ed54a2-e2e0-4935-b812-f41120e4ea00\") " pod="opendatahub/opendatahub-operator-controller-manager-78d8b67ddd-b82c9"
Jul 11 07:46:08.316933 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:08.316804    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20ed54a2-e2e0-4935-b812-f41120e4ea00-webhook-cert\") pod \"opendatahub-operator-controller-manager-78d8b67ddd-b82c9\" (UID: \"20ed54a2-e2e0-4935-b812-f41120e4ea00\") " pod="opendatahub/opendatahub-operator-controller-manager-78d8b67ddd-b82c9"
Jul 11 07:46:08.317355 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:08.317307    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20ed54a2-e2e0-4935-b812-f41120e4ea00-tmp\") pod \"opendatahub-operator-controller-manager-78d8b67ddd-b82c9\" (UID: \"20ed54a2-e2e0-4935-b812-f41120e4ea00\") " pod="opendatahub/opendatahub-operator-controller-manager-78d8b67ddd-b82c9"
Jul 11 07:46:08.317962 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:08.317942    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/20ed54a2-e2e0-4935-b812-f41120e4ea00-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78d8b67ddd-b82c9\" (UID: \"20ed54a2-e2e0-4935-b812-f41120e4ea00\") " pod="opendatahub/opendatahub-operator-controller-manager-78d8b67ddd-b82c9"
Jul 11 07:46:08.320807 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:08.320787    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzt9d\" (UniqueName: \"kubernetes.io/projected/20ed54a2-e2e0-4935-b812-f41120e4ea00-kube-api-access-kzt9d\") pod \"opendatahub-operator-controller-manager-78d8b67ddd-b82c9\" (UID: \"20ed54a2-e2e0-4935-b812-f41120e4ea00\") " pod="opendatahub/opendatahub-operator-controller-manager-78d8b67ddd-b82c9"
Jul 11 07:46:08.403129 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:08.403018    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78d8b67ddd-b82c9"
Jul 11 07:46:08.535602 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:08.535569    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78d8b67ddd-b82c9"]
Jul 11 07:46:08.538715 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:46:08.538690    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20ed54a2_e2e0_4935_b812_f41120e4ea00.slice/crio-8278801ceb79ec5adef7672c7e050be340fbbe8dbbab3506125a3b2a6f5af68d WatchSource:0}: Error finding container 8278801ceb79ec5adef7672c7e050be340fbbe8dbbab3506125a3b2a6f5af68d: Status 404 returned error can't find the container with id 8278801ceb79ec5adef7672c7e050be340fbbe8dbbab3506125a3b2a6f5af68d
Jul 11 07:46:09.021164 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:09.021133    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78d8b67ddd-b82c9" event={"ID":"20ed54a2-e2e0-4935-b812-f41120e4ea00","Type":"ContainerStarted","Data":"8278801ceb79ec5adef7672c7e050be340fbbe8dbbab3506125a3b2a6f5af68d"}
Jul 11 07:46:12.044075 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:12.044036    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78d8b67ddd-b82c9" event={"ID":"20ed54a2-e2e0-4935-b812-f41120e4ea00","Type":"ContainerStarted","Data":"08e538d1acbf5ce7b0dd2f39dd153b055b8f95f5f037bbbf155a71959753b369"}
Jul 11 07:46:13.049093 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:13.049058    2568 generic.go:356] "Generic (PLEG): container finished" podID="20ed54a2-e2e0-4935-b812-f41120e4ea00" containerID="08e538d1acbf5ce7b0dd2f39dd153b055b8f95f5f037bbbf155a71959753b369" exitCode=0
Jul 11 07:46:13.049484 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:13.049116    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78d8b67ddd-b82c9" event={"ID":"20ed54a2-e2e0-4935-b812-f41120e4ea00","Type":"ContainerDied","Data":"08e538d1acbf5ce7b0dd2f39dd153b055b8f95f5f037bbbf155a71959753b369"}
Jul 11 07:46:14.054742 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:14.054706    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78d8b67ddd-b82c9" event={"ID":"20ed54a2-e2e0-4935-b812-f41120e4ea00","Type":"ContainerStarted","Data":"cab48f3b317da6840f0972f5145d9592d6d232c2dcac333d41c87f672c403b95"}
Jul 11 07:46:14.055231 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:14.054812    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-78d8b67ddd-b82c9"
Jul 11 07:46:14.075369 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:14.075301    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-78d8b67ddd-b82c9" podStartSLOduration=1.771321718 podStartE2EDuration="6.075282106s" totalImagesPullingTime="3.261468129s" totalInitContainerRuntime="1.042492259s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:46:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:46:14.073519747 +0000 UTC m=+485.558269880" watchObservedRunningTime="2026-07-11 07:46:14.075282106 +0000 UTC m=+485.560032239"
Jul 11 07:46:25.060688 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:25.060658    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-78d8b67ddd-b82c9"
Jul 11 07:46:28.079504 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.079467    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-p5qwq"]
Jul 11 07:46:28.087637 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.087611    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-p5qwq"
Jul 11 07:46:28.090298 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.090266    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 11 07:46:28.090455 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.090437    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-c5stc\""
Jul 11 07:46:28.106946 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.106916    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-p5qwq"]
Jul 11 07:46:28.194297 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.194264    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5dd5d4cc95-wh9tz"]
Jul 11 07:46:28.197666 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.197640    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5dd5d4cc95-wh9tz"
Jul 11 07:46:28.199867 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.199845    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 11 07:46:28.199996 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.199874    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 11 07:46:28.200244 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.200224    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 11 07:46:28.200244 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.200235    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 11 07:46:28.200244 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.200245    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-z9sdc\""
Jul 11 07:46:28.206483 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.206460    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5dd5d4cc95-wh9tz"]
Jul 11 07:46:28.254888 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.254842    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq4vn\" (UniqueName: \"kubernetes.io/projected/59617955-0bf6-4dd8-a4de-cd85e34315a4-kube-api-access-vq4vn\") pod \"odh-model-controller-7998c67dc4-p5qwq\" (UID: \"59617955-0bf6-4dd8-a4de-cd85e34315a4\") " pod="opendatahub/odh-model-controller-7998c67dc4-p5qwq"
Jul 11 07:46:28.254888 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.254890    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/59617955-0bf6-4dd8-a4de-cd85e34315a4-cert\") pod \"odh-model-controller-7998c67dc4-p5qwq\" (UID: \"59617955-0bf6-4dd8-a4de-cd85e34315a4\") " pod="opendatahub/odh-model-controller-7998c67dc4-p5qwq"
Jul 11 07:46:28.355707 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.355618    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq4vn\" (UniqueName: \"kubernetes.io/projected/59617955-0bf6-4dd8-a4de-cd85e34315a4-kube-api-access-vq4vn\") pod \"odh-model-controller-7998c67dc4-p5qwq\" (UID: \"59617955-0bf6-4dd8-a4de-cd85e34315a4\") " pod="opendatahub/odh-model-controller-7998c67dc4-p5qwq"
Jul 11 07:46:28.355707 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.355654    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/59617955-0bf6-4dd8-a4de-cd85e34315a4-cert\") pod \"odh-model-controller-7998c67dc4-p5qwq\" (UID: \"59617955-0bf6-4dd8-a4de-cd85e34315a4\") " pod="opendatahub/odh-model-controller-7998c67dc4-p5qwq"
Jul 11 07:46:28.355707 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.355681    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc2gs\" (UniqueName: \"kubernetes.io/projected/6f23ab45-4413-4c10-8e7b-a1d41f47c3f9-kube-api-access-cc2gs\") pod \"kube-auth-proxy-5dd5d4cc95-wh9tz\" (UID: \"6f23ab45-4413-4c10-8e7b-a1d41f47c3f9\") " pod="openshift-ingress/kube-auth-proxy-5dd5d4cc95-wh9tz"
Jul 11 07:46:28.355707 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.355709    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f23ab45-4413-4c10-8e7b-a1d41f47c3f9-tmp\") pod \"kube-auth-proxy-5dd5d4cc95-wh9tz\" (UID: \"6f23ab45-4413-4c10-8e7b-a1d41f47c3f9\") " pod="openshift-ingress/kube-auth-proxy-5dd5d4cc95-wh9tz"
Jul 11 07:46:28.355949 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.355726    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f23ab45-4413-4c10-8e7b-a1d41f47c3f9-tls-certs\") pod \"kube-auth-proxy-5dd5d4cc95-wh9tz\" (UID: \"6f23ab45-4413-4c10-8e7b-a1d41f47c3f9\") " pod="openshift-ingress/kube-auth-proxy-5dd5d4cc95-wh9tz"
Jul 11 07:46:28.358184 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.358147    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/59617955-0bf6-4dd8-a4de-cd85e34315a4-cert\") pod \"odh-model-controller-7998c67dc4-p5qwq\" (UID: \"59617955-0bf6-4dd8-a4de-cd85e34315a4\") " pod="opendatahub/odh-model-controller-7998c67dc4-p5qwq"
Jul 11 07:46:28.366681 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.366660    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq4vn\" (UniqueName: \"kubernetes.io/projected/59617955-0bf6-4dd8-a4de-cd85e34315a4-kube-api-access-vq4vn\") pod \"odh-model-controller-7998c67dc4-p5qwq\" (UID: \"59617955-0bf6-4dd8-a4de-cd85e34315a4\") " pod="opendatahub/odh-model-controller-7998c67dc4-p5qwq"
Jul 11 07:46:28.396685 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.396660    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-p5qwq"
Jul 11 07:46:28.457172 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.456954    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc2gs\" (UniqueName: \"kubernetes.io/projected/6f23ab45-4413-4c10-8e7b-a1d41f47c3f9-kube-api-access-cc2gs\") pod \"kube-auth-proxy-5dd5d4cc95-wh9tz\" (UID: \"6f23ab45-4413-4c10-8e7b-a1d41f47c3f9\") " pod="openshift-ingress/kube-auth-proxy-5dd5d4cc95-wh9tz"
Jul 11 07:46:28.457172 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.457021    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f23ab45-4413-4c10-8e7b-a1d41f47c3f9-tmp\") pod \"kube-auth-proxy-5dd5d4cc95-wh9tz\" (UID: \"6f23ab45-4413-4c10-8e7b-a1d41f47c3f9\") " pod="openshift-ingress/kube-auth-proxy-5dd5d4cc95-wh9tz"
Jul 11 07:46:28.457172 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.457049    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f23ab45-4413-4c10-8e7b-a1d41f47c3f9-tls-certs\") pod \"kube-auth-proxy-5dd5d4cc95-wh9tz\" (UID: \"6f23ab45-4413-4c10-8e7b-a1d41f47c3f9\") " pod="openshift-ingress/kube-auth-proxy-5dd5d4cc95-wh9tz"
Jul 11 07:46:28.460850 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.460799    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f23ab45-4413-4c10-8e7b-a1d41f47c3f9-tmp\") pod \"kube-auth-proxy-5dd5d4cc95-wh9tz\" (UID: \"6f23ab45-4413-4c10-8e7b-a1d41f47c3f9\") " pod="openshift-ingress/kube-auth-proxy-5dd5d4cc95-wh9tz"
Jul 11 07:46:28.461205 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.461180    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f23ab45-4413-4c10-8e7b-a1d41f47c3f9-tls-certs\") pod \"kube-auth-proxy-5dd5d4cc95-wh9tz\" (UID: \"6f23ab45-4413-4c10-8e7b-a1d41f47c3f9\") " pod="openshift-ingress/kube-auth-proxy-5dd5d4cc95-wh9tz"
Jul 11 07:46:28.465747 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.465724    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc2gs\" (UniqueName: \"kubernetes.io/projected/6f23ab45-4413-4c10-8e7b-a1d41f47c3f9-kube-api-access-cc2gs\") pod \"kube-auth-proxy-5dd5d4cc95-wh9tz\" (UID: \"6f23ab45-4413-4c10-8e7b-a1d41f47c3f9\") " pod="openshift-ingress/kube-auth-proxy-5dd5d4cc95-wh9tz"
Jul 11 07:46:28.507643 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.507612    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5dd5d4cc95-wh9tz"
Jul 11 07:46:28.520566 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.520538    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-p5qwq"]
Jul 11 07:46:28.523789 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:46:28.523765    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59617955_0bf6_4dd8_a4de_cd85e34315a4.slice/crio-a090fca75a1e2ce57f2a010cbfbdf72e46ab93edbaae1254bec717a7b8229cbb WatchSource:0}: Error finding container a090fca75a1e2ce57f2a010cbfbdf72e46ab93edbaae1254bec717a7b8229cbb: Status 404 returned error can't find the container with id a090fca75a1e2ce57f2a010cbfbdf72e46ab93edbaae1254bec717a7b8229cbb
Jul 11 07:46:28.642784 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.642698    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5dd5d4cc95-wh9tz"]
Jul 11 07:46:28.645857 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:46:28.645827    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f23ab45_4413_4c10_8e7b_a1d41f47c3f9.slice/crio-e0a3c967618e9384f8d5142edbd4cbded31b7025f3e8a939ef2c885ae23be718 WatchSource:0}: Error finding container e0a3c967618e9384f8d5142edbd4cbded31b7025f3e8a939ef2c885ae23be718: Status 404 returned error can't find the container with id e0a3c967618e9384f8d5142edbd4cbded31b7025f3e8a939ef2c885ae23be718
Jul 11 07:46:28.793709 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.793678    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"]
Jul 11 07:46:28.797882 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.797865    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"
Jul 11 07:46:28.800466 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.800443    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 11 07:46:28.800645 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.800620    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 11 07:46:28.800734 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.800646    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kpjms\""
Jul 11 07:46:28.800734 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.800625    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 11 07:46:28.800828 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.800743    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 11 07:46:28.814410 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.814355    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"]
Jul 11 07:46:28.960817 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.960708    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c0c03b91-9caa-43cb-97a3-20287b8dd203-cacerts\") pod \"istiod-openshift-gateway-7574459656-44w6z\" (UID: \"c0c03b91-9caa-43cb-97a3-20287b8dd203\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"
Jul 11 07:46:28.960817 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.960781    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0c03b91-9caa-43cb-97a3-20287b8dd203-local-certs\") pod \"istiod-openshift-gateway-7574459656-44w6z\" (UID: \"c0c03b91-9caa-43cb-97a3-20287b8dd203\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"
Jul 11 07:46:28.960817 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.960806    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0c03b91-9caa-43cb-97a3-20287b8dd203-istio-token\") pod \"istiod-openshift-gateway-7574459656-44w6z\" (UID: \"c0c03b91-9caa-43cb-97a3-20287b8dd203\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"
Jul 11 07:46:28.960817 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.960829    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c0c03b91-9caa-43cb-97a3-20287b8dd203-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-44w6z\" (UID: \"c0c03b91-9caa-43cb-97a3-20287b8dd203\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"
Jul 11 07:46:28.961071 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.960866    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbfnf\" (UniqueName: \"kubernetes.io/projected/c0c03b91-9caa-43cb-97a3-20287b8dd203-kube-api-access-fbfnf\") pod \"istiod-openshift-gateway-7574459656-44w6z\" (UID: \"c0c03b91-9caa-43cb-97a3-20287b8dd203\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"
Jul 11 07:46:28.961071 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.960912    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c0c03b91-9caa-43cb-97a3-20287b8dd203-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-44w6z\" (UID: \"c0c03b91-9caa-43cb-97a3-20287b8dd203\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"
Jul 11 07:46:28.961071 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:28.961017    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c0c03b91-9caa-43cb-97a3-20287b8dd203-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-44w6z\" (UID: \"c0c03b91-9caa-43cb-97a3-20287b8dd203\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"
Jul 11 07:46:29.061755 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:29.061721    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0c03b91-9caa-43cb-97a3-20287b8dd203-local-certs\") pod \"istiod-openshift-gateway-7574459656-44w6z\" (UID: \"c0c03b91-9caa-43cb-97a3-20287b8dd203\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"
Jul 11 07:46:29.061755 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:29.061756    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0c03b91-9caa-43cb-97a3-20287b8dd203-istio-token\") pod \"istiod-openshift-gateway-7574459656-44w6z\" (UID: \"c0c03b91-9caa-43cb-97a3-20287b8dd203\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"
Jul 11 07:46:29.061964 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:29.061778    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c0c03b91-9caa-43cb-97a3-20287b8dd203-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-44w6z\" (UID: \"c0c03b91-9caa-43cb-97a3-20287b8dd203\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"
Jul 11 07:46:29.061964 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:29.061815    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbfnf\" (UniqueName: \"kubernetes.io/projected/c0c03b91-9caa-43cb-97a3-20287b8dd203-kube-api-access-fbfnf\") pod \"istiod-openshift-gateway-7574459656-44w6z\" (UID: \"c0c03b91-9caa-43cb-97a3-20287b8dd203\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"
Jul 11 07:46:29.061964 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:29.061942    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c0c03b91-9caa-43cb-97a3-20287b8dd203-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-44w6z\" (UID: \"c0c03b91-9caa-43cb-97a3-20287b8dd203\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"
Jul 11 07:46:29.062115 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:29.062099    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c0c03b91-9caa-43cb-97a3-20287b8dd203-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-44w6z\" (UID: \"c0c03b91-9caa-43cb-97a3-20287b8dd203\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"
Jul 11 07:46:29.062206 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:29.062159    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c0c03b91-9caa-43cb-97a3-20287b8dd203-cacerts\") pod \"istiod-openshift-gateway-7574459656-44w6z\" (UID: \"c0c03b91-9caa-43cb-97a3-20287b8dd203\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"
Jul 11 07:46:29.062635 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:29.062598    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c0c03b91-9caa-43cb-97a3-20287b8dd203-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-44w6z\" (UID: \"c0c03b91-9caa-43cb-97a3-20287b8dd203\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"
Jul 11 07:46:29.064072 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:29.064049    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0c03b91-9caa-43cb-97a3-20287b8dd203-local-certs\") pod \"istiod-openshift-gateway-7574459656-44w6z\" (UID: \"c0c03b91-9caa-43cb-97a3-20287b8dd203\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"
Jul 11 07:46:29.064166 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:29.064126    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c0c03b91-9caa-43cb-97a3-20287b8dd203-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-44w6z\" (UID: \"c0c03b91-9caa-43cb-97a3-20287b8dd203\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"
Jul 11 07:46:29.064222 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:29.064200    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c0c03b91-9caa-43cb-97a3-20287b8dd203-cacerts\") pod \"istiod-openshift-gateway-7574459656-44w6z\" (UID: \"c0c03b91-9caa-43cb-97a3-20287b8dd203\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"
Jul 11 07:46:29.064360 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:29.064317    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c0c03b91-9caa-43cb-97a3-20287b8dd203-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-44w6z\" (UID: \"c0c03b91-9caa-43cb-97a3-20287b8dd203\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"
Jul 11 07:46:29.068444 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:29.068424    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0c03b91-9caa-43cb-97a3-20287b8dd203-istio-token\") pod \"istiod-openshift-gateway-7574459656-44w6z\" (UID: \"c0c03b91-9caa-43cb-97a3-20287b8dd203\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"
Jul 11 07:46:29.068762 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:29.068743    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbfnf\" (UniqueName: \"kubernetes.io/projected/c0c03b91-9caa-43cb-97a3-20287b8dd203-kube-api-access-fbfnf\") pod \"istiod-openshift-gateway-7574459656-44w6z\" (UID: \"c0c03b91-9caa-43cb-97a3-20287b8dd203\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"
Jul 11 07:46:29.107006 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:29.106980    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"
Jul 11 07:46:29.107994 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:29.107967    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5dd5d4cc95-wh9tz" event={"ID":"6f23ab45-4413-4c10-8e7b-a1d41f47c3f9","Type":"ContainerStarted","Data":"e0a3c967618e9384f8d5142edbd4cbded31b7025f3e8a939ef2c885ae23be718"}
Jul 11 07:46:29.109032 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:29.109011    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-p5qwq" event={"ID":"59617955-0bf6-4dd8-a4de-cd85e34315a4","Type":"ContainerStarted","Data":"a090fca75a1e2ce57f2a010cbfbdf72e46ab93edbaae1254bec717a7b8229cbb"}
Jul 11 07:46:29.252692 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:29.252358    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"]
Jul 11 07:46:29.268274 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:46:29.268124    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0c03b91_9caa_43cb_97a3_20287b8dd203.slice/crio-0efc5fae1effdbd1f1ed6bf6fa2949a4fa798e0e4c1e860596c38f187dc41c34 WatchSource:0}: Error finding container 0efc5fae1effdbd1f1ed6bf6fa2949a4fa798e0e4c1e860596c38f187dc41c34: Status 404 returned error can't find the container with id 0efc5fae1effdbd1f1ed6bf6fa2949a4fa798e0e4c1e860596c38f187dc41c34
Jul 11 07:46:30.115767 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:30.115725    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z" event={"ID":"c0c03b91-9caa-43cb-97a3-20287b8dd203","Type":"ContainerStarted","Data":"0efc5fae1effdbd1f1ed6bf6fa2949a4fa798e0e4c1e860596c38f187dc41c34"}
Jul 11 07:46:33.076998 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:33.076964    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 07:46:33.077420 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:33.077025    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 07:46:34.136413 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.136372    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-p5qwq" event={"ID":"59617955-0bf6-4dd8-a4de-cd85e34315a4","Type":"ContainerStarted","Data":"1f9b6c8bfcf18624e855e3d0a15b45be1328e0b31c1edac0df303fa6ba13a389"}
Jul 11 07:46:34.136894 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.136495    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-p5qwq"
Jul 11 07:46:34.138294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.138269    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z" event={"ID":"c0c03b91-9caa-43cb-97a3-20287b8dd203","Type":"ContainerStarted","Data":"2f03f9503ad45acc7fb706e552f356c508471e14bb2c39266e9efe1ed40f969a"}
Jul 11 07:46:34.138475 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.138417    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"
Jul 11 07:46:34.139730 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.139707    2568 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-44w6z container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 11 07:46:34.139848 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.139768    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z" podUID="c0c03b91-9caa-43cb-97a3-20287b8dd203" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 11 07:46:34.140140 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.140117    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5dd5d4cc95-wh9tz" event={"ID":"6f23ab45-4413-4c10-8e7b-a1d41f47c3f9","Type":"ContainerStarted","Data":"99f3bec2d17fa79b3b0795e690e37b93d2dcc43750a95b52c449908cb4ed1d5e"}
Jul 11 07:46:34.154751 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.154719    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"]
Jul 11 07:46:34.158041 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.158017    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:34.160285 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.160231    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-p5qwq" podStartSLOduration=1.613990276 podStartE2EDuration="6.160212503s" totalImagesPullingTime="4.546222227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:46:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:46:34.159550643 +0000 UTC m=+505.644300776" watchObservedRunningTime="2026-07-11 07:46:34.160212503 +0000 UTC m=+505.644962635"
Jul 11 07:46:34.160977 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.160959    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-mh52f\""
Jul 11 07:46:34.171740 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.171707    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"]
Jul 11 07:46:34.177420 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.177370    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5dd5d4cc95-wh9tz" podStartSLOduration=1.7508220799999998 podStartE2EDuration="6.177353697s" totalImagesPullingTime="4.426531617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:46:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:46:34.176028534 +0000 UTC m=+505.660778664" watchObservedRunningTime="2026-07-11 07:46:34.177353697 +0000 UTC m=+505.662103821"
Jul 11 07:46:34.195966 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.195912    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z" podStartSLOduration=2.39035496 podStartE2EDuration="6.195866287s" totalImagesPullingTime="3.805511327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:46:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:46:34.195040211 +0000 UTC m=+505.679790343" watchObservedRunningTime="2026-07-11 07:46:34.195866287 +0000 UTC m=+505.680616421"
Jul 11 07:46:34.300538 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.300501    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-6gr88\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:34.300538 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.300534    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-6gr88\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:34.300761 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.300741    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-6gr88\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:34.300803 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.300784    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-6gr88\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:34.300853 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.300842    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-6gr88\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:34.300886 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.300869    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr7kv\" (UniqueName: \"kubernetes.io/projected/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-kube-api-access-jr7kv\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-6gr88\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:34.300921 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.300892    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-6gr88\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:34.300966 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.300955    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-6gr88\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:34.301044 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.301029    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-6gr88\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:34.401954 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.401865    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-6gr88\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:34.401954 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.401906    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-6gr88\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:34.402178 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.402018    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-6gr88\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:34.402178 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.402049    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-6gr88\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:34.402178 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.402081    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-6gr88\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:34.402338 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.402195    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-6gr88\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:34.402338 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.402268    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-6gr88\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:34.402338 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.402309    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr7kv\" (UniqueName: \"kubernetes.io/projected/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-kube-api-access-jr7kv\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-6gr88\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:34.402494 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.402314    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-6gr88\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:34.402494 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.402361    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-6gr88\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:34.402494 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.402363    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-6gr88\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:34.402494 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.402409    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-6gr88\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:34.402671 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.402493    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-6gr88\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:34.402947 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.402928    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-6gr88\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:34.404300 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.404280    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-6gr88\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:34.404430 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.404413    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-6gr88\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:34.417797 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.417771    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-6gr88\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:34.418044 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.418027    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr7kv\" (UniqueName: \"kubernetes.io/projected/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-kube-api-access-jr7kv\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-6gr88\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:34.468937 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.468897    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:34.607465 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:34.607428    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"]
Jul 11 07:46:34.610541 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:46:34.610514    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1a7fd06_bd2d_4cc7_9171_929d7eeec26a.slice/crio-6d29ed8dc97267dbe51c3fa593bf2faaaaa9e99121b100595dc8fb8e17efd4d2 WatchSource:0}: Error finding container 6d29ed8dc97267dbe51c3fa593bf2faaaaa9e99121b100595dc8fb8e17efd4d2: Status 404 returned error can't find the container with id 6d29ed8dc97267dbe51c3fa593bf2faaaaa9e99121b100595dc8fb8e17efd4d2
Jul 11 07:46:35.145159 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:35.145123    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88" event={"ID":"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a","Type":"ContainerStarted","Data":"6d29ed8dc97267dbe51c3fa593bf2faaaaa9e99121b100595dc8fb8e17efd4d2"}
Jul 11 07:46:35.146067 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:35.146046    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"
Jul 11 07:46:36.540490 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:36.540454    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv"]
Jul 11 07:46:36.547224 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:36.547189    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv"
Jul 11 07:46:36.557364 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:36.557314    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv"]
Jul 11 07:46:36.626673 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:36.626640    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af19058a-7458-4333-9508-22aa26648594-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-8qrbv\" (UID: \"af19058a-7458-4333-9508-22aa26648594\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv"
Jul 11 07:46:36.626673 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:36.626678    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/af19058a-7458-4333-9508-22aa26648594-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-8qrbv\" (UID: \"af19058a-7458-4333-9508-22aa26648594\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv"
Jul 11 07:46:36.626906 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:36.626720    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/af19058a-7458-4333-9508-22aa26648594-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-8qrbv\" (UID: \"af19058a-7458-4333-9508-22aa26648594\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv"
Jul 11 07:46:36.626906 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:36.626787    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/af19058a-7458-4333-9508-22aa26648594-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-8qrbv\" (UID: \"af19058a-7458-4333-9508-22aa26648594\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv"
Jul 11 07:46:36.626906 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:36.626819    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/af19058a-7458-4333-9508-22aa26648594-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-8qrbv\" (UID: \"af19058a-7458-4333-9508-22aa26648594\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv"
Jul 11 07:46:36.626906 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:36.626835    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbv9n\" (UniqueName: \"kubernetes.io/projected/af19058a-7458-4333-9508-22aa26648594-kube-api-access-wbv9n\") pod \"istiod-openshift-gateway-94bb8fbfd-8qrbv\" (UID: \"af19058a-7458-4333-9508-22aa26648594\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv"
Jul 11 07:46:36.626906 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:36.626859    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/af19058a-7458-4333-9508-22aa26648594-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-8qrbv\" (UID: \"af19058a-7458-4333-9508-22aa26648594\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv"
Jul 11 07:46:36.727914 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:36.727867    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/af19058a-7458-4333-9508-22aa26648594-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-8qrbv\" (UID: \"af19058a-7458-4333-9508-22aa26648594\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv"
Jul 11 07:46:36.727914 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:36.727914    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbv9n\" (UniqueName: \"kubernetes.io/projected/af19058a-7458-4333-9508-22aa26648594-kube-api-access-wbv9n\") pod \"istiod-openshift-gateway-94bb8fbfd-8qrbv\" (UID: \"af19058a-7458-4333-9508-22aa26648594\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv"
Jul 11 07:46:36.728197 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:36.728047    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/af19058a-7458-4333-9508-22aa26648594-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-8qrbv\" (UID: \"af19058a-7458-4333-9508-22aa26648594\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv"
Jul 11 07:46:36.728197 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:36.728093    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af19058a-7458-4333-9508-22aa26648594-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-8qrbv\" (UID: \"af19058a-7458-4333-9508-22aa26648594\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv"
Jul 11 07:46:36.728310 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:36.728267    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/af19058a-7458-4333-9508-22aa26648594-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-8qrbv\" (UID: \"af19058a-7458-4333-9508-22aa26648594\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv"
Jul 11 07:46:36.728405 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:36.728360    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/af19058a-7458-4333-9508-22aa26648594-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-8qrbv\" (UID: \"af19058a-7458-4333-9508-22aa26648594\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv"
Jul 11 07:46:36.728483 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:36.728459    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/af19058a-7458-4333-9508-22aa26648594-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-8qrbv\" (UID: \"af19058a-7458-4333-9508-22aa26648594\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv"
Jul 11 07:46:36.729189 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:36.729142    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/af19058a-7458-4333-9508-22aa26648594-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-8qrbv\" (UID: \"af19058a-7458-4333-9508-22aa26648594\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv"
Jul 11 07:46:36.730824 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:36.730797    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/af19058a-7458-4333-9508-22aa26648594-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-8qrbv\" (UID: \"af19058a-7458-4333-9508-22aa26648594\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv"
Jul 11 07:46:36.730939 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:36.730882    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/af19058a-7458-4333-9508-22aa26648594-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-8qrbv\" (UID: \"af19058a-7458-4333-9508-22aa26648594\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv"
Jul 11 07:46:36.730939 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:36.730882    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/af19058a-7458-4333-9508-22aa26648594-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-8qrbv\" (UID: \"af19058a-7458-4333-9508-22aa26648594\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv"
Jul 11 07:46:36.731033 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:36.730982    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/af19058a-7458-4333-9508-22aa26648594-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-8qrbv\" (UID: \"af19058a-7458-4333-9508-22aa26648594\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv"
Jul 11 07:46:36.736168 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:36.736131    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbv9n\" (UniqueName: \"kubernetes.io/projected/af19058a-7458-4333-9508-22aa26648594-kube-api-access-wbv9n\") pod \"istiod-openshift-gateway-94bb8fbfd-8qrbv\" (UID: \"af19058a-7458-4333-9508-22aa26648594\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv"
Jul 11 07:46:36.736612 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:36.736587    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af19058a-7458-4333-9508-22aa26648594-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-8qrbv\" (UID: \"af19058a-7458-4333-9508-22aa26648594\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv"
Jul 11 07:46:36.859586 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:36.859548    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv"
Jul 11 07:46:37.436056 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:37.436009    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 07:46:37.436192 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:37.436104    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 07:46:37.436192 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:37.436149    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 07:46:37.513126 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:37.512839    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv"]
Jul 11 07:46:37.515166 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:46:37.515139    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf19058a_7458_4333_9508_22aa26648594.slice/crio-f1d8d838f5d45b21d1fdba78ad156bfed1b2f3276fb5c7eb755580e61a27b1df WatchSource:0}: Error finding container f1d8d838f5d45b21d1fdba78ad156bfed1b2f3276fb5c7eb755580e61a27b1df: Status 404 returned error can't find the container with id f1d8d838f5d45b21d1fdba78ad156bfed1b2f3276fb5c7eb755580e61a27b1df
Jul 11 07:46:37.518704 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:37.518665    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 07:46:37.518835 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:37.518734    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 07:46:38.161369 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:38.161307    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88" event={"ID":"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a","Type":"ContainerStarted","Data":"53d7f03fce6e9ed44c96d029d5f876ff80d892c13f52670e23035a37534bdc03"}
Jul 11 07:46:38.163702 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:38.163664    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv" event={"ID":"af19058a-7458-4333-9508-22aa26648594","Type":"ContainerStarted","Data":"0c238999657bf2bb92806d4b98a1e579097451293bdec365bfaeed7fe31e3b55"}
Jul 11 07:46:38.163838 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:38.163722    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv" event={"ID":"af19058a-7458-4333-9508-22aa26648594","Type":"ContainerStarted","Data":"f1d8d838f5d45b21d1fdba78ad156bfed1b2f3276fb5c7eb755580e61a27b1df"}
Jul 11 07:46:38.164530 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:38.164507    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv"
Jul 11 07:46:38.166239 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:38.166211    2568 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-8qrbv container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 11 07:46:38.166360 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:38.166263    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv" podUID="af19058a-7458-4333-9508-22aa26648594" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 11 07:46:38.201478 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:38.201421    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88" podStartSLOduration=1.3782201889999999 podStartE2EDuration="4.201406561s" totalImagesPullingTime="2.823186372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:46:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:46:38.198713738 +0000 UTC m=+509.683463869" watchObservedRunningTime="2026-07-11 07:46:38.201406561 +0000 UTC m=+509.686156693"
Jul 11 07:46:38.233563 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:38.233512    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv" podStartSLOduration=2.233493836 podStartE2EDuration="2.233493836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:46:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:46:38.23074191 +0000 UTC m=+509.715492043" watchObservedRunningTime="2026-07-11 07:46:38.233493836 +0000 UTC m=+509.718243968"
Jul 11 07:46:38.470089 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:38.469994    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:38.471500 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:38.471474    2568 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.20:15021/healthz/ready\": dial tcp 10.132.0.20:15021: connect: connection refused" start-of-body=
Jul 11 07:46:38.471615 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:38.471521    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88" podUID="d1a7fd06-bd2d-4cc7-9171-929d7eeec26a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.20:15021/healthz/ready\": dial tcp 10.132.0.20:15021: connect: connection refused"
Jul 11 07:46:39.168064 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:39.168039    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8qrbv"
Jul 11 07:46:39.255294 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:39.255260    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"]
Jul 11 07:46:39.255445 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:39.255430    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z" podUID="c0c03b91-9caa-43cb-97a3-20287b8dd203" containerName="discovery" containerID="cri-o://2f03f9503ad45acc7fb706e552f356c508471e14bb2c39266e9efe1ed40f969a" gracePeriod=30
Jul 11 07:46:39.469785 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:39.469756    2568 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.20:15021/healthz/ready\": dial tcp 10.132.0.20:15021: connect: connection refused" start-of-body=
Jul 11 07:46:39.469932 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:39.469808    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88" podUID="d1a7fd06-bd2d-4cc7-9171-929d7eeec26a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.20:15021/healthz/ready\": dial tcp 10.132.0.20:15021: connect: connection refused"
Jul 11 07:46:39.496300 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:39.496276    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"
Jul 11 07:46:39.554663 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:39.554630    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbfnf\" (UniqueName: \"kubernetes.io/projected/c0c03b91-9caa-43cb-97a3-20287b8dd203-kube-api-access-fbfnf\") pod \"c0c03b91-9caa-43cb-97a3-20287b8dd203\" (UID: \"c0c03b91-9caa-43cb-97a3-20287b8dd203\") "
Jul 11 07:46:39.554816 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:39.554673    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c0c03b91-9caa-43cb-97a3-20287b8dd203-cacerts\") pod \"c0c03b91-9caa-43cb-97a3-20287b8dd203\" (UID: \"c0c03b91-9caa-43cb-97a3-20287b8dd203\") "
Jul 11 07:46:39.554816 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:39.554696    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c0c03b91-9caa-43cb-97a3-20287b8dd203-istio-csr-ca-configmap\") pod \"c0c03b91-9caa-43cb-97a3-20287b8dd203\" (UID: \"c0c03b91-9caa-43cb-97a3-20287b8dd203\") "
Jul 11 07:46:39.554816 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:39.554766    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c0c03b91-9caa-43cb-97a3-20287b8dd203-istio-csr-dns-cert\") pod \"c0c03b91-9caa-43cb-97a3-20287b8dd203\" (UID: \"c0c03b91-9caa-43cb-97a3-20287b8dd203\") "
Jul 11 07:46:39.554816 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:39.554809    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0c03b91-9caa-43cb-97a3-20287b8dd203-local-certs\") pod \"c0c03b91-9caa-43cb-97a3-20287b8dd203\" (UID: \"c0c03b91-9caa-43cb-97a3-20287b8dd203\") "
Jul 11 07:46:39.554993 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:39.554831    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0c03b91-9caa-43cb-97a3-20287b8dd203-istio-token\") pod \"c0c03b91-9caa-43cb-97a3-20287b8dd203\" (UID: \"c0c03b91-9caa-43cb-97a3-20287b8dd203\") "
Jul 11 07:46:39.554993 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:39.554853    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c0c03b91-9caa-43cb-97a3-20287b8dd203-istio-kubeconfig\") pod \"c0c03b91-9caa-43cb-97a3-20287b8dd203\" (UID: \"c0c03b91-9caa-43cb-97a3-20287b8dd203\") "
Jul 11 07:46:39.555146 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:39.555118    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0c03b91-9caa-43cb-97a3-20287b8dd203-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "c0c03b91-9caa-43cb-97a3-20287b8dd203" (UID: "c0c03b91-9caa-43cb-97a3-20287b8dd203"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 07:46:39.557002 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:39.556978    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0c03b91-9caa-43cb-97a3-20287b8dd203-istio-token" (OuterVolumeSpecName: "istio-token") pod "c0c03b91-9caa-43cb-97a3-20287b8dd203" (UID: "c0c03b91-9caa-43cb-97a3-20287b8dd203"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 07:46:39.557112 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:39.557091    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0c03b91-9caa-43cb-97a3-20287b8dd203-kube-api-access-fbfnf" (OuterVolumeSpecName: "kube-api-access-fbfnf") pod "c0c03b91-9caa-43cb-97a3-20287b8dd203" (UID: "c0c03b91-9caa-43cb-97a3-20287b8dd203"). InnerVolumeSpecName "kube-api-access-fbfnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 07:46:39.557260 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:39.557239    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0c03b91-9caa-43cb-97a3-20287b8dd203-local-certs" (OuterVolumeSpecName: "local-certs") pod "c0c03b91-9caa-43cb-97a3-20287b8dd203" (UID: "c0c03b91-9caa-43cb-97a3-20287b8dd203"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 07:46:39.557316 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:39.557249    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0c03b91-9caa-43cb-97a3-20287b8dd203-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "c0c03b91-9caa-43cb-97a3-20287b8dd203" (UID: "c0c03b91-9caa-43cb-97a3-20287b8dd203"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 07:46:39.557392 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:39.557345    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0c03b91-9caa-43cb-97a3-20287b8dd203-cacerts" (OuterVolumeSpecName: "cacerts") pod "c0c03b91-9caa-43cb-97a3-20287b8dd203" (UID: "c0c03b91-9caa-43cb-97a3-20287b8dd203"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 07:46:39.557445 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:39.557391    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0c03b91-9caa-43cb-97a3-20287b8dd203-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "c0c03b91-9caa-43cb-97a3-20287b8dd203" (UID: "c0c03b91-9caa-43cb-97a3-20287b8dd203"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 07:46:39.656036 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:39.656001    2568 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0c03b91-9caa-43cb-97a3-20287b8dd203-local-certs\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:46:39.656036 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:39.656029    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0c03b91-9caa-43cb-97a3-20287b8dd203-istio-token\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:46:39.656036 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:39.656038    2568 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c0c03b91-9caa-43cb-97a3-20287b8dd203-istio-kubeconfig\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:46:39.656036 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:39.656046    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbfnf\" (UniqueName: \"kubernetes.io/projected/c0c03b91-9caa-43cb-97a3-20287b8dd203-kube-api-access-fbfnf\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:46:39.656298 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:39.656055    2568 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c0c03b91-9caa-43cb-97a3-20287b8dd203-cacerts\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:46:39.656298 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:39.656063    2568 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c0c03b91-9caa-43cb-97a3-20287b8dd203-istio-csr-ca-configmap\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:46:39.656298 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:39.656071    2568 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c0c03b91-9caa-43cb-97a3-20287b8dd203-istio-csr-dns-cert\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:46:39.768381 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:39.768270    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"]
Jul 11 07:46:40.172293 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:40.172258    2568 generic.go:356] "Generic (PLEG): container finished" podID="c0c03b91-9caa-43cb-97a3-20287b8dd203" containerID="2f03f9503ad45acc7fb706e552f356c508471e14bb2c39266e9efe1ed40f969a" exitCode=0
Jul 11 07:46:40.172780 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:40.172314    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"
Jul 11 07:46:40.172780 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:40.172353    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z" event={"ID":"c0c03b91-9caa-43cb-97a3-20287b8dd203","Type":"ContainerDied","Data":"2f03f9503ad45acc7fb706e552f356c508471e14bb2c39266e9efe1ed40f969a"}
Jul 11 07:46:40.172780 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:40.172419    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-44w6z" event={"ID":"c0c03b91-9caa-43cb-97a3-20287b8dd203","Type":"ContainerDied","Data":"0efc5fae1effdbd1f1ed6bf6fa2949a4fa798e0e4c1e860596c38f187dc41c34"}
Jul 11 07:46:40.172780 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:40.172448    2568 scope.go:117] "RemoveContainer" containerID="2f03f9503ad45acc7fb706e552f356c508471e14bb2c39266e9efe1ed40f969a"
Jul 11 07:46:40.180646 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:40.180623    2568 scope.go:117] "RemoveContainer" containerID="2f03f9503ad45acc7fb706e552f356c508471e14bb2c39266e9efe1ed40f969a"
Jul 11 07:46:40.180873 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:46:40.180858    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f03f9503ad45acc7fb706e552f356c508471e14bb2c39266e9efe1ed40f969a\": container with ID starting with 2f03f9503ad45acc7fb706e552f356c508471e14bb2c39266e9efe1ed40f969a not found: ID does not exist" containerID="2f03f9503ad45acc7fb706e552f356c508471e14bb2c39266e9efe1ed40f969a"
Jul 11 07:46:40.180945 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:40.180880    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f03f9503ad45acc7fb706e552f356c508471e14bb2c39266e9efe1ed40f969a"} err="failed to get container status \"2f03f9503ad45acc7fb706e552f356c508471e14bb2c39266e9efe1ed40f969a\": rpc error: code = NotFound desc = could not find container \"2f03f9503ad45acc7fb706e552f356c508471e14bb2c39266e9efe1ed40f969a\": container with ID starting with 2f03f9503ad45acc7fb706e552f356c508471e14bb2c39266e9efe1ed40f969a not found: ID does not exist"
Jul 11 07:46:40.202462 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:40.202434    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"]
Jul 11 07:46:40.213126 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:40.213093    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-44w6z"]
Jul 11 07:46:40.469819 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:40.469730    2568 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.20:15021/healthz/ready\": dial tcp 10.132.0.20:15021: connect: connection refused" start-of-body=
Jul 11 07:46:40.469819 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:40.469791    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88" podUID="d1a7fd06-bd2d-4cc7-9171-929d7eeec26a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.20:15021/healthz/ready\": dial tcp 10.132.0.20:15021: connect: connection refused"
Jul 11 07:46:41.072363 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:41.072304    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0c03b91-9caa-43cb-97a3-20287b8dd203" path="/var/lib/kubelet/pods/c0c03b91-9caa-43cb-97a3-20287b8dd203/volumes"
Jul 11 07:46:41.176768 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:41.176733    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88" podUID="d1a7fd06-bd2d-4cc7-9171-929d7eeec26a" containerName="istio-proxy" containerID="cri-o://53d7f03fce6e9ed44c96d029d5f876ff80d892c13f52670e23035a37534bdc03" gracePeriod=30
Jul 11 07:46:45.147401 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:45.147370    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-p5qwq"
Jul 11 07:46:46.420455 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:46.420429    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:46.515191 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:46.515088    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jr7kv\" (UniqueName: \"kubernetes.io/projected/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-kube-api-access-jr7kv\") pod \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") "
Jul 11 07:46:46.515191 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:46.515139    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-istio-podinfo\") pod \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") "
Jul 11 07:46:46.515191 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:46.515191    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-istio-data\") pod \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") "
Jul 11 07:46:46.515522 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:46.515275    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-istio-envoy\") pod \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") "
Jul 11 07:46:46.515522 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:46.515318    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-istiod-ca-cert\") pod \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") "
Jul 11 07:46:46.515522 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:46.515384    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-workload-socket\") pod \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") "
Jul 11 07:46:46.515522 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:46.515403    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-workload-certs\") pod \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") "
Jul 11 07:46:46.515522 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:46.515427    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-credential-socket\") pod \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") "
Jul 11 07:46:46.515522 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:46.515462    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-istio-data" (OuterVolumeSpecName: "istio-data") pod "d1a7fd06-bd2d-4cc7-9171-929d7eeec26a" (UID: "d1a7fd06-bd2d-4cc7-9171-929d7eeec26a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 07:46:46.515522 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:46.515478    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-istio-token\") pod \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\" (UID: \"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a\") "
Jul 11 07:46:46.515849 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:46.515630    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d1a7fd06-bd2d-4cc7-9171-929d7eeec26a" (UID: "d1a7fd06-bd2d-4cc7-9171-929d7eeec26a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 07:46:46.515849 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:46.515658    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d1a7fd06-bd2d-4cc7-9171-929d7eeec26a" (UID: "d1a7fd06-bd2d-4cc7-9171-929d7eeec26a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 07:46:46.515849 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:46.515741    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-istio-data\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:46:46.515849 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:46.515759    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-workload-socket\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:46:46.515849 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:46.515767    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d1a7fd06-bd2d-4cc7-9171-929d7eeec26a" (UID: "d1a7fd06-bd2d-4cc7-9171-929d7eeec26a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 07:46:46.515849 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:46.515776    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-workload-certs\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:46:46.516132 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:46.515819    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d1a7fd06-bd2d-4cc7-9171-929d7eeec26a" (UID: "d1a7fd06-bd2d-4cc7-9171-929d7eeec26a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 07:46:46.517624 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:46.517590    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d1a7fd06-bd2d-4cc7-9171-929d7eeec26a" (UID: "d1a7fd06-bd2d-4cc7-9171-929d7eeec26a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 11 07:46:46.517735 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:46.517658    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-istio-token" (OuterVolumeSpecName: "istio-token") pod "d1a7fd06-bd2d-4cc7-9171-929d7eeec26a" (UID: "d1a7fd06-bd2d-4cc7-9171-929d7eeec26a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 07:46:46.517735 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:46.517712    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d1a7fd06-bd2d-4cc7-9171-929d7eeec26a" (UID: "d1a7fd06-bd2d-4cc7-9171-929d7eeec26a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 07:46:46.517832 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:46.517817    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-kube-api-access-jr7kv" (OuterVolumeSpecName: "kube-api-access-jr7kv") pod "d1a7fd06-bd2d-4cc7-9171-929d7eeec26a" (UID: "d1a7fd06-bd2d-4cc7-9171-929d7eeec26a"). InnerVolumeSpecName "kube-api-access-jr7kv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 07:46:46.617135 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:46.617096    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-istio-envoy\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:46:46.617135 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:46.617127    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-istiod-ca-cert\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:46:46.617135 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:46.617139    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-credential-socket\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:46:46.617390 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:46.617152    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-istio-token\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:46:46.617390 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:46.617164    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jr7kv\" (UniqueName: \"kubernetes.io/projected/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-kube-api-access-jr7kv\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:46:46.617390 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:46.617177    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a-istio-podinfo\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:46:47.202730 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:47.202688    2568 generic.go:356] "Generic (PLEG): container finished" podID="d1a7fd06-bd2d-4cc7-9171-929d7eeec26a" containerID="53d7f03fce6e9ed44c96d029d5f876ff80d892c13f52670e23035a37534bdc03" exitCode=0
Jul 11 07:46:47.202918 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:47.202737    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"
Jul 11 07:46:47.202918 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:47.202774    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88" event={"ID":"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a","Type":"ContainerDied","Data":"53d7f03fce6e9ed44c96d029d5f876ff80d892c13f52670e23035a37534bdc03"}
Jul 11 07:46:47.202918 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:47.202829    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88" event={"ID":"d1a7fd06-bd2d-4cc7-9171-929d7eeec26a","Type":"ContainerDied","Data":"6d29ed8dc97267dbe51c3fa593bf2faaaaa9e99121b100595dc8fb8e17efd4d2"}
Jul 11 07:46:47.202918 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:47.202853    2568 scope.go:117] "RemoveContainer" containerID="53d7f03fce6e9ed44c96d029d5f876ff80d892c13f52670e23035a37534bdc03"
Jul 11 07:46:47.211070 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:47.211050    2568 scope.go:117] "RemoveContainer" containerID="53d7f03fce6e9ed44c96d029d5f876ff80d892c13f52670e23035a37534bdc03"
Jul 11 07:46:47.211373 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:46:47.211353    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53d7f03fce6e9ed44c96d029d5f876ff80d892c13f52670e23035a37534bdc03\": container with ID starting with 53d7f03fce6e9ed44c96d029d5f876ff80d892c13f52670e23035a37534bdc03 not found: ID does not exist" containerID="53d7f03fce6e9ed44c96d029d5f876ff80d892c13f52670e23035a37534bdc03"
Jul 11 07:46:47.211432 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:47.211381    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53d7f03fce6e9ed44c96d029d5f876ff80d892c13f52670e23035a37534bdc03"} err="failed to get container status \"53d7f03fce6e9ed44c96d029d5f876ff80d892c13f52670e23035a37534bdc03\": rpc error: code = NotFound desc = could not find container \"53d7f03fce6e9ed44c96d029d5f876ff80d892c13f52670e23035a37534bdc03\": container with ID starting with 53d7f03fce6e9ed44c96d029d5f876ff80d892c13f52670e23035a37534bdc03 not found: ID does not exist"
Jul 11 07:46:47.219678 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:47.219648    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"]
Jul 11 07:46:47.224896 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:47.224869    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-6gr88"]
Jul 11 07:46:49.070212 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:46:49.070176    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1a7fd06-bd2d-4cc7-9171-929d7eeec26a" path="/var/lib/kubelet/pods/d1a7fd06-bd2d-4cc7-9171-929d7eeec26a/volumes"
Jul 11 07:47:28.849152 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:28.849117    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v6v64"]
Jul 11 07:47:28.849605 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:28.849401    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0c03b91-9caa-43cb-97a3-20287b8dd203" containerName="discovery"
Jul 11 07:47:28.849605 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:28.849412    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0c03b91-9caa-43cb-97a3-20287b8dd203" containerName="discovery"
Jul 11 07:47:28.849605 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:28.849431    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1a7fd06-bd2d-4cc7-9171-929d7eeec26a" containerName="istio-proxy"
Jul 11 07:47:28.849605 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:28.849436    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1a7fd06-bd2d-4cc7-9171-929d7eeec26a" containerName="istio-proxy"
Jul 11 07:47:28.849605 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:28.849483    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0c03b91-9caa-43cb-97a3-20287b8dd203" containerName="discovery"
Jul 11 07:47:28.849605 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:28.849491    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1a7fd06-bd2d-4cc7-9171-929d7eeec26a" containerName="istio-proxy"
Jul 11 07:47:28.856991 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:28.856960    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v6v64"
Jul 11 07:47:28.859438 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:28.859407    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 11 07:47:28.859591 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:28.859486    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v6v64"]
Jul 11 07:47:28.859591 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:28.859407    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 11 07:47:28.859773 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:28.859753    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-xp5cx\""
Jul 11 07:47:29.032440 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:29.032410    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5ngg\" (UniqueName: \"kubernetes.io/projected/0b5e2a70-f176-4fb3-b3c4-c70a88ea91e7-kube-api-access-s5ngg\") pod \"kuadrant-operator-catalog-v6v64\" (UID: \"0b5e2a70-f176-4fb3-b3c4-c70a88ea91e7\") " pod="kuadrant-system/kuadrant-operator-catalog-v6v64"
Jul 11 07:47:29.133121 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:29.133038    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5ngg\" (UniqueName: \"kubernetes.io/projected/0b5e2a70-f176-4fb3-b3c4-c70a88ea91e7-kube-api-access-s5ngg\") pod \"kuadrant-operator-catalog-v6v64\" (UID: \"0b5e2a70-f176-4fb3-b3c4-c70a88ea91e7\") " pod="kuadrant-system/kuadrant-operator-catalog-v6v64"
Jul 11 07:47:29.140982 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:29.140956    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5ngg\" (UniqueName: \"kubernetes.io/projected/0b5e2a70-f176-4fb3-b3c4-c70a88ea91e7-kube-api-access-s5ngg\") pod \"kuadrant-operator-catalog-v6v64\" (UID: \"0b5e2a70-f176-4fb3-b3c4-c70a88ea91e7\") " pod="kuadrant-system/kuadrant-operator-catalog-v6v64"
Jul 11 07:47:29.167881 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:29.167846    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v6v64"
Jul 11 07:47:29.204376 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:29.204343    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v6v64"]
Jul 11 07:47:29.287620 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:29.287586    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v6v64"]
Jul 11 07:47:29.290210 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:47:29.290184    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b5e2a70_f176_4fb3_b3c4_c70a88ea91e7.slice/crio-47c3f861dbe0ff116df9073effd3817e306f435d181d90326bec502d13ef533f WatchSource:0}: Error finding container 47c3f861dbe0ff116df9073effd3817e306f435d181d90326bec502d13ef533f: Status 404 returned error can't find the container with id 47c3f861dbe0ff116df9073effd3817e306f435d181d90326bec502d13ef533f
Jul 11 07:47:29.358310 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:29.358274    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v6v64" event={"ID":"0b5e2a70-f176-4fb3-b3c4-c70a88ea91e7","Type":"ContainerStarted","Data":"47c3f861dbe0ff116df9073effd3817e306f435d181d90326bec502d13ef533f"}
Jul 11 07:47:29.413214 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:29.413142    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zfpgh"]
Jul 11 07:47:29.415673 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:29.415656    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zfpgh"
Jul 11 07:47:29.424305 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:29.424279    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zfpgh"]
Jul 11 07:47:29.536429 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:29.536400    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx6rz\" (UniqueName: \"kubernetes.io/projected/b15b5c79-e7fc-45b5-a455-c94a7e94ae4c-kube-api-access-xx6rz\") pod \"kuadrant-operator-catalog-zfpgh\" (UID: \"b15b5c79-e7fc-45b5-a455-c94a7e94ae4c\") " pod="kuadrant-system/kuadrant-operator-catalog-zfpgh"
Jul 11 07:47:29.637159 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:29.637127    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx6rz\" (UniqueName: \"kubernetes.io/projected/b15b5c79-e7fc-45b5-a455-c94a7e94ae4c-kube-api-access-xx6rz\") pod \"kuadrant-operator-catalog-zfpgh\" (UID: \"b15b5c79-e7fc-45b5-a455-c94a7e94ae4c\") " pod="kuadrant-system/kuadrant-operator-catalog-zfpgh"
Jul 11 07:47:29.644608 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:29.644582    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx6rz\" (UniqueName: \"kubernetes.io/projected/b15b5c79-e7fc-45b5-a455-c94a7e94ae4c-kube-api-access-xx6rz\") pod \"kuadrant-operator-catalog-zfpgh\" (UID: \"b15b5c79-e7fc-45b5-a455-c94a7e94ae4c\") " pod="kuadrant-system/kuadrant-operator-catalog-zfpgh"
Jul 11 07:47:29.725144 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:29.725073    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zfpgh"
Jul 11 07:47:29.848141 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:29.848112    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zfpgh"]
Jul 11 07:47:29.850822 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:47:29.850800    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb15b5c79_e7fc_45b5_a455_c94a7e94ae4c.slice/crio-7c186b840d9bbcf31679cceb98d305e0e8dd0bd8fd13c5efca0de8181f27a2b6 WatchSource:0}: Error finding container 7c186b840d9bbcf31679cceb98d305e0e8dd0bd8fd13c5efca0de8181f27a2b6: Status 404 returned error can't find the container with id 7c186b840d9bbcf31679cceb98d305e0e8dd0bd8fd13c5efca0de8181f27a2b6
Jul 11 07:47:30.364066 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:30.364028    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zfpgh" event={"ID":"b15b5c79-e7fc-45b5-a455-c94a7e94ae4c","Type":"ContainerStarted","Data":"7c186b840d9bbcf31679cceb98d305e0e8dd0bd8fd13c5efca0de8181f27a2b6"}
Jul 11 07:47:32.372733 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:32.372696    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zfpgh" event={"ID":"b15b5c79-e7fc-45b5-a455-c94a7e94ae4c","Type":"ContainerStarted","Data":"883a5d8f74843163669a3fa8ca4fa0616e0b8f082a5e6214f57d06011ef059b1"}
Jul 11 07:47:32.374025 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:32.373998    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v6v64" event={"ID":"0b5e2a70-f176-4fb3-b3c4-c70a88ea91e7","Type":"ContainerStarted","Data":"eab9d4dcd3a8003094bd2fd688ec66c2912d1781fc0c67a58e37301a00785fdb"}
Jul 11 07:47:32.374162 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:32.374025    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-v6v64" podUID="0b5e2a70-f176-4fb3-b3c4-c70a88ea91e7" containerName="registry-server" containerID="cri-o://eab9d4dcd3a8003094bd2fd688ec66c2912d1781fc0c67a58e37301a00785fdb" gracePeriod=2
Jul 11 07:47:32.386874 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:32.386777    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zfpgh" podStartSLOduration=1.843272113 podStartE2EDuration="3.386762894s" totalImagesPullingTime="1.543490781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:47:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:47:32.385430494 +0000 UTC m=+563.870180626" watchObservedRunningTime="2026-07-11 07:47:32.386762894 +0000 UTC m=+563.871513026"
Jul 11 07:47:32.403067 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:32.399556    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-v6v64" podStartSLOduration=2.298021282 podStartE2EDuration="4.399539022s" totalImagesPullingTime="2.10151774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:47:32.397853934 +0000 UTC m=+563.882604067" watchObservedRunningTime="2026-07-11 07:47:32.399539022 +0000 UTC m=+563.884289157"
Jul 11 07:47:32.606185 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:32.606163    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v6v64"
Jul 11 07:47:32.761547 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:32.761460    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5ngg\" (UniqueName: \"kubernetes.io/projected/0b5e2a70-f176-4fb3-b3c4-c70a88ea91e7-kube-api-access-s5ngg\") pod \"0b5e2a70-f176-4fb3-b3c4-c70a88ea91e7\" (UID: \"0b5e2a70-f176-4fb3-b3c4-c70a88ea91e7\") "
Jul 11 07:47:32.763631 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:32.763608    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b5e2a70-f176-4fb3-b3c4-c70a88ea91e7-kube-api-access-s5ngg" (OuterVolumeSpecName: "kube-api-access-s5ngg") pod "0b5e2a70-f176-4fb3-b3c4-c70a88ea91e7" (UID: "0b5e2a70-f176-4fb3-b3c4-c70a88ea91e7"). InnerVolumeSpecName "kube-api-access-s5ngg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 07:47:32.862121 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:32.862084    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5ngg\" (UniqueName: \"kubernetes.io/projected/0b5e2a70-f176-4fb3-b3c4-c70a88ea91e7-kube-api-access-s5ngg\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:47:33.379684 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:33.379595    2568 generic.go:356] "Generic (PLEG): container finished" podID="0b5e2a70-f176-4fb3-b3c4-c70a88ea91e7" containerID="eab9d4dcd3a8003094bd2fd688ec66c2912d1781fc0c67a58e37301a00785fdb" exitCode=0
Jul 11 07:47:33.379684 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:33.379640    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v6v64"
Jul 11 07:47:33.380085 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:33.379686    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v6v64" event={"ID":"0b5e2a70-f176-4fb3-b3c4-c70a88ea91e7","Type":"ContainerDied","Data":"eab9d4dcd3a8003094bd2fd688ec66c2912d1781fc0c67a58e37301a00785fdb"}
Jul 11 07:47:33.380085 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:33.379738    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v6v64" event={"ID":"0b5e2a70-f176-4fb3-b3c4-c70a88ea91e7","Type":"ContainerDied","Data":"47c3f861dbe0ff116df9073effd3817e306f435d181d90326bec502d13ef533f"}
Jul 11 07:47:33.380085 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:33.379758    2568 scope.go:117] "RemoveContainer" containerID="eab9d4dcd3a8003094bd2fd688ec66c2912d1781fc0c67a58e37301a00785fdb"
Jul 11 07:47:33.388066 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:33.388046    2568 scope.go:117] "RemoveContainer" containerID="eab9d4dcd3a8003094bd2fd688ec66c2912d1781fc0c67a58e37301a00785fdb"
Jul 11 07:47:33.388355 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:47:33.388336    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eab9d4dcd3a8003094bd2fd688ec66c2912d1781fc0c67a58e37301a00785fdb\": container with ID starting with eab9d4dcd3a8003094bd2fd688ec66c2912d1781fc0c67a58e37301a00785fdb not found: ID does not exist" containerID="eab9d4dcd3a8003094bd2fd688ec66c2912d1781fc0c67a58e37301a00785fdb"
Jul 11 07:47:33.388424 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:33.388364    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eab9d4dcd3a8003094bd2fd688ec66c2912d1781fc0c67a58e37301a00785fdb"} err="failed to get container status \"eab9d4dcd3a8003094bd2fd688ec66c2912d1781fc0c67a58e37301a00785fdb\": rpc error: code = NotFound desc = could not find container \"eab9d4dcd3a8003094bd2fd688ec66c2912d1781fc0c67a58e37301a00785fdb\": container with ID starting with eab9d4dcd3a8003094bd2fd688ec66c2912d1781fc0c67a58e37301a00785fdb not found: ID does not exist"
Jul 11 07:47:33.394662 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:33.394641    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v6v64"]
Jul 11 07:47:33.397782 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:33.397761    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v6v64"]
Jul 11 07:47:35.071546 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:35.071513    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b5e2a70-f176-4fb3-b3c4-c70a88ea91e7" path="/var/lib/kubelet/pods/0b5e2a70-f176-4fb3-b3c4-c70a88ea91e7/volumes"
Jul 11 07:47:39.725567 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:39.725532    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-zfpgh"
Jul 11 07:47:39.725975 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:39.725604    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-zfpgh"
Jul 11 07:47:39.747378 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:39.747353    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-zfpgh"
Jul 11 07:47:40.428409 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:47:40.428376    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-zfpgh"
Jul 11 07:48:01.075601 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:01.075566    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6hd9p"]
Jul 11 07:48:01.076044 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:01.075931    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b5e2a70-f176-4fb3-b3c4-c70a88ea91e7" containerName="registry-server"
Jul 11 07:48:01.076044 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:01.075946    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b5e2a70-f176-4fb3-b3c4-c70a88ea91e7" containerName="registry-server"
Jul 11 07:48:01.076044 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:01.076027    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b5e2a70-f176-4fb3-b3c4-c70a88ea91e7" containerName="registry-server"
Jul 11 07:48:01.080051 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:01.080030    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6hd9p"
Jul 11 07:48:01.082254 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:01.082228    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-wfpr6\""
Jul 11 07:48:01.087220 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:01.087202    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6hd9p"]
Jul 11 07:48:01.150187 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:01.150155    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlnc9\" (UniqueName: \"kubernetes.io/projected/f71a48cd-12fd-4a16-a7a6-59894e5ed18d-kube-api-access-hlnc9\") pod \"authorino-operator-75cc8d5cb7-6hd9p\" (UID: \"f71a48cd-12fd-4a16-a7a6-59894e5ed18d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6hd9p"
Jul 11 07:48:01.250557 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:01.250529    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlnc9\" (UniqueName: \"kubernetes.io/projected/f71a48cd-12fd-4a16-a7a6-59894e5ed18d-kube-api-access-hlnc9\") pod \"authorino-operator-75cc8d5cb7-6hd9p\" (UID: \"f71a48cd-12fd-4a16-a7a6-59894e5ed18d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6hd9p"
Jul 11 07:48:01.259343 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:01.259307    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlnc9\" (UniqueName: \"kubernetes.io/projected/f71a48cd-12fd-4a16-a7a6-59894e5ed18d-kube-api-access-hlnc9\") pod \"authorino-operator-75cc8d5cb7-6hd9p\" (UID: \"f71a48cd-12fd-4a16-a7a6-59894e5ed18d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6hd9p"
Jul 11 07:48:01.390241 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:01.390160    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6hd9p"
Jul 11 07:48:01.522620 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:01.522589    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6hd9p"]
Jul 11 07:48:01.526771 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:48:01.526745    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf71a48cd_12fd_4a16_a7a6_59894e5ed18d.slice/crio-96b75f6e914d3a81a6dfd99825667a82a07a4a28fa45fd7566b83211529fe499 WatchSource:0}: Error finding container 96b75f6e914d3a81a6dfd99825667a82a07a4a28fa45fd7566b83211529fe499: Status 404 returned error can't find the container with id 96b75f6e914d3a81a6dfd99825667a82a07a4a28fa45fd7566b83211529fe499
Jul 11 07:48:02.498348 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:02.498293    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6hd9p" event={"ID":"f71a48cd-12fd-4a16-a7a6-59894e5ed18d","Type":"ContainerStarted","Data":"96b75f6e914d3a81a6dfd99825667a82a07a4a28fa45fd7566b83211529fe499"}
Jul 11 07:48:04.508071 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:04.508035    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6hd9p" event={"ID":"f71a48cd-12fd-4a16-a7a6-59894e5ed18d","Type":"ContainerStarted","Data":"770482a8e7571fe154789180e460f93710627d56601fe140b5e4b6474f6746d5"}
Jul 11 07:48:04.508499 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:04.508150    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6hd9p"
Jul 11 07:48:04.534900 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:04.534856    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6hd9p" podStartSLOduration=1.513629367 podStartE2EDuration="3.534841729s" totalImagesPullingTime="2.021212362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:48:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:48:04.533309886 +0000 UTC m=+596.018060018" watchObservedRunningTime="2026-07-11 07:48:04.534841729 +0000 UTC m=+596.019591862"
Jul 11 07:48:09.027843 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:09.027809    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z7lqz"]
Jul 11 07:48:09.032440 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:09.032415    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z7lqz"
Jul 11 07:48:09.034658 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:09.034640    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-95wdx\""
Jul 11 07:48:09.041548 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:09.041528    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z7lqz"]
Jul 11 07:48:09.106768 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:09.106739    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94hwj\" (UniqueName: \"kubernetes.io/projected/81dd3efd-c8ea-4e6b-97fc-8ac2f6b2d7f1-kube-api-access-94hwj\") pod \"limitador-operator-controller-manager-859d7b78bd-z7lqz\" (UID: \"81dd3efd-c8ea-4e6b-97fc-8ac2f6b2d7f1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z7lqz"
Jul 11 07:48:09.207268 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:09.207238    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94hwj\" (UniqueName: \"kubernetes.io/projected/81dd3efd-c8ea-4e6b-97fc-8ac2f6b2d7f1-kube-api-access-94hwj\") pod \"limitador-operator-controller-manager-859d7b78bd-z7lqz\" (UID: \"81dd3efd-c8ea-4e6b-97fc-8ac2f6b2d7f1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z7lqz"
Jul 11 07:48:09.215940 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:09.215877    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94hwj\" (UniqueName: \"kubernetes.io/projected/81dd3efd-c8ea-4e6b-97fc-8ac2f6b2d7f1-kube-api-access-94hwj\") pod \"limitador-operator-controller-manager-859d7b78bd-z7lqz\" (UID: \"81dd3efd-c8ea-4e6b-97fc-8ac2f6b2d7f1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z7lqz"
Jul 11 07:48:09.344550 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:09.344519    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z7lqz"
Jul 11 07:48:09.470014 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:09.469938    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z7lqz"]
Jul 11 07:48:09.475535 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:48:09.475505    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81dd3efd_c8ea_4e6b_97fc_8ac2f6b2d7f1.slice/crio-59180cdb0d5d9400ca7ab779aea2a886146c2a87939c43701a1a7812f61ce887 WatchSource:0}: Error finding container 59180cdb0d5d9400ca7ab779aea2a886146c2a87939c43701a1a7812f61ce887: Status 404 returned error can't find the container with id 59180cdb0d5d9400ca7ab779aea2a886146c2a87939c43701a1a7812f61ce887
Jul 11 07:48:09.533982 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:09.533950    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z7lqz" event={"ID":"81dd3efd-c8ea-4e6b-97fc-8ac2f6b2d7f1","Type":"ContainerStarted","Data":"59180cdb0d5d9400ca7ab779aea2a886146c2a87939c43701a1a7812f61ce887"}
Jul 11 07:48:11.544873 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:11.544841    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z7lqz" event={"ID":"81dd3efd-c8ea-4e6b-97fc-8ac2f6b2d7f1","Type":"ContainerStarted","Data":"83a5ffe368eced02d13e8ce64e6a3e8eb814dffa9291162d7a58ddd37a7e69fe"}
Jul 11 07:48:11.545239 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:11.544962    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z7lqz"
Jul 11 07:48:11.560583 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:11.560536    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z7lqz" podStartSLOduration=0.961269881 podStartE2EDuration="2.560518231s" totalImagesPullingTime="1.59924835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:48:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:48:11.559470654 +0000 UTC m=+603.044220788" watchObservedRunningTime="2026-07-11 07:48:11.560518231 +0000 UTC m=+603.045268364"
Jul 11 07:48:15.519249 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:15.519220    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6hd9p"
Jul 11 07:48:22.551690 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:22.551656    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z7lqz"
Jul 11 07:48:25.897741 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:25.897708    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8x4ft"]
Jul 11 07:48:25.900745 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:25.900727    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8x4ft"
Jul 11 07:48:25.903313 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:25.903289    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-f5qqf\""
Jul 11 07:48:25.917699 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:25.917668    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8x4ft"]
Jul 11 07:48:25.937257 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:25.937225    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef2e31df-842f-499c-bd92-783c57f25a15-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-8x4ft\" (UID: \"ef2e31df-842f-499c-bd92-783c57f25a15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8x4ft"
Jul 11 07:48:25.937552 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:25.937294    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nn5n\" (UniqueName: \"kubernetes.io/projected/ef2e31df-842f-499c-bd92-783c57f25a15-kube-api-access-6nn5n\") pod \"kuadrant-operator-controller-manager-55467d9f7-8x4ft\" (UID: \"ef2e31df-842f-499c-bd92-783c57f25a15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8x4ft"
Jul 11 07:48:25.940734 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:25.940695    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z7lqz"]
Jul 11 07:48:25.940942 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:25.940916    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z7lqz" podUID="81dd3efd-c8ea-4e6b-97fc-8ac2f6b2d7f1" containerName="manager" containerID="cri-o://83a5ffe368eced02d13e8ce64e6a3e8eb814dffa9291162d7a58ddd37a7e69fe" gracePeriod=2
Jul 11 07:48:25.947061 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:48:25.947020    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-z7lqz\" is forbidden: User \"system:node:ip-10-0-142-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-153.ec2.internal' and this object" podUID="81dd3efd-c8ea-4e6b-97fc-8ac2f6b2d7f1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z7lqz"
Jul 11 07:48:25.947878 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:25.947857    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z7lqz"]
Jul 11 07:48:26.037850 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:26.037805    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nn5n\" (UniqueName: \"kubernetes.io/projected/ef2e31df-842f-499c-bd92-783c57f25a15-kube-api-access-6nn5n\") pod \"kuadrant-operator-controller-manager-55467d9f7-8x4ft\" (UID: \"ef2e31df-842f-499c-bd92-783c57f25a15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8x4ft"
Jul 11 07:48:26.038029 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:26.037867    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef2e31df-842f-499c-bd92-783c57f25a15-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-8x4ft\" (UID: \"ef2e31df-842f-499c-bd92-783c57f25a15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8x4ft"
Jul 11 07:48:26.038293 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:26.038258    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef2e31df-842f-499c-bd92-783c57f25a15-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-8x4ft\" (UID: \"ef2e31df-842f-499c-bd92-783c57f25a15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8x4ft"
Jul 11 07:48:26.055041 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:26.055000    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nn5n\" (UniqueName: \"kubernetes.io/projected/ef2e31df-842f-499c-bd92-783c57f25a15-kube-api-access-6nn5n\") pod \"kuadrant-operator-controller-manager-55467d9f7-8x4ft\" (UID: \"ef2e31df-842f-499c-bd92-783c57f25a15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8x4ft"
Jul 11 07:48:26.182472 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:26.182447    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z7lqz"
Jul 11 07:48:26.184689 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:48:26.184658    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-z7lqz\" is forbidden: User \"system:node:ip-10-0-142-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-153.ec2.internal' and this object" podUID="81dd3efd-c8ea-4e6b-97fc-8ac2f6b2d7f1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z7lqz"
Jul 11 07:48:26.211005 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:26.210975    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8x4ft"
Jul 11 07:48:26.240028 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:26.239996    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94hwj\" (UniqueName: \"kubernetes.io/projected/81dd3efd-c8ea-4e6b-97fc-8ac2f6b2d7f1-kube-api-access-94hwj\") pod \"81dd3efd-c8ea-4e6b-97fc-8ac2f6b2d7f1\" (UID: \"81dd3efd-c8ea-4e6b-97fc-8ac2f6b2d7f1\") "
Jul 11 07:48:26.242004 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:26.241974    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81dd3efd-c8ea-4e6b-97fc-8ac2f6b2d7f1-kube-api-access-94hwj" (OuterVolumeSpecName: "kube-api-access-94hwj") pod "81dd3efd-c8ea-4e6b-97fc-8ac2f6b2d7f1" (UID: "81dd3efd-c8ea-4e6b-97fc-8ac2f6b2d7f1"). InnerVolumeSpecName "kube-api-access-94hwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 07:48:26.340946 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:26.340913    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94hwj\" (UniqueName: \"kubernetes.io/projected/81dd3efd-c8ea-4e6b-97fc-8ac2f6b2d7f1-kube-api-access-94hwj\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:48:26.341424 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:26.341400    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8x4ft"]
Jul 11 07:48:26.345391 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:48:26.345366    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef2e31df_842f_499c_bd92_783c57f25a15.slice/crio-dc6513c7ad97d25fa67fc3dfac51a66f0a4876e2cb642676def23aec6b63c176 WatchSource:0}: Error finding container dc6513c7ad97d25fa67fc3dfac51a66f0a4876e2cb642676def23aec6b63c176: Status 404 returned error can't find the container with id dc6513c7ad97d25fa67fc3dfac51a66f0a4876e2cb642676def23aec6b63c176
Jul 11 07:48:26.606396 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:26.606366    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8x4ft" event={"ID":"ef2e31df-842f-499c-bd92-783c57f25a15","Type":"ContainerStarted","Data":"dc6513c7ad97d25fa67fc3dfac51a66f0a4876e2cb642676def23aec6b63c176"}
Jul 11 07:48:26.612554 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:26.612516    2568 generic.go:356] "Generic (PLEG): container finished" podID="81dd3efd-c8ea-4e6b-97fc-8ac2f6b2d7f1" containerID="83a5ffe368eced02d13e8ce64e6a3e8eb814dffa9291162d7a58ddd37a7e69fe" exitCode=0
Jul 11 07:48:26.612728 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:26.612582    2568 scope.go:117] "RemoveContainer" containerID="83a5ffe368eced02d13e8ce64e6a3e8eb814dffa9291162d7a58ddd37a7e69fe"
Jul 11 07:48:26.612728 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:26.612583    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z7lqz"
Jul 11 07:48:26.614872 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:48:26.614837    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-z7lqz\" is forbidden: User \"system:node:ip-10-0-142-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-153.ec2.internal' and this object" podUID="81dd3efd-c8ea-4e6b-97fc-8ac2f6b2d7f1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z7lqz"
Jul 11 07:48:26.620890 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:26.620874    2568 scope.go:117] "RemoveContainer" containerID="83a5ffe368eced02d13e8ce64e6a3e8eb814dffa9291162d7a58ddd37a7e69fe"
Jul 11 07:48:26.621119 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:48:26.621104    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83a5ffe368eced02d13e8ce64e6a3e8eb814dffa9291162d7a58ddd37a7e69fe\": container with ID starting with 83a5ffe368eced02d13e8ce64e6a3e8eb814dffa9291162d7a58ddd37a7e69fe not found: ID does not exist" containerID="83a5ffe368eced02d13e8ce64e6a3e8eb814dffa9291162d7a58ddd37a7e69fe"
Jul 11 07:48:26.621163 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:26.621126    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83a5ffe368eced02d13e8ce64e6a3e8eb814dffa9291162d7a58ddd37a7e69fe"} err="failed to get container status \"83a5ffe368eced02d13e8ce64e6a3e8eb814dffa9291162d7a58ddd37a7e69fe\": rpc error: code = NotFound desc = could not find container \"83a5ffe368eced02d13e8ce64e6a3e8eb814dffa9291162d7a58ddd37a7e69fe\": container with ID starting with 83a5ffe368eced02d13e8ce64e6a3e8eb814dffa9291162d7a58ddd37a7e69fe not found: ID does not exist"
Jul 11 07:48:26.622513 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:48:26.622496    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-z7lqz\" is forbidden: User \"system:node:ip-10-0-142-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-153.ec2.internal' and this object" podUID="81dd3efd-c8ea-4e6b-97fc-8ac2f6b2d7f1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z7lqz"
Jul 11 07:48:27.071821 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:27.071787    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81dd3efd-c8ea-4e6b-97fc-8ac2f6b2d7f1" path="/var/lib/kubelet/pods/81dd3efd-c8ea-4e6b-97fc-8ac2f6b2d7f1/volumes"
Jul 11 07:48:30.635708 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:30.635669    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8x4ft" event={"ID":"ef2e31df-842f-499c-bd92-783c57f25a15","Type":"ContainerStarted","Data":"7cba9f272e4ec2bf15418d49c74a5169de178449dc716e8fc2be288f7d7de293"}
Jul 11 07:48:30.636134 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:30.635812    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8x4ft"
Jul 11 07:48:30.656246 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:30.656146    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8x4ft" podStartSLOduration=1.6071099100000001 podStartE2EDuration="5.656133307s" totalImagesPullingTime="4.049023397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:48:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:48:30.654907281 +0000 UTC m=+622.139657413" watchObservedRunningTime="2026-07-11 07:48:30.656133307 +0000 UTC m=+622.140883440"
Jul 11 07:48:41.642298 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:41.642267    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8x4ft"
Jul 11 07:48:54.423353 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:54.423300    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8x4ft"]
Jul 11 07:48:54.423773 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:54.423536    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8x4ft" podUID="ef2e31df-842f-499c-bd92-783c57f25a15" containerName="manager" containerID="cri-o://7cba9f272e4ec2bf15418d49c74a5169de178449dc716e8fc2be288f7d7de293" gracePeriod=10
Jul 11 07:48:54.667816 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:54.667791    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8x4ft"
Jul 11 07:48:54.736660 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:54.736567    2568 generic.go:356] "Generic (PLEG): container finished" podID="ef2e31df-842f-499c-bd92-783c57f25a15" containerID="7cba9f272e4ec2bf15418d49c74a5169de178449dc716e8fc2be288f7d7de293" exitCode=0
Jul 11 07:48:54.736660 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:54.736622    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8x4ft"
Jul 11 07:48:54.736660 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:54.736636    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8x4ft" event={"ID":"ef2e31df-842f-499c-bd92-783c57f25a15","Type":"ContainerDied","Data":"7cba9f272e4ec2bf15418d49c74a5169de178449dc716e8fc2be288f7d7de293"}
Jul 11 07:48:54.736867 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:54.736685    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8x4ft" event={"ID":"ef2e31df-842f-499c-bd92-783c57f25a15","Type":"ContainerDied","Data":"dc6513c7ad97d25fa67fc3dfac51a66f0a4876e2cb642676def23aec6b63c176"}
Jul 11 07:48:54.736867 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:54.736707    2568 scope.go:117] "RemoveContainer" containerID="7cba9f272e4ec2bf15418d49c74a5169de178449dc716e8fc2be288f7d7de293"
Jul 11 07:48:54.745126 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:54.745095    2568 scope.go:117] "RemoveContainer" containerID="7cba9f272e4ec2bf15418d49c74a5169de178449dc716e8fc2be288f7d7de293"
Jul 11 07:48:54.745359 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:48:54.745341    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cba9f272e4ec2bf15418d49c74a5169de178449dc716e8fc2be288f7d7de293\": container with ID starting with 7cba9f272e4ec2bf15418d49c74a5169de178449dc716e8fc2be288f7d7de293 not found: ID does not exist" containerID="7cba9f272e4ec2bf15418d49c74a5169de178449dc716e8fc2be288f7d7de293"
Jul 11 07:48:54.745415 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:54.745368    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cba9f272e4ec2bf15418d49c74a5169de178449dc716e8fc2be288f7d7de293"} err="failed to get container status \"7cba9f272e4ec2bf15418d49c74a5169de178449dc716e8fc2be288f7d7de293\": rpc error: code = NotFound desc = could not find container \"7cba9f272e4ec2bf15418d49c74a5169de178449dc716e8fc2be288f7d7de293\": container with ID starting with 7cba9f272e4ec2bf15418d49c74a5169de178449dc716e8fc2be288f7d7de293 not found: ID does not exist"
Jul 11 07:48:54.773641 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:54.773622    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef2e31df-842f-499c-bd92-783c57f25a15-extensions-socket-volume\") pod \"ef2e31df-842f-499c-bd92-783c57f25a15\" (UID: \"ef2e31df-842f-499c-bd92-783c57f25a15\") "
Jul 11 07:48:54.773726 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:54.773682    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nn5n\" (UniqueName: \"kubernetes.io/projected/ef2e31df-842f-499c-bd92-783c57f25a15-kube-api-access-6nn5n\") pod \"ef2e31df-842f-499c-bd92-783c57f25a15\" (UID: \"ef2e31df-842f-499c-bd92-783c57f25a15\") "
Jul 11 07:48:54.774145 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:54.774121    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef2e31df-842f-499c-bd92-783c57f25a15-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ef2e31df-842f-499c-bd92-783c57f25a15" (UID: "ef2e31df-842f-499c-bd92-783c57f25a15"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 07:48:54.775625 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:54.775606    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef2e31df-842f-499c-bd92-783c57f25a15-kube-api-access-6nn5n" (OuterVolumeSpecName: "kube-api-access-6nn5n") pod "ef2e31df-842f-499c-bd92-783c57f25a15" (UID: "ef2e31df-842f-499c-bd92-783c57f25a15"). InnerVolumeSpecName "kube-api-access-6nn5n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 07:48:54.874853 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:54.874818    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nn5n\" (UniqueName: \"kubernetes.io/projected/ef2e31df-842f-499c-bd92-783c57f25a15-kube-api-access-6nn5n\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:48:54.874853 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:54.874846    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef2e31df-842f-499c-bd92-783c57f25a15-extensions-socket-volume\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:48:55.058304 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:55.058276    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8x4ft"]
Jul 11 07:48:55.060361 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:55.060313    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8x4ft"]
Jul 11 07:48:55.071145 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:55.071120    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef2e31df-842f-499c-bd92-783c57f25a15" path="/var/lib/kubelet/pods/ef2e31df-842f-499c-bd92-783c57f25a15/volumes"
Jul 11 07:48:57.961577 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:57.961541    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"]
Jul 11 07:48:57.961934 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:57.961805    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81dd3efd-c8ea-4e6b-97fc-8ac2f6b2d7f1" containerName="manager"
Jul 11 07:48:57.961934 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:57.961815    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="81dd3efd-c8ea-4e6b-97fc-8ac2f6b2d7f1" containerName="manager"
Jul 11 07:48:57.961934 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:57.961828    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef2e31df-842f-499c-bd92-783c57f25a15" containerName="manager"
Jul 11 07:48:57.961934 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:57.961834    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef2e31df-842f-499c-bd92-783c57f25a15" containerName="manager"
Jul 11 07:48:57.961934 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:57.961877    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="81dd3efd-c8ea-4e6b-97fc-8ac2f6b2d7f1" containerName="manager"
Jul 11 07:48:57.961934 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:57.961887    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef2e31df-842f-499c-bd92-783c57f25a15" containerName="manager"
Jul 11 07:48:57.966464 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:57.966438    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:57.968696 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:57.968672    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9mn5v\""
Jul 11 07:48:57.974535 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:57.974511    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"]
Jul 11 07:48:58.101063 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.101032    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqmvk\" (UniqueName: \"kubernetes.io/projected/513e718d-c34e-495e-90b9-e52f6f6d85d9-kube-api-access-vqmvk\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2jdj\" (UID: \"513e718d-c34e-495e-90b9-e52f6f6d85d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:58.101254 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.101069    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/513e718d-c34e-495e-90b9-e52f6f6d85d9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2jdj\" (UID: \"513e718d-c34e-495e-90b9-e52f6f6d85d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:58.101254 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.101087    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/513e718d-c34e-495e-90b9-e52f6f6d85d9-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2jdj\" (UID: \"513e718d-c34e-495e-90b9-e52f6f6d85d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:58.101254 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.101109    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/513e718d-c34e-495e-90b9-e52f6f6d85d9-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2jdj\" (UID: \"513e718d-c34e-495e-90b9-e52f6f6d85d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:58.101254 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.101200    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/513e718d-c34e-495e-90b9-e52f6f6d85d9-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2jdj\" (UID: \"513e718d-c34e-495e-90b9-e52f6f6d85d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:58.101254 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.101251    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/513e718d-c34e-495e-90b9-e52f6f6d85d9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2jdj\" (UID: \"513e718d-c34e-495e-90b9-e52f6f6d85d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:58.101466 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.101313    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/513e718d-c34e-495e-90b9-e52f6f6d85d9-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2jdj\" (UID: \"513e718d-c34e-495e-90b9-e52f6f6d85d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:58.101466 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.101355    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/513e718d-c34e-495e-90b9-e52f6f6d85d9-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2jdj\" (UID: \"513e718d-c34e-495e-90b9-e52f6f6d85d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:58.101466 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.101382    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/513e718d-c34e-495e-90b9-e52f6f6d85d9-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2jdj\" (UID: \"513e718d-c34e-495e-90b9-e52f6f6d85d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:58.202039 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.201997    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/513e718d-c34e-495e-90b9-e52f6f6d85d9-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2jdj\" (UID: \"513e718d-c34e-495e-90b9-e52f6f6d85d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:58.202039 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.202042    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqmvk\" (UniqueName: \"kubernetes.io/projected/513e718d-c34e-495e-90b9-e52f6f6d85d9-kube-api-access-vqmvk\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2jdj\" (UID: \"513e718d-c34e-495e-90b9-e52f6f6d85d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:58.202291 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.202172    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/513e718d-c34e-495e-90b9-e52f6f6d85d9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2jdj\" (UID: \"513e718d-c34e-495e-90b9-e52f6f6d85d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:58.202291 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.202217    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/513e718d-c34e-495e-90b9-e52f6f6d85d9-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2jdj\" (UID: \"513e718d-c34e-495e-90b9-e52f6f6d85d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:58.202291 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.202257    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/513e718d-c34e-495e-90b9-e52f6f6d85d9-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2jdj\" (UID: \"513e718d-c34e-495e-90b9-e52f6f6d85d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:58.202470 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.202305    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/513e718d-c34e-495e-90b9-e52f6f6d85d9-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2jdj\" (UID: \"513e718d-c34e-495e-90b9-e52f6f6d85d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:58.202470 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.202363    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/513e718d-c34e-495e-90b9-e52f6f6d85d9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2jdj\" (UID: \"513e718d-c34e-495e-90b9-e52f6f6d85d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:58.202470 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.202414    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/513e718d-c34e-495e-90b9-e52f6f6d85d9-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2jdj\" (UID: \"513e718d-c34e-495e-90b9-e52f6f6d85d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:58.202470 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.202437    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/513e718d-c34e-495e-90b9-e52f6f6d85d9-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2jdj\" (UID: \"513e718d-c34e-495e-90b9-e52f6f6d85d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:58.202681 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.202652    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/513e718d-c34e-495e-90b9-e52f6f6d85d9-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2jdj\" (UID: \"513e718d-c34e-495e-90b9-e52f6f6d85d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:58.202733 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.202688    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/513e718d-c34e-495e-90b9-e52f6f6d85d9-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2jdj\" (UID: \"513e718d-c34e-495e-90b9-e52f6f6d85d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:58.202848 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.202782    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/513e718d-c34e-495e-90b9-e52f6f6d85d9-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2jdj\" (UID: \"513e718d-c34e-495e-90b9-e52f6f6d85d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:58.202895 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.202869    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/513e718d-c34e-495e-90b9-e52f6f6d85d9-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2jdj\" (UID: \"513e718d-c34e-495e-90b9-e52f6f6d85d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:58.203153 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.203132    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/513e718d-c34e-495e-90b9-e52f6f6d85d9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2jdj\" (UID: \"513e718d-c34e-495e-90b9-e52f6f6d85d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:58.204362 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.204343    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/513e718d-c34e-495e-90b9-e52f6f6d85d9-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2jdj\" (UID: \"513e718d-c34e-495e-90b9-e52f6f6d85d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:58.204594 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.204577    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/513e718d-c34e-495e-90b9-e52f6f6d85d9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2jdj\" (UID: \"513e718d-c34e-495e-90b9-e52f6f6d85d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:58.209219 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.209198    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/513e718d-c34e-495e-90b9-e52f6f6d85d9-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2jdj\" (UID: \"513e718d-c34e-495e-90b9-e52f6f6d85d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:58.209401 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.209383    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqmvk\" (UniqueName: \"kubernetes.io/projected/513e718d-c34e-495e-90b9-e52f6f6d85d9-kube-api-access-vqmvk\") pod \"maas-default-gateway-openshift-default-56654dcf7-t2jdj\" (UID: \"513e718d-c34e-495e-90b9-e52f6f6d85d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:58.277143 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.277054    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:58.413491 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.413023    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"]
Jul 11 07:48:58.418463 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.418426    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 07:48:58.418554 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.418494    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 07:48:58.418554 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.418525    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 07:48:58.754637 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.754596    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj" event={"ID":"513e718d-c34e-495e-90b9-e52f6f6d85d9","Type":"ContainerStarted","Data":"12bc155ec5bdea6d302d438089d38b318c768df64cb860b8497b05abf1f7e9c1"}
Jul 11 07:48:58.754789 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.754660    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj" event={"ID":"513e718d-c34e-495e-90b9-e52f6f6d85d9","Type":"ContainerStarted","Data":"78e4ba6ca3a101dcedfedc902318bdf18595993321cf28e1a7f7ddc30a5ec06f"}
Jul 11 07:48:58.773577 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:58.773528    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj" podStartSLOduration=1.7735132139999998 podStartE2EDuration="1.773513214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:48:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:48:58.772463102 +0000 UTC m=+650.257213275" watchObservedRunningTime="2026-07-11 07:48:58.773513214 +0000 UTC m=+650.258263347"
Jul 11 07:48:59.277408 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:59.277377    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:59.282096 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:59.282072    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:59.758936 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:59.758907    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:48:59.759763 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:48:59.759747    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:49:11.346569 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:11.346532    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8wj4b"]
Jul 11 07:49:11.349271 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:11.349253    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8wj4b"
Jul 11 07:49:11.351485 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:11.351459    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 11 07:49:11.351618 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:11.351491    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-j6pgs\""
Jul 11 07:49:11.357017 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:11.356992    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8wj4b"]
Jul 11 07:49:11.404876 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:11.404836    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtqwg\" (UniqueName: \"kubernetes.io/projected/55ee76df-d093-4707-ab04-9f15fe41a404-kube-api-access-dtqwg\") pod \"limitador-limitador-64c94fd64f-8wj4b\" (UID: \"55ee76df-d093-4707-ab04-9f15fe41a404\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8wj4b"
Jul 11 07:49:11.404876 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:11.404878    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/55ee76df-d093-4707-ab04-9f15fe41a404-config-file\") pod \"limitador-limitador-64c94fd64f-8wj4b\" (UID: \"55ee76df-d093-4707-ab04-9f15fe41a404\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8wj4b"
Jul 11 07:49:11.445190 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:11.445150    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8wj4b"]
Jul 11 07:49:11.506277 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:11.506229    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtqwg\" (UniqueName: \"kubernetes.io/projected/55ee76df-d093-4707-ab04-9f15fe41a404-kube-api-access-dtqwg\") pod \"limitador-limitador-64c94fd64f-8wj4b\" (UID: \"55ee76df-d093-4707-ab04-9f15fe41a404\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8wj4b"
Jul 11 07:49:11.506482 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:11.506284    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/55ee76df-d093-4707-ab04-9f15fe41a404-config-file\") pod \"limitador-limitador-64c94fd64f-8wj4b\" (UID: \"55ee76df-d093-4707-ab04-9f15fe41a404\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8wj4b"
Jul 11 07:49:11.506966 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:11.506946    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/55ee76df-d093-4707-ab04-9f15fe41a404-config-file\") pod \"limitador-limitador-64c94fd64f-8wj4b\" (UID: \"55ee76df-d093-4707-ab04-9f15fe41a404\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8wj4b"
Jul 11 07:49:11.517930 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:11.517902    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtqwg\" (UniqueName: \"kubernetes.io/projected/55ee76df-d093-4707-ab04-9f15fe41a404-kube-api-access-dtqwg\") pod \"limitador-limitador-64c94fd64f-8wj4b\" (UID: \"55ee76df-d093-4707-ab04-9f15fe41a404\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8wj4b"
Jul 11 07:49:11.659500 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:11.659405    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8wj4b"
Jul 11 07:49:11.783000 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:11.782974    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8wj4b"]
Jul 11 07:49:11.785248 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:49:11.785222    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55ee76df_d093_4707_ab04_9f15fe41a404.slice/crio-6bc857aba4eccbb2d99a3b8d27de67921bc8ff0ced1561406970ebdc497ac103 WatchSource:0}: Error finding container 6bc857aba4eccbb2d99a3b8d27de67921bc8ff0ced1561406970ebdc497ac103: Status 404 returned error can't find the container with id 6bc857aba4eccbb2d99a3b8d27de67921bc8ff0ced1561406970ebdc497ac103
Jul 11 07:49:11.808910 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:11.808878    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8wj4b" event={"ID":"55ee76df-d093-4707-ab04-9f15fe41a404","Type":"ContainerStarted","Data":"6bc857aba4eccbb2d99a3b8d27de67921bc8ff0ced1561406970ebdc497ac103"}
Jul 11 07:49:14.825236 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:14.825201    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8wj4b" event={"ID":"55ee76df-d093-4707-ab04-9f15fe41a404","Type":"ContainerStarted","Data":"254543333b1a87550e3c5d262b2c35840b9daf0d2cb9696fa3f2b285d906fe0c"}
Jul 11 07:49:14.825678 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:14.825266    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-8wj4b"
Jul 11 07:49:14.842226 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:14.842177    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-8wj4b" podStartSLOduration=1.132162806 podStartE2EDuration="3.842161108s" totalImagesPullingTime="2.709998302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:49:14.840629116 +0000 UTC m=+666.325379227" watchObservedRunningTime="2026-07-11 07:49:14.842161108 +0000 UTC m=+666.326911284"
Jul 11 07:49:25.830788 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:25.830755    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-8wj4b"
Jul 11 07:49:28.611223 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:28.611190    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8wj4b"]
Jul 11 07:49:28.611656 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:28.611387    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-8wj4b" podUID="55ee76df-d093-4707-ab04-9f15fe41a404" containerName="limitador" containerID="cri-o://254543333b1a87550e3c5d262b2c35840b9daf0d2cb9696fa3f2b285d906fe0c" gracePeriod=30
Jul 11 07:49:29.167870 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:29.167846    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8wj4b"
Jul 11 07:49:29.240390 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:29.240287    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtqwg\" (UniqueName: \"kubernetes.io/projected/55ee76df-d093-4707-ab04-9f15fe41a404-kube-api-access-dtqwg\") pod \"55ee76df-d093-4707-ab04-9f15fe41a404\" (UID: \"55ee76df-d093-4707-ab04-9f15fe41a404\") "
Jul 11 07:49:29.240390 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:29.240371    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/55ee76df-d093-4707-ab04-9f15fe41a404-config-file\") pod \"55ee76df-d093-4707-ab04-9f15fe41a404\" (UID: \"55ee76df-d093-4707-ab04-9f15fe41a404\") "
Jul 11 07:49:29.240716 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:29.240687    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55ee76df-d093-4707-ab04-9f15fe41a404-config-file" (OuterVolumeSpecName: "config-file") pod "55ee76df-d093-4707-ab04-9f15fe41a404" (UID: "55ee76df-d093-4707-ab04-9f15fe41a404"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 07:49:29.242402 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:29.242378    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55ee76df-d093-4707-ab04-9f15fe41a404-kube-api-access-dtqwg" (OuterVolumeSpecName: "kube-api-access-dtqwg") pod "55ee76df-d093-4707-ab04-9f15fe41a404" (UID: "55ee76df-d093-4707-ab04-9f15fe41a404"). InnerVolumeSpecName "kube-api-access-dtqwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 07:49:29.341808 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:29.341771    2568 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/55ee76df-d093-4707-ab04-9f15fe41a404-config-file\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:49:29.341808 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:29.341806    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtqwg\" (UniqueName: \"kubernetes.io/projected/55ee76df-d093-4707-ab04-9f15fe41a404-kube-api-access-dtqwg\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:49:29.893980 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:29.893943    2568 generic.go:356] "Generic (PLEG): container finished" podID="55ee76df-d093-4707-ab04-9f15fe41a404" containerID="254543333b1a87550e3c5d262b2c35840b9daf0d2cb9696fa3f2b285d906fe0c" exitCode=0
Jul 11 07:49:29.894444 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:29.893987    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8wj4b"
Jul 11 07:49:29.894444 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:29.894028    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8wj4b" event={"ID":"55ee76df-d093-4707-ab04-9f15fe41a404","Type":"ContainerDied","Data":"254543333b1a87550e3c5d262b2c35840b9daf0d2cb9696fa3f2b285d906fe0c"}
Jul 11 07:49:29.894444 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:29.894100    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8wj4b" event={"ID":"55ee76df-d093-4707-ab04-9f15fe41a404","Type":"ContainerDied","Data":"6bc857aba4eccbb2d99a3b8d27de67921bc8ff0ced1561406970ebdc497ac103"}
Jul 11 07:49:29.894444 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:29.894122    2568 scope.go:117] "RemoveContainer" containerID="254543333b1a87550e3c5d262b2c35840b9daf0d2cb9696fa3f2b285d906fe0c"
Jul 11 07:49:29.902317 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:29.902301    2568 scope.go:117] "RemoveContainer" containerID="254543333b1a87550e3c5d262b2c35840b9daf0d2cb9696fa3f2b285d906fe0c"
Jul 11 07:49:29.902604 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:49:29.902585    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"254543333b1a87550e3c5d262b2c35840b9daf0d2cb9696fa3f2b285d906fe0c\": container with ID starting with 254543333b1a87550e3c5d262b2c35840b9daf0d2cb9696fa3f2b285d906fe0c not found: ID does not exist" containerID="254543333b1a87550e3c5d262b2c35840b9daf0d2cb9696fa3f2b285d906fe0c"
Jul 11 07:49:29.902672 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:29.902615    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"254543333b1a87550e3c5d262b2c35840b9daf0d2cb9696fa3f2b285d906fe0c"} err="failed to get container status \"254543333b1a87550e3c5d262b2c35840b9daf0d2cb9696fa3f2b285d906fe0c\": rpc error: code = NotFound desc = could not find container \"254543333b1a87550e3c5d262b2c35840b9daf0d2cb9696fa3f2b285d906fe0c\": container with ID starting with 254543333b1a87550e3c5d262b2c35840b9daf0d2cb9696fa3f2b285d906fe0c not found: ID does not exist"
Jul 11 07:49:29.912544 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:29.912520    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8wj4b"]
Jul 11 07:49:29.918729 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:29.918707    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8wj4b"]
Jul 11 07:49:31.070445 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:31.070414    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55ee76df-d093-4707-ab04-9f15fe41a404" path="/var/lib/kubelet/pods/55ee76df-d093-4707-ab04-9f15fe41a404/volumes"
Jul 11 07:49:31.575786 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:31.575756    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-7x8pj"]
Jul 11 07:49:31.576068 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:31.576057    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55ee76df-d093-4707-ab04-9f15fe41a404" containerName="limitador"
Jul 11 07:49:31.576115 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:31.576070    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="55ee76df-d093-4707-ab04-9f15fe41a404" containerName="limitador"
Jul 11 07:49:31.576148 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:31.576116    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="55ee76df-d093-4707-ab04-9f15fe41a404" containerName="limitador"
Jul 11 07:49:31.580050 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:31.580028    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7x8pj"
Jul 11 07:49:31.582506 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:31.582484    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 11 07:49:31.583413 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:31.583392    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 11 07:49:31.583502 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:31.583414    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 11 07:49:31.583502 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:31.583446    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-97brc\""
Jul 11 07:49:31.585990 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:31.585964    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-7x8pj"]
Jul 11 07:49:31.662606 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:31.662573    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/65d491c5-d02b-470a-8b24-0eba2db49a1d-data\") pod \"postgres-69fb4594cf-7x8pj\" (UID: \"65d491c5-d02b-470a-8b24-0eba2db49a1d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7x8pj"
Jul 11 07:49:31.662793 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:31.662626    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5whhq\" (UniqueName: \"kubernetes.io/projected/65d491c5-d02b-470a-8b24-0eba2db49a1d-kube-api-access-5whhq\") pod \"postgres-69fb4594cf-7x8pj\" (UID: \"65d491c5-d02b-470a-8b24-0eba2db49a1d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7x8pj"
Jul 11 07:49:31.763879 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:31.763835    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/65d491c5-d02b-470a-8b24-0eba2db49a1d-data\") pod \"postgres-69fb4594cf-7x8pj\" (UID: \"65d491c5-d02b-470a-8b24-0eba2db49a1d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7x8pj"
Jul 11 07:49:31.764101 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:31.763890    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5whhq\" (UniqueName: \"kubernetes.io/projected/65d491c5-d02b-470a-8b24-0eba2db49a1d-kube-api-access-5whhq\") pod \"postgres-69fb4594cf-7x8pj\" (UID: \"65d491c5-d02b-470a-8b24-0eba2db49a1d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7x8pj"
Jul 11 07:49:31.764303 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:31.764281    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/65d491c5-d02b-470a-8b24-0eba2db49a1d-data\") pod \"postgres-69fb4594cf-7x8pj\" (UID: \"65d491c5-d02b-470a-8b24-0eba2db49a1d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7x8pj"
Jul 11 07:49:31.772531 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:31.772489    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5whhq\" (UniqueName: \"kubernetes.io/projected/65d491c5-d02b-470a-8b24-0eba2db49a1d-kube-api-access-5whhq\") pod \"postgres-69fb4594cf-7x8pj\" (UID: \"65d491c5-d02b-470a-8b24-0eba2db49a1d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7x8pj"
Jul 11 07:49:31.890804 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:31.890707    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7x8pj"
Jul 11 07:49:32.017138 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:32.017101    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-7x8pj"]
Jul 11 07:49:32.021227 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:49:32.021199    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65d491c5_d02b_470a_8b24_0eba2db49a1d.slice/crio-6710d957d86ed7b1d7103d16509bb4b3ed024715072ba6f6e245c8e35587863b WatchSource:0}: Error finding container 6710d957d86ed7b1d7103d16509bb4b3ed024715072ba6f6e245c8e35587863b: Status 404 returned error can't find the container with id 6710d957d86ed7b1d7103d16509bb4b3ed024715072ba6f6e245c8e35587863b
Jul 11 07:49:32.022509 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:32.022489    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 07:49:32.911750 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:32.911710    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7x8pj" event={"ID":"65d491c5-d02b-470a-8b24-0eba2db49a1d","Type":"ContainerStarted","Data":"6710d957d86ed7b1d7103d16509bb4b3ed024715072ba6f6e245c8e35587863b"}
Jul 11 07:49:36.931431 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:36.931336    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7x8pj" event={"ID":"65d491c5-d02b-470a-8b24-0eba2db49a1d","Type":"ContainerStarted","Data":"9f459b3347250da10d0cbf98988b39a2b2e4a608b8d1586d7d0a476729f8fff4"}
Jul 11 07:49:36.931840 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:36.931449    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7x8pj"
Jul 11 07:49:36.947013 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:36.946963    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7x8pj" podStartSLOduration=1.3771766300000001 podStartE2EDuration="5.94694923s" totalImagesPullingTime="4.5697726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:49:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:49:36.945557107 +0000 UTC m=+688.430307242" watchObservedRunningTime="2026-07-11 07:49:36.94694923 +0000 UTC m=+688.431699362"
Jul 11 07:49:42.963937 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:42.963908    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7x8pj"
Jul 11 07:49:50.309012 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:50.308972    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-79cdcc45d4-fgxfc"]
Jul 11 07:49:50.334254 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:50.334218    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79cdcc45d4-fgxfc"
Jul 11 07:49:50.334453 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:50.334216    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79cdcc45d4-fgxfc"]
Jul 11 07:49:50.336670 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:50.336628    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 11 07:49:50.336828 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:50.336702    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 11 07:49:50.336828 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:50.336777    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-v2kbp\""
Jul 11 07:49:50.426079 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:50.426044    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/79c24611-467b-4aaa-8514-b54c765675aa-webhook-cert\") pod \"maas-controller-79cdcc45d4-fgxfc\" (UID: \"79c24611-467b-4aaa-8514-b54c765675aa\") " pod="opendatahub/maas-controller-79cdcc45d4-fgxfc"
Jul 11 07:49:50.426252 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:50.426188    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnbbd\" (UniqueName: \"kubernetes.io/projected/79c24611-467b-4aaa-8514-b54c765675aa-kube-api-access-pnbbd\") pod \"maas-controller-79cdcc45d4-fgxfc\" (UID: \"79c24611-467b-4aaa-8514-b54c765675aa\") " pod="opendatahub/maas-controller-79cdcc45d4-fgxfc"
Jul 11 07:49:50.471982 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:50.471947    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9c5f5fdd9-qnhlv"]
Jul 11 07:49:50.475452 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:50.475420    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9c5f5fdd9-qnhlv"
Jul 11 07:49:50.484568 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:50.484539    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9c5f5fdd9-qnhlv"]
Jul 11 07:49:50.527062 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:50.527027    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/79c24611-467b-4aaa-8514-b54c765675aa-webhook-cert\") pod \"maas-controller-79cdcc45d4-fgxfc\" (UID: \"79c24611-467b-4aaa-8514-b54c765675aa\") " pod="opendatahub/maas-controller-79cdcc45d4-fgxfc"
Jul 11 07:49:50.527266 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:50.527119    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnbbd\" (UniqueName: \"kubernetes.io/projected/79c24611-467b-4aaa-8514-b54c765675aa-kube-api-access-pnbbd\") pod \"maas-controller-79cdcc45d4-fgxfc\" (UID: \"79c24611-467b-4aaa-8514-b54c765675aa\") " pod="opendatahub/maas-controller-79cdcc45d4-fgxfc"
Jul 11 07:49:50.529469 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:50.529442    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/79c24611-467b-4aaa-8514-b54c765675aa-webhook-cert\") pod \"maas-controller-79cdcc45d4-fgxfc\" (UID: \"79c24611-467b-4aaa-8514-b54c765675aa\") " pod="opendatahub/maas-controller-79cdcc45d4-fgxfc"
Jul 11 07:49:50.538055 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:50.538029    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnbbd\" (UniqueName: \"kubernetes.io/projected/79c24611-467b-4aaa-8514-b54c765675aa-kube-api-access-pnbbd\") pod \"maas-controller-79cdcc45d4-fgxfc\" (UID: \"79c24611-467b-4aaa-8514-b54c765675aa\") " pod="opendatahub/maas-controller-79cdcc45d4-fgxfc"
Jul 11 07:49:50.628423 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:50.628265    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90498293-3575-424e-97e5-5657df13f266-webhook-cert\") pod \"maas-controller-9c5f5fdd9-qnhlv\" (UID: \"90498293-3575-424e-97e5-5657df13f266\") " pod="opendatahub/maas-controller-9c5f5fdd9-qnhlv"
Jul 11 07:49:50.628423 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:50.628379    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx2lw\" (UniqueName: \"kubernetes.io/projected/90498293-3575-424e-97e5-5657df13f266-kube-api-access-xx2lw\") pod \"maas-controller-9c5f5fdd9-qnhlv\" (UID: \"90498293-3575-424e-97e5-5657df13f266\") " pod="opendatahub/maas-controller-9c5f5fdd9-qnhlv"
Jul 11 07:49:50.644215 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:50.644181    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79cdcc45d4-fgxfc"
Jul 11 07:49:50.729461 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:50.728836    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx2lw\" (UniqueName: \"kubernetes.io/projected/90498293-3575-424e-97e5-5657df13f266-kube-api-access-xx2lw\") pod \"maas-controller-9c5f5fdd9-qnhlv\" (UID: \"90498293-3575-424e-97e5-5657df13f266\") " pod="opendatahub/maas-controller-9c5f5fdd9-qnhlv"
Jul 11 07:49:50.729461 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:50.728970    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90498293-3575-424e-97e5-5657df13f266-webhook-cert\") pod \"maas-controller-9c5f5fdd9-qnhlv\" (UID: \"90498293-3575-424e-97e5-5657df13f266\") " pod="opendatahub/maas-controller-9c5f5fdd9-qnhlv"
Jul 11 07:49:50.731415 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:50.731393    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90498293-3575-424e-97e5-5657df13f266-webhook-cert\") pod \"maas-controller-9c5f5fdd9-qnhlv\" (UID: \"90498293-3575-424e-97e5-5657df13f266\") " pod="opendatahub/maas-controller-9c5f5fdd9-qnhlv"
Jul 11 07:49:50.739155 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:50.739123    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx2lw\" (UniqueName: \"kubernetes.io/projected/90498293-3575-424e-97e5-5657df13f266-kube-api-access-xx2lw\") pod \"maas-controller-9c5f5fdd9-qnhlv\" (UID: \"90498293-3575-424e-97e5-5657df13f266\") " pod="opendatahub/maas-controller-9c5f5fdd9-qnhlv"
Jul 11 07:49:50.778699 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:50.778664    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79cdcc45d4-fgxfc"]
Jul 11 07:49:50.781746 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:49:50.781713    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79c24611_467b_4aaa_8514_b54c765675aa.slice/crio-5e3e3d9b6f814a528b951443cba5daff429806722984e882849c3ebeb37fa85b WatchSource:0}: Error finding container 5e3e3d9b6f814a528b951443cba5daff429806722984e882849c3ebeb37fa85b: Status 404 returned error can't find the container with id 5e3e3d9b6f814a528b951443cba5daff429806722984e882849c3ebeb37fa85b
Jul 11 07:49:50.785392 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:50.785373    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9c5f5fdd9-qnhlv"
Jul 11 07:49:50.912822 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:50.912746    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9c5f5fdd9-qnhlv"]
Jul 11 07:49:50.915503 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:49:50.915477    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90498293_3575_424e_97e5_5657df13f266.slice/crio-19b8a51f4f6c3a8a142c4d718b02e5c8eae493a899515cbe98a8747806cc03a1 WatchSource:0}: Error finding container 19b8a51f4f6c3a8a142c4d718b02e5c8eae493a899515cbe98a8747806cc03a1: Status 404 returned error can't find the container with id 19b8a51f4f6c3a8a142c4d718b02e5c8eae493a899515cbe98a8747806cc03a1
Jul 11 07:49:50.992060 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:50.992021    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79cdcc45d4-fgxfc" event={"ID":"79c24611-467b-4aaa-8514-b54c765675aa","Type":"ContainerStarted","Data":"5e3e3d9b6f814a528b951443cba5daff429806722984e882849c3ebeb37fa85b"}
Jul 11 07:49:50.993133 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:50.993109    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9c5f5fdd9-qnhlv" event={"ID":"90498293-3575-424e-97e5-5657df13f266","Type":"ContainerStarted","Data":"19b8a51f4f6c3a8a142c4d718b02e5c8eae493a899515cbe98a8747806cc03a1"}
Jul 11 07:49:54.014040 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:54.014001    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9c5f5fdd9-qnhlv" event={"ID":"90498293-3575-424e-97e5-5657df13f266","Type":"ContainerStarted","Data":"afd22f558f9b9fea2e611852d418df916007ab9960568d3ddbee70dcffee2e3f"}
Jul 11 07:49:54.014535 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:54.014163    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9c5f5fdd9-qnhlv"
Jul 11 07:49:54.015501 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:54.015477    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79cdcc45d4-fgxfc" event={"ID":"79c24611-467b-4aaa-8514-b54c765675aa","Type":"ContainerStarted","Data":"a28a996220dd024b02c9eb9a7ad5072d84dc42f6f581009644311ad575f18c18"}
Jul 11 07:49:54.015616 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:54.015599    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-79cdcc45d4-fgxfc"
Jul 11 07:49:54.029888 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:54.029831    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9c5f5fdd9-qnhlv" podStartSLOduration=1.993674107 podStartE2EDuration="4.029816087s" totalImagesPullingTime="2.03614198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:49:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:49:54.028140496 +0000 UTC m=+705.512890631" watchObservedRunningTime="2026-07-11 07:49:54.029816087 +0000 UTC m=+705.514566243"
Jul 11 07:49:54.046159 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:49:54.046104    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-79cdcc45d4-fgxfc" podStartSLOduration=1.8864396270000001 podStartE2EDuration="4.046086311s" totalImagesPullingTime="2.159646684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:49:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:49:54.044658169 +0000 UTC m=+705.529408303" watchObservedRunningTime="2026-07-11 07:49:54.046086311 +0000 UTC m=+705.530836443"
Jul 11 07:50:05.024292 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:05.024217    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9c5f5fdd9-qnhlv"
Jul 11 07:50:05.024292 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:05.024283    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-79cdcc45d4-fgxfc"
Jul 11 07:50:05.079251 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:05.079219    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79cdcc45d4-fgxfc"]
Jul 11 07:50:05.079449 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:05.079421    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-79cdcc45d4-fgxfc" podUID="79c24611-467b-4aaa-8514-b54c765675aa" containerName="manager" containerID="cri-o://a28a996220dd024b02c9eb9a7ad5072d84dc42f6f581009644311ad575f18c18" gracePeriod=30
Jul 11 07:50:05.320242 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:05.320219    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79cdcc45d4-fgxfc"
Jul 11 07:50:05.461392 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:05.461312    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/79c24611-467b-4aaa-8514-b54c765675aa-webhook-cert\") pod \"79c24611-467b-4aaa-8514-b54c765675aa\" (UID: \"79c24611-467b-4aaa-8514-b54c765675aa\") "
Jul 11 07:50:05.461571 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:05.461436    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnbbd\" (UniqueName: \"kubernetes.io/projected/79c24611-467b-4aaa-8514-b54c765675aa-kube-api-access-pnbbd\") pod \"79c24611-467b-4aaa-8514-b54c765675aa\" (UID: \"79c24611-467b-4aaa-8514-b54c765675aa\") "
Jul 11 07:50:05.463563 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:05.463529    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79c24611-467b-4aaa-8514-b54c765675aa-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "79c24611-467b-4aaa-8514-b54c765675aa" (UID: "79c24611-467b-4aaa-8514-b54c765675aa"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 07:50:05.463694 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:05.463573    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79c24611-467b-4aaa-8514-b54c765675aa-kube-api-access-pnbbd" (OuterVolumeSpecName: "kube-api-access-pnbbd") pod "79c24611-467b-4aaa-8514-b54c765675aa" (UID: "79c24611-467b-4aaa-8514-b54c765675aa"). InnerVolumeSpecName "kube-api-access-pnbbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 07:50:05.562442 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:05.562334    2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/79c24611-467b-4aaa-8514-b54c765675aa-webhook-cert\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:50:05.562442 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:05.562379    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnbbd\" (UniqueName: \"kubernetes.io/projected/79c24611-467b-4aaa-8514-b54c765675aa-kube-api-access-pnbbd\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:50:06.076530 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:06.076491    2568 generic.go:356] "Generic (PLEG): container finished" podID="79c24611-467b-4aaa-8514-b54c765675aa" containerID="a28a996220dd024b02c9eb9a7ad5072d84dc42f6f581009644311ad575f18c18" exitCode=0
Jul 11 07:50:06.076924 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:06.076537    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79cdcc45d4-fgxfc"
Jul 11 07:50:06.076924 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:06.076578    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79cdcc45d4-fgxfc" event={"ID":"79c24611-467b-4aaa-8514-b54c765675aa","Type":"ContainerDied","Data":"a28a996220dd024b02c9eb9a7ad5072d84dc42f6f581009644311ad575f18c18"}
Jul 11 07:50:06.076924 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:06.076645    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79cdcc45d4-fgxfc" event={"ID":"79c24611-467b-4aaa-8514-b54c765675aa","Type":"ContainerDied","Data":"5e3e3d9b6f814a528b951443cba5daff429806722984e882849c3ebeb37fa85b"}
Jul 11 07:50:06.076924 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:06.076669    2568 scope.go:117] "RemoveContainer" containerID="a28a996220dd024b02c9eb9a7ad5072d84dc42f6f581009644311ad575f18c18"
Jul 11 07:50:06.085589 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:06.085434    2568 scope.go:117] "RemoveContainer" containerID="a28a996220dd024b02c9eb9a7ad5072d84dc42f6f581009644311ad575f18c18"
Jul 11 07:50:06.085685 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:50:06.085669    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a28a996220dd024b02c9eb9a7ad5072d84dc42f6f581009644311ad575f18c18\": container with ID starting with a28a996220dd024b02c9eb9a7ad5072d84dc42f6f581009644311ad575f18c18 not found: ID does not exist" containerID="a28a996220dd024b02c9eb9a7ad5072d84dc42f6f581009644311ad575f18c18"
Jul 11 07:50:06.085728 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:06.085694    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a28a996220dd024b02c9eb9a7ad5072d84dc42f6f581009644311ad575f18c18"} err="failed to get container status \"a28a996220dd024b02c9eb9a7ad5072d84dc42f6f581009644311ad575f18c18\": rpc error: code = NotFound desc = could not find container \"a28a996220dd024b02c9eb9a7ad5072d84dc42f6f581009644311ad575f18c18\": container with ID starting with a28a996220dd024b02c9eb9a7ad5072d84dc42f6f581009644311ad575f18c18 not found: ID does not exist"
Jul 11 07:50:06.095684 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:06.095653    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79cdcc45d4-fgxfc"]
Jul 11 07:50:06.101379 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:06.101357    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-79cdcc45d4-fgxfc"]
Jul 11 07:50:07.071098 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:07.071065    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79c24611-467b-4aaa-8514-b54c765675aa" path="/var/lib/kubelet/pods/79c24611-467b-4aaa-8514-b54c765675aa/volumes"
Jul 11 07:50:25.342287 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:25.342253    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-fbb8fb6cd-hl87x"]
Jul 11 07:50:25.342755 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:25.342605    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79c24611-467b-4aaa-8514-b54c765675aa" containerName="manager"
Jul 11 07:50:25.342755 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:25.342618    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="79c24611-467b-4aaa-8514-b54c765675aa" containerName="manager"
Jul 11 07:50:25.342755 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:25.342673    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="79c24611-467b-4aaa-8514-b54c765675aa" containerName="manager"
Jul 11 07:50:25.346946 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:25.346927    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-fbb8fb6cd-hl87x"
Jul 11 07:50:25.349354 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:25.349319    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-jhxtl\""
Jul 11 07:50:25.349433 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:25.349341    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 11 07:50:25.357720 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:25.357693    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-fbb8fb6cd-hl87x"]
Jul 11 07:50:25.415316 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:25.415274    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e664305-fa22-4192-9f0f-0018360a7647-maas-api-tls\") pod \"maas-api-fbb8fb6cd-hl87x\" (UID: \"3e664305-fa22-4192-9f0f-0018360a7647\") " pod="odh-ai-gateway-infra/maas-api-fbb8fb6cd-hl87x"
Jul 11 07:50:25.415316 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:25.415316    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e664305-fa22-4192-9f0f-0018360a7647-openshift-service-ca\") pod \"maas-api-fbb8fb6cd-hl87x\" (UID: \"3e664305-fa22-4192-9f0f-0018360a7647\") " pod="odh-ai-gateway-infra/maas-api-fbb8fb6cd-hl87x"
Jul 11 07:50:25.415558 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:25.415401    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85vtc\" (UniqueName: \"kubernetes.io/projected/3e664305-fa22-4192-9f0f-0018360a7647-kube-api-access-85vtc\") pod \"maas-api-fbb8fb6cd-hl87x\" (UID: \"3e664305-fa22-4192-9f0f-0018360a7647\") " pod="odh-ai-gateway-infra/maas-api-fbb8fb6cd-hl87x"
Jul 11 07:50:25.516571 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:25.516533    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e664305-fa22-4192-9f0f-0018360a7647-maas-api-tls\") pod \"maas-api-fbb8fb6cd-hl87x\" (UID: \"3e664305-fa22-4192-9f0f-0018360a7647\") " pod="odh-ai-gateway-infra/maas-api-fbb8fb6cd-hl87x"
Jul 11 07:50:25.516571 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:25.516572    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e664305-fa22-4192-9f0f-0018360a7647-openshift-service-ca\") pod \"maas-api-fbb8fb6cd-hl87x\" (UID: \"3e664305-fa22-4192-9f0f-0018360a7647\") " pod="odh-ai-gateway-infra/maas-api-fbb8fb6cd-hl87x"
Jul 11 07:50:25.516856 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:25.516593    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85vtc\" (UniqueName: \"kubernetes.io/projected/3e664305-fa22-4192-9f0f-0018360a7647-kube-api-access-85vtc\") pod \"maas-api-fbb8fb6cd-hl87x\" (UID: \"3e664305-fa22-4192-9f0f-0018360a7647\") " pod="odh-ai-gateway-infra/maas-api-fbb8fb6cd-hl87x"
Jul 11 07:50:25.516856 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:50:25.516707    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 11 07:50:25.516856 ip-10-0-142-153 kubenswrapper[2568]: E0711 07:50:25.516788    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e664305-fa22-4192-9f0f-0018360a7647-maas-api-tls podName:3e664305-fa22-4192-9f0f-0018360a7647 nodeName:}" failed. No retries permitted until 2026-07-11 07:50:26.016768494 +0000 UTC m=+737.501518625 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3e664305-fa22-4192-9f0f-0018360a7647-maas-api-tls") pod "maas-api-fbb8fb6cd-hl87x" (UID: "3e664305-fa22-4192-9f0f-0018360a7647") : secret "maas-api-serving-cert" not found
Jul 11 07:50:25.517275 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:25.517256    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e664305-fa22-4192-9f0f-0018360a7647-openshift-service-ca\") pod \"maas-api-fbb8fb6cd-hl87x\" (UID: \"3e664305-fa22-4192-9f0f-0018360a7647\") " pod="odh-ai-gateway-infra/maas-api-fbb8fb6cd-hl87x"
Jul 11 07:50:25.524730 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:25.524708    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85vtc\" (UniqueName: \"kubernetes.io/projected/3e664305-fa22-4192-9f0f-0018360a7647-kube-api-access-85vtc\") pod \"maas-api-fbb8fb6cd-hl87x\" (UID: \"3e664305-fa22-4192-9f0f-0018360a7647\") " pod="odh-ai-gateway-infra/maas-api-fbb8fb6cd-hl87x"
Jul 11 07:50:25.875485 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:25.875449    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-h5dzn"]
Jul 11 07:50:25.878822 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:25.878805    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-h5dzn"
Jul 11 07:50:25.882165 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:25.882140    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 11 07:50:25.882288 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:25.882200    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-8qxnb\""
Jul 11 07:50:25.883372 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:25.883347    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-k5xdh"]
Jul 11 07:50:25.886261 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:25.886241    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-k5xdh"
Jul 11 07:50:25.893167 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:25.893145    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-h5dzn"]
Jul 11 07:50:25.897245 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:25.897211    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-k5xdh"]
Jul 11 07:50:25.920335 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:25.920285    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtzzv\" (UniqueName: \"kubernetes.io/projected/57513857-d1d2-4eb3-8e97-4e3dd5311e76-kube-api-access-wtzzv\") pod \"payload-pre-processing-74584bb9f8-h5dzn\" (UID: \"57513857-d1d2-4eb3-8e97-4e3dd5311e76\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-h5dzn"
Jul 11 07:50:25.920335 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:25.920336    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwfmb\" (UniqueName: \"kubernetes.io/projected/a3f3b33c-36f6-40dc-9cff-c4eec39f327c-kube-api-access-hwfmb\") pod \"payload-processing-f9b8d9b9b-k5xdh\" (UID: \"a3f3b33c-36f6-40dc-9cff-c4eec39f327c\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-k5xdh"
Jul 11 07:50:25.920583 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:25.920358    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57513857-d1d2-4eb3-8e97-4e3dd5311e76-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-h5dzn\" (UID: \"57513857-d1d2-4eb3-8e97-4e3dd5311e76\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-h5dzn"
Jul 11 07:50:25.920583 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:25.920440    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3f3b33c-36f6-40dc-9cff-c4eec39f327c-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-k5xdh\" (UID: \"a3f3b33c-36f6-40dc-9cff-c4eec39f327c\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-k5xdh"
Jul 11 07:50:26.021160 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:26.021125    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3f3b33c-36f6-40dc-9cff-c4eec39f327c-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-k5xdh\" (UID: \"a3f3b33c-36f6-40dc-9cff-c4eec39f327c\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-k5xdh"
Jul 11 07:50:26.021342 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:26.021184    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e664305-fa22-4192-9f0f-0018360a7647-maas-api-tls\") pod \"maas-api-fbb8fb6cd-hl87x\" (UID: \"3e664305-fa22-4192-9f0f-0018360a7647\") " pod="odh-ai-gateway-infra/maas-api-fbb8fb6cd-hl87x"
Jul 11 07:50:26.021342 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:26.021239    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtzzv\" (UniqueName: \"kubernetes.io/projected/57513857-d1d2-4eb3-8e97-4e3dd5311e76-kube-api-access-wtzzv\") pod \"payload-pre-processing-74584bb9f8-h5dzn\" (UID: \"57513857-d1d2-4eb3-8e97-4e3dd5311e76\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-h5dzn"
Jul 11 07:50:26.021342 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:26.021267    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwfmb\" (UniqueName: \"kubernetes.io/projected/a3f3b33c-36f6-40dc-9cff-c4eec39f327c-kube-api-access-hwfmb\") pod \"payload-processing-f9b8d9b9b-k5xdh\" (UID: \"a3f3b33c-36f6-40dc-9cff-c4eec39f327c\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-k5xdh"
Jul 11 07:50:26.021342 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:26.021300    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57513857-d1d2-4eb3-8e97-4e3dd5311e76-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-h5dzn\" (UID: \"57513857-d1d2-4eb3-8e97-4e3dd5311e76\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-h5dzn"
Jul 11 07:50:26.022076 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:26.022048    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3f3b33c-36f6-40dc-9cff-c4eec39f327c-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-k5xdh\" (UID: \"a3f3b33c-36f6-40dc-9cff-c4eec39f327c\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-k5xdh"
Jul 11 07:50:26.022203 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:26.022048    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57513857-d1d2-4eb3-8e97-4e3dd5311e76-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-h5dzn\" (UID: \"57513857-d1d2-4eb3-8e97-4e3dd5311e76\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-h5dzn"
Jul 11 07:50:26.024021 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:26.023996    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e664305-fa22-4192-9f0f-0018360a7647-maas-api-tls\") pod \"maas-api-fbb8fb6cd-hl87x\" (UID: \"3e664305-fa22-4192-9f0f-0018360a7647\") " pod="odh-ai-gateway-infra/maas-api-fbb8fb6cd-hl87x"
Jul 11 07:50:26.029899 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:26.029874    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtzzv\" (UniqueName: \"kubernetes.io/projected/57513857-d1d2-4eb3-8e97-4e3dd5311e76-kube-api-access-wtzzv\") pod \"payload-pre-processing-74584bb9f8-h5dzn\" (UID: \"57513857-d1d2-4eb3-8e97-4e3dd5311e76\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-h5dzn"
Jul 11 07:50:26.030169 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:26.030147    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwfmb\" (UniqueName: \"kubernetes.io/projected/a3f3b33c-36f6-40dc-9cff-c4eec39f327c-kube-api-access-hwfmb\") pod \"payload-processing-f9b8d9b9b-k5xdh\" (UID: \"a3f3b33c-36f6-40dc-9cff-c4eec39f327c\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-k5xdh"
Jul 11 07:50:26.189658 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:26.189579    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-h5dzn"
Jul 11 07:50:26.199648 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:26.199620    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-k5xdh"
Jul 11 07:50:26.257575 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:26.257151    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-fbb8fb6cd-hl87x"
Jul 11 07:50:26.340306 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:26.339267    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-h5dzn"]
Jul 11 07:50:26.363866 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:26.363436    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-k5xdh"]
Jul 11 07:50:26.366318 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:50:26.366275    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3f3b33c_36f6_40dc_9cff_c4eec39f327c.slice/crio-f67e41ed5b40e9cf3b0fbe9dba56d6088e16578ffc6b21d679537fa1802f0ef5 WatchSource:0}: Error finding container f67e41ed5b40e9cf3b0fbe9dba56d6088e16578ffc6b21d679537fa1802f0ef5: Status 404 returned error can't find the container with id f67e41ed5b40e9cf3b0fbe9dba56d6088e16578ffc6b21d679537fa1802f0ef5
Jul 11 07:50:26.419613 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:26.419513    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-fbb8fb6cd-hl87x"]
Jul 11 07:50:27.169233 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:27.169184    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-fbb8fb6cd-hl87x" event={"ID":"3e664305-fa22-4192-9f0f-0018360a7647","Type":"ContainerStarted","Data":"49665d65953f4ed6be6747122dfd669dae70f5a3ae1524f7301e59e8a942c960"}
Jul 11 07:50:27.171130 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:27.170986    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-k5xdh" event={"ID":"a3f3b33c-36f6-40dc-9cff-c4eec39f327c","Type":"ContainerStarted","Data":"f67e41ed5b40e9cf3b0fbe9dba56d6088e16578ffc6b21d679537fa1802f0ef5"}
Jul 11 07:50:27.172808 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:27.172774    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-h5dzn" event={"ID":"57513857-d1d2-4eb3-8e97-4e3dd5311e76","Type":"ContainerStarted","Data":"97075dd2fbf99fa1c2dd4d43a52767ed6c1d43dfd3e29c207a27b9c0eaece731"}
Jul 11 07:50:29.186657 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:29.186614    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-k5xdh" event={"ID":"a3f3b33c-36f6-40dc-9cff-c4eec39f327c","Type":"ContainerStarted","Data":"6e152e9bd75641cf2cd226d04eaa5cef7f77f6ccecfd9ff7f71e339f781f97da"}
Jul 11 07:50:29.187125 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:29.186740    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-k5xdh"
Jul 11 07:50:29.188617 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:29.188577    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-h5dzn" event={"ID":"57513857-d1d2-4eb3-8e97-4e3dd5311e76","Type":"ContainerStarted","Data":"7459b284b4ffb5085bebb181397ff678c8d1b2e951ac80dfb1d01c478e047dd4"}
Jul 11 07:50:29.188760 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:29.188733    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-h5dzn"
Jul 11 07:50:29.198686 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:29.190441    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-fbb8fb6cd-hl87x" event={"ID":"3e664305-fa22-4192-9f0f-0018360a7647","Type":"ContainerStarted","Data":"acb71e9a8c1f6bcb37bfec29a6d5c2be717c9efcd0e6757a192a5deb1f5ff6d8"}
Jul 11 07:50:29.198686 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:29.190911    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-fbb8fb6cd-hl87x"
Jul 11 07:50:29.206699 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:29.206636    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-k5xdh" podStartSLOduration=2.113655029 podStartE2EDuration="4.206616523s" totalImagesPullingTime="2.092961494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:50:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:50:29.20258744 +0000 UTC m=+740.687337566" watchObservedRunningTime="2026-07-11 07:50:29.206616523 +0000 UTC m=+740.691366656"
Jul 11 07:50:29.216776 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:29.216701    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-h5dzn" podStartSLOduration=2.096853522 podStartE2EDuration="4.216687063s" totalImagesPullingTime="2.119833541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:50:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:50:29.215977996 +0000 UTC m=+740.700728130" watchObservedRunningTime="2026-07-11 07:50:29.216687063 +0000 UTC m=+740.701437214"
Jul 11 07:50:29.231624 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:29.231572    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-fbb8fb6cd-hl87x" podStartSLOduration=2.198722479 podStartE2EDuration="4.231556222s" totalImagesPullingTime="2.032833743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:50:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:50:29.23083984 +0000 UTC m=+740.715589983" watchObservedRunningTime="2026-07-11 07:50:29.231556222 +0000 UTC m=+740.716306354"
Jul 11 07:50:33.211784 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:33.211702    2568 generic.go:356] "Generic (PLEG): container finished" podID="513e718d-c34e-495e-90b9-e52f6f6d85d9" containerID="12bc155ec5bdea6d302d438089d38b318c768df64cb860b8497b05abf1f7e9c1" exitCode=0
Jul 11 07:50:33.211784 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:33.211743    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj" event={"ID":"513e718d-c34e-495e-90b9-e52f6f6d85d9","Type":"ContainerDied","Data":"12bc155ec5bdea6d302d438089d38b318c768df64cb860b8497b05abf1f7e9c1"}
Jul 11 07:50:33.212193 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:33.212150    2568 scope.go:117] "RemoveContainer" containerID="12bc155ec5bdea6d302d438089d38b318c768df64cb860b8497b05abf1f7e9c1"
Jul 11 07:50:33.213057 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:33.213029    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 07:50:33.213111 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:33.213097    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 07:50:33.213144 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:33.213128    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 07:50:34.217513 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:34.217472    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj" event={"ID":"513e718d-c34e-495e-90b9-e52f6f6d85d9","Type":"ContainerStarted","Data":"496afad85ff84fba1fb5a4de74afb7bdde2fdb8fcf30c44e34a803be784ad7d5"}
Jul 11 07:50:34.277852 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:34.277811    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:50:34.278097 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:34.278076    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-t2jdj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body=
Jul 11 07:50:34.278145 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:34.278121    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj" podUID="513e718d-c34e-495e-90b9-e52f6f6d85d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused"
Jul 11 07:50:35.277491 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:35.277452    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-t2jdj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body=
Jul 11 07:50:35.277865 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:35.277518    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj" podUID="513e718d-c34e-495e-90b9-e52f6f6d85d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused"
Jul 11 07:50:36.211221 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:36.211191    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-fbb8fb6cd-hl87x"
Jul 11 07:50:36.277624 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:36.277591    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-t2jdj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body=
Jul 11 07:50:36.278003 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:36.277646    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj" podUID="513e718d-c34e-495e-90b9-e52f6f6d85d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused"
Jul 11 07:50:37.278354 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:37.278294    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-t2jdj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body=
Jul 11 07:50:37.278835 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:37.278389    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj" podUID="513e718d-c34e-495e-90b9-e52f6f6d85d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused"
Jul 11 07:50:38.280520 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:38.280489    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:50:38.281005 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:38.280763    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:50:38.281520 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:38.281503    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-t2jdj"
Jul 11 07:50:40.198898 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:40.198867    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-k5xdh"
Jul 11 07:50:40.199286 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:40.199048    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-h5dzn"
Jul 11 07:50:54.256095 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:54.256061    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cvdcs"]
Jul 11 07:50:54.260250 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:54.260228    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvdcs"
Jul 11 07:50:54.263693 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:54.263671    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 11 07:50:54.263819 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:54.263689    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 11 07:50:54.263819 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:54.263678    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wldk6\""
Jul 11 07:50:54.263819 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:54.263671    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 11 07:50:54.268792 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:54.268768    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cvdcs"]
Jul 11 07:50:54.384962 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:54.384930    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/886cccf6-b241-4d87-acb1-39f24e9cffdc-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvdcs\" (UID: \"886cccf6-b241-4d87-acb1-39f24e9cffdc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvdcs"
Jul 11 07:50:54.384962 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:54.384963    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/886cccf6-b241-4d87-acb1-39f24e9cffdc-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvdcs\" (UID: \"886cccf6-b241-4d87-acb1-39f24e9cffdc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvdcs"
Jul 11 07:50:54.385174 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:54.385045    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/886cccf6-b241-4d87-acb1-39f24e9cffdc-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvdcs\" (UID: \"886cccf6-b241-4d87-acb1-39f24e9cffdc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvdcs"
Jul 11 07:50:54.385174 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:54.385085    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jv9h\" (UniqueName: \"kubernetes.io/projected/886cccf6-b241-4d87-acb1-39f24e9cffdc-kube-api-access-2jv9h\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvdcs\" (UID: \"886cccf6-b241-4d87-acb1-39f24e9cffdc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvdcs"
Jul 11 07:50:54.385174 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:54.385111    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/886cccf6-b241-4d87-acb1-39f24e9cffdc-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvdcs\" (UID: \"886cccf6-b241-4d87-acb1-39f24e9cffdc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvdcs"
Jul 11 07:50:54.385174 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:54.385138    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/886cccf6-b241-4d87-acb1-39f24e9cffdc-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvdcs\" (UID: \"886cccf6-b241-4d87-acb1-39f24e9cffdc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvdcs"
Jul 11 07:50:54.486300 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:54.486264    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/886cccf6-b241-4d87-acb1-39f24e9cffdc-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvdcs\" (UID: \"886cccf6-b241-4d87-acb1-39f24e9cffdc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvdcs"
Jul 11 07:50:54.486488 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:54.486310    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jv9h\" (UniqueName: \"kubernetes.io/projected/886cccf6-b241-4d87-acb1-39f24e9cffdc-kube-api-access-2jv9h\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvdcs\" (UID: \"886cccf6-b241-4d87-acb1-39f24e9cffdc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvdcs"
Jul 11 07:50:54.486488 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:54.486453    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/886cccf6-b241-4d87-acb1-39f24e9cffdc-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvdcs\" (UID: \"886cccf6-b241-4d87-acb1-39f24e9cffdc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvdcs"
Jul 11 07:50:54.486562 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:54.486499    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/886cccf6-b241-4d87-acb1-39f24e9cffdc-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvdcs\" (UID: \"886cccf6-b241-4d87-acb1-39f24e9cffdc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvdcs"
Jul 11 07:50:54.486562 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:54.486545    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/886cccf6-b241-4d87-acb1-39f24e9cffdc-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvdcs\" (UID: \"886cccf6-b241-4d87-acb1-39f24e9cffdc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvdcs"
Jul 11 07:50:54.486663 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:54.486563    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/886cccf6-b241-4d87-acb1-39f24e9cffdc-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvdcs\" (UID: \"886cccf6-b241-4d87-acb1-39f24e9cffdc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvdcs"
Jul 11 07:50:54.486778 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:54.486756    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/886cccf6-b241-4d87-acb1-39f24e9cffdc-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvdcs\" (UID: \"886cccf6-b241-4d87-acb1-39f24e9cffdc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvdcs"
Jul 11 07:50:54.486845 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:54.486775    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/886cccf6-b241-4d87-acb1-39f24e9cffdc-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvdcs\" (UID: \"886cccf6-b241-4d87-acb1-39f24e9cffdc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvdcs"
Jul 11 07:50:54.486964 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:54.486946    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/886cccf6-b241-4d87-acb1-39f24e9cffdc-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvdcs\" (UID: \"886cccf6-b241-4d87-acb1-39f24e9cffdc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvdcs"
Jul 11 07:50:54.488792 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:54.488770    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/886cccf6-b241-4d87-acb1-39f24e9cffdc-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvdcs\" (UID: \"886cccf6-b241-4d87-acb1-39f24e9cffdc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvdcs"
Jul 11 07:50:54.489122 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:54.489104    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/886cccf6-b241-4d87-acb1-39f24e9cffdc-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvdcs\" (UID: \"886cccf6-b241-4d87-acb1-39f24e9cffdc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvdcs"
Jul 11 07:50:54.494043 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:54.494019    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jv9h\" (UniqueName: \"kubernetes.io/projected/886cccf6-b241-4d87-acb1-39f24e9cffdc-kube-api-access-2jv9h\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvdcs\" (UID: \"886cccf6-b241-4d87-acb1-39f24e9cffdc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvdcs"
Jul 11 07:50:54.571948 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:54.571905    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvdcs"
Jul 11 07:50:54.704891 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:54.704799    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cvdcs"]
Jul 11 07:50:54.707668 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:50:54.707635    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod886cccf6_b241_4d87_acb1_39f24e9cffdc.slice/crio-db7cdf0eb93e76bbde6ff70e095095ec663f1cb0eeac52f7668646e0615398c7 WatchSource:0}: Error finding container db7cdf0eb93e76bbde6ff70e095095ec663f1cb0eeac52f7668646e0615398c7: Status 404 returned error can't find the container with id db7cdf0eb93e76bbde6ff70e095095ec663f1cb0eeac52f7668646e0615398c7
Jul 11 07:50:55.307047 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:55.307009    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvdcs" event={"ID":"886cccf6-b241-4d87-acb1-39f24e9cffdc","Type":"ContainerStarted","Data":"db7cdf0eb93e76bbde6ff70e095095ec663f1cb0eeac52f7668646e0615398c7"}
Jul 11 07:50:56.314271 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:56.314222    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvdcs" event={"ID":"886cccf6-b241-4d87-acb1-39f24e9cffdc","Type":"ContainerStarted","Data":"d761aded9568611d9d0d47907a762df65bd3f094cdd95338e87e328366745a45"}
Jul 11 07:50:56.331000 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:50:56.330948    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvdcs" podStartSLOduration=1.362630496 podStartE2EDuration="2.330931954s" totalImagesPullingTime="968.301458ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:50:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:50:56.329534576 +0000 UTC m=+767.814284713" watchObservedRunningTime="2026-07-11 07:50:56.330931954 +0000 UTC m=+767.815682086"
Jul 11 07:51:04.572232 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:04.572196    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvdcs"
Jul 11 07:51:04.572701 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:04.572377    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvdcs"
Jul 11 07:51:04.585003 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:04.584977    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvdcs"
Jul 11 07:51:05.364218 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:05.364192    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvdcs"
Jul 11 07:51:27.757651 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:27.757610    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6"]
Jul 11 07:51:27.761359 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:27.761314    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6"
Jul 11 07:51:27.763579 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:27.763556    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 11 07:51:27.770562 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:27.770541    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6"]
Jul 11 07:51:27.854429 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:27.854382    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw4ng\" (UniqueName: \"kubernetes.io/projected/438be0e5-1d04-46f7-95bb-9c61bc8596f3-kube-api-access-vw4ng\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6\" (UID: \"438be0e5-1d04-46f7-95bb-9c61bc8596f3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6"
Jul 11 07:51:27.854627 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:27.854470    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/438be0e5-1d04-46f7-95bb-9c61bc8596f3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6\" (UID: \"438be0e5-1d04-46f7-95bb-9c61bc8596f3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6"
Jul 11 07:51:27.854627 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:27.854555    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/438be0e5-1d04-46f7-95bb-9c61bc8596f3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6\" (UID: \"438be0e5-1d04-46f7-95bb-9c61bc8596f3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6"
Jul 11 07:51:27.854627 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:27.854586    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/438be0e5-1d04-46f7-95bb-9c61bc8596f3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6\" (UID: \"438be0e5-1d04-46f7-95bb-9c61bc8596f3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6"
Jul 11 07:51:27.854627 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:27.854602    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/438be0e5-1d04-46f7-95bb-9c61bc8596f3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6\" (UID: \"438be0e5-1d04-46f7-95bb-9c61bc8596f3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6"
Jul 11 07:51:27.854839 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:27.854678    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/438be0e5-1d04-46f7-95bb-9c61bc8596f3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6\" (UID: \"438be0e5-1d04-46f7-95bb-9c61bc8596f3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6"
Jul 11 07:51:27.956138 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:27.956096    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/438be0e5-1d04-46f7-95bb-9c61bc8596f3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6\" (UID: \"438be0e5-1d04-46f7-95bb-9c61bc8596f3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6"
Jul 11 07:51:27.956138 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:27.956141    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/438be0e5-1d04-46f7-95bb-9c61bc8596f3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6\" (UID: \"438be0e5-1d04-46f7-95bb-9c61bc8596f3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6"
Jul 11 07:51:27.956406 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:27.956165    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/438be0e5-1d04-46f7-95bb-9c61bc8596f3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6\" (UID: \"438be0e5-1d04-46f7-95bb-9c61bc8596f3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6"
Jul 11 07:51:27.956406 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:27.956205    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/438be0e5-1d04-46f7-95bb-9c61bc8596f3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6\" (UID: \"438be0e5-1d04-46f7-95bb-9c61bc8596f3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6"
Jul 11 07:51:27.956406 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:27.956257    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw4ng\" (UniqueName: \"kubernetes.io/projected/438be0e5-1d04-46f7-95bb-9c61bc8596f3-kube-api-access-vw4ng\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6\" (UID: \"438be0e5-1d04-46f7-95bb-9c61bc8596f3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6"
Jul 11 07:51:27.956406 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:27.956283    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/438be0e5-1d04-46f7-95bb-9c61bc8596f3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6\" (UID: \"438be0e5-1d04-46f7-95bb-9c61bc8596f3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6"
Jul 11 07:51:27.956613 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:27.956588    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/438be0e5-1d04-46f7-95bb-9c61bc8596f3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6\" (UID: \"438be0e5-1d04-46f7-95bb-9c61bc8596f3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6"
Jul 11 07:51:27.956683 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:27.956656    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/438be0e5-1d04-46f7-95bb-9c61bc8596f3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6\" (UID: \"438be0e5-1d04-46f7-95bb-9c61bc8596f3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6"
Jul 11 07:51:27.956900 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:27.956873    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/438be0e5-1d04-46f7-95bb-9c61bc8596f3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6\" (UID: \"438be0e5-1d04-46f7-95bb-9c61bc8596f3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6"
Jul 11 07:51:27.958861 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:27.958812    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/438be0e5-1d04-46f7-95bb-9c61bc8596f3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6\" (UID: \"438be0e5-1d04-46f7-95bb-9c61bc8596f3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6"
Jul 11 07:51:27.959147 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:27.959121    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/438be0e5-1d04-46f7-95bb-9c61bc8596f3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6\" (UID: \"438be0e5-1d04-46f7-95bb-9c61bc8596f3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6"
Jul 11 07:51:27.964306 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:27.964279    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw4ng\" (UniqueName: \"kubernetes.io/projected/438be0e5-1d04-46f7-95bb-9c61bc8596f3-kube-api-access-vw4ng\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6\" (UID: \"438be0e5-1d04-46f7-95bb-9c61bc8596f3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6"
Jul 11 07:51:28.071546 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:28.071512    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6"
Jul 11 07:51:28.203730 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:28.203703    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6"]
Jul 11 07:51:28.206427 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:51:28.206397    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod438be0e5_1d04_46f7_95bb_9c61bc8596f3.slice/crio-369ccd8e864bbf1d10ce73db04fa6942cf99f18029832fcf2fcf50986905a21f WatchSource:0}: Error finding container 369ccd8e864bbf1d10ce73db04fa6942cf99f18029832fcf2fcf50986905a21f: Status 404 returned error can't find the container with id 369ccd8e864bbf1d10ce73db04fa6942cf99f18029832fcf2fcf50986905a21f
Jul 11 07:51:28.453733 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:28.453700    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6" event={"ID":"438be0e5-1d04-46f7-95bb-9c61bc8596f3","Type":"ContainerStarted","Data":"4e11966cf0b6fce36f86ad01176987279b8f90883809607b9d79d9fbf0490ac0"}
Jul 11 07:51:28.453926 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:28.453753    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6" event={"ID":"438be0e5-1d04-46f7-95bb-9c61bc8596f3","Type":"ContainerStarted","Data":"369ccd8e864bbf1d10ce73db04fa6942cf99f18029832fcf2fcf50986905a21f"}
Jul 11 07:51:28.470205 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:28.470121    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6" podStartSLOduration=1.296965294 podStartE2EDuration="1.470103949s" totalImagesPullingTime="173.138655ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:51:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:51:28.467786112 +0000 UTC m=+799.952536246" watchObservedRunningTime="2026-07-11 07:51:28.470103949 +0000 UTC m=+799.954854082"
Jul 11 07:51:38.071791 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:38.071696    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6"
Jul 11 07:51:38.071791 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:38.071757    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6"
Jul 11 07:51:38.084431 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:38.084403    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6"
Jul 11 07:51:38.518976 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:38.518890    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6"
Jul 11 07:51:40.046234 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:40.046183    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cc6v6"]
Jul 11 07:51:40.049685 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:40.049663    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cc6v6"
Jul 11 07:51:40.051921 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:40.051895    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 11 07:51:40.059190 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:40.059165    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cc6v6"]
Jul 11 07:51:40.164956 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:40.164922    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/080bc059-4111-41f4-8fa6-ec0856bc0d45-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cc6v6\" (UID: \"080bc059-4111-41f4-8fa6-ec0856bc0d45\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cc6v6"
Jul 11 07:51:40.164956 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:40.164959    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/080bc059-4111-41f4-8fa6-ec0856bc0d45-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cc6v6\" (UID: \"080bc059-4111-41f4-8fa6-ec0856bc0d45\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cc6v6"
Jul 11 07:51:40.165173 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:40.164983    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/080bc059-4111-41f4-8fa6-ec0856bc0d45-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cc6v6\" (UID: \"080bc059-4111-41f4-8fa6-ec0856bc0d45\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cc6v6"
Jul 11 07:51:40.165173 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:40.165072    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/080bc059-4111-41f4-8fa6-ec0856bc0d45-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cc6v6\" (UID: \"080bc059-4111-41f4-8fa6-ec0856bc0d45\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cc6v6"
Jul 11 07:51:40.165173 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:40.165112    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/080bc059-4111-41f4-8fa6-ec0856bc0d45-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cc6v6\" (UID: \"080bc059-4111-41f4-8fa6-ec0856bc0d45\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cc6v6"
Jul 11 07:51:40.165173 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:40.165135    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68mmf\" (UniqueName: \"kubernetes.io/projected/080bc059-4111-41f4-8fa6-ec0856bc0d45-kube-api-access-68mmf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cc6v6\" (UID: \"080bc059-4111-41f4-8fa6-ec0856bc0d45\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cc6v6"
Jul 11 07:51:40.266535 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:40.266500    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/080bc059-4111-41f4-8fa6-ec0856bc0d45-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cc6v6\" (UID: \"080bc059-4111-41f4-8fa6-ec0856bc0d45\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cc6v6"
Jul 11 07:51:40.266535 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:40.266538    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/080bc059-4111-41f4-8fa6-ec0856bc0d45-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cc6v6\" (UID: \"080bc059-4111-41f4-8fa6-ec0856bc0d45\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cc6v6"
Jul 11 07:51:40.266777 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:40.266562    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68mmf\" (UniqueName: \"kubernetes.io/projected/080bc059-4111-41f4-8fa6-ec0856bc0d45-kube-api-access-68mmf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cc6v6\" (UID: \"080bc059-4111-41f4-8fa6-ec0856bc0d45\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cc6v6"
Jul 11 07:51:40.266777 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:40.266617    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/080bc059-4111-41f4-8fa6-ec0856bc0d45-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cc6v6\" (UID: \"080bc059-4111-41f4-8fa6-ec0856bc0d45\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cc6v6"
Jul 11 07:51:40.266777 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:40.266632    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/080bc059-4111-41f4-8fa6-ec0856bc0d45-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cc6v6\" (UID: \"080bc059-4111-41f4-8fa6-ec0856bc0d45\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cc6v6"
Jul 11 07:51:40.266777 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:40.266661    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/080bc059-4111-41f4-8fa6-ec0856bc0d45-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cc6v6\" (UID: \"080bc059-4111-41f4-8fa6-ec0856bc0d45\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cc6v6"
Jul 11 07:51:40.267023 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:40.266996    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/080bc059-4111-41f4-8fa6-ec0856bc0d45-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cc6v6\" (UID: \"080bc059-4111-41f4-8fa6-ec0856bc0d45\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cc6v6"
Jul 11 07:51:40.267152 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:40.267032    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/080bc059-4111-41f4-8fa6-ec0856bc0d45-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cc6v6\" (UID: \"080bc059-4111-41f4-8fa6-ec0856bc0d45\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cc6v6"
Jul 11 07:51:40.267152 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:40.267066    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/080bc059-4111-41f4-8fa6-ec0856bc0d45-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cc6v6\" (UID: \"080bc059-4111-41f4-8fa6-ec0856bc0d45\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cc6v6"
Jul 11 07:51:40.268976 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:40.268954    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/080bc059-4111-41f4-8fa6-ec0856bc0d45-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cc6v6\" (UID: \"080bc059-4111-41f4-8fa6-ec0856bc0d45\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cc6v6"
Jul 11 07:51:40.269266 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:40.269244    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/080bc059-4111-41f4-8fa6-ec0856bc0d45-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cc6v6\" (UID: \"080bc059-4111-41f4-8fa6-ec0856bc0d45\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cc6v6"
Jul 11 07:51:40.273740 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:40.273716    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68mmf\" (UniqueName: \"kubernetes.io/projected/080bc059-4111-41f4-8fa6-ec0856bc0d45-kube-api-access-68mmf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cc6v6\" (UID: \"080bc059-4111-41f4-8fa6-ec0856bc0d45\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cc6v6"
Jul 11 07:51:40.363130 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:40.363038    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cc6v6"
Jul 11 07:51:40.499968 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:40.499898    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cc6v6"]
Jul 11 07:51:40.502516 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:51:40.502487    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod080bc059_4111_41f4_8fa6_ec0856bc0d45.slice/crio-5f94fe14b8498f3f91e448869f6fc6c10b8fce389734032333135fce5afbbd46 WatchSource:0}: Error finding container 5f94fe14b8498f3f91e448869f6fc6c10b8fce389734032333135fce5afbbd46: Status 404 returned error can't find the container with id 5f94fe14b8498f3f91e448869f6fc6c10b8fce389734032333135fce5afbbd46
Jul 11 07:51:40.518524 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:40.518487    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cc6v6" event={"ID":"080bc059-4111-41f4-8fa6-ec0856bc0d45","Type":"ContainerStarted","Data":"5f94fe14b8498f3f91e448869f6fc6c10b8fce389734032333135fce5afbbd46"}
Jul 11 07:51:41.524359 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:41.524311    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cc6v6" event={"ID":"080bc059-4111-41f4-8fa6-ec0856bc0d45","Type":"ContainerStarted","Data":"87c52ac092e638fa6f6865942afcb8f924d1358e79341faf7bb51f19999d80dc"}
Jul 11 07:51:41.541571 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:41.541521    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cc6v6" podStartSLOduration=1.3808989870000001 podStartE2EDuration="1.541503473s" totalImagesPullingTime="160.604486ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:51:41.539746321 +0000 UTC m=+813.024496453" watchObservedRunningTime="2026-07-11 07:51:41.541503473 +0000 UTC m=+813.026253606"
Jul 11 07:51:50.364159 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:50.364117    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cc6v6"
Jul 11 07:51:50.364612 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:50.364183    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cc6v6"
Jul 11 07:51:50.376647 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:50.376613    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cc6v6"
Jul 11 07:51:50.576453 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:51:50.576421    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cc6v6"
Jul 11 07:54:23.119348 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:23.119285    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9c5f5fdd9-qnhlv"]
Jul 11 07:54:23.119899 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:23.119508    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-9c5f5fdd9-qnhlv" podUID="90498293-3575-424e-97e5-5657df13f266" containerName="manager" containerID="cri-o://afd22f558f9b9fea2e611852d418df916007ab9960568d3ddbee70dcffee2e3f" gracePeriod=30
Jul 11 07:54:23.242250 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:23.242220    2568 generic.go:356] "Generic (PLEG): container finished" podID="90498293-3575-424e-97e5-5657df13f266" containerID="afd22f558f9b9fea2e611852d418df916007ab9960568d3ddbee70dcffee2e3f" exitCode=0
Jul 11 07:54:23.242404 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:23.242299    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9c5f5fdd9-qnhlv" event={"ID":"90498293-3575-424e-97e5-5657df13f266","Type":"ContainerDied","Data":"afd22f558f9b9fea2e611852d418df916007ab9960568d3ddbee70dcffee2e3f"}
Jul 11 07:54:23.373940 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:23.373852    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9c5f5fdd9-qnhlv"
Jul 11 07:54:23.496941 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:23.496904    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xx2lw\" (UniqueName: \"kubernetes.io/projected/90498293-3575-424e-97e5-5657df13f266-kube-api-access-xx2lw\") pod \"90498293-3575-424e-97e5-5657df13f266\" (UID: \"90498293-3575-424e-97e5-5657df13f266\") "
Jul 11 07:54:23.497104 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:23.496991    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90498293-3575-424e-97e5-5657df13f266-webhook-cert\") pod \"90498293-3575-424e-97e5-5657df13f266\" (UID: \"90498293-3575-424e-97e5-5657df13f266\") "
Jul 11 07:54:23.499035 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:23.499003    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90498293-3575-424e-97e5-5657df13f266-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "90498293-3575-424e-97e5-5657df13f266" (UID: "90498293-3575-424e-97e5-5657df13f266"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 07:54:23.499035 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:23.499019    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90498293-3575-424e-97e5-5657df13f266-kube-api-access-xx2lw" (OuterVolumeSpecName: "kube-api-access-xx2lw") pod "90498293-3575-424e-97e5-5657df13f266" (UID: "90498293-3575-424e-97e5-5657df13f266"). InnerVolumeSpecName "kube-api-access-xx2lw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 07:54:23.597886 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:23.597827    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xx2lw\" (UniqueName: \"kubernetes.io/projected/90498293-3575-424e-97e5-5657df13f266-kube-api-access-xx2lw\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:54:23.597886 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:23.597863    2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90498293-3575-424e-97e5-5657df13f266-webhook-cert\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 07:54:24.248186 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:24.248154    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9c5f5fdd9-qnhlv"
Jul 11 07:54:24.248611 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:24.248192    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9c5f5fdd9-qnhlv" event={"ID":"90498293-3575-424e-97e5-5657df13f266","Type":"ContainerDied","Data":"19b8a51f4f6c3a8a142c4d718b02e5c8eae493a899515cbe98a8747806cc03a1"}
Jul 11 07:54:24.248611 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:24.248257    2568 scope.go:117] "RemoveContainer" containerID="afd22f558f9b9fea2e611852d418df916007ab9960568d3ddbee70dcffee2e3f"
Jul 11 07:54:24.270248 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:24.270213    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9c5f5fdd9-qnhlv"]
Jul 11 07:54:24.278140 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:24.275786    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-9c5f5fdd9-qnhlv"]
Jul 11 07:54:25.022551 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:25.022513    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9c5f5fdd9-csjnx"]
Jul 11 07:54:25.022894 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:25.022882    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90498293-3575-424e-97e5-5657df13f266" containerName="manager"
Jul 11 07:54:25.022936 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:25.022896    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="90498293-3575-424e-97e5-5657df13f266" containerName="manager"
Jul 11 07:54:25.022969 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:25.022950    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="90498293-3575-424e-97e5-5657df13f266" containerName="manager"
Jul 11 07:54:25.026967 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:25.026947    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9c5f5fdd9-csjnx"
Jul 11 07:54:25.030104 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:25.030075    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 11 07:54:25.030251 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:25.030118    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-v2kbp\""
Jul 11 07:54:25.030251 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:25.030084    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 11 07:54:25.033052 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:25.033025    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9c5f5fdd9-csjnx"]
Jul 11 07:54:25.071926 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:25.071892    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90498293-3575-424e-97e5-5657df13f266" path="/var/lib/kubelet/pods/90498293-3575-424e-97e5-5657df13f266/volumes"
Jul 11 07:54:25.113426 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:25.113389    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5331f330-43fa-4495-999b-e7580c09978c-webhook-cert\") pod \"maas-controller-9c5f5fdd9-csjnx\" (UID: \"5331f330-43fa-4495-999b-e7580c09978c\") " pod="opendatahub/maas-controller-9c5f5fdd9-csjnx"
Jul 11 07:54:25.113578 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:25.113441    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pzc6\" (UniqueName: \"kubernetes.io/projected/5331f330-43fa-4495-999b-e7580c09978c-kube-api-access-4pzc6\") pod \"maas-controller-9c5f5fdd9-csjnx\" (UID: \"5331f330-43fa-4495-999b-e7580c09978c\") " pod="opendatahub/maas-controller-9c5f5fdd9-csjnx"
Jul 11 07:54:25.214139 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:25.214105    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pzc6\" (UniqueName: \"kubernetes.io/projected/5331f330-43fa-4495-999b-e7580c09978c-kube-api-access-4pzc6\") pod \"maas-controller-9c5f5fdd9-csjnx\" (UID: \"5331f330-43fa-4495-999b-e7580c09978c\") " pod="opendatahub/maas-controller-9c5f5fdd9-csjnx"
Jul 11 07:54:25.214319 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:25.214200    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5331f330-43fa-4495-999b-e7580c09978c-webhook-cert\") pod \"maas-controller-9c5f5fdd9-csjnx\" (UID: \"5331f330-43fa-4495-999b-e7580c09978c\") " pod="opendatahub/maas-controller-9c5f5fdd9-csjnx"
Jul 11 07:54:25.216621 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:25.216597    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5331f330-43fa-4495-999b-e7580c09978c-webhook-cert\") pod \"maas-controller-9c5f5fdd9-csjnx\" (UID: \"5331f330-43fa-4495-999b-e7580c09978c\") " pod="opendatahub/maas-controller-9c5f5fdd9-csjnx"
Jul 11 07:54:25.221463 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:25.221439    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pzc6\" (UniqueName: \"kubernetes.io/projected/5331f330-43fa-4495-999b-e7580c09978c-kube-api-access-4pzc6\") pod \"maas-controller-9c5f5fdd9-csjnx\" (UID: \"5331f330-43fa-4495-999b-e7580c09978c\") " pod="opendatahub/maas-controller-9c5f5fdd9-csjnx"
Jul 11 07:54:25.337900 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:25.337861    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9c5f5fdd9-csjnx"
Jul 11 07:54:25.471541 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:25.471504    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9c5f5fdd9-csjnx"]
Jul 11 07:54:25.475462 ip-10-0-142-153 kubenswrapper[2568]: W0711 07:54:25.475435    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5331f330_43fa_4495_999b_e7580c09978c.slice/crio-0cc166aee51160d55c8ce9b01e580338a519885201d319f1a30dd38ab758b8a5 WatchSource:0}: Error finding container 0cc166aee51160d55c8ce9b01e580338a519885201d319f1a30dd38ab758b8a5: Status 404 returned error can't find the container with id 0cc166aee51160d55c8ce9b01e580338a519885201d319f1a30dd38ab758b8a5
Jul 11 07:54:26.259696 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:26.259605    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9c5f5fdd9-csjnx" event={"ID":"5331f330-43fa-4495-999b-e7580c09978c","Type":"ContainerStarted","Data":"e3baeb60be371fdb2076ba4c9c71df65ca7037f91e75b97315b9ea53daad17e8"}
Jul 11 07:54:26.259696 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:26.259667    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9c5f5fdd9-csjnx"
Jul 11 07:54:26.259696 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:26.259683    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9c5f5fdd9-csjnx" event={"ID":"5331f330-43fa-4495-999b-e7580c09978c","Type":"ContainerStarted","Data":"0cc166aee51160d55c8ce9b01e580338a519885201d319f1a30dd38ab758b8a5"}
Jul 11 07:54:26.275737 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:26.275683    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9c5f5fdd9-csjnx" podStartSLOduration=0.852679281 podStartE2EDuration="1.27566733s" totalImagesPullingTime="422.988049ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 07:54:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 07:54:26.27461945 +0000 UTC m=+977.759369582" watchObservedRunningTime="2026-07-11 07:54:26.27566733 +0000 UTC m=+977.760417462"
Jul 11 07:54:37.266246 ip-10-0-142-153 kubenswrapper[2568]: I0711 07:54:37.266163    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9c5f5fdd9-csjnx"
Jul 11 08:06:11.580478 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.580446    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"]
Jul 11 08:06:11.584035 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.584008    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:11.586436 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.586415    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-8bc07405-openshift-default-dockercfg-fdwrg\""
Jul 11 08:06:11.606977 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.606939    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"]
Jul 11 08:06:11.660602 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.660571    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-istio-data\") pod \"e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") " pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:11.660602 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.660604    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnnpm\" (UniqueName: \"kubernetes.io/projected/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-kube-api-access-jnnpm\") pod \"e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") " pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:11.660832 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.660626    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-workload-socket\") pod \"e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") " pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:11.660832 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.660650    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-credential-socket\") pod \"e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") " pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:11.660832 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.660700    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-istio-token\") pod \"e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") " pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:11.660832 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.660814    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-istio-envoy\") pod \"e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") " pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:11.660987 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.660838    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-workload-certs\") pod \"e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") " pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:11.660987 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.660865    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-istio-podinfo\") pod \"e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") " pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:11.660987 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.660912    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-istiod-ca-cert\") pod \"e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") " pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:11.762141 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.762111    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-istio-data\") pod \"e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") " pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:11.762141 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.762145    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnnpm\" (UniqueName: \"kubernetes.io/projected/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-kube-api-access-jnnpm\") pod \"e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") " pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:11.762441 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.762165    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-workload-socket\") pod \"e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") " pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:11.762441 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.762190    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-credential-socket\") pod \"e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") " pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:11.762441 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.762212    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-istio-token\") pod \"e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") " pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:11.762441 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.762242    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-istio-envoy\") pod \"e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") " pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:11.762441 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.762270    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-workload-certs\") pod \"e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") " pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:11.762441 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.762305    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-istio-podinfo\") pod \"e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") " pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:11.762441 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.762374    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-istiod-ca-cert\") pod \"e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") " pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:11.762855 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.762561    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-istio-data\") pod \"e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") " pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:11.762855 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.762621    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-credential-socket\") pod \"e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") " pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:11.762855 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.762660    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-workload-socket\") pod \"e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") " pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:11.762855 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.762765    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-workload-certs\") pod \"e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") " pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:11.763045 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.762938    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-istiod-ca-cert\") pod \"e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") " pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:11.764543 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.764524    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-istio-envoy\") pod \"e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") " pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:11.764833 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.764815    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-istio-podinfo\") pod \"e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") " pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:11.769690 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.769668    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnnpm\" (UniqueName: \"kubernetes.io/projected/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-kube-api-access-jnnpm\") pod \"e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") " pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:11.769690 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.769686    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-istio-token\") pod \"e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") " pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:11.893892 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:11.893810    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:12.028369 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:12.028345    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"]
Jul 11 08:06:12.030616 ip-10-0-142-153 kubenswrapper[2568]: W0711 08:06:12.030593    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6856750f_f64c_4d50_8dba_37c5d4b0c5bf.slice/crio-bb68a333efcd67f6d8c3eec93bb0022631e750c915d75c4c879a928f2d6f4749 WatchSource:0}: Error finding container bb68a333efcd67f6d8c3eec93bb0022631e750c915d75c4c879a928f2d6f4749: Status 404 returned error can't find the container with id bb68a333efcd67f6d8c3eec93bb0022631e750c915d75c4c879a928f2d6f4749
Jul 11 08:06:12.033175 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:12.033138    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:06:12.033273 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:12.033223    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:06:12.033358 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:12.033271    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:06:12.420570 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:12.420535    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5" event={"ID":"6856750f-f64c-4d50-8dba-37c5d4b0c5bf","Type":"ContainerStarted","Data":"ec0975112581aeb3fc5a0cb43fc81cb21321344fd52b14790c387cbb48997ba2"}
Jul 11 08:06:12.420746 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:12.420585    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5" event={"ID":"6856750f-f64c-4d50-8dba-37c5d4b0c5bf","Type":"ContainerStarted","Data":"bb68a333efcd67f6d8c3eec93bb0022631e750c915d75c4c879a928f2d6f4749"}
Jul 11 08:06:12.439381 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:12.439317    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5" podStartSLOduration=1.439302586 podStartE2EDuration="1.439302586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 08:06:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 08:06:12.438247587 +0000 UTC m=+1683.922997723" watchObservedRunningTime="2026-07-11 08:06:12.439302586 +0000 UTC m=+1683.924052718"
Jul 11 08:06:12.893950 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:12.893902    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:13.900111 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:13.900084    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:14.429406 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:14.429372    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:14.430515 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:14.430493    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:23.469437 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:23.469411    2568 generic.go:356] "Generic (PLEG): container finished" podID="6856750f-f64c-4d50-8dba-37c5d4b0c5bf" containerID="ec0975112581aeb3fc5a0cb43fc81cb21321344fd52b14790c387cbb48997ba2" exitCode=0
Jul 11 08:06:23.469762 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:23.469482    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5" event={"ID":"6856750f-f64c-4d50-8dba-37c5d4b0c5bf","Type":"ContainerDied","Data":"ec0975112581aeb3fc5a0cb43fc81cb21321344fd52b14790c387cbb48997ba2"}
Jul 11 08:06:23.469846 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:23.469832    2568 scope.go:117] "RemoveContainer" containerID="ec0975112581aeb3fc5a0cb43fc81cb21321344fd52b14790c387cbb48997ba2"
Jul 11 08:06:23.470744 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:23.470715    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:06:23.470859 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:23.470781    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:06:23.470859 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:23.470814    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:06:24.475377 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:24.475317    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5" event={"ID":"6856750f-f64c-4d50-8dba-37c5d4b0c5bf","Type":"ContainerStarted","Data":"2607b5d0e9a6c4f31b5266a1126dfff8933bcfcdf7ca7cdb6386a2eb9bb0f2b0"}
Jul 11 08:06:24.894585 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:24.894553    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:24.895821 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:24.895784    2568 patch_prober.go:28] interesting pod/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 11 08:06:24.895952 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:24.895860    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5" podUID="6856750f-f64c-4d50-8dba-37c5d4b0c5bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 11 08:06:25.894777 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:25.894734    2568 patch_prober.go:28] interesting pod/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 11 08:06:25.895258 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:25.894799    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5" podUID="6856750f-f64c-4d50-8dba-37c5d4b0c5bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 11 08:06:26.894792 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:26.894753    2568 patch_prober.go:28] interesting pod/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 11 08:06:26.895406 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:26.895374    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5" podUID="6856750f-f64c-4d50-8dba-37c5d4b0c5bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 11 08:06:27.894603 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:27.894564    2568 patch_prober.go:28] interesting pod/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 11 08:06:27.894896 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:27.894867    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5" podUID="6856750f-f64c-4d50-8dba-37c5d4b0c5bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 11 08:06:28.898746 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:28.898713    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:28.899111 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:28.898988    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:06:28.899654 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:06:28.899636    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:07:33.059060 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:33.059019    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"]
Jul 11 08:07:33.059627 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:33.059257    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5" podUID="6856750f-f64c-4d50-8dba-37c5d4b0c5bf" containerName="istio-proxy" containerID="cri-o://2607b5d0e9a6c4f31b5266a1126dfff8933bcfcdf7ca7cdb6386a2eb9bb0f2b0" gracePeriod=30
Jul 11 08:07:35.023860 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:35.023821    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr"]
Jul 11 08:07:35.026859 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:35.026830    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr"
Jul 11 08:07:35.029310 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:35.029283    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-7f7e8a77-serving-cert\""
Jul 11 08:07:35.035371 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:35.035341    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr"]
Jul 11 08:07:35.073937 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:35.073905    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71cc9544-a088-4f59-8ab9-763d7e372a6d-openshift-service-ca\") pod \"maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr\" (UID: \"71cc9544-a088-4f59-8ab9-763d7e372a6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr"
Jul 11 08:07:35.074119 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:35.073966    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71cc9544-a088-4f59-8ab9-763d7e372a6d-maas-api-tls\") pod \"maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr\" (UID: \"71cc9544-a088-4f59-8ab9-763d7e372a6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr"
Jul 11 08:07:35.074119 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:35.074058    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m69wk\" (UniqueName: \"kubernetes.io/projected/71cc9544-a088-4f59-8ab9-763d7e372a6d-kube-api-access-m69wk\") pod \"maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr\" (UID: \"71cc9544-a088-4f59-8ab9-763d7e372a6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr"
Jul 11 08:07:35.174503 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:35.174473    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m69wk\" (UniqueName: \"kubernetes.io/projected/71cc9544-a088-4f59-8ab9-763d7e372a6d-kube-api-access-m69wk\") pod \"maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr\" (UID: \"71cc9544-a088-4f59-8ab9-763d7e372a6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr"
Jul 11 08:07:35.174683 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:35.174545    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71cc9544-a088-4f59-8ab9-763d7e372a6d-openshift-service-ca\") pod \"maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr\" (UID: \"71cc9544-a088-4f59-8ab9-763d7e372a6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr"
Jul 11 08:07:35.174683 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:35.174576    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71cc9544-a088-4f59-8ab9-763d7e372a6d-maas-api-tls\") pod \"maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr\" (UID: \"71cc9544-a088-4f59-8ab9-763d7e372a6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr"
Jul 11 08:07:35.175162 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:35.175142    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71cc9544-a088-4f59-8ab9-763d7e372a6d-openshift-service-ca\") pod \"maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr\" (UID: \"71cc9544-a088-4f59-8ab9-763d7e372a6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr"
Jul 11 08:07:35.177076 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:35.177056    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71cc9544-a088-4f59-8ab9-763d7e372a6d-maas-api-tls\") pod \"maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr\" (UID: \"71cc9544-a088-4f59-8ab9-763d7e372a6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr"
Jul 11 08:07:35.182435 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:35.182415    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m69wk\" (UniqueName: \"kubernetes.io/projected/71cc9544-a088-4f59-8ab9-763d7e372a6d-kube-api-access-m69wk\") pod \"maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr\" (UID: \"71cc9544-a088-4f59-8ab9-763d7e372a6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr"
Jul 11 08:07:35.339205 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:35.339175    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr"
Jul 11 08:07:35.479158 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:35.479120    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr"]
Jul 11 08:07:35.482259 ip-10-0-142-153 kubenswrapper[2568]: W0711 08:07:35.482232    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71cc9544_a088_4f59_8ab9_763d7e372a6d.slice/crio-a565e07f44d833045ed5a7e086f31c8dcc94959a40148e55eaca72e972ce4fc0 WatchSource:0}: Error finding container a565e07f44d833045ed5a7e086f31c8dcc94959a40148e55eaca72e972ce4fc0: Status 404 returned error can't find the container with id a565e07f44d833045ed5a7e086f31c8dcc94959a40148e55eaca72e972ce4fc0
Jul 11 08:07:35.483588 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:35.483570    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 08:07:35.792240 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:35.792141    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr" event={"ID":"71cc9544-a088-4f59-8ab9-763d7e372a6d","Type":"ContainerStarted","Data":"a565e07f44d833045ed5a7e086f31c8dcc94959a40148e55eaca72e972ce4fc0"}
Jul 11 08:07:36.798539 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:36.798504    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr" event={"ID":"71cc9544-a088-4f59-8ab9-763d7e372a6d","Type":"ContainerStarted","Data":"31eba311fe6fe848bc179bfad6da87db0e1f4f3001bbf35c522210546f0c2362"}
Jul 11 08:07:36.798912 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:36.798636    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr"
Jul 11 08:07:36.814755 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:36.814704    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr" podStartSLOduration=1.356334649 podStartE2EDuration="1.814687211s" totalImagesPullingTime="458.352562ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 08:07:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 08:07:36.813755623 +0000 UTC m=+1768.298505758" watchObservedRunningTime="2026-07-11 08:07:36.814687211 +0000 UTC m=+1768.299437346"
Jul 11 08:07:38.304290 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.304266    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:07:38.405002 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.404971    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-istio-podinfo\") pod \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") "
Jul 11 08:07:38.405193 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.405012    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnnpm\" (UniqueName: \"kubernetes.io/projected/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-kube-api-access-jnnpm\") pod \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") "
Jul 11 08:07:38.405193 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.405043    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-istio-data\") pod \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") "
Jul 11 08:07:38.405193 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.405062    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-credential-socket\") pod \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") "
Jul 11 08:07:38.405193 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.405078    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-istio-envoy\") pod \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") "
Jul 11 08:07:38.405193 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.405100    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-workload-socket\") pod \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") "
Jul 11 08:07:38.405193 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.405128    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-workload-certs\") pod \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") "
Jul 11 08:07:38.405537 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.405203    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-istiod-ca-cert\") pod \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") "
Jul 11 08:07:38.405537 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.405249    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-istio-token\") pod \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\" (UID: \"6856750f-f64c-4d50-8dba-37c5d4b0c5bf\") "
Jul 11 08:07:38.405537 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.405388    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6856750f-f64c-4d50-8dba-37c5d4b0c5bf" (UID: "6856750f-f64c-4d50-8dba-37c5d4b0c5bf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:07:38.405537 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.405512    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6856750f-f64c-4d50-8dba-37c5d4b0c5bf" (UID: "6856750f-f64c-4d50-8dba-37c5d4b0c5bf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:07:38.405537 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.405523    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6856750f-f64c-4d50-8dba-37c5d4b0c5bf" (UID: "6856750f-f64c-4d50-8dba-37c5d4b0c5bf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:07:38.405772 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.405640    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-credential-socket\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:07:38.405772 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.405662    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-workload-socket\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:07:38.405772 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.405711    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-workload-certs\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:07:38.405901 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.405803    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6856750f-f64c-4d50-8dba-37c5d4b0c5bf" (UID: "6856750f-f64c-4d50-8dba-37c5d4b0c5bf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 08:07:38.406016 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.405997    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-istio-data" (OuterVolumeSpecName: "istio-data") pod "6856750f-f64c-4d50-8dba-37c5d4b0c5bf" (UID: "6856750f-f64c-4d50-8dba-37c5d4b0c5bf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:07:38.407710 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.407689    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6856750f-f64c-4d50-8dba-37c5d4b0c5bf" (UID: "6856750f-f64c-4d50-8dba-37c5d4b0c5bf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 11 08:07:38.407710 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.407696    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6856750f-f64c-4d50-8dba-37c5d4b0c5bf" (UID: "6856750f-f64c-4d50-8dba-37c5d4b0c5bf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:07:38.407814 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.407712    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-istio-token" (OuterVolumeSpecName: "istio-token") pod "6856750f-f64c-4d50-8dba-37c5d4b0c5bf" (UID: "6856750f-f64c-4d50-8dba-37c5d4b0c5bf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 08:07:38.407814 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.407734    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-kube-api-access-jnnpm" (OuterVolumeSpecName: "kube-api-access-jnnpm") pod "6856750f-f64c-4d50-8dba-37c5d4b0c5bf" (UID: "6856750f-f64c-4d50-8dba-37c5d4b0c5bf"). InnerVolumeSpecName "kube-api-access-jnnpm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 08:07:38.506234 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.506199    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-istiod-ca-cert\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:07:38.506234 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.506226    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-istio-token\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:07:38.506234 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.506234    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-istio-podinfo\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:07:38.506234 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.506242    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnnpm\" (UniqueName: \"kubernetes.io/projected/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-kube-api-access-jnnpm\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:07:38.506514 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.506251    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-istio-data\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:07:38.506514 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.506260    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6856750f-f64c-4d50-8dba-37c5d4b0c5bf-istio-envoy\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:07:38.808743 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.808710    2568 generic.go:356] "Generic (PLEG): container finished" podID="6856750f-f64c-4d50-8dba-37c5d4b0c5bf" containerID="2607b5d0e9a6c4f31b5266a1126dfff8933bcfcdf7ca7cdb6386a2eb9bb0f2b0" exitCode=0
Jul 11 08:07:38.808915 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.808762    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"
Jul 11 08:07:38.808915 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.808804    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5" event={"ID":"6856750f-f64c-4d50-8dba-37c5d4b0c5bf","Type":"ContainerDied","Data":"2607b5d0e9a6c4f31b5266a1126dfff8933bcfcdf7ca7cdb6386a2eb9bb0f2b0"}
Jul 11 08:07:38.808915 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.808864    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5" event={"ID":"6856750f-f64c-4d50-8dba-37c5d4b0c5bf","Type":"ContainerDied","Data":"bb68a333efcd67f6d8c3eec93bb0022631e750c915d75c4c879a928f2d6f4749"}
Jul 11 08:07:38.808915 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.808895    2568 scope.go:117] "RemoveContainer" containerID="2607b5d0e9a6c4f31b5266a1126dfff8933bcfcdf7ca7cdb6386a2eb9bb0f2b0"
Jul 11 08:07:38.818630 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.818612    2568 scope.go:117] "RemoveContainer" containerID="ec0975112581aeb3fc5a0cb43fc81cb21321344fd52b14790c387cbb48997ba2"
Jul 11 08:07:38.826683 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.826667    2568 scope.go:117] "RemoveContainer" containerID="2607b5d0e9a6c4f31b5266a1126dfff8933bcfcdf7ca7cdb6386a2eb9bb0f2b0"
Jul 11 08:07:38.826910 ip-10-0-142-153 kubenswrapper[2568]: E0711 08:07:38.826889    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2607b5d0e9a6c4f31b5266a1126dfff8933bcfcdf7ca7cdb6386a2eb9bb0f2b0\": container with ID starting with 2607b5d0e9a6c4f31b5266a1126dfff8933bcfcdf7ca7cdb6386a2eb9bb0f2b0 not found: ID does not exist" containerID="2607b5d0e9a6c4f31b5266a1126dfff8933bcfcdf7ca7cdb6386a2eb9bb0f2b0"
Jul 11 08:07:38.826989 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.826923    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2607b5d0e9a6c4f31b5266a1126dfff8933bcfcdf7ca7cdb6386a2eb9bb0f2b0"} err="failed to get container status \"2607b5d0e9a6c4f31b5266a1126dfff8933bcfcdf7ca7cdb6386a2eb9bb0f2b0\": rpc error: code = NotFound desc = could not find container \"2607b5d0e9a6c4f31b5266a1126dfff8933bcfcdf7ca7cdb6386a2eb9bb0f2b0\": container with ID starting with 2607b5d0e9a6c4f31b5266a1126dfff8933bcfcdf7ca7cdb6386a2eb9bb0f2b0 not found: ID does not exist"
Jul 11 08:07:38.826989 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.826948    2568 scope.go:117] "RemoveContainer" containerID="ec0975112581aeb3fc5a0cb43fc81cb21321344fd52b14790c387cbb48997ba2"
Jul 11 08:07:38.827195 ip-10-0-142-153 kubenswrapper[2568]: E0711 08:07:38.827177    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec0975112581aeb3fc5a0cb43fc81cb21321344fd52b14790c387cbb48997ba2\": container with ID starting with ec0975112581aeb3fc5a0cb43fc81cb21321344fd52b14790c387cbb48997ba2 not found: ID does not exist" containerID="ec0975112581aeb3fc5a0cb43fc81cb21321344fd52b14790c387cbb48997ba2"
Jul 11 08:07:38.827265 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.827201    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec0975112581aeb3fc5a0cb43fc81cb21321344fd52b14790c387cbb48997ba2"} err="failed to get container status \"ec0975112581aeb3fc5a0cb43fc81cb21321344fd52b14790c387cbb48997ba2\": rpc error: code = NotFound desc = could not find container \"ec0975112581aeb3fc5a0cb43fc81cb21321344fd52b14790c387cbb48997ba2\": container with ID starting with ec0975112581aeb3fc5a0cb43fc81cb21321344fd52b14790c387cbb48997ba2 not found: ID does not exist"
Jul 11 08:07:38.829513 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.829492    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"]
Jul 11 08:07:38.833428 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:38.833407    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-8bc07405-openshift-default-85b88696d5-vsrc5"]
Jul 11 08:07:39.071706 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:39.071631    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6856750f-f64c-4d50-8dba-37c5d4b0c5bf" path="/var/lib/kubelet/pods/6856750f-f64c-4d50-8dba-37c5d4b0c5bf/volumes"
Jul 11 08:07:42.808518 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:07:42.808492    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr"
Jul 11 08:08:44.831524 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:44.831485    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr"]
Jul 11 08:08:44.832064 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:44.831768    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr" podUID="71cc9544-a088-4f59-8ab9-763d7e372a6d" containerName="maas-api" containerID="cri-o://31eba311fe6fe848bc179bfad6da87db0e1f4f3001bbf35c522210546f0c2362" gracePeriod=30
Jul 11 08:08:45.095852 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:45.095825    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr"
Jul 11 08:08:45.107424 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:45.107397    2568 generic.go:356] "Generic (PLEG): container finished" podID="71cc9544-a088-4f59-8ab9-763d7e372a6d" containerID="31eba311fe6fe848bc179bfad6da87db0e1f4f3001bbf35c522210546f0c2362" exitCode=0
Jul 11 08:08:45.107541 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:45.107438    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr"
Jul 11 08:08:45.107541 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:45.107478    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr" event={"ID":"71cc9544-a088-4f59-8ab9-763d7e372a6d","Type":"ContainerDied","Data":"31eba311fe6fe848bc179bfad6da87db0e1f4f3001bbf35c522210546f0c2362"}
Jul 11 08:08:45.107541 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:45.107528    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr" event={"ID":"71cc9544-a088-4f59-8ab9-763d7e372a6d","Type":"ContainerDied","Data":"a565e07f44d833045ed5a7e086f31c8dcc94959a40148e55eaca72e972ce4fc0"}
Jul 11 08:08:45.107642 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:45.107550    2568 scope.go:117] "RemoveContainer" containerID="31eba311fe6fe848bc179bfad6da87db0e1f4f3001bbf35c522210546f0c2362"
Jul 11 08:08:45.121107 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:45.121087    2568 scope.go:117] "RemoveContainer" containerID="31eba311fe6fe848bc179bfad6da87db0e1f4f3001bbf35c522210546f0c2362"
Jul 11 08:08:45.121435 ip-10-0-142-153 kubenswrapper[2568]: E0711 08:08:45.121402    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31eba311fe6fe848bc179bfad6da87db0e1f4f3001bbf35c522210546f0c2362\": container with ID starting with 31eba311fe6fe848bc179bfad6da87db0e1f4f3001bbf35c522210546f0c2362 not found: ID does not exist" containerID="31eba311fe6fe848bc179bfad6da87db0e1f4f3001bbf35c522210546f0c2362"
Jul 11 08:08:45.121545 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:45.121450    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31eba311fe6fe848bc179bfad6da87db0e1f4f3001bbf35c522210546f0c2362"} err="failed to get container status \"31eba311fe6fe848bc179bfad6da87db0e1f4f3001bbf35c522210546f0c2362\": rpc error: code = NotFound desc = could not find container \"31eba311fe6fe848bc179bfad6da87db0e1f4f3001bbf35c522210546f0c2362\": container with ID starting with 31eba311fe6fe848bc179bfad6da87db0e1f4f3001bbf35c522210546f0c2362 not found: ID does not exist"
Jul 11 08:08:45.193600 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:45.193580    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71cc9544-a088-4f59-8ab9-763d7e372a6d-openshift-service-ca\") pod \"71cc9544-a088-4f59-8ab9-763d7e372a6d\" (UID: \"71cc9544-a088-4f59-8ab9-763d7e372a6d\") "
Jul 11 08:08:45.193702 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:45.193641    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71cc9544-a088-4f59-8ab9-763d7e372a6d-maas-api-tls\") pod \"71cc9544-a088-4f59-8ab9-763d7e372a6d\" (UID: \"71cc9544-a088-4f59-8ab9-763d7e372a6d\") "
Jul 11 08:08:45.193741 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:45.193710    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m69wk\" (UniqueName: \"kubernetes.io/projected/71cc9544-a088-4f59-8ab9-763d7e372a6d-kube-api-access-m69wk\") pod \"71cc9544-a088-4f59-8ab9-763d7e372a6d\" (UID: \"71cc9544-a088-4f59-8ab9-763d7e372a6d\") "
Jul 11 08:08:45.193977 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:45.193955    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71cc9544-a088-4f59-8ab9-763d7e372a6d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "71cc9544-a088-4f59-8ab9-763d7e372a6d" (UID: "71cc9544-a088-4f59-8ab9-763d7e372a6d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 08:08:45.195803 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:45.195786    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71cc9544-a088-4f59-8ab9-763d7e372a6d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "71cc9544-a088-4f59-8ab9-763d7e372a6d" (UID: "71cc9544-a088-4f59-8ab9-763d7e372a6d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 08:08:45.195803 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:45.195795    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71cc9544-a088-4f59-8ab9-763d7e372a6d-kube-api-access-m69wk" (OuterVolumeSpecName: "kube-api-access-m69wk") pod "71cc9544-a088-4f59-8ab9-763d7e372a6d" (UID: "71cc9544-a088-4f59-8ab9-763d7e372a6d"). InnerVolumeSpecName "kube-api-access-m69wk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 08:08:45.294830 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:45.294803    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71cc9544-a088-4f59-8ab9-763d7e372a6d-maas-api-tls\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:08:45.294830 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:45.294827    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m69wk\" (UniqueName: \"kubernetes.io/projected/71cc9544-a088-4f59-8ab9-763d7e372a6d-kube-api-access-m69wk\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:08:45.294830 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:45.294836    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71cc9544-a088-4f59-8ab9-763d7e372a6d-openshift-service-ca\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:08:45.427739 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:45.427708    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr"]
Jul 11 08:08:45.429964 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:45.429939    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7f7e8a77-6997d86fc6-228rr"]
Jul 11 08:08:47.072086 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:47.072049    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71cc9544-a088-4f59-8ab9-763d7e372a6d" path="/var/lib/kubelet/pods/71cc9544-a088-4f59-8ab9-763d7e372a6d/volumes"
Jul 11 08:08:51.297126 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.297095    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"]
Jul 11 08:08:51.297674 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.297598    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6856750f-f64c-4d50-8dba-37c5d4b0c5bf" containerName="istio-proxy"
Jul 11 08:08:51.297674 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.297617    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6856750f-f64c-4d50-8dba-37c5d4b0c5bf" containerName="istio-proxy"
Jul 11 08:08:51.297674 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.297651    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6856750f-f64c-4d50-8dba-37c5d4b0c5bf" containerName="istio-proxy"
Jul 11 08:08:51.297674 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.297659    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6856750f-f64c-4d50-8dba-37c5d4b0c5bf" containerName="istio-proxy"
Jul 11 08:08:51.297674 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.297669    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71cc9544-a088-4f59-8ab9-763d7e372a6d" containerName="maas-api"
Jul 11 08:08:51.297674 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.297677    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="71cc9544-a088-4f59-8ab9-763d7e372a6d" containerName="maas-api"
Jul 11 08:08:51.297967 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.297786    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6856750f-f64c-4d50-8dba-37c5d4b0c5bf" containerName="istio-proxy"
Jul 11 08:08:51.297967 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.297797    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6856750f-f64c-4d50-8dba-37c5d4b0c5bf" containerName="istio-proxy"
Jul 11 08:08:51.297967 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.297809    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="71cc9544-a088-4f59-8ab9-763d7e372a6d" containerName="maas-api"
Jul 11 08:08:51.302523 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.302503    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:51.304828 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.304809    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b0adf7bb-openshift-default-dockercfg-rzzjt\""
Jul 11 08:08:51.313563 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.313534    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"]
Jul 11 08:08:51.441231 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.441192    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnrkg\" (UniqueName: \"kubernetes.io/projected/d997e526-84d0-4b12-94ee-1248da43733e-kube-api-access-pnrkg\") pod \"e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") " pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:51.441231 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.441234    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d997e526-84d0-4b12-94ee-1248da43733e-istiod-ca-cert\") pod \"e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") " pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:51.441528 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.441275    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d997e526-84d0-4b12-94ee-1248da43733e-credential-socket\") pod \"e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") " pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:51.441528 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.441295    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d997e526-84d0-4b12-94ee-1248da43733e-istio-data\") pod \"e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") " pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:51.441528 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.441442    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d997e526-84d0-4b12-94ee-1248da43733e-workload-certs\") pod \"e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") " pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:51.441528 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.441479    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d997e526-84d0-4b12-94ee-1248da43733e-workload-socket\") pod \"e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") " pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:51.441528 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.441520    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d997e526-84d0-4b12-94ee-1248da43733e-istio-envoy\") pod \"e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") " pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:51.441719 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.441547    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d997e526-84d0-4b12-94ee-1248da43733e-istio-podinfo\") pod \"e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") " pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:51.441719 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.441572    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d997e526-84d0-4b12-94ee-1248da43733e-istio-token\") pod \"e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") " pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:51.542783 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.542729    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnrkg\" (UniqueName: \"kubernetes.io/projected/d997e526-84d0-4b12-94ee-1248da43733e-kube-api-access-pnrkg\") pod \"e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") " pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:51.542783 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.542784    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d997e526-84d0-4b12-94ee-1248da43733e-istiod-ca-cert\") pod \"e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") " pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:51.543042 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.542829    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d997e526-84d0-4b12-94ee-1248da43733e-credential-socket\") pod \"e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") " pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:51.543042 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.542851    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d997e526-84d0-4b12-94ee-1248da43733e-istio-data\") pod \"e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") " pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:51.543042 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.542922    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d997e526-84d0-4b12-94ee-1248da43733e-workload-certs\") pod \"e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") " pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:51.543042 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.542944    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d997e526-84d0-4b12-94ee-1248da43733e-workload-socket\") pod \"e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") " pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:51.543042 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.542977    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d997e526-84d0-4b12-94ee-1248da43733e-istio-envoy\") pod \"e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") " pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:51.543042 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.543006    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d997e526-84d0-4b12-94ee-1248da43733e-istio-podinfo\") pod \"e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") " pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:51.543042 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.543029    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d997e526-84d0-4b12-94ee-1248da43733e-istio-token\") pod \"e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") " pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:51.543423 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.543287    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d997e526-84d0-4b12-94ee-1248da43733e-credential-socket\") pod \"e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") " pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:51.543423 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.543380    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d997e526-84d0-4b12-94ee-1248da43733e-workload-socket\") pod \"e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") " pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:51.543585 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.543548    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d997e526-84d0-4b12-94ee-1248da43733e-workload-certs\") pod \"e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") " pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:51.543655 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.543558    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d997e526-84d0-4b12-94ee-1248da43733e-istio-data\") pod \"e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") " pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:51.543655 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.543635    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d997e526-84d0-4b12-94ee-1248da43733e-istiod-ca-cert\") pod \"e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") " pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:51.545511 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.545494    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d997e526-84d0-4b12-94ee-1248da43733e-istio-envoy\") pod \"e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") " pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:51.545714 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.545694    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d997e526-84d0-4b12-94ee-1248da43733e-istio-podinfo\") pod \"e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") " pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:51.549880 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.549821    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnrkg\" (UniqueName: \"kubernetes.io/projected/d997e526-84d0-4b12-94ee-1248da43733e-kube-api-access-pnrkg\") pod \"e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") " pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:51.549880 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.549853    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d997e526-84d0-4b12-94ee-1248da43733e-istio-token\") pod \"e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") " pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:51.615899 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.615862    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:51.751378 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.751262    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"]
Jul 11 08:08:51.755368 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.755311    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:08:51.755483 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.755410    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:08:51.755483 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:51.755456    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:08:52.141876 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:52.141775    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49" event={"ID":"d997e526-84d0-4b12-94ee-1248da43733e","Type":"ContainerStarted","Data":"c9b4d03aed02982f15f0c299977957421416edb67f16cfd1277a9e43c69ca6f8"}
Jul 11 08:08:52.141876 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:52.141844    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49" event={"ID":"d997e526-84d0-4b12-94ee-1248da43733e","Type":"ContainerStarted","Data":"0497a31e0388d9e621e4da2d79176c5d6530cf3b1afb56a8cafbca6ccad7e340"}
Jul 11 08:08:52.160642 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:52.160585    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49" podStartSLOduration=1.16056647 podStartE2EDuration="1.16056647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 08:08:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 08:08:52.159605237 +0000 UTC m=+1843.644355366" watchObservedRunningTime="2026-07-11 08:08:52.16056647 +0000 UTC m=+1843.645316614"
Jul 11 08:08:52.616987 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:52.616950    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:52.621675 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:52.621652    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:53.147189 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:53.147155    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:08:53.148202 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:08:53.148180    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:09:03.193844 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:09:03.193739    2568 generic.go:356] "Generic (PLEG): container finished" podID="d997e526-84d0-4b12-94ee-1248da43733e" containerID="c9b4d03aed02982f15f0c299977957421416edb67f16cfd1277a9e43c69ca6f8" exitCode=0
Jul 11 08:09:03.193844 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:09:03.193779    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49" event={"ID":"d997e526-84d0-4b12-94ee-1248da43733e","Type":"ContainerDied","Data":"c9b4d03aed02982f15f0c299977957421416edb67f16cfd1277a9e43c69ca6f8"}
Jul 11 08:09:03.194437 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:09:03.194232    2568 scope.go:117] "RemoveContainer" containerID="c9b4d03aed02982f15f0c299977957421416edb67f16cfd1277a9e43c69ca6f8"
Jul 11 08:09:03.195253 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:09:03.195223    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:09:03.195363 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:09:03.195289    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:09:03.195363 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:09:03.195346    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:09:04.204541 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:09:04.204473    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49" event={"ID":"d997e526-84d0-4b12-94ee-1248da43733e","Type":"ContainerStarted","Data":"ddf3495c473e7600ced7a106345939afc3dc0689758ca226296cebceeacab8d3"}
Jul 11 08:09:04.617007 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:09:04.616963    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:09:04.618003 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:09:04.617979    2568 patch_prober.go:28] interesting pod/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 11 08:09:04.618058 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:09:04.618037    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49" podUID="d997e526-84d0-4b12-94ee-1248da43733e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 11 08:09:05.616280 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:09:05.616239    2568 patch_prober.go:28] interesting pod/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 11 08:09:05.616699 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:09:05.616307    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49" podUID="d997e526-84d0-4b12-94ee-1248da43733e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 11 08:09:06.617250 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:09:06.617209    2568 patch_prober.go:28] interesting pod/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 11 08:09:06.617684 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:09:06.617282    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49" podUID="d997e526-84d0-4b12-94ee-1248da43733e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 11 08:09:07.616241 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:09:07.616192    2568 patch_prober.go:28] interesting pod/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 11 08:09:07.616464 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:09:07.616267    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49" podUID="d997e526-84d0-4b12-94ee-1248da43733e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 11 08:09:08.147511 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:09:08.147472    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:09:08.619971 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:09:08.619944    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:09:08.620850 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:09:08.620831    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:10:23.666399 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:23.666360    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"]
Jul 11 08:10:23.666861 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:23.666578    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49" podUID="d997e526-84d0-4b12-94ee-1248da43733e" containerName="istio-proxy" containerID="cri-o://ddf3495c473e7600ced7a106345939afc3dc0689758ca226296cebceeacab8d3" gracePeriod=30
Jul 11 08:10:25.146787 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:25.146754    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn"]
Jul 11 08:10:25.150227 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:25.150201    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn"
Jul 11 08:10:25.152631 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:25.152607    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-c12c06b3-serving-cert\""
Jul 11 08:10:25.161141 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:25.161115    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn"]
Jul 11 08:10:25.225537 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:25.225506    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5mgq\" (UniqueName: \"kubernetes.io/projected/9cba9020-131b-4078-9253-825c3991a9c9-kube-api-access-g5mgq\") pod \"maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn\" (UID: \"9cba9020-131b-4078-9253-825c3991a9c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn"
Jul 11 08:10:25.225705 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:25.225569    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cba9020-131b-4078-9253-825c3991a9c9-openshift-service-ca\") pod \"maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn\" (UID: \"9cba9020-131b-4078-9253-825c3991a9c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn"
Jul 11 08:10:25.225705 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:25.225605    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cba9020-131b-4078-9253-825c3991a9c9-maas-api-tls\") pod \"maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn\" (UID: \"9cba9020-131b-4078-9253-825c3991a9c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn"
Jul 11 08:10:25.326973 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:25.326943    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cba9020-131b-4078-9253-825c3991a9c9-openshift-service-ca\") pod \"maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn\" (UID: \"9cba9020-131b-4078-9253-825c3991a9c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn"
Jul 11 08:10:25.327144 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:25.326992    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cba9020-131b-4078-9253-825c3991a9c9-maas-api-tls\") pod \"maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn\" (UID: \"9cba9020-131b-4078-9253-825c3991a9c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn"
Jul 11 08:10:25.327144 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:25.327029    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5mgq\" (UniqueName: \"kubernetes.io/projected/9cba9020-131b-4078-9253-825c3991a9c9-kube-api-access-g5mgq\") pod \"maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn\" (UID: \"9cba9020-131b-4078-9253-825c3991a9c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn"
Jul 11 08:10:25.327665 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:25.327646    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cba9020-131b-4078-9253-825c3991a9c9-openshift-service-ca\") pod \"maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn\" (UID: \"9cba9020-131b-4078-9253-825c3991a9c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn"
Jul 11 08:10:25.329409 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:25.329385    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cba9020-131b-4078-9253-825c3991a9c9-maas-api-tls\") pod \"maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn\" (UID: \"9cba9020-131b-4078-9253-825c3991a9c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn"
Jul 11 08:10:25.340542 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:25.340521    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5mgq\" (UniqueName: \"kubernetes.io/projected/9cba9020-131b-4078-9253-825c3991a9c9-kube-api-access-g5mgq\") pod \"maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn\" (UID: \"9cba9020-131b-4078-9253-825c3991a9c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn"
Jul 11 08:10:25.462514 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:25.462437    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn"
Jul 11 08:10:25.593370 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:25.593302    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn"]
Jul 11 08:10:25.595679 ip-10-0-142-153 kubenswrapper[2568]: W0711 08:10:25.595650    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cba9020_131b_4078_9253_825c3991a9c9.slice/crio-420178635f2e26f535c30b4712a2a37019d0d8b627a5b24d1e52544ed819f34b WatchSource:0}: Error finding container 420178635f2e26f535c30b4712a2a37019d0d8b627a5b24d1e52544ed819f34b: Status 404 returned error can't find the container with id 420178635f2e26f535c30b4712a2a37019d0d8b627a5b24d1e52544ed819f34b
Jul 11 08:10:26.571775 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:26.571737    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn" event={"ID":"9cba9020-131b-4078-9253-825c3991a9c9","Type":"ContainerStarted","Data":"10c44fdadca4426cc7fb363e31804edb50de79d50bdbafecfd7932cd9145605e"}
Jul 11 08:10:26.572248 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:26.571796    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn" event={"ID":"9cba9020-131b-4078-9253-825c3991a9c9","Type":"ContainerStarted","Data":"420178635f2e26f535c30b4712a2a37019d0d8b627a5b24d1e52544ed819f34b"}
Jul 11 08:10:26.572248 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:26.571854    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn"
Jul 11 08:10:26.588869 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:26.588820    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn" podStartSLOduration=1.196132807 podStartE2EDuration="1.588807119s" totalImagesPullingTime="392.674312ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 08:10:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 08:10:26.586074407 +0000 UTC m=+1938.070824540" watchObservedRunningTime="2026-07-11 08:10:26.588807119 +0000 UTC m=+1938.073557252"
Jul 11 08:10:28.912148 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:28.912127    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:10:28.957845 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:28.957819    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d997e526-84d0-4b12-94ee-1248da43733e-istiod-ca-cert\") pod \"d997e526-84d0-4b12-94ee-1248da43733e\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") "
Jul 11 08:10:28.957943 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:28.957868    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d997e526-84d0-4b12-94ee-1248da43733e-workload-socket\") pod \"d997e526-84d0-4b12-94ee-1248da43733e\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") "
Jul 11 08:10:28.957943 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:28.957901    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d997e526-84d0-4b12-94ee-1248da43733e-istio-token\") pod \"d997e526-84d0-4b12-94ee-1248da43733e\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") "
Jul 11 08:10:28.957943 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:28.957923    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d997e526-84d0-4b12-94ee-1248da43733e-istio-data\") pod \"d997e526-84d0-4b12-94ee-1248da43733e\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") "
Jul 11 08:10:28.958096 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:28.957952    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d997e526-84d0-4b12-94ee-1248da43733e-istio-envoy\") pod \"d997e526-84d0-4b12-94ee-1248da43733e\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") "
Jul 11 08:10:28.958096 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:28.957983    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d997e526-84d0-4b12-94ee-1248da43733e-credential-socket\") pod \"d997e526-84d0-4b12-94ee-1248da43733e\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") "
Jul 11 08:10:28.958096 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:28.958018    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d997e526-84d0-4b12-94ee-1248da43733e-istio-podinfo\") pod \"d997e526-84d0-4b12-94ee-1248da43733e\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") "
Jul 11 08:10:28.958096 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:28.958061    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnrkg\" (UniqueName: \"kubernetes.io/projected/d997e526-84d0-4b12-94ee-1248da43733e-kube-api-access-pnrkg\") pod \"d997e526-84d0-4b12-94ee-1248da43733e\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") "
Jul 11 08:10:28.958281 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:28.958105    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d997e526-84d0-4b12-94ee-1248da43733e-workload-certs\") pod \"d997e526-84d0-4b12-94ee-1248da43733e\" (UID: \"d997e526-84d0-4b12-94ee-1248da43733e\") "
Jul 11 08:10:28.958281 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:28.958163    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d997e526-84d0-4b12-94ee-1248da43733e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d997e526-84d0-4b12-94ee-1248da43733e" (UID: "d997e526-84d0-4b12-94ee-1248da43733e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:10:28.958281 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:28.958257    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d997e526-84d0-4b12-94ee-1248da43733e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d997e526-84d0-4b12-94ee-1248da43733e" (UID: "d997e526-84d0-4b12-94ee-1248da43733e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 08:10:28.958575 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:28.958552    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d997e526-84d0-4b12-94ee-1248da43733e-istiod-ca-cert\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:10:28.958703 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:28.958586    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d997e526-84d0-4b12-94ee-1248da43733e-workload-socket\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:10:28.958703 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:28.958553    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d997e526-84d0-4b12-94ee-1248da43733e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d997e526-84d0-4b12-94ee-1248da43733e" (UID: "d997e526-84d0-4b12-94ee-1248da43733e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:10:28.958805 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:28.958753    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d997e526-84d0-4b12-94ee-1248da43733e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d997e526-84d0-4b12-94ee-1248da43733e" (UID: "d997e526-84d0-4b12-94ee-1248da43733e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:10:28.959103 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:28.959077    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d997e526-84d0-4b12-94ee-1248da43733e-istio-data" (OuterVolumeSpecName: "istio-data") pod "d997e526-84d0-4b12-94ee-1248da43733e" (UID: "d997e526-84d0-4b12-94ee-1248da43733e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:10:28.960462 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:28.960433    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d997e526-84d0-4b12-94ee-1248da43733e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d997e526-84d0-4b12-94ee-1248da43733e" (UID: "d997e526-84d0-4b12-94ee-1248da43733e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:10:28.960573 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:28.960561    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d997e526-84d0-4b12-94ee-1248da43733e-istio-token" (OuterVolumeSpecName: "istio-token") pod "d997e526-84d0-4b12-94ee-1248da43733e" (UID: "d997e526-84d0-4b12-94ee-1248da43733e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 08:10:28.960792 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:28.960769    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d997e526-84d0-4b12-94ee-1248da43733e-kube-api-access-pnrkg" (OuterVolumeSpecName: "kube-api-access-pnrkg") pod "d997e526-84d0-4b12-94ee-1248da43733e" (UID: "d997e526-84d0-4b12-94ee-1248da43733e"). InnerVolumeSpecName "kube-api-access-pnrkg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 08:10:28.960895 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:28.960838    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d997e526-84d0-4b12-94ee-1248da43733e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d997e526-84d0-4b12-94ee-1248da43733e" (UID: "d997e526-84d0-4b12-94ee-1248da43733e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 11 08:10:29.059166 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:29.059134    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d997e526-84d0-4b12-94ee-1248da43733e-istio-token\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:10:29.059166 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:29.059161    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d997e526-84d0-4b12-94ee-1248da43733e-istio-data\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:10:29.059166 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:29.059172    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d997e526-84d0-4b12-94ee-1248da43733e-istio-envoy\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:10:29.059414 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:29.059180    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d997e526-84d0-4b12-94ee-1248da43733e-credential-socket\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:10:29.059414 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:29.059189    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d997e526-84d0-4b12-94ee-1248da43733e-istio-podinfo\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:10:29.059414 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:29.059197    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnrkg\" (UniqueName: \"kubernetes.io/projected/d997e526-84d0-4b12-94ee-1248da43733e-kube-api-access-pnrkg\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:10:29.059414 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:29.059206    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d997e526-84d0-4b12-94ee-1248da43733e-workload-certs\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:10:29.589843 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:29.589802    2568 generic.go:356] "Generic (PLEG): container finished" podID="d997e526-84d0-4b12-94ee-1248da43733e" containerID="ddf3495c473e7600ced7a106345939afc3dc0689758ca226296cebceeacab8d3" exitCode=0
Jul 11 08:10:29.590020 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:29.589857    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49" event={"ID":"d997e526-84d0-4b12-94ee-1248da43733e","Type":"ContainerDied","Data":"ddf3495c473e7600ced7a106345939afc3dc0689758ca226296cebceeacab8d3"}
Jul 11 08:10:29.590020 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:29.589863    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"
Jul 11 08:10:29.590020 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:29.589934    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49" event={"ID":"d997e526-84d0-4b12-94ee-1248da43733e","Type":"ContainerDied","Data":"0497a31e0388d9e621e4da2d79176c5d6530cf3b1afb56a8cafbca6ccad7e340"}
Jul 11 08:10:29.590020 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:29.589958    2568 scope.go:117] "RemoveContainer" containerID="ddf3495c473e7600ced7a106345939afc3dc0689758ca226296cebceeacab8d3"
Jul 11 08:10:29.598440 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:29.598421    2568 scope.go:117] "RemoveContainer" containerID="c9b4d03aed02982f15f0c299977957421416edb67f16cfd1277a9e43c69ca6f8"
Jul 11 08:10:29.605637 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:29.605609    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"]
Jul 11 08:10:29.606074 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:29.606062    2568 scope.go:117] "RemoveContainer" containerID="ddf3495c473e7600ced7a106345939afc3dc0689758ca226296cebceeacab8d3"
Jul 11 08:10:29.606315 ip-10-0-142-153 kubenswrapper[2568]: E0711 08:10:29.606298    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddf3495c473e7600ced7a106345939afc3dc0689758ca226296cebceeacab8d3\": container with ID starting with ddf3495c473e7600ced7a106345939afc3dc0689758ca226296cebceeacab8d3 not found: ID does not exist" containerID="ddf3495c473e7600ced7a106345939afc3dc0689758ca226296cebceeacab8d3"
Jul 11 08:10:29.606380 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:29.606336    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddf3495c473e7600ced7a106345939afc3dc0689758ca226296cebceeacab8d3"} err="failed to get container status \"ddf3495c473e7600ced7a106345939afc3dc0689758ca226296cebceeacab8d3\": rpc error: code = NotFound desc = could not find container \"ddf3495c473e7600ced7a106345939afc3dc0689758ca226296cebceeacab8d3\": container with ID starting with ddf3495c473e7600ced7a106345939afc3dc0689758ca226296cebceeacab8d3 not found: ID does not exist"
Jul 11 08:10:29.606380 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:29.606356    2568 scope.go:117] "RemoveContainer" containerID="c9b4d03aed02982f15f0c299977957421416edb67f16cfd1277a9e43c69ca6f8"
Jul 11 08:10:29.606599 ip-10-0-142-153 kubenswrapper[2568]: E0711 08:10:29.606577    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9b4d03aed02982f15f0c299977957421416edb67f16cfd1277a9e43c69ca6f8\": container with ID starting with c9b4d03aed02982f15f0c299977957421416edb67f16cfd1277a9e43c69ca6f8 not found: ID does not exist" containerID="c9b4d03aed02982f15f0c299977957421416edb67f16cfd1277a9e43c69ca6f8"
Jul 11 08:10:29.606599 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:29.606595    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9b4d03aed02982f15f0c299977957421416edb67f16cfd1277a9e43c69ca6f8"} err="failed to get container status \"c9b4d03aed02982f15f0c299977957421416edb67f16cfd1277a9e43c69ca6f8\": rpc error: code = NotFound desc = could not find container \"c9b4d03aed02982f15f0c299977957421416edb67f16cfd1277a9e43c69ca6f8\": container with ID starting with c9b4d03aed02982f15f0c299977957421416edb67f16cfd1277a9e43c69ca6f8 not found: ID does not exist"
Jul 11 08:10:29.609029 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:29.609008    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b0adf7bb-openshift-default-b7c9db499-xkq49"]
Jul 11 08:10:31.070924 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:31.070891    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d997e526-84d0-4b12-94ee-1248da43733e" path="/var/lib/kubelet/pods/d997e526-84d0-4b12-94ee-1248da43733e/volumes"
Jul 11 08:10:32.584715 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:10:32.584688    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn"
Jul 11 08:11:29.901781 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:11:29.901736    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn"]
Jul 11 08:11:29.902230 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:11:29.901979    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn" podUID="9cba9020-131b-4078-9253-825c3991a9c9" containerName="maas-api" containerID="cri-o://10c44fdadca4426cc7fb363e31804edb50de79d50bdbafecfd7932cd9145605e" gracePeriod=30
Jul 11 08:11:30.148692 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:11:30.148667    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn"
Jul 11 08:11:30.267207 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:11:30.267115    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cba9020-131b-4078-9253-825c3991a9c9-openshift-service-ca\") pod \"9cba9020-131b-4078-9253-825c3991a9c9\" (UID: \"9cba9020-131b-4078-9253-825c3991a9c9\") "
Jul 11 08:11:30.267207 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:11:30.267159    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cba9020-131b-4078-9253-825c3991a9c9-maas-api-tls\") pod \"9cba9020-131b-4078-9253-825c3991a9c9\" (UID: \"9cba9020-131b-4078-9253-825c3991a9c9\") "
Jul 11 08:11:30.267207 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:11:30.267180    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5mgq\" (UniqueName: \"kubernetes.io/projected/9cba9020-131b-4078-9253-825c3991a9c9-kube-api-access-g5mgq\") pod \"9cba9020-131b-4078-9253-825c3991a9c9\" (UID: \"9cba9020-131b-4078-9253-825c3991a9c9\") "
Jul 11 08:11:30.267553 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:11:30.267526    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cba9020-131b-4078-9253-825c3991a9c9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9cba9020-131b-4078-9253-825c3991a9c9" (UID: "9cba9020-131b-4078-9253-825c3991a9c9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 08:11:30.269188 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:11:30.269166    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cba9020-131b-4078-9253-825c3991a9c9-kube-api-access-g5mgq" (OuterVolumeSpecName: "kube-api-access-g5mgq") pod "9cba9020-131b-4078-9253-825c3991a9c9" (UID: "9cba9020-131b-4078-9253-825c3991a9c9"). InnerVolumeSpecName "kube-api-access-g5mgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 08:11:30.269284 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:11:30.269214    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cba9020-131b-4078-9253-825c3991a9c9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9cba9020-131b-4078-9253-825c3991a9c9" (UID: "9cba9020-131b-4078-9253-825c3991a9c9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 08:11:30.368334 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:11:30.368292    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cba9020-131b-4078-9253-825c3991a9c9-openshift-service-ca\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:11:30.368334 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:11:30.368318    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cba9020-131b-4078-9253-825c3991a9c9-maas-api-tls\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:11:30.368523 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:11:30.368344    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5mgq\" (UniqueName: \"kubernetes.io/projected/9cba9020-131b-4078-9253-825c3991a9c9-kube-api-access-g5mgq\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:11:30.861542 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:11:30.861508    2568 generic.go:356] "Generic (PLEG): container finished" podID="9cba9020-131b-4078-9253-825c3991a9c9" containerID="10c44fdadca4426cc7fb363e31804edb50de79d50bdbafecfd7932cd9145605e" exitCode=0
Jul 11 08:11:30.861717 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:11:30.861553    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn"
Jul 11 08:11:30.861717 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:11:30.861577    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn" event={"ID":"9cba9020-131b-4078-9253-825c3991a9c9","Type":"ContainerDied","Data":"10c44fdadca4426cc7fb363e31804edb50de79d50bdbafecfd7932cd9145605e"}
Jul 11 08:11:30.861717 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:11:30.861616    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn" event={"ID":"9cba9020-131b-4078-9253-825c3991a9c9","Type":"ContainerDied","Data":"420178635f2e26f535c30b4712a2a37019d0d8b627a5b24d1e52544ed819f34b"}
Jul 11 08:11:30.861717 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:11:30.861637    2568 scope.go:117] "RemoveContainer" containerID="10c44fdadca4426cc7fb363e31804edb50de79d50bdbafecfd7932cd9145605e"
Jul 11 08:11:30.870238 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:11:30.870222    2568 scope.go:117] "RemoveContainer" containerID="10c44fdadca4426cc7fb363e31804edb50de79d50bdbafecfd7932cd9145605e"
Jul 11 08:11:30.870514 ip-10-0-142-153 kubenswrapper[2568]: E0711 08:11:30.870497    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10c44fdadca4426cc7fb363e31804edb50de79d50bdbafecfd7932cd9145605e\": container with ID starting with 10c44fdadca4426cc7fb363e31804edb50de79d50bdbafecfd7932cd9145605e not found: ID does not exist" containerID="10c44fdadca4426cc7fb363e31804edb50de79d50bdbafecfd7932cd9145605e"
Jul 11 08:11:30.870591 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:11:30.870521    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10c44fdadca4426cc7fb363e31804edb50de79d50bdbafecfd7932cd9145605e"} err="failed to get container status \"10c44fdadca4426cc7fb363e31804edb50de79d50bdbafecfd7932cd9145605e\": rpc error: code = NotFound desc = could not find container \"10c44fdadca4426cc7fb363e31804edb50de79d50bdbafecfd7932cd9145605e\": container with ID starting with 10c44fdadca4426cc7fb363e31804edb50de79d50bdbafecfd7932cd9145605e not found: ID does not exist"
Jul 11 08:11:30.880775 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:11:30.880750    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn"]
Jul 11 08:11:30.883848 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:11:30.883826    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c12c06b3-56f5cdcf6d-fq6gn"]
Jul 11 08:11:31.073265 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:11:31.073234    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cba9020-131b-4078-9253-825c3991a9c9" path="/var/lib/kubelet/pods/9cba9020-131b-4078-9253-825c3991a9c9/volumes"
Jul 11 08:13:21.008728 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.008694    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"]
Jul 11 08:13:21.009198 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.009020    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cba9020-131b-4078-9253-825c3991a9c9" containerName="maas-api"
Jul 11 08:13:21.009198 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.009030    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cba9020-131b-4078-9253-825c3991a9c9" containerName="maas-api"
Jul 11 08:13:21.009198 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.009046    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d997e526-84d0-4b12-94ee-1248da43733e" containerName="istio-proxy"
Jul 11 08:13:21.009198 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.009051    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d997e526-84d0-4b12-94ee-1248da43733e" containerName="istio-proxy"
Jul 11 08:13:21.009198 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.009062    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d997e526-84d0-4b12-94ee-1248da43733e" containerName="istio-proxy"
Jul 11 08:13:21.009198 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.009068    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d997e526-84d0-4b12-94ee-1248da43733e" containerName="istio-proxy"
Jul 11 08:13:21.009198 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.009137    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d997e526-84d0-4b12-94ee-1248da43733e" containerName="istio-proxy"
Jul 11 08:13:21.009198 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.009145    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d997e526-84d0-4b12-94ee-1248da43733e" containerName="istio-proxy"
Jul 11 08:13:21.009198 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.009152    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cba9020-131b-4078-9253-825c3991a9c9" containerName="maas-api"
Jul 11 08:13:21.012010 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.011995    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:21.015449 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.015431    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-df2809d2-openshift-default-dockercfg-dj44f\""
Jul 11 08:13:21.044948 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.044916    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"]
Jul 11 08:13:21.061520 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.061494    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7b05a8f-8505-4263-b6b3-fb5757f14cff-istio-podinfo\") pod \"e2e-mt-df2809d2-openshift-default-66997bb767-vzllm\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") " pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:21.061653 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.061543    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7b05a8f-8505-4263-b6b3-fb5757f14cff-istio-data\") pod \"e2e-mt-df2809d2-openshift-default-66997bb767-vzllm\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") " pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:21.061653 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.061562    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7b05a8f-8505-4263-b6b3-fb5757f14cff-istiod-ca-cert\") pod \"e2e-mt-df2809d2-openshift-default-66997bb767-vzllm\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") " pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:21.061653 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.061632    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7b05a8f-8505-4263-b6b3-fb5757f14cff-istio-token\") pod \"e2e-mt-df2809d2-openshift-default-66997bb767-vzllm\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") " pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:21.061817 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.061678    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7b05a8f-8505-4263-b6b3-fb5757f14cff-workload-socket\") pod \"e2e-mt-df2809d2-openshift-default-66997bb767-vzllm\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") " pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:21.061817 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.061704    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd8w4\" (UniqueName: \"kubernetes.io/projected/e7b05a8f-8505-4263-b6b3-fb5757f14cff-kube-api-access-jd8w4\") pod \"e2e-mt-df2809d2-openshift-default-66997bb767-vzllm\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") " pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:21.061817 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.061733    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7b05a8f-8505-4263-b6b3-fb5757f14cff-istio-envoy\") pod \"e2e-mt-df2809d2-openshift-default-66997bb767-vzllm\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") " pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:21.061817 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.061771    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7b05a8f-8505-4263-b6b3-fb5757f14cff-credential-socket\") pod \"e2e-mt-df2809d2-openshift-default-66997bb767-vzllm\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") " pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:21.061817 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.061787    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7b05a8f-8505-4263-b6b3-fb5757f14cff-workload-certs\") pod \"e2e-mt-df2809d2-openshift-default-66997bb767-vzllm\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") " pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:21.163055 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.163019    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7b05a8f-8505-4263-b6b3-fb5757f14cff-istio-podinfo\") pod \"e2e-mt-df2809d2-openshift-default-66997bb767-vzllm\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") " pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:21.163232 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.163074    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7b05a8f-8505-4263-b6b3-fb5757f14cff-istio-data\") pod \"e2e-mt-df2809d2-openshift-default-66997bb767-vzllm\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") " pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:21.163232 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.163101    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7b05a8f-8505-4263-b6b3-fb5757f14cff-istiod-ca-cert\") pod \"e2e-mt-df2809d2-openshift-default-66997bb767-vzllm\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") " pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:21.163232 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.163131    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7b05a8f-8505-4263-b6b3-fb5757f14cff-istio-token\") pod \"e2e-mt-df2809d2-openshift-default-66997bb767-vzllm\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") " pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:21.163232 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.163164    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7b05a8f-8505-4263-b6b3-fb5757f14cff-workload-socket\") pod \"e2e-mt-df2809d2-openshift-default-66997bb767-vzllm\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") " pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:21.163232 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.163190    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd8w4\" (UniqueName: \"kubernetes.io/projected/e7b05a8f-8505-4263-b6b3-fb5757f14cff-kube-api-access-jd8w4\") pod \"e2e-mt-df2809d2-openshift-default-66997bb767-vzllm\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") " pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:21.163232 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.163227    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7b05a8f-8505-4263-b6b3-fb5757f14cff-istio-envoy\") pod \"e2e-mt-df2809d2-openshift-default-66997bb767-vzllm\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") " pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:21.163586 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.163254    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7b05a8f-8505-4263-b6b3-fb5757f14cff-credential-socket\") pod \"e2e-mt-df2809d2-openshift-default-66997bb767-vzllm\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") " pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:21.163586 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.163273    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7b05a8f-8505-4263-b6b3-fb5757f14cff-workload-certs\") pod \"e2e-mt-df2809d2-openshift-default-66997bb767-vzllm\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") " pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:21.163693 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.163645    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7b05a8f-8505-4263-b6b3-fb5757f14cff-istio-data\") pod \"e2e-mt-df2809d2-openshift-default-66997bb767-vzllm\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") " pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:21.163693 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.163653    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7b05a8f-8505-4263-b6b3-fb5757f14cff-workload-socket\") pod \"e2e-mt-df2809d2-openshift-default-66997bb767-vzllm\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") " pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:21.163795 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.163744    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7b05a8f-8505-4263-b6b3-fb5757f14cff-workload-certs\") pod \"e2e-mt-df2809d2-openshift-default-66997bb767-vzllm\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") " pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:21.163891 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.163869    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7b05a8f-8505-4263-b6b3-fb5757f14cff-credential-socket\") pod \"e2e-mt-df2809d2-openshift-default-66997bb767-vzllm\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") " pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:21.164040 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.164020    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7b05a8f-8505-4263-b6b3-fb5757f14cff-istiod-ca-cert\") pod \"e2e-mt-df2809d2-openshift-default-66997bb767-vzllm\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") " pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:21.165603 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.165580    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7b05a8f-8505-4263-b6b3-fb5757f14cff-istio-envoy\") pod \"e2e-mt-df2809d2-openshift-default-66997bb767-vzllm\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") " pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:21.165654 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.165641    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7b05a8f-8505-4263-b6b3-fb5757f14cff-istio-podinfo\") pod \"e2e-mt-df2809d2-openshift-default-66997bb767-vzllm\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") " pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:21.170948 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.170927    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7b05a8f-8505-4263-b6b3-fb5757f14cff-istio-token\") pod \"e2e-mt-df2809d2-openshift-default-66997bb767-vzllm\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") " pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:21.171157 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.171141    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd8w4\" (UniqueName: \"kubernetes.io/projected/e7b05a8f-8505-4263-b6b3-fb5757f14cff-kube-api-access-jd8w4\") pod \"e2e-mt-df2809d2-openshift-default-66997bb767-vzllm\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") " pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:21.321827 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.321799    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:21.454179 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.454142    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"]
Jul 11 08:13:21.457032 ip-10-0-142-153 kubenswrapper[2568]: W0711 08:13:21.457005    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7b05a8f_8505_4263_b6b3_fb5757f14cff.slice/crio-1291476dc4592d8f3640f7128c71ca00164bc3ec909a4b5a600a8e9b95f067c6 WatchSource:0}: Error finding container 1291476dc4592d8f3640f7128c71ca00164bc3ec909a4b5a600a8e9b95f067c6: Status 404 returned error can't find the container with id 1291476dc4592d8f3640f7128c71ca00164bc3ec909a4b5a600a8e9b95f067c6
Jul 11 08:13:21.459068 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.459035    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:13:21.459120 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.459100    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:13:21.459157 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:21.459128    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:13:22.350221 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:22.350188    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm" event={"ID":"e7b05a8f-8505-4263-b6b3-fb5757f14cff","Type":"ContainerStarted","Data":"314a46b644029c262f50b65025c614a468dbb538812430cf1546d26c03e29f2e"}
Jul 11 08:13:22.350711 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:22.350244    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm" event={"ID":"e7b05a8f-8505-4263-b6b3-fb5757f14cff","Type":"ContainerStarted","Data":"1291476dc4592d8f3640f7128c71ca00164bc3ec909a4b5a600a8e9b95f067c6"}
Jul 11 08:13:22.369268 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:22.369218    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm" podStartSLOduration=2.369203874 podStartE2EDuration="2.369203874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 08:13:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 08:13:22.367826257 +0000 UTC m=+2113.852576390" watchObservedRunningTime="2026-07-11 08:13:22.369203874 +0000 UTC m=+2113.853954006"
Jul 11 08:13:23.322394 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:23.322361    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:23.326863 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:23.326837    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:23.355432 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:23.355401    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:23.356222 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:23.356205    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:24.339237 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:24.339206    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh"]
Jul 11 08:13:24.342905 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:24.342881    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh"
Jul 11 08:13:24.345350 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:24.345307    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-df2809d2-serving-cert\""
Jul 11 08:13:24.353269 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:24.353243    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh"]
Jul 11 08:13:24.389393 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:24.389363    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dgz6\" (UniqueName: \"kubernetes.io/projected/ca2d7aae-6305-4d3d-a3f4-ed499f6450f8-kube-api-access-5dgz6\") pod \"maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh\" (UID: \"ca2d7aae-6305-4d3d-a3f4-ed499f6450f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh"
Jul 11 08:13:24.389792 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:24.389442    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca2d7aae-6305-4d3d-a3f4-ed499f6450f8-maas-api-tls\") pod \"maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh\" (UID: \"ca2d7aae-6305-4d3d-a3f4-ed499f6450f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh"
Jul 11 08:13:24.389792 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:24.389473    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca2d7aae-6305-4d3d-a3f4-ed499f6450f8-openshift-service-ca\") pod \"maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh\" (UID: \"ca2d7aae-6305-4d3d-a3f4-ed499f6450f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh"
Jul 11 08:13:24.490514 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:24.490474    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca2d7aae-6305-4d3d-a3f4-ed499f6450f8-maas-api-tls\") pod \"maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh\" (UID: \"ca2d7aae-6305-4d3d-a3f4-ed499f6450f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh"
Jul 11 08:13:24.490514 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:24.490513    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca2d7aae-6305-4d3d-a3f4-ed499f6450f8-openshift-service-ca\") pod \"maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh\" (UID: \"ca2d7aae-6305-4d3d-a3f4-ed499f6450f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh"
Jul 11 08:13:24.490780 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:24.490593    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dgz6\" (UniqueName: \"kubernetes.io/projected/ca2d7aae-6305-4d3d-a3f4-ed499f6450f8-kube-api-access-5dgz6\") pod \"maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh\" (UID: \"ca2d7aae-6305-4d3d-a3f4-ed499f6450f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh"
Jul 11 08:13:24.490780 ip-10-0-142-153 kubenswrapper[2568]: E0711 08:13:24.490630    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-df2809d2-serving-cert: secret "maas-api-e2e-mt-df2809d2-serving-cert" not found
Jul 11 08:13:24.490780 ip-10-0-142-153 kubenswrapper[2568]: E0711 08:13:24.490706    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca2d7aae-6305-4d3d-a3f4-ed499f6450f8-maas-api-tls podName:ca2d7aae-6305-4d3d-a3f4-ed499f6450f8 nodeName:}" failed. No retries permitted until 2026-07-11 08:13:24.99068543 +0000 UTC m=+2116.475435541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ca2d7aae-6305-4d3d-a3f4-ed499f6450f8-maas-api-tls") pod "maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh" (UID: "ca2d7aae-6305-4d3d-a3f4-ed499f6450f8") : secret "maas-api-e2e-mt-df2809d2-serving-cert" not found
Jul 11 08:13:24.491144 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:24.491123    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca2d7aae-6305-4d3d-a3f4-ed499f6450f8-openshift-service-ca\") pod \"maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh\" (UID: \"ca2d7aae-6305-4d3d-a3f4-ed499f6450f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh"
Jul 11 08:13:24.500424 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:24.500403    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dgz6\" (UniqueName: \"kubernetes.io/projected/ca2d7aae-6305-4d3d-a3f4-ed499f6450f8-kube-api-access-5dgz6\") pod \"maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh\" (UID: \"ca2d7aae-6305-4d3d-a3f4-ed499f6450f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh"
Jul 11 08:13:24.995461 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:24.995428    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca2d7aae-6305-4d3d-a3f4-ed499f6450f8-maas-api-tls\") pod \"maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh\" (UID: \"ca2d7aae-6305-4d3d-a3f4-ed499f6450f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh"
Jul 11 08:13:24.997810 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:24.997789    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca2d7aae-6305-4d3d-a3f4-ed499f6450f8-maas-api-tls\") pod \"maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh\" (UID: \"ca2d7aae-6305-4d3d-a3f4-ed499f6450f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh"
Jul 11 08:13:25.254711 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:25.254620    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh"
Jul 11 08:13:25.389193 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:25.389172    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh"]
Jul 11 08:13:25.391046 ip-10-0-142-153 kubenswrapper[2568]: W0711 08:13:25.391014    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca2d7aae_6305_4d3d_a3f4_ed499f6450f8.slice/crio-ad6adbad4326839da06eb362078952fd9e5f5eb2a9d6eacfd154ca3219edd923 WatchSource:0}: Error finding container ad6adbad4326839da06eb362078952fd9e5f5eb2a9d6eacfd154ca3219edd923: Status 404 returned error can't find the container with id ad6adbad4326839da06eb362078952fd9e5f5eb2a9d6eacfd154ca3219edd923
Jul 11 08:13:25.392413 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:25.392394    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 08:13:26.372611 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:26.372575    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh" event={"ID":"ca2d7aae-6305-4d3d-a3f4-ed499f6450f8","Type":"ContainerStarted","Data":"7610295c251e0ae0a438176965b5d750a2c18f8da8f734a1d27ff91114c45d69"}
Jul 11 08:13:26.372805 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:26.372636    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh" event={"ID":"ca2d7aae-6305-4d3d-a3f4-ed499f6450f8","Type":"ContainerStarted","Data":"ad6adbad4326839da06eb362078952fd9e5f5eb2a9d6eacfd154ca3219edd923"}
Jul 11 08:13:26.372805 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:26.372761    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh"
Jul 11 08:13:26.390083 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:26.390037    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh" podStartSLOduration=1.9439558890000002 podStartE2EDuration="2.390023689s" totalImagesPullingTime="446.0678ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 08:13:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 08:13:26.388871959 +0000 UTC m=+2117.873622092" watchObservedRunningTime="2026-07-11 08:13:26.390023689 +0000 UTC m=+2117.874773823"
Jul 11 08:13:32.381548 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:32.381520    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh"
Jul 11 08:13:39.221240 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:39.220129    2568 patch_prober.go:28] interesting pod/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": read tcp 10.132.0.2:38484->10.132.0.43:15021: read: connection reset by peer" start-of-body=
Jul 11 08:13:39.221240 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:39.220202    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm" podUID="e7b05a8f-8505-4263-b6b3-fb5757f14cff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": read tcp 10.132.0.2:38484->10.132.0.43:15021: read: connection reset by peer"
Jul 11 08:13:39.435217 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:39.435135    2568 generic.go:356] "Generic (PLEG): container finished" podID="e7b05a8f-8505-4263-b6b3-fb5757f14cff" containerID="314a46b644029c262f50b65025c614a468dbb538812430cf1546d26c03e29f2e" exitCode=0
Jul 11 08:13:39.435380 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:39.435207    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm" event={"ID":"e7b05a8f-8505-4263-b6b3-fb5757f14cff","Type":"ContainerDied","Data":"314a46b644029c262f50b65025c614a468dbb538812430cf1546d26c03e29f2e"}
Jul 11 08:13:39.435605 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:39.435592    2568 scope.go:117] "RemoveContainer" containerID="314a46b644029c262f50b65025c614a468dbb538812430cf1546d26c03e29f2e"
Jul 11 08:13:39.436631 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:39.436601    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:13:39.436723 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:39.436703    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:13:39.436760 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:39.436752    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:13:40.441664 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:40.441631    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm" event={"ID":"e7b05a8f-8505-4263-b6b3-fb5757f14cff","Type":"ContainerStarted","Data":"ae77caaf3deed8ac5e4adabc8dbee9100421746402653fcdda6cb97ea86c6067"}
Jul 11 08:13:41.322005 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:41.321966    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:41.322261 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:41.322236    2568 patch_prober.go:28] interesting pod/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 11 08:13:41.322311 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:41.322289    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm" podUID="e7b05a8f-8505-4263-b6b3-fb5757f14cff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 11 08:13:42.322770 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:42.322732    2568 patch_prober.go:28] interesting pod/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 11 08:13:42.323152 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:42.322791    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm" podUID="e7b05a8f-8505-4263-b6b3-fb5757f14cff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 11 08:13:43.322402 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:43.322366    2568 patch_prober.go:28] interesting pod/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 11 08:13:43.322580 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:43.322419    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm" podUID="e7b05a8f-8505-4263-b6b3-fb5757f14cff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 11 08:13:44.326277 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:44.326247    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:44.326733 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:44.326655    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:44.327423 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:44.327402    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:13:46.288362 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:46.288310    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh"]
Jul 11 08:13:46.288867 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:46.288613    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh" podUID="ca2d7aae-6305-4d3d-a3f4-ed499f6450f8" containerName="maas-api" containerID="cri-o://7610295c251e0ae0a438176965b5d750a2c18f8da8f734a1d27ff91114c45d69" gracePeriod=30
Jul 11 08:13:46.472401 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:46.472373    2568 generic.go:356] "Generic (PLEG): container finished" podID="ca2d7aae-6305-4d3d-a3f4-ed499f6450f8" containerID="7610295c251e0ae0a438176965b5d750a2c18f8da8f734a1d27ff91114c45d69" exitCode=0
Jul 11 08:13:46.472538 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:46.472438    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh" event={"ID":"ca2d7aae-6305-4d3d-a3f4-ed499f6450f8","Type":"ContainerDied","Data":"7610295c251e0ae0a438176965b5d750a2c18f8da8f734a1d27ff91114c45d69"}
Jul 11 08:13:46.535789 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:46.535767    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh"
Jul 11 08:13:46.685471 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:46.685441    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca2d7aae-6305-4d3d-a3f4-ed499f6450f8-openshift-service-ca\") pod \"ca2d7aae-6305-4d3d-a3f4-ed499f6450f8\" (UID: \"ca2d7aae-6305-4d3d-a3f4-ed499f6450f8\") "
Jul 11 08:13:46.685666 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:46.685479    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca2d7aae-6305-4d3d-a3f4-ed499f6450f8-maas-api-tls\") pod \"ca2d7aae-6305-4d3d-a3f4-ed499f6450f8\" (UID: \"ca2d7aae-6305-4d3d-a3f4-ed499f6450f8\") "
Jul 11 08:13:46.685666 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:46.685514    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dgz6\" (UniqueName: \"kubernetes.io/projected/ca2d7aae-6305-4d3d-a3f4-ed499f6450f8-kube-api-access-5dgz6\") pod \"ca2d7aae-6305-4d3d-a3f4-ed499f6450f8\" (UID: \"ca2d7aae-6305-4d3d-a3f4-ed499f6450f8\") "
Jul 11 08:13:46.685811 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:46.685790    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca2d7aae-6305-4d3d-a3f4-ed499f6450f8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ca2d7aae-6305-4d3d-a3f4-ed499f6450f8" (UID: "ca2d7aae-6305-4d3d-a3f4-ed499f6450f8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 08:13:46.687553 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:46.687531    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca2d7aae-6305-4d3d-a3f4-ed499f6450f8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ca2d7aae-6305-4d3d-a3f4-ed499f6450f8" (UID: "ca2d7aae-6305-4d3d-a3f4-ed499f6450f8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 08:13:46.687639 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:46.687554    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca2d7aae-6305-4d3d-a3f4-ed499f6450f8-kube-api-access-5dgz6" (OuterVolumeSpecName: "kube-api-access-5dgz6") pod "ca2d7aae-6305-4d3d-a3f4-ed499f6450f8" (UID: "ca2d7aae-6305-4d3d-a3f4-ed499f6450f8"). InnerVolumeSpecName "kube-api-access-5dgz6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 08:13:46.786046 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:46.786020    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca2d7aae-6305-4d3d-a3f4-ed499f6450f8-openshift-service-ca\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:13:46.786046 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:46.786044    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca2d7aae-6305-4d3d-a3f4-ed499f6450f8-maas-api-tls\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:13:46.786199 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:46.786054    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dgz6\" (UniqueName: \"kubernetes.io/projected/ca2d7aae-6305-4d3d-a3f4-ed499f6450f8-kube-api-access-5dgz6\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:13:47.477915 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:47.477829    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh"
Jul 11 08:13:47.478378 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:47.477833    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh" event={"ID":"ca2d7aae-6305-4d3d-a3f4-ed499f6450f8","Type":"ContainerDied","Data":"ad6adbad4326839da06eb362078952fd9e5f5eb2a9d6eacfd154ca3219edd923"}
Jul 11 08:13:47.478378 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:47.477954    2568 scope.go:117] "RemoveContainer" containerID="7610295c251e0ae0a438176965b5d750a2c18f8da8f734a1d27ff91114c45d69"
Jul 11 08:13:47.492568 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:47.492538    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh"]
Jul 11 08:13:47.494808 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:47.494786    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-df2809d2-67877c4f9c-gh8zh"]
Jul 11 08:13:49.073441 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:13:49.073410    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca2d7aae-6305-4d3d-a3f4-ed499f6450f8" path="/var/lib/kubelet/pods/ca2d7aae-6305-4d3d-a3f4-ed499f6450f8/volumes"
Jul 11 08:14:01.560973 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:01.560890    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"]
Jul 11 08:14:01.561571 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:01.561083    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm" podUID="e7b05a8f-8505-4263-b6b3-fb5757f14cff" containerName="istio-proxy" containerID="cri-o://ae77caaf3deed8ac5e4adabc8dbee9100421746402653fcdda6cb97ea86c6067" gracePeriod=30
Jul 11 08:14:06.819572 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:06.819548    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:14:06.853713 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:06.853644    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7b05a8f-8505-4263-b6b3-fb5757f14cff-istiod-ca-cert\") pod \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") "
Jul 11 08:14:06.853713 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:06.853685    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7b05a8f-8505-4263-b6b3-fb5757f14cff-istio-data\") pod \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") "
Jul 11 08:14:06.853713 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:06.853700    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7b05a8f-8505-4263-b6b3-fb5757f14cff-credential-socket\") pod \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") "
Jul 11 08:14:06.853951 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:06.853753    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7b05a8f-8505-4263-b6b3-fb5757f14cff-istio-podinfo\") pod \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") "
Jul 11 08:14:06.853951 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:06.853787    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7b05a8f-8505-4263-b6b3-fb5757f14cff-workload-socket\") pod \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") "
Jul 11 08:14:06.853951 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:06.853846    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7b05a8f-8505-4263-b6b3-fb5757f14cff-workload-certs\") pod \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") "
Jul 11 08:14:06.853951 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:06.853879    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jd8w4\" (UniqueName: \"kubernetes.io/projected/e7b05a8f-8505-4263-b6b3-fb5757f14cff-kube-api-access-jd8w4\") pod \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") "
Jul 11 08:14:06.853951 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:06.853905    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7b05a8f-8505-4263-b6b3-fb5757f14cff-istio-token\") pod \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") "
Jul 11 08:14:06.853951 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:06.853936    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7b05a8f-8505-4263-b6b3-fb5757f14cff-istio-envoy\") pod \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\" (UID: \"e7b05a8f-8505-4263-b6b3-fb5757f14cff\") "
Jul 11 08:14:06.854249 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:06.854101    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7b05a8f-8505-4263-b6b3-fb5757f14cff-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e7b05a8f-8505-4263-b6b3-fb5757f14cff" (UID: "e7b05a8f-8505-4263-b6b3-fb5757f14cff"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:14:06.854249 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:06.854118    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7b05a8f-8505-4263-b6b3-fb5757f14cff-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e7b05a8f-8505-4263-b6b3-fb5757f14cff" (UID: "e7b05a8f-8505-4263-b6b3-fb5757f14cff"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:14:06.854249 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:06.854123    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7b05a8f-8505-4263-b6b3-fb5757f14cff-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e7b05a8f-8505-4263-b6b3-fb5757f14cff" (UID: "e7b05a8f-8505-4263-b6b3-fb5757f14cff"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 08:14:06.854249 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:06.854223    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7b05a8f-8505-4263-b6b3-fb5757f14cff-credential-socket\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:14:06.854249 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:06.854241    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7b05a8f-8505-4263-b6b3-fb5757f14cff-workload-socket\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:14:06.854523 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:06.854486    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7b05a8f-8505-4263-b6b3-fb5757f14cff-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e7b05a8f-8505-4263-b6b3-fb5757f14cff" (UID: "e7b05a8f-8505-4263-b6b3-fb5757f14cff"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:14:06.854611 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:06.854589    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7b05a8f-8505-4263-b6b3-fb5757f14cff-istio-data" (OuterVolumeSpecName: "istio-data") pod "e7b05a8f-8505-4263-b6b3-fb5757f14cff" (UID: "e7b05a8f-8505-4263-b6b3-fb5757f14cff"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:14:06.856107 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:06.856070    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7b05a8f-8505-4263-b6b3-fb5757f14cff-kube-api-access-jd8w4" (OuterVolumeSpecName: "kube-api-access-jd8w4") pod "e7b05a8f-8505-4263-b6b3-fb5757f14cff" (UID: "e7b05a8f-8505-4263-b6b3-fb5757f14cff"). InnerVolumeSpecName "kube-api-access-jd8w4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 08:14:06.856213 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:06.856163    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e7b05a8f-8505-4263-b6b3-fb5757f14cff-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e7b05a8f-8505-4263-b6b3-fb5757f14cff" (UID: "e7b05a8f-8505-4263-b6b3-fb5757f14cff"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 11 08:14:06.856479 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:06.856462    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7b05a8f-8505-4263-b6b3-fb5757f14cff-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e7b05a8f-8505-4263-b6b3-fb5757f14cff" (UID: "e7b05a8f-8505-4263-b6b3-fb5757f14cff"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:14:06.856539 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:06.856462    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7b05a8f-8505-4263-b6b3-fb5757f14cff-istio-token" (OuterVolumeSpecName: "istio-token") pod "e7b05a8f-8505-4263-b6b3-fb5757f14cff" (UID: "e7b05a8f-8505-4263-b6b3-fb5757f14cff"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 08:14:06.955213 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:06.955190    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7b05a8f-8505-4263-b6b3-fb5757f14cff-istio-podinfo\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:14:06.955213 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:06.955209    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7b05a8f-8505-4263-b6b3-fb5757f14cff-workload-certs\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:14:06.955372 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:06.955219    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jd8w4\" (UniqueName: \"kubernetes.io/projected/e7b05a8f-8505-4263-b6b3-fb5757f14cff-kube-api-access-jd8w4\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:14:06.955372 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:06.955228    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7b05a8f-8505-4263-b6b3-fb5757f14cff-istio-token\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:14:06.955372 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:06.955236    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7b05a8f-8505-4263-b6b3-fb5757f14cff-istio-envoy\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:14:06.955372 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:06.955245    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7b05a8f-8505-4263-b6b3-fb5757f14cff-istiod-ca-cert\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:14:06.955372 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:06.955253    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7b05a8f-8505-4263-b6b3-fb5757f14cff-istio-data\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:14:07.569925 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:07.569894    2568 generic.go:356] "Generic (PLEG): container finished" podID="e7b05a8f-8505-4263-b6b3-fb5757f14cff" containerID="ae77caaf3deed8ac5e4adabc8dbee9100421746402653fcdda6cb97ea86c6067" exitCode=0
Jul 11 08:14:07.570093 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:07.569959    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"
Jul 11 08:14:07.570093 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:07.569970    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm" event={"ID":"e7b05a8f-8505-4263-b6b3-fb5757f14cff","Type":"ContainerDied","Data":"ae77caaf3deed8ac5e4adabc8dbee9100421746402653fcdda6cb97ea86c6067"}
Jul 11 08:14:07.570093 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:07.570020    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm" event={"ID":"e7b05a8f-8505-4263-b6b3-fb5757f14cff","Type":"ContainerDied","Data":"1291476dc4592d8f3640f7128c71ca00164bc3ec909a4b5a600a8e9b95f067c6"}
Jul 11 08:14:07.570093 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:07.570044    2568 scope.go:117] "RemoveContainer" containerID="ae77caaf3deed8ac5e4adabc8dbee9100421746402653fcdda6cb97ea86c6067"
Jul 11 08:14:07.578668 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:07.578651    2568 scope.go:117] "RemoveContainer" containerID="314a46b644029c262f50b65025c614a468dbb538812430cf1546d26c03e29f2e"
Jul 11 08:14:07.586371 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:07.586354    2568 scope.go:117] "RemoveContainer" containerID="ae77caaf3deed8ac5e4adabc8dbee9100421746402653fcdda6cb97ea86c6067"
Jul 11 08:14:07.586653 ip-10-0-142-153 kubenswrapper[2568]: E0711 08:14:07.586619    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae77caaf3deed8ac5e4adabc8dbee9100421746402653fcdda6cb97ea86c6067\": container with ID starting with ae77caaf3deed8ac5e4adabc8dbee9100421746402653fcdda6cb97ea86c6067 not found: ID does not exist" containerID="ae77caaf3deed8ac5e4adabc8dbee9100421746402653fcdda6cb97ea86c6067"
Jul 11 08:14:07.586742 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:07.586652    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae77caaf3deed8ac5e4adabc8dbee9100421746402653fcdda6cb97ea86c6067"} err="failed to get container status \"ae77caaf3deed8ac5e4adabc8dbee9100421746402653fcdda6cb97ea86c6067\": rpc error: code = NotFound desc = could not find container \"ae77caaf3deed8ac5e4adabc8dbee9100421746402653fcdda6cb97ea86c6067\": container with ID starting with ae77caaf3deed8ac5e4adabc8dbee9100421746402653fcdda6cb97ea86c6067 not found: ID does not exist"
Jul 11 08:14:07.586742 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:07.586675    2568 scope.go:117] "RemoveContainer" containerID="314a46b644029c262f50b65025c614a468dbb538812430cf1546d26c03e29f2e"
Jul 11 08:14:07.586942 ip-10-0-142-153 kubenswrapper[2568]: E0711 08:14:07.586925    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"314a46b644029c262f50b65025c614a468dbb538812430cf1546d26c03e29f2e\": container with ID starting with 314a46b644029c262f50b65025c614a468dbb538812430cf1546d26c03e29f2e not found: ID does not exist" containerID="314a46b644029c262f50b65025c614a468dbb538812430cf1546d26c03e29f2e"
Jul 11 08:14:07.586985 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:07.586948    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"314a46b644029c262f50b65025c614a468dbb538812430cf1546d26c03e29f2e"} err="failed to get container status \"314a46b644029c262f50b65025c614a468dbb538812430cf1546d26c03e29f2e\": rpc error: code = NotFound desc = could not find container \"314a46b644029c262f50b65025c614a468dbb538812430cf1546d26c03e29f2e\": container with ID starting with 314a46b644029c262f50b65025c614a468dbb538812430cf1546d26c03e29f2e not found: ID does not exist"
Jul 11 08:14:07.587500 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:07.587483    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"]
Jul 11 08:14:07.591140 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:07.591117    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-df2809d2-openshift-default-66997bb767-vzllm"]
Jul 11 08:14:09.078432 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:09.078401    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7b05a8f-8505-4263-b6b3-fb5757f14cff" path="/var/lib/kubelet/pods/e7b05a8f-8505-4263-b6b3-fb5757f14cff/volumes"
Jul 11 08:14:20.759561 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.759524    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"]
Jul 11 08:14:20.759925 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.759869    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca2d7aae-6305-4d3d-a3f4-ed499f6450f8" containerName="maas-api"
Jul 11 08:14:20.759925 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.759881    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca2d7aae-6305-4d3d-a3f4-ed499f6450f8" containerName="maas-api"
Jul 11 08:14:20.759925 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.759899    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7b05a8f-8505-4263-b6b3-fb5757f14cff" containerName="istio-proxy"
Jul 11 08:14:20.759925 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.759905    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7b05a8f-8505-4263-b6b3-fb5757f14cff" containerName="istio-proxy"
Jul 11 08:14:20.760045 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.759966    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca2d7aae-6305-4d3d-a3f4-ed499f6450f8" containerName="maas-api"
Jul 11 08:14:20.760045 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.759974    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7b05a8f-8505-4263-b6b3-fb5757f14cff" containerName="istio-proxy"
Jul 11 08:14:20.760045 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.759982    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7b05a8f-8505-4263-b6b3-fb5757f14cff" containerName="istio-proxy"
Jul 11 08:14:20.762864 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.762842    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:20.765239 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.765217    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-683f5ca7-openshift-default-dockercfg-mw6ql\""
Jul 11 08:14:20.774818 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.774791    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"]
Jul 11 08:14:20.869606 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.869572    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/804f71ce-542d-448a-95f5-88a9ecc93906-istio-token\") pod \"e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") " pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:20.869606 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.869609    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjtm9\" (UniqueName: \"kubernetes.io/projected/804f71ce-542d-448a-95f5-88a9ecc93906-kube-api-access-vjtm9\") pod \"e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") " pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:20.869814 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.869636    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/804f71ce-542d-448a-95f5-88a9ecc93906-credential-socket\") pod \"e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") " pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:20.869814 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.869692    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/804f71ce-542d-448a-95f5-88a9ecc93906-istio-data\") pod \"e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") " pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:20.869814 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.869751    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/804f71ce-542d-448a-95f5-88a9ecc93906-workload-certs\") pod \"e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") " pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:20.869814 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.869772    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/804f71ce-542d-448a-95f5-88a9ecc93906-workload-socket\") pod \"e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") " pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:20.869814 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.869787    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/804f71ce-542d-448a-95f5-88a9ecc93906-istiod-ca-cert\") pod \"e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") " pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:20.869814 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.869804    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/804f71ce-542d-448a-95f5-88a9ecc93906-istio-podinfo\") pod \"e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") " pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:20.869997 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.869821    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/804f71ce-542d-448a-95f5-88a9ecc93906-istio-envoy\") pod \"e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") " pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:20.971040 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.971001    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/804f71ce-542d-448a-95f5-88a9ecc93906-istio-token\") pod \"e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") " pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:20.971040 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.971041    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjtm9\" (UniqueName: \"kubernetes.io/projected/804f71ce-542d-448a-95f5-88a9ecc93906-kube-api-access-vjtm9\") pod \"e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") " pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:20.971289 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.971064    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/804f71ce-542d-448a-95f5-88a9ecc93906-credential-socket\") pod \"e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") " pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:20.971289 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.971248    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/804f71ce-542d-448a-95f5-88a9ecc93906-istio-data\") pod \"e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") " pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:20.971435 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.971356    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/804f71ce-542d-448a-95f5-88a9ecc93906-workload-certs\") pod \"e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") " pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:20.971435 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.971401    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/804f71ce-542d-448a-95f5-88a9ecc93906-workload-socket\") pod \"e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") " pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:20.971435 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.971429    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/804f71ce-542d-448a-95f5-88a9ecc93906-istiod-ca-cert\") pod \"e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") " pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:20.971594 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.971457    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/804f71ce-542d-448a-95f5-88a9ecc93906-istio-podinfo\") pod \"e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") " pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:20.971594 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.971466    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/804f71ce-542d-448a-95f5-88a9ecc93906-credential-socket\") pod \"e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") " pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:20.971594 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.971486    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/804f71ce-542d-448a-95f5-88a9ecc93906-istio-envoy\") pod \"e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") " pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:20.971733 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.971641    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/804f71ce-542d-448a-95f5-88a9ecc93906-istio-data\") pod \"e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") " pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:20.971733 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.971671    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/804f71ce-542d-448a-95f5-88a9ecc93906-workload-certs\") pod \"e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") " pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:20.971733 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.971700    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/804f71ce-542d-448a-95f5-88a9ecc93906-workload-socket\") pod \"e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") " pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:20.972113 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.972092    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/804f71ce-542d-448a-95f5-88a9ecc93906-istiod-ca-cert\") pod \"e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") " pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:20.973711 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.973680    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/804f71ce-542d-448a-95f5-88a9ecc93906-istio-envoy\") pod \"e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") " pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:20.973864 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.973848    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/804f71ce-542d-448a-95f5-88a9ecc93906-istio-podinfo\") pod \"e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") " pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:20.978497 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.978480    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjtm9\" (UniqueName: \"kubernetes.io/projected/804f71ce-542d-448a-95f5-88a9ecc93906-kube-api-access-vjtm9\") pod \"e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") " pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:20.978645 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:20.978626    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/804f71ce-542d-448a-95f5-88a9ecc93906-istio-token\") pod \"e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") " pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:21.072925 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:21.072898    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:21.208950 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:21.208925    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"]
Jul 11 08:14:21.211456 ip-10-0-142-153 kubenswrapper[2568]: W0711 08:14:21.211430    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod804f71ce_542d_448a_95f5_88a9ecc93906.slice/crio-36be5a0a5147cf279e600fca7084ed0ca6ca0891bf929ca9d509553a20b95cc2 WatchSource:0}: Error finding container 36be5a0a5147cf279e600fca7084ed0ca6ca0891bf929ca9d509553a20b95cc2: Status 404 returned error can't find the container with id 36be5a0a5147cf279e600fca7084ed0ca6ca0891bf929ca9d509553a20b95cc2
Jul 11 08:14:21.213517 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:21.213486    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:14:21.213592 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:21.213550    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:14:21.213592 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:21.213579    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:14:21.635889 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:21.635853    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs" event={"ID":"804f71ce-542d-448a-95f5-88a9ecc93906","Type":"ContainerStarted","Data":"65b2d78e444d92069ceb007a4d9583409591eecce9e8a026128628bb002ea175"}
Jul 11 08:14:21.636039 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:21.635909    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs" event={"ID":"804f71ce-542d-448a-95f5-88a9ecc93906","Type":"ContainerStarted","Data":"36be5a0a5147cf279e600fca7084ed0ca6ca0891bf929ca9d509553a20b95cc2"}
Jul 11 08:14:21.655461 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:21.655414    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs" podStartSLOduration=1.655400384 podStartE2EDuration="1.655400384s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 08:14:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 08:14:21.653539492 +0000 UTC m=+2173.138289625" watchObservedRunningTime="2026-07-11 08:14:21.655400384 +0000 UTC m=+2173.140150546"
Jul 11 08:14:22.073650 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:22.073617    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:22.078456 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:22.078435    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:22.640393 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:22.640364    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:22.641264 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:22.641247    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:23.608811 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:23.608782    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6"]
Jul 11 08:14:23.609183 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:23.609120    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7b05a8f-8505-4263-b6b3-fb5757f14cff" containerName="istio-proxy"
Jul 11 08:14:23.609183 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:23.609130    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7b05a8f-8505-4263-b6b3-fb5757f14cff" containerName="istio-proxy"
Jul 11 08:14:23.612160 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:23.612139    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6"
Jul 11 08:14:23.614683 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:23.614661    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-683f5ca7-serving-cert\""
Jul 11 08:14:23.621580 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:23.621555    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6"]
Jul 11 08:14:23.695079 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:23.695048    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b18f50e-97f4-4060-9708-dab6377e1b68-openshift-service-ca\") pod \"maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6\" (UID: \"9b18f50e-97f4-4060-9708-dab6377e1b68\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6"
Jul 11 08:14:23.695265 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:23.695101    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pb8d\" (UniqueName: \"kubernetes.io/projected/9b18f50e-97f4-4060-9708-dab6377e1b68-kube-api-access-9pb8d\") pod \"maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6\" (UID: \"9b18f50e-97f4-4060-9708-dab6377e1b68\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6"
Jul 11 08:14:23.695265 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:23.695167    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b18f50e-97f4-4060-9708-dab6377e1b68-maas-api-tls\") pod \"maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6\" (UID: \"9b18f50e-97f4-4060-9708-dab6377e1b68\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6"
Jul 11 08:14:23.795963 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:23.795928    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b18f50e-97f4-4060-9708-dab6377e1b68-openshift-service-ca\") pod \"maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6\" (UID: \"9b18f50e-97f4-4060-9708-dab6377e1b68\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6"
Jul 11 08:14:23.796148 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:23.795973    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pb8d\" (UniqueName: \"kubernetes.io/projected/9b18f50e-97f4-4060-9708-dab6377e1b68-kube-api-access-9pb8d\") pod \"maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6\" (UID: \"9b18f50e-97f4-4060-9708-dab6377e1b68\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6"
Jul 11 08:14:23.796148 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:23.796010    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b18f50e-97f4-4060-9708-dab6377e1b68-maas-api-tls\") pod \"maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6\" (UID: \"9b18f50e-97f4-4060-9708-dab6377e1b68\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6"
Jul 11 08:14:23.796618 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:23.796591    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b18f50e-97f4-4060-9708-dab6377e1b68-openshift-service-ca\") pod \"maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6\" (UID: \"9b18f50e-97f4-4060-9708-dab6377e1b68\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6"
Jul 11 08:14:23.798517 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:23.798494    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b18f50e-97f4-4060-9708-dab6377e1b68-maas-api-tls\") pod \"maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6\" (UID: \"9b18f50e-97f4-4060-9708-dab6377e1b68\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6"
Jul 11 08:14:23.804792 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:23.804767    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pb8d\" (UniqueName: \"kubernetes.io/projected/9b18f50e-97f4-4060-9708-dab6377e1b68-kube-api-access-9pb8d\") pod \"maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6\" (UID: \"9b18f50e-97f4-4060-9708-dab6377e1b68\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6"
Jul 11 08:14:23.924166 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:23.924084    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6"
Jul 11 08:14:24.057053 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:24.056614    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6"]
Jul 11 08:14:24.058896 ip-10-0-142-153 kubenswrapper[2568]: W0711 08:14:24.058867    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b18f50e_97f4_4060_9708_dab6377e1b68.slice/crio-e2cc60bf8fe639f43a9f1a14c67b2752e893cc657d93436eda2cbf9f3a5224a8 WatchSource:0}: Error finding container e2cc60bf8fe639f43a9f1a14c67b2752e893cc657d93436eda2cbf9f3a5224a8: Status 404 returned error can't find the container with id e2cc60bf8fe639f43a9f1a14c67b2752e893cc657d93436eda2cbf9f3a5224a8
Jul 11 08:14:24.651229 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:24.651132    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6" event={"ID":"9b18f50e-97f4-4060-9708-dab6377e1b68","Type":"ContainerStarted","Data":"36feeabf37cfda00a85b3ddb727d6f22b9111924ccd42230ba7af048066f174c"}
Jul 11 08:14:24.651229 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:24.651185    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6" event={"ID":"9b18f50e-97f4-4060-9708-dab6377e1b68","Type":"ContainerStarted","Data":"e2cc60bf8fe639f43a9f1a14c67b2752e893cc657d93436eda2cbf9f3a5224a8"}
Jul 11 08:14:24.651757 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:24.651440    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6"
Jul 11 08:14:24.666915 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:24.666855    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6" podStartSLOduration=1.328668898 podStartE2EDuration="1.66683927s" totalImagesPullingTime="338.170372ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 08:14:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 08:14:24.666403942 +0000 UTC m=+2176.151154077" watchObservedRunningTime="2026-07-11 08:14:24.66683927 +0000 UTC m=+2176.151589408"
Jul 11 08:14:30.661287 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:30.661259    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6"
Jul 11 08:14:37.641939 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:37.641901    2568 patch_prober.go:28] interesting pod/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 11 08:14:37.642377 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:37.641960    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs" podUID="804f71ce-542d-448a-95f5-88a9ecc93906" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 11 08:14:37.726258 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:37.726224    2568 generic.go:356] "Generic (PLEG): container finished" podID="804f71ce-542d-448a-95f5-88a9ecc93906" containerID="65b2d78e444d92069ceb007a4d9583409591eecce9e8a026128628bb002ea175" exitCode=0
Jul 11 08:14:37.726436 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:37.726275    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs" event={"ID":"804f71ce-542d-448a-95f5-88a9ecc93906","Type":"ContainerDied","Data":"65b2d78e444d92069ceb007a4d9583409591eecce9e8a026128628bb002ea175"}
Jul 11 08:14:37.726648 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:37.726635    2568 scope.go:117] "RemoveContainer" containerID="65b2d78e444d92069ceb007a4d9583409591eecce9e8a026128628bb002ea175"
Jul 11 08:14:37.727603 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:37.727573    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:14:37.727667 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:37.727644    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:14:37.727706 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:37.727682    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:14:38.737307 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:38.737257    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs" event={"ID":"804f71ce-542d-448a-95f5-88a9ecc93906","Type":"ContainerStarted","Data":"cdbde91f04598aa4a34e540aa3fda675dd25e533c6ee113550638f6245b53438"}
Jul 11 08:14:39.073364 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:39.073337    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:39.073536 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:39.073491    2568 patch_prober.go:28] interesting pod/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 11 08:14:39.073596 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:39.073542    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs" podUID="804f71ce-542d-448a-95f5-88a9ecc93906" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 11 08:14:40.073472 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:40.073433    2568 patch_prober.go:28] interesting pod/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 11 08:14:40.073946 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:40.073485    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs" podUID="804f71ce-542d-448a-95f5-88a9ecc93906" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 11 08:14:41.074184 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:41.074153    2568 patch_prober.go:28] interesting pod/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 11 08:14:41.074615 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:41.074205    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs" podUID="804f71ce-542d-448a-95f5-88a9ecc93906" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 11 08:14:42.074154 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:42.074117    2568 patch_prober.go:28] interesting pod/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 11 08:14:42.074303 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:42.074172    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs" podUID="804f71ce-542d-448a-95f5-88a9ecc93906" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 11 08:14:43.077749 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:43.077721    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:43.078156 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:43.077950    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:14:43.078687 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:14:43.078670    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:15:21.671124 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:15:21.671090    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6"]
Jul 11 08:15:21.671636 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:15:21.671314    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6" podUID="9b18f50e-97f4-4060-9708-dab6377e1b68" containerName="maas-api" containerID="cri-o://36feeabf37cfda00a85b3ddb727d6f22b9111924ccd42230ba7af048066f174c" gracePeriod=30
Jul 11 08:15:21.918734 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:15:21.918712    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6"
Jul 11 08:15:21.934590 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:15:21.933911    2568 generic.go:356] "Generic (PLEG): container finished" podID="9b18f50e-97f4-4060-9708-dab6377e1b68" containerID="36feeabf37cfda00a85b3ddb727d6f22b9111924ccd42230ba7af048066f174c" exitCode=0
Jul 11 08:15:21.934590 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:15:21.934016    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6"
Jul 11 08:15:21.934590 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:15:21.934013    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6" event={"ID":"9b18f50e-97f4-4060-9708-dab6377e1b68","Type":"ContainerDied","Data":"36feeabf37cfda00a85b3ddb727d6f22b9111924ccd42230ba7af048066f174c"}
Jul 11 08:15:21.934590 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:15:21.934212    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6" event={"ID":"9b18f50e-97f4-4060-9708-dab6377e1b68","Type":"ContainerDied","Data":"e2cc60bf8fe639f43a9f1a14c67b2752e893cc657d93436eda2cbf9f3a5224a8"}
Jul 11 08:15:21.934590 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:15:21.934245    2568 scope.go:117] "RemoveContainer" containerID="36feeabf37cfda00a85b3ddb727d6f22b9111924ccd42230ba7af048066f174c"
Jul 11 08:15:21.944586 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:15:21.944562    2568 scope.go:117] "RemoveContainer" containerID="36feeabf37cfda00a85b3ddb727d6f22b9111924ccd42230ba7af048066f174c"
Jul 11 08:15:21.944854 ip-10-0-142-153 kubenswrapper[2568]: E0711 08:15:21.944836    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36feeabf37cfda00a85b3ddb727d6f22b9111924ccd42230ba7af048066f174c\": container with ID starting with 36feeabf37cfda00a85b3ddb727d6f22b9111924ccd42230ba7af048066f174c not found: ID does not exist" containerID="36feeabf37cfda00a85b3ddb727d6f22b9111924ccd42230ba7af048066f174c"
Jul 11 08:15:21.944922 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:15:21.944866    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36feeabf37cfda00a85b3ddb727d6f22b9111924ccd42230ba7af048066f174c"} err="failed to get container status \"36feeabf37cfda00a85b3ddb727d6f22b9111924ccd42230ba7af048066f174c\": rpc error: code = NotFound desc = could not find container \"36feeabf37cfda00a85b3ddb727d6f22b9111924ccd42230ba7af048066f174c\": container with ID starting with 36feeabf37cfda00a85b3ddb727d6f22b9111924ccd42230ba7af048066f174c not found: ID does not exist"
Jul 11 08:15:22.000113 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:15:22.000078    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b18f50e-97f4-4060-9708-dab6377e1b68-maas-api-tls\") pod \"9b18f50e-97f4-4060-9708-dab6377e1b68\" (UID: \"9b18f50e-97f4-4060-9708-dab6377e1b68\") "
Jul 11 08:15:22.000240 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:15:22.000169    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pb8d\" (UniqueName: \"kubernetes.io/projected/9b18f50e-97f4-4060-9708-dab6377e1b68-kube-api-access-9pb8d\") pod \"9b18f50e-97f4-4060-9708-dab6377e1b68\" (UID: \"9b18f50e-97f4-4060-9708-dab6377e1b68\") "
Jul 11 08:15:22.000284 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:15:22.000241    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b18f50e-97f4-4060-9708-dab6377e1b68-openshift-service-ca\") pod \"9b18f50e-97f4-4060-9708-dab6377e1b68\" (UID: \"9b18f50e-97f4-4060-9708-dab6377e1b68\") "
Jul 11 08:15:22.000603 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:15:22.000580    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b18f50e-97f4-4060-9708-dab6377e1b68-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9b18f50e-97f4-4060-9708-dab6377e1b68" (UID: "9b18f50e-97f4-4060-9708-dab6377e1b68"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 08:15:22.002117 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:15:22.002094    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b18f50e-97f4-4060-9708-dab6377e1b68-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9b18f50e-97f4-4060-9708-dab6377e1b68" (UID: "9b18f50e-97f4-4060-9708-dab6377e1b68"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 08:15:22.002220 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:15:22.002205    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b18f50e-97f4-4060-9708-dab6377e1b68-kube-api-access-9pb8d" (OuterVolumeSpecName: "kube-api-access-9pb8d") pod "9b18f50e-97f4-4060-9708-dab6377e1b68" (UID: "9b18f50e-97f4-4060-9708-dab6377e1b68"). InnerVolumeSpecName "kube-api-access-9pb8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 08:15:22.101379 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:15:22.101288    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pb8d\" (UniqueName: \"kubernetes.io/projected/9b18f50e-97f4-4060-9708-dab6377e1b68-kube-api-access-9pb8d\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:15:22.101379 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:15:22.101315    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b18f50e-97f4-4060-9708-dab6377e1b68-openshift-service-ca\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:15:22.101379 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:15:22.101348    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b18f50e-97f4-4060-9708-dab6377e1b68-maas-api-tls\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:15:22.257604 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:15:22.257558    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6"]
Jul 11 08:15:22.259193 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:15:22.259173    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-683f5ca7-57cfdbddc5-cfmv6"]
Jul 11 08:15:23.072163 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:15:23.072132    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b18f50e-97f4-4060-9708-dab6377e1b68" path="/var/lib/kubelet/pods/9b18f50e-97f4-4060-9708-dab6377e1b68/volumes"
Jul 11 08:16:18.523058 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:18.523024    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"]
Jul 11 08:16:18.523611 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:18.523220    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs" podUID="804f71ce-542d-448a-95f5-88a9ecc93906" containerName="istio-proxy" containerID="cri-o://cdbde91f04598aa4a34e540aa3fda675dd25e533c6ee113550638f6245b53438" gracePeriod=30
Jul 11 08:16:23.773923 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:23.773894    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:16:23.913141 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:23.913101    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/804f71ce-542d-448a-95f5-88a9ecc93906-istiod-ca-cert\") pod \"804f71ce-542d-448a-95f5-88a9ecc93906\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") "
Jul 11 08:16:23.913364 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:23.913159    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/804f71ce-542d-448a-95f5-88a9ecc93906-istio-data\") pod \"804f71ce-542d-448a-95f5-88a9ecc93906\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") "
Jul 11 08:16:23.913364 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:23.913183    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/804f71ce-542d-448a-95f5-88a9ecc93906-workload-certs\") pod \"804f71ce-542d-448a-95f5-88a9ecc93906\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") "
Jul 11 08:16:23.913364 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:23.913221    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/804f71ce-542d-448a-95f5-88a9ecc93906-workload-socket\") pod \"804f71ce-542d-448a-95f5-88a9ecc93906\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") "
Jul 11 08:16:23.913364 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:23.913243    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/804f71ce-542d-448a-95f5-88a9ecc93906-credential-socket\") pod \"804f71ce-542d-448a-95f5-88a9ecc93906\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") "
Jul 11 08:16:23.913364 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:23.913257    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/804f71ce-542d-448a-95f5-88a9ecc93906-istio-envoy\") pod \"804f71ce-542d-448a-95f5-88a9ecc93906\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") "
Jul 11 08:16:23.913364 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:23.913273    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/804f71ce-542d-448a-95f5-88a9ecc93906-istio-podinfo\") pod \"804f71ce-542d-448a-95f5-88a9ecc93906\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") "
Jul 11 08:16:23.913364 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:23.913291    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/804f71ce-542d-448a-95f5-88a9ecc93906-istio-token\") pod \"804f71ce-542d-448a-95f5-88a9ecc93906\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") "
Jul 11 08:16:23.913364 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:23.913347    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjtm9\" (UniqueName: \"kubernetes.io/projected/804f71ce-542d-448a-95f5-88a9ecc93906-kube-api-access-vjtm9\") pod \"804f71ce-542d-448a-95f5-88a9ecc93906\" (UID: \"804f71ce-542d-448a-95f5-88a9ecc93906\") "
Jul 11 08:16:23.913781 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:23.913589    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/804f71ce-542d-448a-95f5-88a9ecc93906-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "804f71ce-542d-448a-95f5-88a9ecc93906" (UID: "804f71ce-542d-448a-95f5-88a9ecc93906"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:16:23.913781 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:23.913614    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/804f71ce-542d-448a-95f5-88a9ecc93906-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "804f71ce-542d-448a-95f5-88a9ecc93906" (UID: "804f71ce-542d-448a-95f5-88a9ecc93906"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:16:23.913781 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:23.913657    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/804f71ce-542d-448a-95f5-88a9ecc93906-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "804f71ce-542d-448a-95f5-88a9ecc93906" (UID: "804f71ce-542d-448a-95f5-88a9ecc93906"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 08:16:23.913781 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:23.913737    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/804f71ce-542d-448a-95f5-88a9ecc93906-credential-socket\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:16:23.913781 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:23.913754    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/804f71ce-542d-448a-95f5-88a9ecc93906-workload-certs\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:16:23.913997 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:23.913801    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/804f71ce-542d-448a-95f5-88a9ecc93906-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "804f71ce-542d-448a-95f5-88a9ecc93906" (UID: "804f71ce-542d-448a-95f5-88a9ecc93906"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:16:23.914574 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:23.914547    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/804f71ce-542d-448a-95f5-88a9ecc93906-istio-data" (OuterVolumeSpecName: "istio-data") pod "804f71ce-542d-448a-95f5-88a9ecc93906" (UID: "804f71ce-542d-448a-95f5-88a9ecc93906"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:16:23.915583 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:23.915553    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/804f71ce-542d-448a-95f5-88a9ecc93906-istio-token" (OuterVolumeSpecName: "istio-token") pod "804f71ce-542d-448a-95f5-88a9ecc93906" (UID: "804f71ce-542d-448a-95f5-88a9ecc93906"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 08:16:23.915669 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:23.915593    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/804f71ce-542d-448a-95f5-88a9ecc93906-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "804f71ce-542d-448a-95f5-88a9ecc93906" (UID: "804f71ce-542d-448a-95f5-88a9ecc93906"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:16:23.915669 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:23.915637    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/804f71ce-542d-448a-95f5-88a9ecc93906-kube-api-access-vjtm9" (OuterVolumeSpecName: "kube-api-access-vjtm9") pod "804f71ce-542d-448a-95f5-88a9ecc93906" (UID: "804f71ce-542d-448a-95f5-88a9ecc93906"). InnerVolumeSpecName "kube-api-access-vjtm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 08:16:23.915741 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:23.915655    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/804f71ce-542d-448a-95f5-88a9ecc93906-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "804f71ce-542d-448a-95f5-88a9ecc93906" (UID: "804f71ce-542d-448a-95f5-88a9ecc93906"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 11 08:16:24.015182 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:24.015137    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/804f71ce-542d-448a-95f5-88a9ecc93906-workload-socket\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:16:24.015182 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:24.015174    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/804f71ce-542d-448a-95f5-88a9ecc93906-istio-envoy\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:16:24.015182 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:24.015183    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/804f71ce-542d-448a-95f5-88a9ecc93906-istio-podinfo\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:16:24.015182 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:24.015192    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/804f71ce-542d-448a-95f5-88a9ecc93906-istio-token\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:16:24.015483 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:24.015201    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjtm9\" (UniqueName: \"kubernetes.io/projected/804f71ce-542d-448a-95f5-88a9ecc93906-kube-api-access-vjtm9\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:16:24.015483 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:24.015210    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/804f71ce-542d-448a-95f5-88a9ecc93906-istiod-ca-cert\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:16:24.015483 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:24.015218    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/804f71ce-542d-448a-95f5-88a9ecc93906-istio-data\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:16:24.207769 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:24.207669    2568 generic.go:356] "Generic (PLEG): container finished" podID="804f71ce-542d-448a-95f5-88a9ecc93906" containerID="cdbde91f04598aa4a34e540aa3fda675dd25e533c6ee113550638f6245b53438" exitCode=0
Jul 11 08:16:24.207769 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:24.207730    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"
Jul 11 08:16:24.207769 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:24.207755    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs" event={"ID":"804f71ce-542d-448a-95f5-88a9ecc93906","Type":"ContainerDied","Data":"cdbde91f04598aa4a34e540aa3fda675dd25e533c6ee113550638f6245b53438"}
Jul 11 08:16:24.207977 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:24.207810    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs" event={"ID":"804f71ce-542d-448a-95f5-88a9ecc93906","Type":"ContainerDied","Data":"36be5a0a5147cf279e600fca7084ed0ca6ca0891bf929ca9d509553a20b95cc2"}
Jul 11 08:16:24.207977 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:24.207833    2568 scope.go:117] "RemoveContainer" containerID="cdbde91f04598aa4a34e540aa3fda675dd25e533c6ee113550638f6245b53438"
Jul 11 08:16:24.216765 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:24.216745    2568 scope.go:117] "RemoveContainer" containerID="65b2d78e444d92069ceb007a4d9583409591eecce9e8a026128628bb002ea175"
Jul 11 08:16:24.225098 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:24.225027    2568 scope.go:117] "RemoveContainer" containerID="cdbde91f04598aa4a34e540aa3fda675dd25e533c6ee113550638f6245b53438"
Jul 11 08:16:24.225538 ip-10-0-142-153 kubenswrapper[2568]: E0711 08:16:24.225415    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdbde91f04598aa4a34e540aa3fda675dd25e533c6ee113550638f6245b53438\": container with ID starting with cdbde91f04598aa4a34e540aa3fda675dd25e533c6ee113550638f6245b53438 not found: ID does not exist" containerID="cdbde91f04598aa4a34e540aa3fda675dd25e533c6ee113550638f6245b53438"
Jul 11 08:16:24.225538 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:24.225451    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdbde91f04598aa4a34e540aa3fda675dd25e533c6ee113550638f6245b53438"} err="failed to get container status \"cdbde91f04598aa4a34e540aa3fda675dd25e533c6ee113550638f6245b53438\": rpc error: code = NotFound desc = could not find container \"cdbde91f04598aa4a34e540aa3fda675dd25e533c6ee113550638f6245b53438\": container with ID starting with cdbde91f04598aa4a34e540aa3fda675dd25e533c6ee113550638f6245b53438 not found: ID does not exist"
Jul 11 08:16:24.225538 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:24.225472    2568 scope.go:117] "RemoveContainer" containerID="65b2d78e444d92069ceb007a4d9583409591eecce9e8a026128628bb002ea175"
Jul 11 08:16:24.225880 ip-10-0-142-153 kubenswrapper[2568]: E0711 08:16:24.225821    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65b2d78e444d92069ceb007a4d9583409591eecce9e8a026128628bb002ea175\": container with ID starting with 65b2d78e444d92069ceb007a4d9583409591eecce9e8a026128628bb002ea175 not found: ID does not exist" containerID="65b2d78e444d92069ceb007a4d9583409591eecce9e8a026128628bb002ea175"
Jul 11 08:16:24.225880 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:24.225850    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65b2d78e444d92069ceb007a4d9583409591eecce9e8a026128628bb002ea175"} err="failed to get container status \"65b2d78e444d92069ceb007a4d9583409591eecce9e8a026128628bb002ea175\": rpc error: code = NotFound desc = could not find container \"65b2d78e444d92069ceb007a4d9583409591eecce9e8a026128628bb002ea175\": container with ID starting with 65b2d78e444d92069ceb007a4d9583409591eecce9e8a026128628bb002ea175 not found: ID does not exist"
Jul 11 08:16:24.230091 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:24.230067    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"]
Jul 11 08:16:24.233400 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:24.233379    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-683f5ca7-openshift-default-8d4d9f4b7-kdtvs"]
Jul 11 08:16:25.071544 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:16:25.071508    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="804f71ce-542d-448a-95f5-88a9ecc93906" path="/var/lib/kubelet/pods/804f71ce-542d-448a-95f5-88a9ecc93906/volumes"
Jul 11 08:17:12.544379 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.544313    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"]
Jul 11 08:17:12.544785 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.544681    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b18f50e-97f4-4060-9708-dab6377e1b68" containerName="maas-api"
Jul 11 08:17:12.544785 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.544692    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b18f50e-97f4-4060-9708-dab6377e1b68" containerName="maas-api"
Jul 11 08:17:12.544785 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.544702    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="804f71ce-542d-448a-95f5-88a9ecc93906" containerName="istio-proxy"
Jul 11 08:17:12.544785 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.544708    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="804f71ce-542d-448a-95f5-88a9ecc93906" containerName="istio-proxy"
Jul 11 08:17:12.544785 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.544744    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="804f71ce-542d-448a-95f5-88a9ecc93906" containerName="istio-proxy"
Jul 11 08:17:12.544785 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.544750    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="804f71ce-542d-448a-95f5-88a9ecc93906" containerName="istio-proxy"
Jul 11 08:17:12.544966 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.544810    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="804f71ce-542d-448a-95f5-88a9ecc93906" containerName="istio-proxy"
Jul 11 08:17:12.544966 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.544818    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b18f50e-97f4-4060-9708-dab6377e1b68" containerName="maas-api"
Jul 11 08:17:12.544966 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.544824    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="804f71ce-542d-448a-95f5-88a9ecc93906" containerName="istio-proxy"
Jul 11 08:17:12.549205 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.549189    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:12.551645 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.551625    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-8da7f7-openshift-default-dockercfg-57wqw\""
Jul 11 08:17:12.558111 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.558085    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"]
Jul 11 08:17:12.589387 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.589347    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b752ab2-f7cc-4296-9853-319254930b17-workload-socket\") pod \"e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") " pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:12.589387 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.589379    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b752ab2-f7cc-4296-9853-319254930b17-istio-podinfo\") pod \"e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") " pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:12.589563 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.589408    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b752ab2-f7cc-4296-9853-319254930b17-istio-envoy\") pod \"e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") " pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:12.589563 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.589466    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b752ab2-f7cc-4296-9853-319254930b17-istio-data\") pod \"e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") " pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:12.589563 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.589489    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b752ab2-f7cc-4296-9853-319254930b17-istiod-ca-cert\") pod \"e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") " pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:12.589563 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.589509    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b752ab2-f7cc-4296-9853-319254930b17-credential-socket\") pod \"e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") " pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:12.589713 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.589576    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b752ab2-f7cc-4296-9853-319254930b17-istio-token\") pod \"e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") " pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:12.589713 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.589598    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptgps\" (UniqueName: \"kubernetes.io/projected/5b752ab2-f7cc-4296-9853-319254930b17-kube-api-access-ptgps\") pod \"e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") " pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:12.589713 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.589615    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b752ab2-f7cc-4296-9853-319254930b17-workload-certs\") pod \"e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") " pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:12.690170 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.690136    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b752ab2-f7cc-4296-9853-319254930b17-workload-socket\") pod \"e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") " pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:12.690170 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.690168    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b752ab2-f7cc-4296-9853-319254930b17-istio-podinfo\") pod \"e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") " pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:12.690429 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.690203    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b752ab2-f7cc-4296-9853-319254930b17-istio-envoy\") pod \"e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") " pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:12.690429 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.690230    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b752ab2-f7cc-4296-9853-319254930b17-istio-data\") pod \"e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") " pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:12.690429 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.690245    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b752ab2-f7cc-4296-9853-319254930b17-istiod-ca-cert\") pod \"e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") " pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:12.690429 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.690262    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b752ab2-f7cc-4296-9853-319254930b17-credential-socket\") pod \"e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") " pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:12.690429 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.690384    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b752ab2-f7cc-4296-9853-319254930b17-istio-token\") pod \"e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") " pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:12.690429 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.690425    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptgps\" (UniqueName: \"kubernetes.io/projected/5b752ab2-f7cc-4296-9853-319254930b17-kube-api-access-ptgps\") pod \"e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") " pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:12.690718 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.690449    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b752ab2-f7cc-4296-9853-319254930b17-workload-certs\") pod \"e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") " pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:12.690718 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.690607    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b752ab2-f7cc-4296-9853-319254930b17-workload-socket\") pod \"e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") " pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:12.690718 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.690625    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b752ab2-f7cc-4296-9853-319254930b17-istio-data\") pod \"e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") " pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:12.690936 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.690918    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b752ab2-f7cc-4296-9853-319254930b17-istiod-ca-cert\") pod \"e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") " pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:12.691031 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.691009    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b752ab2-f7cc-4296-9853-319254930b17-credential-socket\") pod \"e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") " pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:12.691147 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.691126    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b752ab2-f7cc-4296-9853-319254930b17-workload-certs\") pod \"e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") " pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:12.692740 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.692715    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b752ab2-f7cc-4296-9853-319254930b17-istio-envoy\") pod \"e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") " pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:12.692859 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.692744    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b752ab2-f7cc-4296-9853-319254930b17-istio-podinfo\") pod \"e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") " pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:12.700578 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.700558    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b752ab2-f7cc-4296-9853-319254930b17-istio-token\") pod \"e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") " pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:12.700703 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.700564    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptgps\" (UniqueName: \"kubernetes.io/projected/5b752ab2-f7cc-4296-9853-319254930b17-kube-api-access-ptgps\") pod \"e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") " pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:12.859943 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.859844    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:12.997391 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:12.997367    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"]
Jul 11 08:17:12.999935 ip-10-0-142-153 kubenswrapper[2568]: W0711 08:17:12.999904    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b752ab2_f7cc_4296_9853_319254930b17.slice/crio-12477b023d7d1f11edbf2ac3b2f9be02df11f93a34f96fccf2f61c63fb9fae34 WatchSource:0}: Error finding container 12477b023d7d1f11edbf2ac3b2f9be02df11f93a34f96fccf2f61c63fb9fae34: Status 404 returned error can't find the container with id 12477b023d7d1f11edbf2ac3b2f9be02df11f93a34f96fccf2f61c63fb9fae34
Jul 11 08:17:13.002010 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:13.001978    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:17:13.002099 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:13.002041    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:17:13.002099 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:13.002076    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:17:13.425612 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:13.425572    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m" event={"ID":"5b752ab2-f7cc-4296-9853-319254930b17","Type":"ContainerStarted","Data":"a9b236be2990aa8e1c127485b6f4c5b5fb452cb4b6205840f139875b19f0aa54"}
Jul 11 08:17:13.425822 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:13.425627    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m" event={"ID":"5b752ab2-f7cc-4296-9853-319254930b17","Type":"ContainerStarted","Data":"12477b023d7d1f11edbf2ac3b2f9be02df11f93a34f96fccf2f61c63fb9fae34"}
Jul 11 08:17:13.450283 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:13.450236    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m" podStartSLOduration=1.450221252 podStartE2EDuration="1.450221252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 08:17:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 08:17:13.447692148 +0000 UTC m=+2344.932442271" watchObservedRunningTime="2026-07-11 08:17:13.450221252 +0000 UTC m=+2344.934971381"
Jul 11 08:17:13.860442 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:13.860408    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:14.864977 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:14.864947    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:15.435757 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:15.435718    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:15.436618 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:15.436587    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:15.555830 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:15.555792    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb"]
Jul 11 08:17:15.559748 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:15.559724    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb"
Jul 11 08:17:15.562003 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:15.561979    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-8da7f7-serving-cert\""
Jul 11 08:17:15.567904 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:15.567867    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb"]
Jul 11 08:17:15.609410 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:15.609384    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/912d4dc0-a1f8-48f6-ae2e-678da0599cf0-maas-api-tls\") pod \"maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb\" (UID: \"912d4dc0-a1f8-48f6-ae2e-678da0599cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb"
Jul 11 08:17:15.609560 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:15.609438    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/912d4dc0-a1f8-48f6-ae2e-678da0599cf0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb\" (UID: \"912d4dc0-a1f8-48f6-ae2e-678da0599cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb"
Jul 11 08:17:15.609630 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:15.609559    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rthf2\" (UniqueName: \"kubernetes.io/projected/912d4dc0-a1f8-48f6-ae2e-678da0599cf0-kube-api-access-rthf2\") pod \"maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb\" (UID: \"912d4dc0-a1f8-48f6-ae2e-678da0599cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb"
Jul 11 08:17:15.710479 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:15.710395    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rthf2\" (UniqueName: \"kubernetes.io/projected/912d4dc0-a1f8-48f6-ae2e-678da0599cf0-kube-api-access-rthf2\") pod \"maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb\" (UID: \"912d4dc0-a1f8-48f6-ae2e-678da0599cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb"
Jul 11 08:17:15.710479 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:15.710433    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/912d4dc0-a1f8-48f6-ae2e-678da0599cf0-maas-api-tls\") pod \"maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb\" (UID: \"912d4dc0-a1f8-48f6-ae2e-678da0599cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb"
Jul 11 08:17:15.710662 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:15.710487    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/912d4dc0-a1f8-48f6-ae2e-678da0599cf0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb\" (UID: \"912d4dc0-a1f8-48f6-ae2e-678da0599cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb"
Jul 11 08:17:15.711179 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:15.711156    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/912d4dc0-a1f8-48f6-ae2e-678da0599cf0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb\" (UID: \"912d4dc0-a1f8-48f6-ae2e-678da0599cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb"
Jul 11 08:17:15.712910 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:15.712890    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/912d4dc0-a1f8-48f6-ae2e-678da0599cf0-maas-api-tls\") pod \"maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb\" (UID: \"912d4dc0-a1f8-48f6-ae2e-678da0599cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb"
Jul 11 08:17:15.718231 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:15.718210    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rthf2\" (UniqueName: \"kubernetes.io/projected/912d4dc0-a1f8-48f6-ae2e-678da0599cf0-kube-api-access-rthf2\") pod \"maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb\" (UID: \"912d4dc0-a1f8-48f6-ae2e-678da0599cf0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb"
Jul 11 08:17:15.872801 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:15.872766    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb"
Jul 11 08:17:16.004443 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:16.004391    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb"]
Jul 11 08:17:16.006224 ip-10-0-142-153 kubenswrapper[2568]: W0711 08:17:16.006198    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod912d4dc0_a1f8_48f6_ae2e_678da0599cf0.slice/crio-06c1e790f2a7808a0a54a94f67d2cf052b2849d48d0da5cbd2dd677b287adae3 WatchSource:0}: Error finding container 06c1e790f2a7808a0a54a94f67d2cf052b2849d48d0da5cbd2dd677b287adae3: Status 404 returned error can't find the container with id 06c1e790f2a7808a0a54a94f67d2cf052b2849d48d0da5cbd2dd677b287adae3
Jul 11 08:17:16.441638 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:16.441601    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb" event={"ID":"912d4dc0-a1f8-48f6-ae2e-678da0599cf0","Type":"ContainerStarted","Data":"06c1e790f2a7808a0a54a94f67d2cf052b2849d48d0da5cbd2dd677b287adae3"}
Jul 11 08:17:17.447792 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:17.447757    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb" event={"ID":"912d4dc0-a1f8-48f6-ae2e-678da0599cf0","Type":"ContainerStarted","Data":"aee07fffce254182628a3700dd19413c56e33444ef8ea97567ecb86641a4bf60"}
Jul 11 08:17:17.448189 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:17.447814    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb"
Jul 11 08:17:17.465332 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:17.465280    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb" podStartSLOduration=1.948627822 podStartE2EDuration="2.465264799s" totalImagesPullingTime="516.636977ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 08:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 08:17:17.463428812 +0000 UTC m=+2348.948178946" watchObservedRunningTime="2026-07-11 08:17:17.465264799 +0000 UTC m=+2348.950014931"
Jul 11 08:17:23.457165 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:23.457129    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb"
Jul 11 08:17:30.437511 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:30.437476    2568 patch_prober.go:28] interesting pod/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 11 08:17:30.437914 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:30.437544    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m" podUID="5b752ab2-f7cc-4296-9853-319254930b17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 11 08:17:30.515209 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:30.515173    2568 generic.go:356] "Generic (PLEG): container finished" podID="5b752ab2-f7cc-4296-9853-319254930b17" containerID="a9b236be2990aa8e1c127485b6f4c5b5fb452cb4b6205840f139875b19f0aa54" exitCode=0
Jul 11 08:17:30.515412 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:30.515244    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m" event={"ID":"5b752ab2-f7cc-4296-9853-319254930b17","Type":"ContainerDied","Data":"a9b236be2990aa8e1c127485b6f4c5b5fb452cb4b6205840f139875b19f0aa54"}
Jul 11 08:17:30.515639 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:30.515626    2568 scope.go:117] "RemoveContainer" containerID="a9b236be2990aa8e1c127485b6f4c5b5fb452cb4b6205840f139875b19f0aa54"
Jul 11 08:17:30.516606 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:30.516576    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:17:30.516701 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:30.516652    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:17:30.516701 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:30.516692    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:17:31.521363 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:31.521314    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m" event={"ID":"5b752ab2-f7cc-4296-9853-319254930b17","Type":"ContainerStarted","Data":"fb8cbe0ec091c6661c6665a3b2698ff7269f48f18a51acdf194ace3945c6f8e9"}
Jul 11 08:17:31.860443 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:31.860404    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:31.860677 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:31.860653    2568 patch_prober.go:28] interesting pod/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 11 08:17:31.860724 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:31.860699    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m" podUID="5b752ab2-f7cc-4296-9853-319254930b17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 11 08:17:32.861275 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:32.861238    2568 patch_prober.go:28] interesting pod/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 11 08:17:32.861724 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:32.861295    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m" podUID="5b752ab2-f7cc-4296-9853-319254930b17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 11 08:17:33.860640 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:33.860595    2568 patch_prober.go:28] interesting pod/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 11 08:17:33.860822 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:33.860657    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m" podUID="5b752ab2-f7cc-4296-9853-319254930b17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 11 08:17:34.860967 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:34.860928    2568 patch_prober.go:28] interesting pod/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 11 08:17:34.861387 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:34.861002    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m" podUID="5b752ab2-f7cc-4296-9853-319254930b17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 11 08:17:35.864359 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:35.864318    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:35.864751 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:35.864596    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:17:35.865351 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:17:35.865318    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:18:37.300663 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:37.300434    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb"]
Jul 11 08:18:37.301201 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:37.300688    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb" podUID="912d4dc0-a1f8-48f6-ae2e-678da0599cf0" containerName="maas-api" containerID="cri-o://aee07fffce254182628a3700dd19413c56e33444ef8ea97567ecb86641a4bf60" gracePeriod=30
Jul 11 08:18:37.548287 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:37.548259    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb"
Jul 11 08:18:37.626461 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:37.626372    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/912d4dc0-a1f8-48f6-ae2e-678da0599cf0-maas-api-tls\") pod \"912d4dc0-a1f8-48f6-ae2e-678da0599cf0\" (UID: \"912d4dc0-a1f8-48f6-ae2e-678da0599cf0\") "
Jul 11 08:18:37.626461 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:37.626447    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/912d4dc0-a1f8-48f6-ae2e-678da0599cf0-openshift-service-ca\") pod \"912d4dc0-a1f8-48f6-ae2e-678da0599cf0\" (UID: \"912d4dc0-a1f8-48f6-ae2e-678da0599cf0\") "
Jul 11 08:18:37.626686 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:37.626524    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rthf2\" (UniqueName: \"kubernetes.io/projected/912d4dc0-a1f8-48f6-ae2e-678da0599cf0-kube-api-access-rthf2\") pod \"912d4dc0-a1f8-48f6-ae2e-678da0599cf0\" (UID: \"912d4dc0-a1f8-48f6-ae2e-678da0599cf0\") "
Jul 11 08:18:37.626808 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:37.626779    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/912d4dc0-a1f8-48f6-ae2e-678da0599cf0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "912d4dc0-a1f8-48f6-ae2e-678da0599cf0" (UID: "912d4dc0-a1f8-48f6-ae2e-678da0599cf0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 08:18:37.628504 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:37.628474    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/912d4dc0-a1f8-48f6-ae2e-678da0599cf0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "912d4dc0-a1f8-48f6-ae2e-678da0599cf0" (UID: "912d4dc0-a1f8-48f6-ae2e-678da0599cf0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 08:18:37.628615 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:37.628583    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/912d4dc0-a1f8-48f6-ae2e-678da0599cf0-kube-api-access-rthf2" (OuterVolumeSpecName: "kube-api-access-rthf2") pod "912d4dc0-a1f8-48f6-ae2e-678da0599cf0" (UID: "912d4dc0-a1f8-48f6-ae2e-678da0599cf0"). InnerVolumeSpecName "kube-api-access-rthf2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 08:18:37.727348 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:37.727270    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rthf2\" (UniqueName: \"kubernetes.io/projected/912d4dc0-a1f8-48f6-ae2e-678da0599cf0-kube-api-access-rthf2\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:18:37.727348 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:37.727317    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/912d4dc0-a1f8-48f6-ae2e-678da0599cf0-maas-api-tls\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:18:37.727348 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:37.727352    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/912d4dc0-a1f8-48f6-ae2e-678da0599cf0-openshift-service-ca\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:18:37.823458 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:37.823426    2568 generic.go:356] "Generic (PLEG): container finished" podID="912d4dc0-a1f8-48f6-ae2e-678da0599cf0" containerID="aee07fffce254182628a3700dd19413c56e33444ef8ea97567ecb86641a4bf60" exitCode=0
Jul 11 08:18:37.823618 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:37.823476    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb"
Jul 11 08:18:37.823618 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:37.823519    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb" event={"ID":"912d4dc0-a1f8-48f6-ae2e-678da0599cf0","Type":"ContainerDied","Data":"aee07fffce254182628a3700dd19413c56e33444ef8ea97567ecb86641a4bf60"}
Jul 11 08:18:37.823618 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:37.823576    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb" event={"ID":"912d4dc0-a1f8-48f6-ae2e-678da0599cf0","Type":"ContainerDied","Data":"06c1e790f2a7808a0a54a94f67d2cf052b2849d48d0da5cbd2dd677b287adae3"}
Jul 11 08:18:37.824903 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:37.823603    2568 scope.go:117] "RemoveContainer" containerID="aee07fffce254182628a3700dd19413c56e33444ef8ea97567ecb86641a4bf60"
Jul 11 08:18:37.833662 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:37.833642    2568 scope.go:117] "RemoveContainer" containerID="aee07fffce254182628a3700dd19413c56e33444ef8ea97567ecb86641a4bf60"
Jul 11 08:18:37.833932 ip-10-0-142-153 kubenswrapper[2568]: E0711 08:18:37.833914    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aee07fffce254182628a3700dd19413c56e33444ef8ea97567ecb86641a4bf60\": container with ID starting with aee07fffce254182628a3700dd19413c56e33444ef8ea97567ecb86641a4bf60 not found: ID does not exist" containerID="aee07fffce254182628a3700dd19413c56e33444ef8ea97567ecb86641a4bf60"
Jul 11 08:18:37.833979 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:37.833942    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aee07fffce254182628a3700dd19413c56e33444ef8ea97567ecb86641a4bf60"} err="failed to get container status \"aee07fffce254182628a3700dd19413c56e33444ef8ea97567ecb86641a4bf60\": rpc error: code = NotFound desc = could not find container \"aee07fffce254182628a3700dd19413c56e33444ef8ea97567ecb86641a4bf60\": container with ID starting with aee07fffce254182628a3700dd19413c56e33444ef8ea97567ecb86641a4bf60 not found: ID does not exist"
Jul 11 08:18:37.846790 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:37.846768    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb"]
Jul 11 08:18:37.851006 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:37.850988    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8da7f7-6f5b8b6887-7rdhb"]
Jul 11 08:18:39.071966 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:39.071921    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="912d4dc0-a1f8-48f6-ae2e-678da0599cf0" path="/var/lib/kubelet/pods/912d4dc0-a1f8-48f6-ae2e-678da0599cf0/volumes"
Jul 11 08:18:52.661078 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:52.661042    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"]
Jul 11 08:18:52.661625 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:52.661299    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m" podUID="5b752ab2-f7cc-4296-9853-319254930b17" containerName="istio-proxy" containerID="cri-o://fb8cbe0ec091c6661c6665a3b2698ff7269f48f18a51acdf194ace3945c6f8e9" gracePeriod=30
Jul 11 08:18:57.910379 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:57.910355    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:18:57.913068 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:57.913042    2568 generic.go:356] "Generic (PLEG): container finished" podID="5b752ab2-f7cc-4296-9853-319254930b17" containerID="fb8cbe0ec091c6661c6665a3b2698ff7269f48f18a51acdf194ace3945c6f8e9" exitCode=0
Jul 11 08:18:57.913169 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:57.913080    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"
Jul 11 08:18:57.913169 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:57.913081    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m" event={"ID":"5b752ab2-f7cc-4296-9853-319254930b17","Type":"ContainerDied","Data":"fb8cbe0ec091c6661c6665a3b2698ff7269f48f18a51acdf194ace3945c6f8e9"}
Jul 11 08:18:57.913169 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:57.913130    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m" event={"ID":"5b752ab2-f7cc-4296-9853-319254930b17","Type":"ContainerDied","Data":"12477b023d7d1f11edbf2ac3b2f9be02df11f93a34f96fccf2f61c63fb9fae34"}
Jul 11 08:18:57.913169 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:57.913159    2568 scope.go:117] "RemoveContainer" containerID="fb8cbe0ec091c6661c6665a3b2698ff7269f48f18a51acdf194ace3945c6f8e9"
Jul 11 08:18:57.920783 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:57.920764    2568 scope.go:117] "RemoveContainer" containerID="a9b236be2990aa8e1c127485b6f4c5b5fb452cb4b6205840f139875b19f0aa54"
Jul 11 08:18:57.928266 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:57.928244    2568 scope.go:117] "RemoveContainer" containerID="fb8cbe0ec091c6661c6665a3b2698ff7269f48f18a51acdf194ace3945c6f8e9"
Jul 11 08:18:57.929072 ip-10-0-142-153 kubenswrapper[2568]: E0711 08:18:57.928677    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb8cbe0ec091c6661c6665a3b2698ff7269f48f18a51acdf194ace3945c6f8e9\": container with ID starting with fb8cbe0ec091c6661c6665a3b2698ff7269f48f18a51acdf194ace3945c6f8e9 not found: ID does not exist" containerID="fb8cbe0ec091c6661c6665a3b2698ff7269f48f18a51acdf194ace3945c6f8e9"
Jul 11 08:18:57.929072 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:57.928746    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb8cbe0ec091c6661c6665a3b2698ff7269f48f18a51acdf194ace3945c6f8e9"} err="failed to get container status \"fb8cbe0ec091c6661c6665a3b2698ff7269f48f18a51acdf194ace3945c6f8e9\": rpc error: code = NotFound desc = could not find container \"fb8cbe0ec091c6661c6665a3b2698ff7269f48f18a51acdf194ace3945c6f8e9\": container with ID starting with fb8cbe0ec091c6661c6665a3b2698ff7269f48f18a51acdf194ace3945c6f8e9 not found: ID does not exist"
Jul 11 08:18:57.929072 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:57.928770    2568 scope.go:117] "RemoveContainer" containerID="a9b236be2990aa8e1c127485b6f4c5b5fb452cb4b6205840f139875b19f0aa54"
Jul 11 08:18:57.929278 ip-10-0-142-153 kubenswrapper[2568]: E0711 08:18:57.929068    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9b236be2990aa8e1c127485b6f4c5b5fb452cb4b6205840f139875b19f0aa54\": container with ID starting with a9b236be2990aa8e1c127485b6f4c5b5fb452cb4b6205840f139875b19f0aa54 not found: ID does not exist" containerID="a9b236be2990aa8e1c127485b6f4c5b5fb452cb4b6205840f139875b19f0aa54"
Jul 11 08:18:57.929278 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:57.929094    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9b236be2990aa8e1c127485b6f4c5b5fb452cb4b6205840f139875b19f0aa54"} err="failed to get container status \"a9b236be2990aa8e1c127485b6f4c5b5fb452cb4b6205840f139875b19f0aa54\": rpc error: code = NotFound desc = could not find container \"a9b236be2990aa8e1c127485b6f4c5b5fb452cb4b6205840f139875b19f0aa54\": container with ID starting with a9b236be2990aa8e1c127485b6f4c5b5fb452cb4b6205840f139875b19f0aa54 not found: ID does not exist"
Jul 11 08:18:58.003639 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:58.003609    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b752ab2-f7cc-4296-9853-319254930b17-istio-envoy\") pod \"5b752ab2-f7cc-4296-9853-319254930b17\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") "
Jul 11 08:18:58.003639 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:58.003638    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b752ab2-f7cc-4296-9853-319254930b17-istiod-ca-cert\") pod \"5b752ab2-f7cc-4296-9853-319254930b17\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") "
Jul 11 08:18:58.003820 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:58.003653    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b752ab2-f7cc-4296-9853-319254930b17-workload-certs\") pod \"5b752ab2-f7cc-4296-9853-319254930b17\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") "
Jul 11 08:18:58.003820 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:58.003679    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b752ab2-f7cc-4296-9853-319254930b17-workload-socket\") pod \"5b752ab2-f7cc-4296-9853-319254930b17\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") "
Jul 11 08:18:58.003900 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:58.003874    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b752ab2-f7cc-4296-9853-319254930b17-istio-data\") pod \"5b752ab2-f7cc-4296-9853-319254930b17\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") "
Jul 11 08:18:58.003941 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:58.003917    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b752ab2-f7cc-4296-9853-319254930b17-credential-socket\") pod \"5b752ab2-f7cc-4296-9853-319254930b17\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") "
Jul 11 08:18:58.003941 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:58.003920    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b752ab2-f7cc-4296-9853-319254930b17-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5b752ab2-f7cc-4296-9853-319254930b17" (UID: "5b752ab2-f7cc-4296-9853-319254930b17"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:18:58.004021 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:58.003950    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b752ab2-f7cc-4296-9853-319254930b17-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5b752ab2-f7cc-4296-9853-319254930b17" (UID: "5b752ab2-f7cc-4296-9853-319254930b17"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:18:58.004021 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:58.003957    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b752ab2-f7cc-4296-9853-319254930b17-istio-podinfo\") pod \"5b752ab2-f7cc-4296-9853-319254930b17\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") "
Jul 11 08:18:58.004101 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:58.004017    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b752ab2-f7cc-4296-9853-319254930b17-istio-token\") pod \"5b752ab2-f7cc-4296-9853-319254930b17\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") "
Jul 11 08:18:58.004101 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:58.004065    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b752ab2-f7cc-4296-9853-319254930b17-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5b752ab2-f7cc-4296-9853-319254930b17" (UID: "5b752ab2-f7cc-4296-9853-319254930b17"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 08:18:58.004101 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:58.004068    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptgps\" (UniqueName: \"kubernetes.io/projected/5b752ab2-f7cc-4296-9853-319254930b17-kube-api-access-ptgps\") pod \"5b752ab2-f7cc-4296-9853-319254930b17\" (UID: \"5b752ab2-f7cc-4296-9853-319254930b17\") "
Jul 11 08:18:58.004246 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:58.004138    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b752ab2-f7cc-4296-9853-319254930b17-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5b752ab2-f7cc-4296-9853-319254930b17" (UID: "5b752ab2-f7cc-4296-9853-319254930b17"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:18:58.004302 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:58.004273    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b752ab2-f7cc-4296-9853-319254930b17-istiod-ca-cert\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:18:58.004302 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:58.004284    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b752ab2-f7cc-4296-9853-319254930b17-workload-certs\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:18:58.004302 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:58.004292    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b752ab2-f7cc-4296-9853-319254930b17-workload-socket\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:18:58.004302 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:58.004300    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b752ab2-f7cc-4296-9853-319254930b17-credential-socket\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:18:58.004856 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:58.004826    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b752ab2-f7cc-4296-9853-319254930b17-istio-data" (OuterVolumeSpecName: "istio-data") pod "5b752ab2-f7cc-4296-9853-319254930b17" (UID: "5b752ab2-f7cc-4296-9853-319254930b17"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:18:58.005745 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:58.005719    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b752ab2-f7cc-4296-9853-319254930b17-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5b752ab2-f7cc-4296-9853-319254930b17" (UID: "5b752ab2-f7cc-4296-9853-319254930b17"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:18:58.005876 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:58.005835    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5b752ab2-f7cc-4296-9853-319254930b17-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5b752ab2-f7cc-4296-9853-319254930b17" (UID: "5b752ab2-f7cc-4296-9853-319254930b17"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 11 08:18:58.006165 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:58.006144    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b752ab2-f7cc-4296-9853-319254930b17-istio-token" (OuterVolumeSpecName: "istio-token") pod "5b752ab2-f7cc-4296-9853-319254930b17" (UID: "5b752ab2-f7cc-4296-9853-319254930b17"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 08:18:58.006165 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:58.006149    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b752ab2-f7cc-4296-9853-319254930b17-kube-api-access-ptgps" (OuterVolumeSpecName: "kube-api-access-ptgps") pod "5b752ab2-f7cc-4296-9853-319254930b17" (UID: "5b752ab2-f7cc-4296-9853-319254930b17"). InnerVolumeSpecName "kube-api-access-ptgps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 08:18:58.105493 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:58.105458    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b752ab2-f7cc-4296-9853-319254930b17-istio-podinfo\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:18:58.105493 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:58.105493    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b752ab2-f7cc-4296-9853-319254930b17-istio-token\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:18:58.105687 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:58.105507    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptgps\" (UniqueName: \"kubernetes.io/projected/5b752ab2-f7cc-4296-9853-319254930b17-kube-api-access-ptgps\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:18:58.105687 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:58.105522    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b752ab2-f7cc-4296-9853-319254930b17-istio-envoy\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:18:58.105687 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:58.105534    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b752ab2-f7cc-4296-9853-319254930b17-istio-data\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:18:58.233834 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:58.233802    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"]
Jul 11 08:18:58.239412 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:58.239387    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-8da7f7-openshift-default-6965c48d99-9tf4m"]
Jul 11 08:18:59.072915 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:18:59.072878    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b752ab2-f7cc-4296-9853-319254930b17" path="/var/lib/kubelet/pods/5b752ab2-f7cc-4296-9853-319254930b17/volumes"
Jul 11 08:19:19.672812 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.672776    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"]
Jul 11 08:19:19.673225 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.673121    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b752ab2-f7cc-4296-9853-319254930b17" containerName="istio-proxy"
Jul 11 08:19:19.673225 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.673132    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b752ab2-f7cc-4296-9853-319254930b17" containerName="istio-proxy"
Jul 11 08:19:19.673225 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.673149    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="912d4dc0-a1f8-48f6-ae2e-678da0599cf0" containerName="maas-api"
Jul 11 08:19:19.673225 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.673155    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="912d4dc0-a1f8-48f6-ae2e-678da0599cf0" containerName="maas-api"
Jul 11 08:19:19.673225 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.673169    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b752ab2-f7cc-4296-9853-319254930b17" containerName="istio-proxy"
Jul 11 08:19:19.673225 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.673174    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b752ab2-f7cc-4296-9853-319254930b17" containerName="istio-proxy"
Jul 11 08:19:19.673225 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.673218    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b752ab2-f7cc-4296-9853-319254930b17" containerName="istio-proxy"
Jul 11 08:19:19.673225 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.673225    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="912d4dc0-a1f8-48f6-ae2e-678da0599cf0" containerName="maas-api"
Jul 11 08:19:19.673504 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.673232    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b752ab2-f7cc-4296-9853-319254930b17" containerName="istio-proxy"
Jul 11 08:19:19.676236 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.676220    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:19.678608 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.678589    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-393a88-openshift-default-dockercfg-fxsh5\""
Jul 11 08:19:19.686545 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.686523    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"]
Jul 11 08:19:19.794478 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.794441    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d94d142-9d4e-4071-b386-3dac43d2baf0-istiod-ca-cert\") pod \"e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") " pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:19.794478 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.794483    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d94d142-9d4e-4071-b386-3dac43d2baf0-istio-envoy\") pod \"e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") " pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:19.794688 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.794543    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d94d142-9d4e-4071-b386-3dac43d2baf0-istio-podinfo\") pod \"e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") " pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:19.794688 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.794580    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d94d142-9d4e-4071-b386-3dac43d2baf0-credential-socket\") pod \"e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") " pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:19.794688 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.794602    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d94d142-9d4e-4071-b386-3dac43d2baf0-istio-token\") pod \"e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") " pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:19.794688 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.794667    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d94d142-9d4e-4071-b386-3dac43d2baf0-workload-socket\") pod \"e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") " pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:19.794688 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.794686    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d94d142-9d4e-4071-b386-3dac43d2baf0-istio-data\") pod \"e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") " pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:19.794843 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.794718    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jbbp\" (UniqueName: \"kubernetes.io/projected/3d94d142-9d4e-4071-b386-3dac43d2baf0-kube-api-access-8jbbp\") pod \"e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") " pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:19.794843 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.794765    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d94d142-9d4e-4071-b386-3dac43d2baf0-workload-certs\") pod \"e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") " pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:19.895655 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.895623    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d94d142-9d4e-4071-b386-3dac43d2baf0-workload-certs\") pod \"e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") " pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:19.895824 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.895663    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d94d142-9d4e-4071-b386-3dac43d2baf0-istiod-ca-cert\") pod \"e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") " pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:19.895824 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.895680    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d94d142-9d4e-4071-b386-3dac43d2baf0-istio-envoy\") pod \"e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") " pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:19.895824 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.895700    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d94d142-9d4e-4071-b386-3dac43d2baf0-istio-podinfo\") pod \"e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") " pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:19.895824 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.895716    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d94d142-9d4e-4071-b386-3dac43d2baf0-credential-socket\") pod \"e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") " pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:19.895824 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.895733    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d94d142-9d4e-4071-b386-3dac43d2baf0-istio-token\") pod \"e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") " pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:19.895824 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.895789    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d94d142-9d4e-4071-b386-3dac43d2baf0-workload-socket\") pod \"e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") " pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:19.895824 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.895813    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d94d142-9d4e-4071-b386-3dac43d2baf0-istio-data\") pod \"e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") " pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:19.896196 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.896168    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d94d142-9d4e-4071-b386-3dac43d2baf0-credential-socket\") pod \"e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") " pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:19.896196 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.896184    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jbbp\" (UniqueName: \"kubernetes.io/projected/3d94d142-9d4e-4071-b386-3dac43d2baf0-kube-api-access-8jbbp\") pod \"e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") " pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:19.896309 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.896203    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d94d142-9d4e-4071-b386-3dac43d2baf0-workload-socket\") pod \"e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") " pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:19.896309 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.896213    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d94d142-9d4e-4071-b386-3dac43d2baf0-istio-data\") pod \"e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") " pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:19.896451 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.896356    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d94d142-9d4e-4071-b386-3dac43d2baf0-workload-certs\") pod \"e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") " pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:19.896520 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.896501    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d94d142-9d4e-4071-b386-3dac43d2baf0-istiod-ca-cert\") pod \"e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") " pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:19.897968 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.897951    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d94d142-9d4e-4071-b386-3dac43d2baf0-istio-envoy\") pod \"e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") " pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:19.898252 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.898236    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d94d142-9d4e-4071-b386-3dac43d2baf0-istio-podinfo\") pod \"e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") " pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:19.903964 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.903939    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d94d142-9d4e-4071-b386-3dac43d2baf0-istio-token\") pod \"e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") " pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:19.904075 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.904053    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jbbp\" (UniqueName: \"kubernetes.io/projected/3d94d142-9d4e-4071-b386-3dac43d2baf0-kube-api-access-8jbbp\") pod \"e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") " pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:19.986898 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:19.986812    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:20.119292 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:20.119264    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"]
Jul 11 08:19:20.121385 ip-10-0-142-153 kubenswrapper[2568]: W0711 08:19:20.121359    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d94d142_9d4e_4071_b386_3dac43d2baf0.slice/crio-bff1dd6b308c34c7de2c3e4cdc1264eef9af18afdbcb03f25e111028dd7a2452 WatchSource:0}: Error finding container bff1dd6b308c34c7de2c3e4cdc1264eef9af18afdbcb03f25e111028dd7a2452: Status 404 returned error can't find the container with id bff1dd6b308c34c7de2c3e4cdc1264eef9af18afdbcb03f25e111028dd7a2452
Jul 11 08:19:20.123623 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:20.123593    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:19:20.123725 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:20.123672    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:19:20.123725 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:20.123714    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:19:21.017971 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:21.017939    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf" event={"ID":"3d94d142-9d4e-4071-b386-3dac43d2baf0","Type":"ContainerStarted","Data":"0bc6db0440b62a99cbc4cbb8a82959d990b82e5f7c99df8ce06680ad873fb0f2"}
Jul 11 08:19:21.018357 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:21.018015    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf" event={"ID":"3d94d142-9d4e-4071-b386-3dac43d2baf0","Type":"ContainerStarted","Data":"bff1dd6b308c34c7de2c3e4cdc1264eef9af18afdbcb03f25e111028dd7a2452"}
Jul 11 08:19:21.038710 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:21.038660    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf" podStartSLOduration=2.038646046 podStartE2EDuration="2.038646046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 08:19:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 08:19:21.037151444 +0000 UTC m=+2472.521901577" watchObservedRunningTime="2026-07-11 08:19:21.038646046 +0000 UTC m=+2472.523396246"
Jul 11 08:19:21.987217 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:21.987125    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:21.991848 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:21.991823    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:22.022552 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:22.022528    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:22.023358 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:22.023317    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:23.156911 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:23.156883    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-393a88-65db585dd5-lrqxz"]
Jul 11 08:19:23.160180 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:23.160161    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-393a88-65db585dd5-lrqxz"
Jul 11 08:19:23.162823 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:23.162794    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-393a88-serving-cert\""
Jul 11 08:19:23.172187 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:23.172156    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-393a88-65db585dd5-lrqxz"]
Jul 11 08:19:23.330243 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:23.330216    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6cc4fb6-1e08-401b-9ea7-5092fbff3374-openshift-service-ca\") pod \"maas-api-e2e-api-a-393a88-65db585dd5-lrqxz\" (UID: \"d6cc4fb6-1e08-401b-9ea7-5092fbff3374\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-393a88-65db585dd5-lrqxz"
Jul 11 08:19:23.330424 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:23.330262    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs8fd\" (UniqueName: \"kubernetes.io/projected/d6cc4fb6-1e08-401b-9ea7-5092fbff3374-kube-api-access-cs8fd\") pod \"maas-api-e2e-api-a-393a88-65db585dd5-lrqxz\" (UID: \"d6cc4fb6-1e08-401b-9ea7-5092fbff3374\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-393a88-65db585dd5-lrqxz"
Jul 11 08:19:23.330424 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:23.330359    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6cc4fb6-1e08-401b-9ea7-5092fbff3374-maas-api-tls\") pod \"maas-api-e2e-api-a-393a88-65db585dd5-lrqxz\" (UID: \"d6cc4fb6-1e08-401b-9ea7-5092fbff3374\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-393a88-65db585dd5-lrqxz"
Jul 11 08:19:23.431160 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:23.431070    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs8fd\" (UniqueName: \"kubernetes.io/projected/d6cc4fb6-1e08-401b-9ea7-5092fbff3374-kube-api-access-cs8fd\") pod \"maas-api-e2e-api-a-393a88-65db585dd5-lrqxz\" (UID: \"d6cc4fb6-1e08-401b-9ea7-5092fbff3374\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-393a88-65db585dd5-lrqxz"
Jul 11 08:19:23.431160 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:23.431122    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6cc4fb6-1e08-401b-9ea7-5092fbff3374-maas-api-tls\") pod \"maas-api-e2e-api-a-393a88-65db585dd5-lrqxz\" (UID: \"d6cc4fb6-1e08-401b-9ea7-5092fbff3374\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-393a88-65db585dd5-lrqxz"
Jul 11 08:19:23.431372 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:23.431169    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6cc4fb6-1e08-401b-9ea7-5092fbff3374-openshift-service-ca\") pod \"maas-api-e2e-api-a-393a88-65db585dd5-lrqxz\" (UID: \"d6cc4fb6-1e08-401b-9ea7-5092fbff3374\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-393a88-65db585dd5-lrqxz"
Jul 11 08:19:23.431751 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:23.431727    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6cc4fb6-1e08-401b-9ea7-5092fbff3374-openshift-service-ca\") pod \"maas-api-e2e-api-a-393a88-65db585dd5-lrqxz\" (UID: \"d6cc4fb6-1e08-401b-9ea7-5092fbff3374\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-393a88-65db585dd5-lrqxz"
Jul 11 08:19:23.433489 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:23.433471    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6cc4fb6-1e08-401b-9ea7-5092fbff3374-maas-api-tls\") pod \"maas-api-e2e-api-a-393a88-65db585dd5-lrqxz\" (UID: \"d6cc4fb6-1e08-401b-9ea7-5092fbff3374\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-393a88-65db585dd5-lrqxz"
Jul 11 08:19:23.439083 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:23.439058    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs8fd\" (UniqueName: \"kubernetes.io/projected/d6cc4fb6-1e08-401b-9ea7-5092fbff3374-kube-api-access-cs8fd\") pod \"maas-api-e2e-api-a-393a88-65db585dd5-lrqxz\" (UID: \"d6cc4fb6-1e08-401b-9ea7-5092fbff3374\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-393a88-65db585dd5-lrqxz"
Jul 11 08:19:23.471038 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:23.471014    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-393a88-65db585dd5-lrqxz"
Jul 11 08:19:23.600873 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:23.600742    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-393a88-65db585dd5-lrqxz"]
Jul 11 08:19:23.603340 ip-10-0-142-153 kubenswrapper[2568]: W0711 08:19:23.603292    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6cc4fb6_1e08_401b_9ea7_5092fbff3374.slice/crio-022b80e5dd36ae1b6d8165a91ac8731eab699b56ab1d60a5e30f38204093f684 WatchSource:0}: Error finding container 022b80e5dd36ae1b6d8165a91ac8731eab699b56ab1d60a5e30f38204093f684: Status 404 returned error can't find the container with id 022b80e5dd36ae1b6d8165a91ac8731eab699b56ab1d60a5e30f38204093f684
Jul 11 08:19:23.605090 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:23.605075    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 08:19:24.033252 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:24.033215    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-393a88-65db585dd5-lrqxz" event={"ID":"d6cc4fb6-1e08-401b-9ea7-5092fbff3374","Type":"ContainerStarted","Data":"022b80e5dd36ae1b6d8165a91ac8731eab699b56ab1d60a5e30f38204093f684"}
Jul 11 08:19:25.040378 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:25.040318    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-393a88-65db585dd5-lrqxz" event={"ID":"d6cc4fb6-1e08-401b-9ea7-5092fbff3374","Type":"ContainerStarted","Data":"585794cde9406a9e7dd56fe5eca99e21dbb1ca4ab3dacc25e1c5a487c9abbead"}
Jul 11 08:19:25.040837 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:25.040509    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-393a88-65db585dd5-lrqxz"
Jul 11 08:19:25.059303 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:25.059259    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-393a88-65db585dd5-lrqxz" podStartSLOduration=1.544943821 podStartE2EDuration="2.059243992s" totalImagesPullingTime="514.300171ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 08:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 08:19:25.057043331 +0000 UTC m=+2476.541793465" watchObservedRunningTime="2026-07-11 08:19:25.059243992 +0000 UTC m=+2476.543994125"
Jul 11 08:19:30.907351 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:30.907301    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np"]
Jul 11 08:19:30.911961 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:30.911930    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np"
Jul 11 08:19:30.914446 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:30.914419    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-f92f11-serving-cert\""
Jul 11 08:19:30.919458 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:30.919429    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np"]
Jul 11 08:19:30.999873 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:30.999789    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79zwm\" (UniqueName: \"kubernetes.io/projected/d3035091-2c83-4935-8f96-7b27139b5199-kube-api-access-79zwm\") pod \"maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np\" (UID: \"d3035091-2c83-4935-8f96-7b27139b5199\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np"
Jul 11 08:19:31.000200 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:31.000176    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3035091-2c83-4935-8f96-7b27139b5199-maas-api-tls\") pod \"maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np\" (UID: \"d3035091-2c83-4935-8f96-7b27139b5199\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np"
Jul 11 08:19:31.000423 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:31.000405    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3035091-2c83-4935-8f96-7b27139b5199-openshift-service-ca\") pod \"maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np\" (UID: \"d3035091-2c83-4935-8f96-7b27139b5199\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np"
Jul 11 08:19:31.050002 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:31.049972    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-393a88-65db585dd5-lrqxz"
Jul 11 08:19:31.103832 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:31.103794    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79zwm\" (UniqueName: \"kubernetes.io/projected/d3035091-2c83-4935-8f96-7b27139b5199-kube-api-access-79zwm\") pod \"maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np\" (UID: \"d3035091-2c83-4935-8f96-7b27139b5199\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np"
Jul 11 08:19:31.104138 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:31.104115    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3035091-2c83-4935-8f96-7b27139b5199-maas-api-tls\") pod \"maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np\" (UID: \"d3035091-2c83-4935-8f96-7b27139b5199\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np"
Jul 11 08:19:31.104289 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:31.104274    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3035091-2c83-4935-8f96-7b27139b5199-openshift-service-ca\") pod \"maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np\" (UID: \"d3035091-2c83-4935-8f96-7b27139b5199\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np"
Jul 11 08:19:31.105183 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:31.105161    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3035091-2c83-4935-8f96-7b27139b5199-openshift-service-ca\") pod \"maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np\" (UID: \"d3035091-2c83-4935-8f96-7b27139b5199\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np"
Jul 11 08:19:31.113195 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:31.113172    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3035091-2c83-4935-8f96-7b27139b5199-maas-api-tls\") pod \"maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np\" (UID: \"d3035091-2c83-4935-8f96-7b27139b5199\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np"
Jul 11 08:19:31.114459 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:31.114437    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79zwm\" (UniqueName: \"kubernetes.io/projected/d3035091-2c83-4935-8f96-7b27139b5199-kube-api-access-79zwm\") pod \"maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np\" (UID: \"d3035091-2c83-4935-8f96-7b27139b5199\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np"
Jul 11 08:19:31.224926 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:31.224846    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np"
Jul 11 08:19:31.379374 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:31.379338    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np"]
Jul 11 08:19:31.380639 ip-10-0-142-153 kubenswrapper[2568]: W0711 08:19:31.380614    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3035091_2c83_4935_8f96_7b27139b5199.slice/crio-044d9402f3f4e23050de9c9e6d38d6de751e3e6a20d5ff5f5aeb97f2ae85ca5b WatchSource:0}: Error finding container 044d9402f3f4e23050de9c9e6d38d6de751e3e6a20d5ff5f5aeb97f2ae85ca5b: Status 404 returned error can't find the container with id 044d9402f3f4e23050de9c9e6d38d6de751e3e6a20d5ff5f5aeb97f2ae85ca5b
Jul 11 08:19:32.071409 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:32.071367    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np" event={"ID":"d3035091-2c83-4935-8f96-7b27139b5199","Type":"ContainerStarted","Data":"30fd58688d0b99b20c6a902b99b92fff40745c690b4ff3a01bc5af7572cb9b4d"}
Jul 11 08:19:32.071882 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:32.071433    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np" event={"ID":"d3035091-2c83-4935-8f96-7b27139b5199","Type":"ContainerStarted","Data":"044d9402f3f4e23050de9c9e6d38d6de751e3e6a20d5ff5f5aeb97f2ae85ca5b"}
Jul 11 08:19:32.071882 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:32.071505    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np"
Jul 11 08:19:35.087110 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:35.087079    2568 generic.go:356] "Generic (PLEG): container finished" podID="3d94d142-9d4e-4071-b386-3dac43d2baf0" containerID="0bc6db0440b62a99cbc4cbb8a82959d990b82e5f7c99df8ce06680ad873fb0f2" exitCode=0
Jul 11 08:19:35.087534 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:35.087151    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf" event={"ID":"3d94d142-9d4e-4071-b386-3dac43d2baf0","Type":"ContainerDied","Data":"0bc6db0440b62a99cbc4cbb8a82959d990b82e5f7c99df8ce06680ad873fb0f2"}
Jul 11 08:19:35.087534 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:35.087518    2568 scope.go:117] "RemoveContainer" containerID="0bc6db0440b62a99cbc4cbb8a82959d990b82e5f7c99df8ce06680ad873fb0f2"
Jul 11 08:19:35.088520 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:35.088488    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:19:35.088644 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:35.088555    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:19:35.088644 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:35.088589    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:19:35.108698 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:35.108640    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np" podStartSLOduration=4.765706924 podStartE2EDuration="5.108622964s" totalImagesPullingTime="342.91604ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 08:19:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 08:19:32.089726048 +0000 UTC m=+2483.574476181" watchObservedRunningTime="2026-07-11 08:19:35.108622964 +0000 UTC m=+2486.593373097"
Jul 11 08:19:36.096593 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:36.096547    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf" event={"ID":"3d94d142-9d4e-4071-b386-3dac43d2baf0","Type":"ContainerStarted","Data":"0c5b9bbab76b4bab87f1de00cf09c17734a4f3d8992e27831ff35eb9ff8cc18e"}
Jul 11 08:19:36.988043 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:36.988007    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:36.989178 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:36.989149    2568 patch_prober.go:28] interesting pod/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 11 08:19:36.989398 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:36.989369    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf" podUID="3d94d142-9d4e-4071-b386-3dac43d2baf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 11 08:19:37.022399 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:37.022379    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:37.987732 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:37.987692    2568 patch_prober.go:28] interesting pod/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 11 08:19:37.988200 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:37.987755    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf" podUID="3d94d142-9d4e-4071-b386-3dac43d2baf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 11 08:19:38.083735 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:38.083703    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np"
Jul 11 08:19:38.987366 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:38.987307    2568 patch_prober.go:28] interesting pod/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 11 08:19:38.987572 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:38.987397    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf" podUID="3d94d142-9d4e-4071-b386-3dac43d2baf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 11 08:19:39.991181 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:39.991152    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:39.992137 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:39.992115    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:19:54.177943 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:54.177912    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-393a88-65db585dd5-lrqxz"]
Jul 11 08:19:54.178567 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:54.178181    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-393a88-65db585dd5-lrqxz" podUID="d6cc4fb6-1e08-401b-9ea7-5092fbff3374" containerName="maas-api" containerID="cri-o://585794cde9406a9e7dd56fe5eca99e21dbb1ca4ab3dacc25e1c5a487c9abbead" gracePeriod=30
Jul 11 08:19:54.431567 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:54.431508    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-393a88-65db585dd5-lrqxz"
Jul 11 08:19:54.511746 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:54.511715    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6cc4fb6-1e08-401b-9ea7-5092fbff3374-maas-api-tls\") pod \"d6cc4fb6-1e08-401b-9ea7-5092fbff3374\" (UID: \"d6cc4fb6-1e08-401b-9ea7-5092fbff3374\") "
Jul 11 08:19:54.511920 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:54.511780    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6cc4fb6-1e08-401b-9ea7-5092fbff3374-openshift-service-ca\") pod \"d6cc4fb6-1e08-401b-9ea7-5092fbff3374\" (UID: \"d6cc4fb6-1e08-401b-9ea7-5092fbff3374\") "
Jul 11 08:19:54.511920 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:54.511843    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cs8fd\" (UniqueName: \"kubernetes.io/projected/d6cc4fb6-1e08-401b-9ea7-5092fbff3374-kube-api-access-cs8fd\") pod \"d6cc4fb6-1e08-401b-9ea7-5092fbff3374\" (UID: \"d6cc4fb6-1e08-401b-9ea7-5092fbff3374\") "
Jul 11 08:19:54.512173 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:54.512147    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6cc4fb6-1e08-401b-9ea7-5092fbff3374-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d6cc4fb6-1e08-401b-9ea7-5092fbff3374" (UID: "d6cc4fb6-1e08-401b-9ea7-5092fbff3374"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 08:19:54.513730 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:54.513703    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6cc4fb6-1e08-401b-9ea7-5092fbff3374-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d6cc4fb6-1e08-401b-9ea7-5092fbff3374" (UID: "d6cc4fb6-1e08-401b-9ea7-5092fbff3374"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 08:19:54.513818 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:54.513772    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6cc4fb6-1e08-401b-9ea7-5092fbff3374-kube-api-access-cs8fd" (OuterVolumeSpecName: "kube-api-access-cs8fd") pod "d6cc4fb6-1e08-401b-9ea7-5092fbff3374" (UID: "d6cc4fb6-1e08-401b-9ea7-5092fbff3374"). InnerVolumeSpecName "kube-api-access-cs8fd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 08:19:54.613385 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:54.613355    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6cc4fb6-1e08-401b-9ea7-5092fbff3374-maas-api-tls\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:19:54.613385 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:54.613380    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6cc4fb6-1e08-401b-9ea7-5092fbff3374-openshift-service-ca\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:19:54.613385 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:54.613390    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cs8fd\" (UniqueName: \"kubernetes.io/projected/d6cc4fb6-1e08-401b-9ea7-5092fbff3374-kube-api-access-cs8fd\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:19:55.186266 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:55.186234    2568 generic.go:356] "Generic (PLEG): container finished" podID="d6cc4fb6-1e08-401b-9ea7-5092fbff3374" containerID="585794cde9406a9e7dd56fe5eca99e21dbb1ca4ab3dacc25e1c5a487c9abbead" exitCode=0
Jul 11 08:19:55.186649 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:55.186273    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-393a88-65db585dd5-lrqxz" event={"ID":"d6cc4fb6-1e08-401b-9ea7-5092fbff3374","Type":"ContainerDied","Data":"585794cde9406a9e7dd56fe5eca99e21dbb1ca4ab3dacc25e1c5a487c9abbead"}
Jul 11 08:19:55.186649 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:55.186308    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-393a88-65db585dd5-lrqxz" event={"ID":"d6cc4fb6-1e08-401b-9ea7-5092fbff3374","Type":"ContainerDied","Data":"022b80e5dd36ae1b6d8165a91ac8731eab699b56ab1d60a5e30f38204093f684"}
Jul 11 08:19:55.186649 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:55.186349    2568 scope.go:117] "RemoveContainer" containerID="585794cde9406a9e7dd56fe5eca99e21dbb1ca4ab3dacc25e1c5a487c9abbead"
Jul 11 08:19:55.186649 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:55.186275    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-393a88-65db585dd5-lrqxz"
Jul 11 08:19:55.194775 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:55.194756    2568 scope.go:117] "RemoveContainer" containerID="585794cde9406a9e7dd56fe5eca99e21dbb1ca4ab3dacc25e1c5a487c9abbead"
Jul 11 08:19:55.195011 ip-10-0-142-153 kubenswrapper[2568]: E0711 08:19:55.194994    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"585794cde9406a9e7dd56fe5eca99e21dbb1ca4ab3dacc25e1c5a487c9abbead\": container with ID starting with 585794cde9406a9e7dd56fe5eca99e21dbb1ca4ab3dacc25e1c5a487c9abbead not found: ID does not exist" containerID="585794cde9406a9e7dd56fe5eca99e21dbb1ca4ab3dacc25e1c5a487c9abbead"
Jul 11 08:19:55.195070 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:55.195017    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"585794cde9406a9e7dd56fe5eca99e21dbb1ca4ab3dacc25e1c5a487c9abbead"} err="failed to get container status \"585794cde9406a9e7dd56fe5eca99e21dbb1ca4ab3dacc25e1c5a487c9abbead\": rpc error: code = NotFound desc = could not find container \"585794cde9406a9e7dd56fe5eca99e21dbb1ca4ab3dacc25e1c5a487c9abbead\": container with ID starting with 585794cde9406a9e7dd56fe5eca99e21dbb1ca4ab3dacc25e1c5a487c9abbead not found: ID does not exist"
Jul 11 08:19:55.201309 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:55.201290    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-393a88-65db585dd5-lrqxz"]
Jul 11 08:19:55.205577 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:55.205555    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-393a88-65db585dd5-lrqxz"]
Jul 11 08:19:57.072635 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:19:57.072605    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6cc4fb6-1e08-401b-9ea7-5092fbff3374" path="/var/lib/kubelet/pods/d6cc4fb6-1e08-401b-9ea7-5092fbff3374/volumes"
Jul 11 08:20:09.155524 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:09.155438    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"]
Jul 11 08:20:09.155961 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:09.155687    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf" podUID="3d94d142-9d4e-4071-b386-3dac43d2baf0" containerName="istio-proxy" containerID="cri-o://0c5b9bbab76b4bab87f1de00cf09c17734a4f3d8992e27831ff35eb9ff8cc18e" gracePeriod=30
Jul 11 08:20:09.993925 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:09.993887    2568 patch_prober.go:28] interesting pod/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 11 08:20:09.994123 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:09.993976    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf" podUID="3d94d142-9d4e-4071-b386-3dac43d2baf0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 11 08:20:14.275630 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.275598    2568 generic.go:356] "Generic (PLEG): container finished" podID="3d94d142-9d4e-4071-b386-3dac43d2baf0" containerID="0c5b9bbab76b4bab87f1de00cf09c17734a4f3d8992e27831ff35eb9ff8cc18e" exitCode=0
Jul 11 08:20:14.275958 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.275673    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf" event={"ID":"3d94d142-9d4e-4071-b386-3dac43d2baf0","Type":"ContainerDied","Data":"0c5b9bbab76b4bab87f1de00cf09c17734a4f3d8992e27831ff35eb9ff8cc18e"}
Jul 11 08:20:14.275958 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.275747    2568 scope.go:117] "RemoveContainer" containerID="0bc6db0440b62a99cbc4cbb8a82959d990b82e5f7c99df8ce06680ad873fb0f2"
Jul 11 08:20:14.399472 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.399446    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:20:14.470287 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.470200    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jbbp\" (UniqueName: \"kubernetes.io/projected/3d94d142-9d4e-4071-b386-3dac43d2baf0-kube-api-access-8jbbp\") pod \"3d94d142-9d4e-4071-b386-3dac43d2baf0\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") "
Jul 11 08:20:14.470287 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.470260    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d94d142-9d4e-4071-b386-3dac43d2baf0-workload-certs\") pod \"3d94d142-9d4e-4071-b386-3dac43d2baf0\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") "
Jul 11 08:20:14.470530 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.470305    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d94d142-9d4e-4071-b386-3dac43d2baf0-istio-token\") pod \"3d94d142-9d4e-4071-b386-3dac43d2baf0\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") "
Jul 11 08:20:14.470530 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.470341    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d94d142-9d4e-4071-b386-3dac43d2baf0-istio-data\") pod \"3d94d142-9d4e-4071-b386-3dac43d2baf0\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") "
Jul 11 08:20:14.470530 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.470475    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d94d142-9d4e-4071-b386-3dac43d2baf0-istiod-ca-cert\") pod \"3d94d142-9d4e-4071-b386-3dac43d2baf0\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") "
Jul 11 08:20:14.470530 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.470521    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d94d142-9d4e-4071-b386-3dac43d2baf0-credential-socket\") pod \"3d94d142-9d4e-4071-b386-3dac43d2baf0\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") "
Jul 11 08:20:14.470733 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.470554    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d94d142-9d4e-4071-b386-3dac43d2baf0-istio-envoy\") pod \"3d94d142-9d4e-4071-b386-3dac43d2baf0\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") "
Jul 11 08:20:14.470733 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.470629    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d94d142-9d4e-4071-b386-3dac43d2baf0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3d94d142-9d4e-4071-b386-3dac43d2baf0" (UID: "3d94d142-9d4e-4071-b386-3dac43d2baf0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:20:14.470733 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.470649    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d94d142-9d4e-4071-b386-3dac43d2baf0-istio-podinfo\") pod \"3d94d142-9d4e-4071-b386-3dac43d2baf0\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") "
Jul 11 08:20:14.470733 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.470684    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d94d142-9d4e-4071-b386-3dac43d2baf0-workload-socket\") pod \"3d94d142-9d4e-4071-b386-3dac43d2baf0\" (UID: \"3d94d142-9d4e-4071-b386-3dac43d2baf0\") "
Jul 11 08:20:14.470940 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.470764    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d94d142-9d4e-4071-b386-3dac43d2baf0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3d94d142-9d4e-4071-b386-3dac43d2baf0" (UID: "3d94d142-9d4e-4071-b386-3dac43d2baf0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:20:14.470940 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.470833    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d94d142-9d4e-4071-b386-3dac43d2baf0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3d94d142-9d4e-4071-b386-3dac43d2baf0" (UID: "3d94d142-9d4e-4071-b386-3dac43d2baf0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 08:20:14.471055 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.470984    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d94d142-9d4e-4071-b386-3dac43d2baf0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3d94d142-9d4e-4071-b386-3dac43d2baf0" (UID: "3d94d142-9d4e-4071-b386-3dac43d2baf0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:20:14.471129 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.471101    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d94d142-9d4e-4071-b386-3dac43d2baf0-istiod-ca-cert\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:20:14.471253 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.471127    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d94d142-9d4e-4071-b386-3dac43d2baf0-credential-socket\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:20:14.471253 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.471140    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d94d142-9d4e-4071-b386-3dac43d2baf0-workload-socket\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:20:14.471253 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.471153    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d94d142-9d4e-4071-b386-3dac43d2baf0-workload-certs\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:20:14.471253 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.471192    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d94d142-9d4e-4071-b386-3dac43d2baf0-istio-data" (OuterVolumeSpecName: "istio-data") pod "3d94d142-9d4e-4071-b386-3dac43d2baf0" (UID: "3d94d142-9d4e-4071-b386-3dac43d2baf0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:20:14.472584 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.472559    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d94d142-9d4e-4071-b386-3dac43d2baf0-kube-api-access-8jbbp" (OuterVolumeSpecName: "kube-api-access-8jbbp") pod "3d94d142-9d4e-4071-b386-3dac43d2baf0" (UID: "3d94d142-9d4e-4071-b386-3dac43d2baf0"). InnerVolumeSpecName "kube-api-access-8jbbp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 08:20:14.472681 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.472608    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d94d142-9d4e-4071-b386-3dac43d2baf0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3d94d142-9d4e-4071-b386-3dac43d2baf0" (UID: "3d94d142-9d4e-4071-b386-3dac43d2baf0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:20:14.472852 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.472837    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d94d142-9d4e-4071-b386-3dac43d2baf0-istio-token" (OuterVolumeSpecName: "istio-token") pod "3d94d142-9d4e-4071-b386-3dac43d2baf0" (UID: "3d94d142-9d4e-4071-b386-3dac43d2baf0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 08:20:14.472956 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.472937    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3d94d142-9d4e-4071-b386-3dac43d2baf0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3d94d142-9d4e-4071-b386-3dac43d2baf0" (UID: "3d94d142-9d4e-4071-b386-3dac43d2baf0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 11 08:20:14.572055 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.572011    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d94d142-9d4e-4071-b386-3dac43d2baf0-istio-podinfo\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:20:14.572055 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.572050    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jbbp\" (UniqueName: \"kubernetes.io/projected/3d94d142-9d4e-4071-b386-3dac43d2baf0-kube-api-access-8jbbp\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:20:14.572264 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.572065    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d94d142-9d4e-4071-b386-3dac43d2baf0-istio-token\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:20:14.572264 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.572074    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d94d142-9d4e-4071-b386-3dac43d2baf0-istio-data\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:20:14.572264 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:14.572082    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d94d142-9d4e-4071-b386-3dac43d2baf0-istio-envoy\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:20:15.281577 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:15.281548    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"
Jul 11 08:20:15.281992 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:15.281571    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf" event={"ID":"3d94d142-9d4e-4071-b386-3dac43d2baf0","Type":"ContainerDied","Data":"bff1dd6b308c34c7de2c3e4cdc1264eef9af18afdbcb03f25e111028dd7a2452"}
Jul 11 08:20:15.281992 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:15.281646    2568 scope.go:117] "RemoveContainer" containerID="0c5b9bbab76b4bab87f1de00cf09c17734a4f3d8992e27831ff35eb9ff8cc18e"
Jul 11 08:20:15.298664 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:15.298639    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"]
Jul 11 08:20:15.302090 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:15.302068    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-393a88-openshift-default-564f6468bc-dlvbf"]
Jul 11 08:20:17.071727 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:17.071696    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d94d142-9d4e-4071-b386-3dac43d2baf0" path="/var/lib/kubelet/pods/3d94d142-9d4e-4071-b386-3dac43d2baf0/volumes"
Jul 11 08:20:20.050076 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:20.050040    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np"]
Jul 11 08:20:20.050566 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:20.050302    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np" podUID="d3035091-2c83-4935-8f96-7b27139b5199" containerName="maas-api" containerID="cri-o://30fd58688d0b99b20c6a902b99b92fff40745c690b4ff3a01bc5af7572cb9b4d" gracePeriod=30
Jul 11 08:20:20.301358 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:20.301278    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np"
Jul 11 08:20:20.306358 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:20.306315    2568 generic.go:356] "Generic (PLEG): container finished" podID="d3035091-2c83-4935-8f96-7b27139b5199" containerID="30fd58688d0b99b20c6a902b99b92fff40745c690b4ff3a01bc5af7572cb9b4d" exitCode=0
Jul 11 08:20:20.306480 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:20.306356    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np" event={"ID":"d3035091-2c83-4935-8f96-7b27139b5199","Type":"ContainerDied","Data":"30fd58688d0b99b20c6a902b99b92fff40745c690b4ff3a01bc5af7572cb9b4d"}
Jul 11 08:20:20.306480 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:20.306413    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np" event={"ID":"d3035091-2c83-4935-8f96-7b27139b5199","Type":"ContainerDied","Data":"044d9402f3f4e23050de9c9e6d38d6de751e3e6a20d5ff5f5aeb97f2ae85ca5b"}
Jul 11 08:20:20.306480 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:20.306434    2568 scope.go:117] "RemoveContainer" containerID="30fd58688d0b99b20c6a902b99b92fff40745c690b4ff3a01bc5af7572cb9b4d"
Jul 11 08:20:20.306480 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:20.306373    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np"
Jul 11 08:20:20.314013 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:20.313998    2568 scope.go:117] "RemoveContainer" containerID="30fd58688d0b99b20c6a902b99b92fff40745c690b4ff3a01bc5af7572cb9b4d"
Jul 11 08:20:20.314254 ip-10-0-142-153 kubenswrapper[2568]: E0711 08:20:20.314236    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30fd58688d0b99b20c6a902b99b92fff40745c690b4ff3a01bc5af7572cb9b4d\": container with ID starting with 30fd58688d0b99b20c6a902b99b92fff40745c690b4ff3a01bc5af7572cb9b4d not found: ID does not exist" containerID="30fd58688d0b99b20c6a902b99b92fff40745c690b4ff3a01bc5af7572cb9b4d"
Jul 11 08:20:20.314302 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:20.314263    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30fd58688d0b99b20c6a902b99b92fff40745c690b4ff3a01bc5af7572cb9b4d"} err="failed to get container status \"30fd58688d0b99b20c6a902b99b92fff40745c690b4ff3a01bc5af7572cb9b4d\": rpc error: code = NotFound desc = could not find container \"30fd58688d0b99b20c6a902b99b92fff40745c690b4ff3a01bc5af7572cb9b4d\": container with ID starting with 30fd58688d0b99b20c6a902b99b92fff40745c690b4ff3a01bc5af7572cb9b4d not found: ID does not exist"
Jul 11 08:20:20.427798 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:20.427768    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3035091-2c83-4935-8f96-7b27139b5199-openshift-service-ca\") pod \"d3035091-2c83-4935-8f96-7b27139b5199\" (UID: \"d3035091-2c83-4935-8f96-7b27139b5199\") "
Jul 11 08:20:20.428000 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:20.427854    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3035091-2c83-4935-8f96-7b27139b5199-maas-api-tls\") pod \"d3035091-2c83-4935-8f96-7b27139b5199\" (UID: \"d3035091-2c83-4935-8f96-7b27139b5199\") "
Jul 11 08:20:20.428000 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:20.427937    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79zwm\" (UniqueName: \"kubernetes.io/projected/d3035091-2c83-4935-8f96-7b27139b5199-kube-api-access-79zwm\") pod \"d3035091-2c83-4935-8f96-7b27139b5199\" (UID: \"d3035091-2c83-4935-8f96-7b27139b5199\") "
Jul 11 08:20:20.428203 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:20.428170    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3035091-2c83-4935-8f96-7b27139b5199-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d3035091-2c83-4935-8f96-7b27139b5199" (UID: "d3035091-2c83-4935-8f96-7b27139b5199"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 08:20:20.429988 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:20.429963    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3035091-2c83-4935-8f96-7b27139b5199-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d3035091-2c83-4935-8f96-7b27139b5199" (UID: "d3035091-2c83-4935-8f96-7b27139b5199"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 08:20:20.430066 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:20.429973    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3035091-2c83-4935-8f96-7b27139b5199-kube-api-access-79zwm" (OuterVolumeSpecName: "kube-api-access-79zwm") pod "d3035091-2c83-4935-8f96-7b27139b5199" (UID: "d3035091-2c83-4935-8f96-7b27139b5199"). InnerVolumeSpecName "kube-api-access-79zwm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 08:20:20.529098 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:20.529057    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79zwm\" (UniqueName: \"kubernetes.io/projected/d3035091-2c83-4935-8f96-7b27139b5199-kube-api-access-79zwm\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:20:20.529098 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:20.529090    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3035091-2c83-4935-8f96-7b27139b5199-openshift-service-ca\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:20:20.529098 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:20.529103    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3035091-2c83-4935-8f96-7b27139b5199-maas-api-tls\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:20:20.627053 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:20.627020    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np"]
Jul 11 08:20:20.628750 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:20.628726    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f92f11-5dd78b5c9c-p85np"]
Jul 11 08:20:21.078548 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:21.078512    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3035091-2c83-4935-8f96-7b27139b5199" path="/var/lib/kubelet/pods/d3035091-2c83-4935-8f96-7b27139b5199/volumes"
Jul 11 08:20:36.120437 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.120404    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"]
Jul 11 08:20:36.121098 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.120778    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6cc4fb6-1e08-401b-9ea7-5092fbff3374" containerName="maas-api"
Jul 11 08:20:36.121098 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.120790    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6cc4fb6-1e08-401b-9ea7-5092fbff3374" containerName="maas-api"
Jul 11 08:20:36.121098 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.120803    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d94d142-9d4e-4071-b386-3dac43d2baf0" containerName="istio-proxy"
Jul 11 08:20:36.121098 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.120809    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d94d142-9d4e-4071-b386-3dac43d2baf0" containerName="istio-proxy"
Jul 11 08:20:36.121098 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.120826    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3035091-2c83-4935-8f96-7b27139b5199" containerName="maas-api"
Jul 11 08:20:36.121098 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.120835    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3035091-2c83-4935-8f96-7b27139b5199" containerName="maas-api"
Jul 11 08:20:36.121098 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.120846    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d94d142-9d4e-4071-b386-3dac43d2baf0" containerName="istio-proxy"
Jul 11 08:20:36.121098 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.120852    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d94d142-9d4e-4071-b386-3dac43d2baf0" containerName="istio-proxy"
Jul 11 08:20:36.121098 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.120898    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d94d142-9d4e-4071-b386-3dac43d2baf0" containerName="istio-proxy"
Jul 11 08:20:36.121098 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.120906    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6cc4fb6-1e08-401b-9ea7-5092fbff3374" containerName="maas-api"
Jul 11 08:20:36.121098 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.120919    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3035091-2c83-4935-8f96-7b27139b5199" containerName="maas-api"
Jul 11 08:20:36.125554 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.125531    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:36.127851 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.127822    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-f178a6-openshift-default-dockercfg-rtctn\""
Jul 11 08:20:36.134900 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.134876    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"]
Jul 11 08:20:36.154840 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.154798    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42aedc2d-90fc-47f1-b0dc-21d75aed6342-workload-socket\") pod \"e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") " pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:36.154988 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.154849    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42aedc2d-90fc-47f1-b0dc-21d75aed6342-workload-certs\") pod \"e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") " pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:36.154988 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.154924    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2p44\" (UniqueName: \"kubernetes.io/projected/42aedc2d-90fc-47f1-b0dc-21d75aed6342-kube-api-access-d2p44\") pod \"e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") " pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:36.154988 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.154961    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42aedc2d-90fc-47f1-b0dc-21d75aed6342-istio-podinfo\") pod \"e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") " pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:36.155121 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.154997    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42aedc2d-90fc-47f1-b0dc-21d75aed6342-credential-socket\") pod \"e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") " pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:36.155121 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.155035    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42aedc2d-90fc-47f1-b0dc-21d75aed6342-istio-envoy\") pod \"e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") " pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:36.155121 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.155070    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42aedc2d-90fc-47f1-b0dc-21d75aed6342-istio-data\") pod \"e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") " pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:36.155121 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.155090    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42aedc2d-90fc-47f1-b0dc-21d75aed6342-istio-token\") pod \"e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") " pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:36.155252 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.155123    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42aedc2d-90fc-47f1-b0dc-21d75aed6342-istiod-ca-cert\") pod \"e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") " pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:36.255867 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.255831    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42aedc2d-90fc-47f1-b0dc-21d75aed6342-credential-socket\") pod \"e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") " pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:36.256074 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.255879    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42aedc2d-90fc-47f1-b0dc-21d75aed6342-istio-envoy\") pod \"e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") " pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:36.256074 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.255894    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42aedc2d-90fc-47f1-b0dc-21d75aed6342-istio-data\") pod \"e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") " pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:36.256074 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.255909    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42aedc2d-90fc-47f1-b0dc-21d75aed6342-istio-token\") pod \"e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") " pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:36.256074 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.256036    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42aedc2d-90fc-47f1-b0dc-21d75aed6342-istiod-ca-cert\") pod \"e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") " pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:36.256283 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.256141    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42aedc2d-90fc-47f1-b0dc-21d75aed6342-workload-socket\") pod \"e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") " pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:36.256283 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.256171    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42aedc2d-90fc-47f1-b0dc-21d75aed6342-workload-certs\") pod \"e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") " pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:36.256283 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.256220    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2p44\" (UniqueName: \"kubernetes.io/projected/42aedc2d-90fc-47f1-b0dc-21d75aed6342-kube-api-access-d2p44\") pod \"e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") " pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:36.256283 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.256252    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42aedc2d-90fc-47f1-b0dc-21d75aed6342-istio-podinfo\") pod \"e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") " pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:36.256524 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.256284    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42aedc2d-90fc-47f1-b0dc-21d75aed6342-credential-socket\") pod \"e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") " pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:36.256524 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.256310    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42aedc2d-90fc-47f1-b0dc-21d75aed6342-istio-data\") pod \"e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") " pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:36.256524 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.256475    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42aedc2d-90fc-47f1-b0dc-21d75aed6342-workload-socket\") pod \"e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") " pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:36.256691 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.256633    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42aedc2d-90fc-47f1-b0dc-21d75aed6342-workload-certs\") pod \"e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") " pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:36.256759 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.256741    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42aedc2d-90fc-47f1-b0dc-21d75aed6342-istiod-ca-cert\") pod \"e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") " pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:36.258355 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.258314    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42aedc2d-90fc-47f1-b0dc-21d75aed6342-istio-envoy\") pod \"e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") " pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:36.258536 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.258519    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42aedc2d-90fc-47f1-b0dc-21d75aed6342-istio-podinfo\") pod \"e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") " pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:36.263356 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.263312    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42aedc2d-90fc-47f1-b0dc-21d75aed6342-istio-token\") pod \"e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") " pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:36.263447 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.263393    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2p44\" (UniqueName: \"kubernetes.io/projected/42aedc2d-90fc-47f1-b0dc-21d75aed6342-kube-api-access-d2p44\") pod \"e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") " pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:36.436585 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.436487    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:36.565293 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.565260    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"]
Jul 11 08:20:36.568829 ip-10-0-142-153 kubenswrapper[2568]: W0711 08:20:36.568804    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42aedc2d_90fc_47f1_b0dc_21d75aed6342.slice/crio-da314d5eee525681c104c11be145e5f8f9c91159a2417f5627d6932029827e2a WatchSource:0}: Error finding container da314d5eee525681c104c11be145e5f8f9c91159a2417f5627d6932029827e2a: Status 404 returned error can't find the container with id da314d5eee525681c104c11be145e5f8f9c91159a2417f5627d6932029827e2a
Jul 11 08:20:36.570805 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.570773    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:20:36.570882 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.570833    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:20:36.570882 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:36.570859    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:20:37.386053 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:37.386009    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5" event={"ID":"42aedc2d-90fc-47f1-b0dc-21d75aed6342","Type":"ContainerStarted","Data":"4df112a5b9ac3d843b2f5dfda14bfa90eda6a79f39a7ca60aec368529f4a9e30"}
Jul 11 08:20:37.386477 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:37.386075    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5" event={"ID":"42aedc2d-90fc-47f1-b0dc-21d75aed6342","Type":"ContainerStarted","Data":"da314d5eee525681c104c11be145e5f8f9c91159a2417f5627d6932029827e2a"}
Jul 11 08:20:37.406464 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:37.406412    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5" podStartSLOduration=1.406396393 podStartE2EDuration="1.406396393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 08:20:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 08:20:37.40499334 +0000 UTC m=+2548.889743474" watchObservedRunningTime="2026-07-11 08:20:37.406396393 +0000 UTC m=+2548.891146525"
Jul 11 08:20:37.437610 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:37.437576    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:37.442347 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:37.442307    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:38.391238 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:38.391209    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:38.397603 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:38.397578    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:39.370205 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:39.370166    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq"]
Jul 11 08:20:39.370921 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:39.370887    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d94d142-9d4e-4071-b386-3dac43d2baf0" containerName="istio-proxy"
Jul 11 08:20:39.374376 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:39.374358    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq"
Jul 11 08:20:39.377550 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:39.377517    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-f178a6-serving-cert\""
Jul 11 08:20:39.379016 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:39.378993    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b6c8817-ba61-4aff-ba99-fba7c64efbf7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq\" (UID: \"1b6c8817-ba61-4aff-ba99-fba7c64efbf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq"
Jul 11 08:20:39.379116 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:39.379044    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj9db\" (UniqueName: \"kubernetes.io/projected/1b6c8817-ba61-4aff-ba99-fba7c64efbf7-kube-api-access-sj9db\") pod \"maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq\" (UID: \"1b6c8817-ba61-4aff-ba99-fba7c64efbf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq"
Jul 11 08:20:39.379168 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:39.379114    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b6c8817-ba61-4aff-ba99-fba7c64efbf7-maas-api-tls\") pod \"maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq\" (UID: \"1b6c8817-ba61-4aff-ba99-fba7c64efbf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq"
Jul 11 08:20:39.383612 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:39.383588    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq"]
Jul 11 08:20:39.479661 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:39.479616    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b6c8817-ba61-4aff-ba99-fba7c64efbf7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq\" (UID: \"1b6c8817-ba61-4aff-ba99-fba7c64efbf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq"
Jul 11 08:20:39.480114 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:39.479672    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj9db\" (UniqueName: \"kubernetes.io/projected/1b6c8817-ba61-4aff-ba99-fba7c64efbf7-kube-api-access-sj9db\") pod \"maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq\" (UID: \"1b6c8817-ba61-4aff-ba99-fba7c64efbf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq"
Jul 11 08:20:39.480114 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:39.479736    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b6c8817-ba61-4aff-ba99-fba7c64efbf7-maas-api-tls\") pod \"maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq\" (UID: \"1b6c8817-ba61-4aff-ba99-fba7c64efbf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq"
Jul 11 08:20:39.480114 ip-10-0-142-153 kubenswrapper[2568]: E0711 08:20:39.479837    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-f178a6-serving-cert: secret "maas-api-e2e-shared-a-f178a6-serving-cert" not found
Jul 11 08:20:39.480114 ip-10-0-142-153 kubenswrapper[2568]: E0711 08:20:39.479906    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b6c8817-ba61-4aff-ba99-fba7c64efbf7-maas-api-tls podName:1b6c8817-ba61-4aff-ba99-fba7c64efbf7 nodeName:}" failed. No retries permitted until 2026-07-11 08:20:39.979886601 +0000 UTC m=+2551.464636713 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1b6c8817-ba61-4aff-ba99-fba7c64efbf7-maas-api-tls") pod "maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq" (UID: "1b6c8817-ba61-4aff-ba99-fba7c64efbf7") : secret "maas-api-e2e-shared-a-f178a6-serving-cert" not found
Jul 11 08:20:39.480475 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:39.480451    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b6c8817-ba61-4aff-ba99-fba7c64efbf7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq\" (UID: \"1b6c8817-ba61-4aff-ba99-fba7c64efbf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq"
Jul 11 08:20:39.494479 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:39.494440    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj9db\" (UniqueName: \"kubernetes.io/projected/1b6c8817-ba61-4aff-ba99-fba7c64efbf7-kube-api-access-sj9db\") pod \"maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq\" (UID: \"1b6c8817-ba61-4aff-ba99-fba7c64efbf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq"
Jul 11 08:20:39.983909 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:39.983871    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b6c8817-ba61-4aff-ba99-fba7c64efbf7-maas-api-tls\") pod \"maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq\" (UID: \"1b6c8817-ba61-4aff-ba99-fba7c64efbf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq"
Jul 11 08:20:39.986604 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:39.986573    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b6c8817-ba61-4aff-ba99-fba7c64efbf7-maas-api-tls\") pod \"maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq\" (UID: \"1b6c8817-ba61-4aff-ba99-fba7c64efbf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq"
Jul 11 08:20:40.286402 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:40.286295    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq"
Jul 11 08:20:40.424040 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:40.424016    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq"]
Jul 11 08:20:40.426257 ip-10-0-142-153 kubenswrapper[2568]: W0711 08:20:40.426219    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b6c8817_ba61_4aff_ba99_fba7c64efbf7.slice/crio-66a5a0cc65ced4ea459b927dedcc514c50b08ef78d00fa2a84c9c7cb5c2bb685 WatchSource:0}: Error finding container 66a5a0cc65ced4ea459b927dedcc514c50b08ef78d00fa2a84c9c7cb5c2bb685: Status 404 returned error can't find the container with id 66a5a0cc65ced4ea459b927dedcc514c50b08ef78d00fa2a84c9c7cb5c2bb685
Jul 11 08:20:41.407048 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:41.407012    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq" event={"ID":"1b6c8817-ba61-4aff-ba99-fba7c64efbf7","Type":"ContainerStarted","Data":"7de0a54f0619b17636b9d495106aa5641932b46a0fab7db6de1a5572a2daf27a"}
Jul 11 08:20:41.407459 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:41.407072    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq" event={"ID":"1b6c8817-ba61-4aff-ba99-fba7c64efbf7","Type":"ContainerStarted","Data":"66a5a0cc65ced4ea459b927dedcc514c50b08ef78d00fa2a84c9c7cb5c2bb685"}
Jul 11 08:20:41.407459 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:41.407110    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq"
Jul 11 08:20:41.423500 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:41.423451    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq" podStartSLOduration=2.086553054 podStartE2EDuration="2.423435491s" totalImagesPullingTime="336.882437ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 08:20:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 08:20:41.421314932 +0000 UTC m=+2552.906065058" watchObservedRunningTime="2026-07-11 08:20:41.423435491 +0000 UTC m=+2552.908185623"
Jul 11 08:20:47.306744 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:47.306678    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl"]
Jul 11 08:20:47.310727 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:47.310695    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl"
Jul 11 08:20:47.313084 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:47.313059    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-12fff0-serving-cert\""
Jul 11 08:20:47.334734 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:47.324194    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl"]
Jul 11 08:20:47.345130 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:47.345094    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ea107b7-3091-4e30-9dfe-3a2746712aef-maas-api-tls\") pod \"maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl\" (UID: \"0ea107b7-3091-4e30-9dfe-3a2746712aef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl"
Jul 11 08:20:47.345457 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:47.345437    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvg4w\" (UniqueName: \"kubernetes.io/projected/0ea107b7-3091-4e30-9dfe-3a2746712aef-kube-api-access-hvg4w\") pod \"maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl\" (UID: \"0ea107b7-3091-4e30-9dfe-3a2746712aef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl"
Jul 11 08:20:47.345644 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:47.345628    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ea107b7-3091-4e30-9dfe-3a2746712aef-openshift-service-ca\") pod \"maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl\" (UID: \"0ea107b7-3091-4e30-9dfe-3a2746712aef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl"
Jul 11 08:20:47.424005 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:47.423974    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq"
Jul 11 08:20:47.447074 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:47.447045    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ea107b7-3091-4e30-9dfe-3a2746712aef-maas-api-tls\") pod \"maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl\" (UID: \"0ea107b7-3091-4e30-9dfe-3a2746712aef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl"
Jul 11 08:20:47.447255 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:47.447089    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvg4w\" (UniqueName: \"kubernetes.io/projected/0ea107b7-3091-4e30-9dfe-3a2746712aef-kube-api-access-hvg4w\") pod \"maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl\" (UID: \"0ea107b7-3091-4e30-9dfe-3a2746712aef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl"
Jul 11 08:20:47.447255 ip-10-0-142-153 kubenswrapper[2568]: E0711 08:20:47.447187    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-12fff0-serving-cert: secret "maas-api-e2e-shared-b-12fff0-serving-cert" not found
Jul 11 08:20:47.447255 ip-10-0-142-153 kubenswrapper[2568]: E0711 08:20:47.447252    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ea107b7-3091-4e30-9dfe-3a2746712aef-maas-api-tls podName:0ea107b7-3091-4e30-9dfe-3a2746712aef nodeName:}" failed. No retries permitted until 2026-07-11 08:20:47.947232035 +0000 UTC m=+2559.431982146 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0ea107b7-3091-4e30-9dfe-3a2746712aef-maas-api-tls") pod "maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl" (UID: "0ea107b7-3091-4e30-9dfe-3a2746712aef") : secret "maas-api-e2e-shared-b-12fff0-serving-cert" not found
Jul 11 08:20:47.447391 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:47.447359    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ea107b7-3091-4e30-9dfe-3a2746712aef-openshift-service-ca\") pod \"maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl\" (UID: \"0ea107b7-3091-4e30-9dfe-3a2746712aef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl"
Jul 11 08:20:47.448043 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:47.448015    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ea107b7-3091-4e30-9dfe-3a2746712aef-openshift-service-ca\") pod \"maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl\" (UID: \"0ea107b7-3091-4e30-9dfe-3a2746712aef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl"
Jul 11 08:20:47.455340 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:47.455298    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvg4w\" (UniqueName: \"kubernetes.io/projected/0ea107b7-3091-4e30-9dfe-3a2746712aef-kube-api-access-hvg4w\") pod \"maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl\" (UID: \"0ea107b7-3091-4e30-9dfe-3a2746712aef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl"
Jul 11 08:20:47.953171 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:47.953137    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ea107b7-3091-4e30-9dfe-3a2746712aef-maas-api-tls\") pod \"maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl\" (UID: \"0ea107b7-3091-4e30-9dfe-3a2746712aef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl"
Jul 11 08:20:47.955998 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:47.955967    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ea107b7-3091-4e30-9dfe-3a2746712aef-maas-api-tls\") pod \"maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl\" (UID: \"0ea107b7-3091-4e30-9dfe-3a2746712aef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl"
Jul 11 08:20:48.235002 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:48.234904    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl"
Jul 11 08:20:48.396407 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:48.387528    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl"]
Jul 11 08:20:48.413710 ip-10-0-142-153 kubenswrapper[2568]: W0711 08:20:48.413676    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ea107b7_3091_4e30_9dfe_3a2746712aef.slice/crio-ea0eb752923e008213ea6195cf01a30f16cb40469db2d4cbc1b5d87aad86d2ba WatchSource:0}: Error finding container ea0eb752923e008213ea6195cf01a30f16cb40469db2d4cbc1b5d87aad86d2ba: Status 404 returned error can't find the container with id ea0eb752923e008213ea6195cf01a30f16cb40469db2d4cbc1b5d87aad86d2ba
Jul 11 08:20:48.447189 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:48.447152    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl" event={"ID":"0ea107b7-3091-4e30-9dfe-3a2746712aef","Type":"ContainerStarted","Data":"ea0eb752923e008213ea6195cf01a30f16cb40469db2d4cbc1b5d87aad86d2ba"}
Jul 11 08:20:49.453694 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:49.453596    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl" event={"ID":"0ea107b7-3091-4e30-9dfe-3a2746712aef","Type":"ContainerStarted","Data":"6911b2eaecf44dedcf19a436603677ef3521b36977897d90a07b5d416e7dc42f"}
Jul 11 08:20:49.454048 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:49.453704    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl"
Jul 11 08:20:49.482069 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:49.482016    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl" podStartSLOduration=2.198303825 podStartE2EDuration="2.481998925s" totalImagesPullingTime="283.6951ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 08:20:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 08:20:49.478566039 +0000 UTC m=+2560.963316172" watchObservedRunningTime="2026-07-11 08:20:49.481998925 +0000 UTC m=+2560.966749056"
Jul 11 08:20:52.469075 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:52.469041    2568 generic.go:356] "Generic (PLEG): container finished" podID="42aedc2d-90fc-47f1-b0dc-21d75aed6342" containerID="4df112a5b9ac3d843b2f5dfda14bfa90eda6a79f39a7ca60aec368529f4a9e30" exitCode=0
Jul 11 08:20:52.469512 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:52.469112    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5" event={"ID":"42aedc2d-90fc-47f1-b0dc-21d75aed6342","Type":"ContainerDied","Data":"4df112a5b9ac3d843b2f5dfda14bfa90eda6a79f39a7ca60aec368529f4a9e30"}
Jul 11 08:20:52.469557 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:52.469538    2568 scope.go:117] "RemoveContainer" containerID="4df112a5b9ac3d843b2f5dfda14bfa90eda6a79f39a7ca60aec368529f4a9e30"
Jul 11 08:20:52.470503 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:52.470474    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:20:52.470564 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:52.470544    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:20:52.470599 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:52.470584    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 11 08:20:53.392256 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:53.392215    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:53.475553 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:53.475516    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5" event={"ID":"42aedc2d-90fc-47f1-b0dc-21d75aed6342","Type":"ContainerStarted","Data":"4cb6380f3f3373a6dfbada52b9474bd49ce68b47516794a24db71f7dff3af00b"}
Jul 11 08:20:54.437584 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:54.437544    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:54.438729 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:54.438704    2568 patch_prober.go:28] interesting pod/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 11 08:20:54.438851 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:54.438753    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5" podUID="42aedc2d-90fc-47f1-b0dc-21d75aed6342" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 11 08:20:55.436947 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:55.436912    2568 patch_prober.go:28] interesting pod/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 11 08:20:55.437361 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:55.436971    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5" podUID="42aedc2d-90fc-47f1-b0dc-21d75aed6342" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 11 08:20:55.464201 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:55.464173    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl"
Jul 11 08:20:56.437505 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:56.437465    2568 patch_prober.go:28] interesting pod/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 11 08:20:56.437998 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:56.437541    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5" podUID="42aedc2d-90fc-47f1-b0dc-21d75aed6342" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 11 08:20:57.441061 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:57.441025    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:57.441561 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:57.441417    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:20:57.441949 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:20:57.441931    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:26:10.677070 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:10.676870    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq"]
Jul 11 08:26:10.679578 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:10.677691    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq" podUID="1b6c8817-ba61-4aff-ba99-fba7c64efbf7" containerName="maas-api" containerID="cri-o://7de0a54f0619b17636b9d495106aa5641932b46a0fab7db6de1a5572a2daf27a" gracePeriod=30
Jul 11 08:26:11.126034 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:11.126011    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq"
Jul 11 08:26:11.319656 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:11.319626    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b6c8817-ba61-4aff-ba99-fba7c64efbf7-maas-api-tls\") pod \"1b6c8817-ba61-4aff-ba99-fba7c64efbf7\" (UID: \"1b6c8817-ba61-4aff-ba99-fba7c64efbf7\") "
Jul 11 08:26:11.319821 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:11.319687    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sj9db\" (UniqueName: \"kubernetes.io/projected/1b6c8817-ba61-4aff-ba99-fba7c64efbf7-kube-api-access-sj9db\") pod \"1b6c8817-ba61-4aff-ba99-fba7c64efbf7\" (UID: \"1b6c8817-ba61-4aff-ba99-fba7c64efbf7\") "
Jul 11 08:26:11.319821 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:11.319727    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b6c8817-ba61-4aff-ba99-fba7c64efbf7-openshift-service-ca\") pod \"1b6c8817-ba61-4aff-ba99-fba7c64efbf7\" (UID: \"1b6c8817-ba61-4aff-ba99-fba7c64efbf7\") "
Jul 11 08:26:11.320147 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:11.320117    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b6c8817-ba61-4aff-ba99-fba7c64efbf7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1b6c8817-ba61-4aff-ba99-fba7c64efbf7" (UID: "1b6c8817-ba61-4aff-ba99-fba7c64efbf7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 08:26:11.321703 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:11.321680    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b6c8817-ba61-4aff-ba99-fba7c64efbf7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1b6c8817-ba61-4aff-ba99-fba7c64efbf7" (UID: "1b6c8817-ba61-4aff-ba99-fba7c64efbf7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 08:26:11.321804 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:11.321750    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b6c8817-ba61-4aff-ba99-fba7c64efbf7-kube-api-access-sj9db" (OuterVolumeSpecName: "kube-api-access-sj9db") pod "1b6c8817-ba61-4aff-ba99-fba7c64efbf7" (UID: "1b6c8817-ba61-4aff-ba99-fba7c64efbf7"). InnerVolumeSpecName "kube-api-access-sj9db". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 08:26:11.421208 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:11.421167    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b6c8817-ba61-4aff-ba99-fba7c64efbf7-maas-api-tls\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:26:11.421208 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:11.421199    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sj9db\" (UniqueName: \"kubernetes.io/projected/1b6c8817-ba61-4aff-ba99-fba7c64efbf7-kube-api-access-sj9db\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:26:11.421208 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:11.421212    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b6c8817-ba61-4aff-ba99-fba7c64efbf7-openshift-service-ca\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:26:11.932701 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:11.932666    2568 generic.go:356] "Generic (PLEG): container finished" podID="1b6c8817-ba61-4aff-ba99-fba7c64efbf7" containerID="7de0a54f0619b17636b9d495106aa5641932b46a0fab7db6de1a5572a2daf27a" exitCode=0
Jul 11 08:26:11.933168 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:11.932714    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq"
Jul 11 08:26:11.933168 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:11.932747    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq" event={"ID":"1b6c8817-ba61-4aff-ba99-fba7c64efbf7","Type":"ContainerDied","Data":"7de0a54f0619b17636b9d495106aa5641932b46a0fab7db6de1a5572a2daf27a"}
Jul 11 08:26:11.933168 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:11.932807    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq" event={"ID":"1b6c8817-ba61-4aff-ba99-fba7c64efbf7","Type":"ContainerDied","Data":"66a5a0cc65ced4ea459b927dedcc514c50b08ef78d00fa2a84c9c7cb5c2bb685"}
Jul 11 08:26:11.933168 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:11.932832    2568 scope.go:117] "RemoveContainer" containerID="7de0a54f0619b17636b9d495106aa5641932b46a0fab7db6de1a5572a2daf27a"
Jul 11 08:26:11.942009 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:11.941992    2568 scope.go:117] "RemoveContainer" containerID="7de0a54f0619b17636b9d495106aa5641932b46a0fab7db6de1a5572a2daf27a"
Jul 11 08:26:11.942249 ip-10-0-142-153 kubenswrapper[2568]: E0711 08:26:11.942234    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7de0a54f0619b17636b9d495106aa5641932b46a0fab7db6de1a5572a2daf27a\": container with ID starting with 7de0a54f0619b17636b9d495106aa5641932b46a0fab7db6de1a5572a2daf27a not found: ID does not exist" containerID="7de0a54f0619b17636b9d495106aa5641932b46a0fab7db6de1a5572a2daf27a"
Jul 11 08:26:11.942289 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:11.942255    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7de0a54f0619b17636b9d495106aa5641932b46a0fab7db6de1a5572a2daf27a"} err="failed to get container status \"7de0a54f0619b17636b9d495106aa5641932b46a0fab7db6de1a5572a2daf27a\": rpc error: code = NotFound desc = could not find container \"7de0a54f0619b17636b9d495106aa5641932b46a0fab7db6de1a5572a2daf27a\": container with ID starting with 7de0a54f0619b17636b9d495106aa5641932b46a0fab7db6de1a5572a2daf27a not found: ID does not exist"
Jul 11 08:26:11.953204 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:11.953179    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq"]
Jul 11 08:26:11.958418 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:11.958399    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f178a6-b56c68bc5-5l4pq"]
Jul 11 08:26:13.071707 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:13.071676    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b6c8817-ba61-4aff-ba99-fba7c64efbf7" path="/var/lib/kubelet/pods/1b6c8817-ba61-4aff-ba99-fba7c64efbf7/volumes"
Jul 11 08:26:25.261394 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:25.261358    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"]
Jul 11 08:26:25.261869 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:25.261604    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5" podUID="42aedc2d-90fc-47f1-b0dc-21d75aed6342" containerName="istio-proxy" containerID="cri-o://4cb6380f3f3373a6dfbada52b9474bd49ce68b47516794a24db71f7dff3af00b" gracePeriod=30
Jul 11 08:26:27.443645 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:27.443599    2568 patch_prober.go:28] interesting pod/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 11 08:26:27.444020 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:27.443670    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5" podUID="42aedc2d-90fc-47f1-b0dc-21d75aed6342" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 11 08:26:30.512807 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:30.512780    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:26:30.587198 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:30.587169    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42aedc2d-90fc-47f1-b0dc-21d75aed6342-workload-socket\") pod \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") "
Jul 11 08:26:30.587429 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:30.587240    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42aedc2d-90fc-47f1-b0dc-21d75aed6342-istio-podinfo\") pod \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") "
Jul 11 08:26:30.587429 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:30.587266    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42aedc2d-90fc-47f1-b0dc-21d75aed6342-credential-socket\") pod \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") "
Jul 11 08:26:30.587429 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:30.587303    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2p44\" (UniqueName: \"kubernetes.io/projected/42aedc2d-90fc-47f1-b0dc-21d75aed6342-kube-api-access-d2p44\") pod \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") "
Jul 11 08:26:30.587429 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:30.587353    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42aedc2d-90fc-47f1-b0dc-21d75aed6342-istio-data\") pod \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") "
Jul 11 08:26:30.587429 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:30.587376    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42aedc2d-90fc-47f1-b0dc-21d75aed6342-workload-certs\") pod \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") "
Jul 11 08:26:30.587429 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:30.587400    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42aedc2d-90fc-47f1-b0dc-21d75aed6342-istio-envoy\") pod \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") "
Jul 11 08:26:30.587734 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:30.587431    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42aedc2d-90fc-47f1-b0dc-21d75aed6342-istio-token\") pod \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") "
Jul 11 08:26:30.587734 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:30.587472    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42aedc2d-90fc-47f1-b0dc-21d75aed6342-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "42aedc2d-90fc-47f1-b0dc-21d75aed6342" (UID: "42aedc2d-90fc-47f1-b0dc-21d75aed6342"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:26:30.587734 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:30.587491    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42aedc2d-90fc-47f1-b0dc-21d75aed6342-istiod-ca-cert\") pod \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\" (UID: \"42aedc2d-90fc-47f1-b0dc-21d75aed6342\") "
Jul 11 08:26:30.587734 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:30.587614    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42aedc2d-90fc-47f1-b0dc-21d75aed6342-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "42aedc2d-90fc-47f1-b0dc-21d75aed6342" (UID: "42aedc2d-90fc-47f1-b0dc-21d75aed6342"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:26:30.587939 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:30.587743    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42aedc2d-90fc-47f1-b0dc-21d75aed6342-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "42aedc2d-90fc-47f1-b0dc-21d75aed6342" (UID: "42aedc2d-90fc-47f1-b0dc-21d75aed6342"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:26:30.587939 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:30.587840    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42aedc2d-90fc-47f1-b0dc-21d75aed6342-workload-socket\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:26:30.587939 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:30.587858    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42aedc2d-90fc-47f1-b0dc-21d75aed6342-credential-socket\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:26:30.587939 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:30.587867    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42aedc2d-90fc-47f1-b0dc-21d75aed6342-workload-certs\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:26:30.588111 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:30.587938    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42aedc2d-90fc-47f1-b0dc-21d75aed6342-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "42aedc2d-90fc-47f1-b0dc-21d75aed6342" (UID: "42aedc2d-90fc-47f1-b0dc-21d75aed6342"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 08:26:30.588247 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:30.588225    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42aedc2d-90fc-47f1-b0dc-21d75aed6342-istio-data" (OuterVolumeSpecName: "istio-data") pod "42aedc2d-90fc-47f1-b0dc-21d75aed6342" (UID: "42aedc2d-90fc-47f1-b0dc-21d75aed6342"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:26:30.589561 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:30.589535    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/42aedc2d-90fc-47f1-b0dc-21d75aed6342-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "42aedc2d-90fc-47f1-b0dc-21d75aed6342" (UID: "42aedc2d-90fc-47f1-b0dc-21d75aed6342"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 11 08:26:30.589719 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:30.589705    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42aedc2d-90fc-47f1-b0dc-21d75aed6342-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "42aedc2d-90fc-47f1-b0dc-21d75aed6342" (UID: "42aedc2d-90fc-47f1-b0dc-21d75aed6342"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 08:26:30.589963 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:30.589935    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42aedc2d-90fc-47f1-b0dc-21d75aed6342-istio-token" (OuterVolumeSpecName: "istio-token") pod "42aedc2d-90fc-47f1-b0dc-21d75aed6342" (UID: "42aedc2d-90fc-47f1-b0dc-21d75aed6342"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 08:26:30.590040 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:30.589935    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42aedc2d-90fc-47f1-b0dc-21d75aed6342-kube-api-access-d2p44" (OuterVolumeSpecName: "kube-api-access-d2p44") pod "42aedc2d-90fc-47f1-b0dc-21d75aed6342" (UID: "42aedc2d-90fc-47f1-b0dc-21d75aed6342"). InnerVolumeSpecName "kube-api-access-d2p44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 08:26:30.688789 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:30.688757    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42aedc2d-90fc-47f1-b0dc-21d75aed6342-istiod-ca-cert\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:26:30.688789 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:30.688784    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42aedc2d-90fc-47f1-b0dc-21d75aed6342-istio-podinfo\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:26:30.688789 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:30.688793    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2p44\" (UniqueName: \"kubernetes.io/projected/42aedc2d-90fc-47f1-b0dc-21d75aed6342-kube-api-access-d2p44\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:26:30.689011 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:30.688802    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42aedc2d-90fc-47f1-b0dc-21d75aed6342-istio-data\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:26:30.689011 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:30.688811    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42aedc2d-90fc-47f1-b0dc-21d75aed6342-istio-envoy\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:26:30.689011 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:30.688819    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42aedc2d-90fc-47f1-b0dc-21d75aed6342-istio-token\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:26:31.023385 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:31.023283    2568 generic.go:356] "Generic (PLEG): container finished" podID="42aedc2d-90fc-47f1-b0dc-21d75aed6342" containerID="4cb6380f3f3373a6dfbada52b9474bd49ce68b47516794a24db71f7dff3af00b" exitCode=0
Jul 11 08:26:31.023385 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:31.023347    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"
Jul 11 08:26:31.023385 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:31.023367    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5" event={"ID":"42aedc2d-90fc-47f1-b0dc-21d75aed6342","Type":"ContainerDied","Data":"4cb6380f3f3373a6dfbada52b9474bd49ce68b47516794a24db71f7dff3af00b"}
Jul 11 08:26:31.023645 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:31.023422    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5" event={"ID":"42aedc2d-90fc-47f1-b0dc-21d75aed6342","Type":"ContainerDied","Data":"da314d5eee525681c104c11be145e5f8f9c91159a2417f5627d6932029827e2a"}
Jul 11 08:26:31.023645 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:31.023446    2568 scope.go:117] "RemoveContainer" containerID="4cb6380f3f3373a6dfbada52b9474bd49ce68b47516794a24db71f7dff3af00b"
Jul 11 08:26:31.038033 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:31.038013    2568 scope.go:117] "RemoveContainer" containerID="4df112a5b9ac3d843b2f5dfda14bfa90eda6a79f39a7ca60aec368529f4a9e30"
Jul 11 08:26:31.046336 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:31.046301    2568 scope.go:117] "RemoveContainer" containerID="4cb6380f3f3373a6dfbada52b9474bd49ce68b47516794a24db71f7dff3af00b"
Jul 11 08:26:31.046590 ip-10-0-142-153 kubenswrapper[2568]: E0711 08:26:31.046571    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cb6380f3f3373a6dfbada52b9474bd49ce68b47516794a24db71f7dff3af00b\": container with ID starting with 4cb6380f3f3373a6dfbada52b9474bd49ce68b47516794a24db71f7dff3af00b not found: ID does not exist" containerID="4cb6380f3f3373a6dfbada52b9474bd49ce68b47516794a24db71f7dff3af00b"
Jul 11 08:26:31.046633 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:31.046597    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cb6380f3f3373a6dfbada52b9474bd49ce68b47516794a24db71f7dff3af00b"} err="failed to get container status \"4cb6380f3f3373a6dfbada52b9474bd49ce68b47516794a24db71f7dff3af00b\": rpc error: code = NotFound desc = could not find container \"4cb6380f3f3373a6dfbada52b9474bd49ce68b47516794a24db71f7dff3af00b\": container with ID starting with 4cb6380f3f3373a6dfbada52b9474bd49ce68b47516794a24db71f7dff3af00b not found: ID does not exist"
Jul 11 08:26:31.046633 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:31.046615    2568 scope.go:117] "RemoveContainer" containerID="4df112a5b9ac3d843b2f5dfda14bfa90eda6a79f39a7ca60aec368529f4a9e30"
Jul 11 08:26:31.046835 ip-10-0-142-153 kubenswrapper[2568]: E0711 08:26:31.046818    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4df112a5b9ac3d843b2f5dfda14bfa90eda6a79f39a7ca60aec368529f4a9e30\": container with ID starting with 4df112a5b9ac3d843b2f5dfda14bfa90eda6a79f39a7ca60aec368529f4a9e30 not found: ID does not exist" containerID="4df112a5b9ac3d843b2f5dfda14bfa90eda6a79f39a7ca60aec368529f4a9e30"
Jul 11 08:26:31.046884 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:31.046842    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4df112a5b9ac3d843b2f5dfda14bfa90eda6a79f39a7ca60aec368529f4a9e30"} err="failed to get container status \"4df112a5b9ac3d843b2f5dfda14bfa90eda6a79f39a7ca60aec368529f4a9e30\": rpc error: code = NotFound desc = could not find container \"4df112a5b9ac3d843b2f5dfda14bfa90eda6a79f39a7ca60aec368529f4a9e30\": container with ID starting with 4df112a5b9ac3d843b2f5dfda14bfa90eda6a79f39a7ca60aec368529f4a9e30 not found: ID does not exist"
Jul 11 08:26:31.050489 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:31.050469    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"]
Jul 11 08:26:31.055492 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:31.055473    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-f178a6-openshift-default-657c4c5c55-mpmp5"]
Jul 11 08:26:31.071502 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:31.071481    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42aedc2d-90fc-47f1-b0dc-21d75aed6342" path="/var/lib/kubelet/pods/42aedc2d-90fc-47f1-b0dc-21d75aed6342/volumes"
Jul 11 08:26:35.985269 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:35.985233    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl"]
Jul 11 08:26:35.985792 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:35.985481    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl" podUID="0ea107b7-3091-4e30-9dfe-3a2746712aef" containerName="maas-api" containerID="cri-o://6911b2eaecf44dedcf19a436603677ef3521b36977897d90a07b5d416e7dc42f" gracePeriod=30
Jul 11 08:26:36.425901 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:36.425877    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl"
Jul 11 08:26:36.541459 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:36.541376    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ea107b7-3091-4e30-9dfe-3a2746712aef-maas-api-tls\") pod \"0ea107b7-3091-4e30-9dfe-3a2746712aef\" (UID: \"0ea107b7-3091-4e30-9dfe-3a2746712aef\") "
Jul 11 08:26:36.541459 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:36.541437    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ea107b7-3091-4e30-9dfe-3a2746712aef-openshift-service-ca\") pod \"0ea107b7-3091-4e30-9dfe-3a2746712aef\" (UID: \"0ea107b7-3091-4e30-9dfe-3a2746712aef\") "
Jul 11 08:26:36.541459 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:36.541460    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvg4w\" (UniqueName: \"kubernetes.io/projected/0ea107b7-3091-4e30-9dfe-3a2746712aef-kube-api-access-hvg4w\") pod \"0ea107b7-3091-4e30-9dfe-3a2746712aef\" (UID: \"0ea107b7-3091-4e30-9dfe-3a2746712aef\") "
Jul 11 08:26:36.541829 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:36.541805    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ea107b7-3091-4e30-9dfe-3a2746712aef-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0ea107b7-3091-4e30-9dfe-3a2746712aef" (UID: "0ea107b7-3091-4e30-9dfe-3a2746712aef"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 08:26:36.543452 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:36.543426    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ea107b7-3091-4e30-9dfe-3a2746712aef-kube-api-access-hvg4w" (OuterVolumeSpecName: "kube-api-access-hvg4w") pod "0ea107b7-3091-4e30-9dfe-3a2746712aef" (UID: "0ea107b7-3091-4e30-9dfe-3a2746712aef"). InnerVolumeSpecName "kube-api-access-hvg4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 08:26:36.543564 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:36.543471    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ea107b7-3091-4e30-9dfe-3a2746712aef-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0ea107b7-3091-4e30-9dfe-3a2746712aef" (UID: "0ea107b7-3091-4e30-9dfe-3a2746712aef"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 08:26:36.642314 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:36.642273    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ea107b7-3091-4e30-9dfe-3a2746712aef-maas-api-tls\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:26:36.642314 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:36.642310    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ea107b7-3091-4e30-9dfe-3a2746712aef-openshift-service-ca\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:26:36.642314 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:36.642319    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvg4w\" (UniqueName: \"kubernetes.io/projected/0ea107b7-3091-4e30-9dfe-3a2746712aef-kube-api-access-hvg4w\") on node \"ip-10-0-142-153.ec2.internal\" DevicePath \"\""
Jul 11 08:26:37.054470 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:37.054430    2568 generic.go:356] "Generic (PLEG): container finished" podID="0ea107b7-3091-4e30-9dfe-3a2746712aef" containerID="6911b2eaecf44dedcf19a436603677ef3521b36977897d90a07b5d416e7dc42f" exitCode=0
Jul 11 08:26:37.054883 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:37.054492    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl"
Jul 11 08:26:37.054883 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:37.054520    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl" event={"ID":"0ea107b7-3091-4e30-9dfe-3a2746712aef","Type":"ContainerDied","Data":"6911b2eaecf44dedcf19a436603677ef3521b36977897d90a07b5d416e7dc42f"}
Jul 11 08:26:37.054883 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:37.054595    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl" event={"ID":"0ea107b7-3091-4e30-9dfe-3a2746712aef","Type":"ContainerDied","Data":"ea0eb752923e008213ea6195cf01a30f16cb40469db2d4cbc1b5d87aad86d2ba"}
Jul 11 08:26:37.054883 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:37.054617    2568 scope.go:117] "RemoveContainer" containerID="6911b2eaecf44dedcf19a436603677ef3521b36977897d90a07b5d416e7dc42f"
Jul 11 08:26:37.063031 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:37.063010    2568 scope.go:117] "RemoveContainer" containerID="6911b2eaecf44dedcf19a436603677ef3521b36977897d90a07b5d416e7dc42f"
Jul 11 08:26:37.063284 ip-10-0-142-153 kubenswrapper[2568]: E0711 08:26:37.063265    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6911b2eaecf44dedcf19a436603677ef3521b36977897d90a07b5d416e7dc42f\": container with ID starting with 6911b2eaecf44dedcf19a436603677ef3521b36977897d90a07b5d416e7dc42f not found: ID does not exist" containerID="6911b2eaecf44dedcf19a436603677ef3521b36977897d90a07b5d416e7dc42f"
Jul 11 08:26:37.063353 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:37.063293    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6911b2eaecf44dedcf19a436603677ef3521b36977897d90a07b5d416e7dc42f"} err="failed to get container status \"6911b2eaecf44dedcf19a436603677ef3521b36977897d90a07b5d416e7dc42f\": rpc error: code = NotFound desc = could not find container \"6911b2eaecf44dedcf19a436603677ef3521b36977897d90a07b5d416e7dc42f\": container with ID starting with 6911b2eaecf44dedcf19a436603677ef3521b36977897d90a07b5d416e7dc42f not found: ID does not exist"
Jul 11 08:26:37.073613 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:37.073591    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl"]
Jul 11 08:26:37.077311 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:37.077293    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-12fff0-bb67877f6-gsqgl"]
Jul 11 08:26:39.070978 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:39.070947    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ea107b7-3091-4e30-9dfe-3a2746712aef" path="/var/lib/kubelet/pods/0ea107b7-3091-4e30-9dfe-3a2746712aef/volumes"
Jul 11 08:26:56.873202 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:56.873169    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-9c5f5fdd9-csjnx_5331f330-43fa-4495-999b-e7580c09978c/manager/0.log"
Jul 11 08:26:57.110523 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:57.110493    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-p5qwq_59617955-0bf6-4dd8-a4de-cd85e34315a4/manager/0.log"
Jul 11 08:26:57.338945 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:57.338920    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78d8b67ddd-b82c9_20ed54a2-e2e0-4935-b812-f41120e4ea00/manager/0.log"
Jul 11 08:26:57.344396 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:57.344377    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78d8b67ddd-b82c9_20ed54a2-e2e0-4935-b812-f41120e4ea00/copy-manifests/0.log"
Jul 11 08:26:57.826123 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:57.826089    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-fbb8fb6cd-hl87x_3e664305-fa22-4192-9f0f-0018360a7647/maas-api/0.log"
Jul 11 08:26:59.473945 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:26:59.473912    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-7x8pj_65d491c5-d02b-470a-8b24-0eba2db49a1d/postgres/0.log"
Jul 11 08:27:00.841072 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:00.841040    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-6hd9p_f71a48cd-12fd-4a16-a7a6-59894e5ed18d/manager/0.log"
Jul 11 08:27:01.174389 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:01.174295    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zfpgh_b15b5c79-e7fc-45b5-a455-c94a7e94ae4c/registry-server/0.log"
Jul 11 08:27:01.976621 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:01.976587    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-8qrbv_af19058a-7458-4333-9508-22aa26648594/discovery/0.log"
Jul 11 08:27:02.202206 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:02.202178    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dd5d4cc95-wh9tz_6f23ab45-4413-4c10-8e7b-a1d41f47c3f9/kube-auth-proxy/0.log"
Jul 11 08:27:02.321845 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:02.321815    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-t2jdj_513e718d-c34e-495e-90b9-e52f6f6d85d9/istio-proxy/1.log"
Jul 11 08:27:02.436757 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:02.436725    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-h5dzn_57513857-d1d2-4eb3-8e97-4e3dd5311e76/payload-pre-processing/0.log"
Jul 11 08:27:02.559038 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:02.559010    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-k5xdh_a3f3b33c-36f6-40dc-9cff-c4eec39f327c/payload-processing/0.log"
Jul 11 08:27:03.109096 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:03.109069    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-cvdcs_886cccf6-b241-4d87-acb1-39f24e9cffdc/main/0.log"
Jul 11 08:27:03.323189 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:03.323162    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44vl6_438be0e5-1d04-46f7-95bb-9c61bc8596f3/main/0.log"
Jul 11 08:27:03.432003 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:03.431919    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-cc6v6_080bc059-4111-41f4-8fa6-ec0856bc0d45/main/0.log"
Jul 11 08:27:09.924069 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:09.924035    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rw4gk_b500f11c-abb4-4699-a581-bceb7b49a3fc/global-pull-secret-syncer/0.log"
Jul 11 08:27:10.010620 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:10.010587    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wz8dm_96fc09f9-3d14-499b-a562-b79587638c6d/konnectivity-agent/0.log"
Jul 11 08:27:10.109047 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:10.109014    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-153.ec2.internal_e3125c49de272370fc2d31148f0eaee6/haproxy/0.log"
Jul 11 08:27:15.692899 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:15.692866    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-6hd9p_f71a48cd-12fd-4a16-a7a6-59894e5ed18d/manager/0.log"
Jul 11 08:27:15.799063 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:15.799009    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zfpgh_b15b5c79-e7fc-45b5-a455-c94a7e94ae4c/registry-server/0.log"
Jul 11 08:27:18.044728 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:18.044698    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v5s95_a07d014d-e577-4299-9cd6-41308503680e/node-exporter/0.log"
Jul 11 08:27:18.062606 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:18.062579    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v5s95_a07d014d-e577-4299-9cd6-41308503680e/kube-rbac-proxy/0.log"
Jul 11 08:27:18.079733 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:18.079707    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v5s95_a07d014d-e577-4299-9cd6-41308503680e/init-textfile/0.log"
Jul 11 08:27:19.405771 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.405731    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dchrv/perf-node-gather-daemonset-6hcck"]
Jul 11 08:27:19.406339 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.406304    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ea107b7-3091-4e30-9dfe-3a2746712aef" containerName="maas-api"
Jul 11 08:27:19.406435 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.406343    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ea107b7-3091-4e30-9dfe-3a2746712aef" containerName="maas-api"
Jul 11 08:27:19.406435 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.406365    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b6c8817-ba61-4aff-ba99-fba7c64efbf7" containerName="maas-api"
Jul 11 08:27:19.406435 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.406372    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b6c8817-ba61-4aff-ba99-fba7c64efbf7" containerName="maas-api"
Jul 11 08:27:19.406435 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.406384    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42aedc2d-90fc-47f1-b0dc-21d75aed6342" containerName="istio-proxy"
Jul 11 08:27:19.406435 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.406392    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="42aedc2d-90fc-47f1-b0dc-21d75aed6342" containerName="istio-proxy"
Jul 11 08:27:19.406435 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.406417    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42aedc2d-90fc-47f1-b0dc-21d75aed6342" containerName="istio-proxy"
Jul 11 08:27:19.406435 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.406425    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="42aedc2d-90fc-47f1-b0dc-21d75aed6342" containerName="istio-proxy"
Jul 11 08:27:19.406779 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.406508    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="42aedc2d-90fc-47f1-b0dc-21d75aed6342" containerName="istio-proxy"
Jul 11 08:27:19.406779 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.406520    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b6c8817-ba61-4aff-ba99-fba7c64efbf7" containerName="maas-api"
Jul 11 08:27:19.406779 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.406530    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ea107b7-3091-4e30-9dfe-3a2746712aef" containerName="maas-api"
Jul 11 08:27:19.410055 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.410031    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dchrv/perf-node-gather-daemonset-6hcck"
Jul 11 08:27:19.412598 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.412578    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dchrv\"/\"kube-root-ca.crt\""
Jul 11 08:27:19.412727 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.412592    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dchrv\"/\"openshift-service-ca.crt\""
Jul 11 08:27:19.413425 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.413409    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dchrv\"/\"default-dockercfg-xfdth\""
Jul 11 08:27:19.418209 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.418181    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dchrv/perf-node-gather-daemonset-6hcck"]
Jul 11 08:27:19.482181 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.482143    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df5e1111-4bef-4831-9dda-592a224e96a0-lib-modules\") pod \"perf-node-gather-daemonset-6hcck\" (UID: \"df5e1111-4bef-4831-9dda-592a224e96a0\") " pod="openshift-must-gather-dchrv/perf-node-gather-daemonset-6hcck"
Jul 11 08:27:19.482181 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.482184    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lwrd\" (UniqueName: \"kubernetes.io/projected/df5e1111-4bef-4831-9dda-592a224e96a0-kube-api-access-2lwrd\") pod \"perf-node-gather-daemonset-6hcck\" (UID: \"df5e1111-4bef-4831-9dda-592a224e96a0\") " pod="openshift-must-gather-dchrv/perf-node-gather-daemonset-6hcck"
Jul 11 08:27:19.482482 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.482211    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df5e1111-4bef-4831-9dda-592a224e96a0-sys\") pod \"perf-node-gather-daemonset-6hcck\" (UID: \"df5e1111-4bef-4831-9dda-592a224e96a0\") " pod="openshift-must-gather-dchrv/perf-node-gather-daemonset-6hcck"
Jul 11 08:27:19.482482 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.482279    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/df5e1111-4bef-4831-9dda-592a224e96a0-proc\") pod \"perf-node-gather-daemonset-6hcck\" (UID: \"df5e1111-4bef-4831-9dda-592a224e96a0\") " pod="openshift-must-gather-dchrv/perf-node-gather-daemonset-6hcck"
Jul 11 08:27:19.482482 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.482382    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/df5e1111-4bef-4831-9dda-592a224e96a0-podres\") pod \"perf-node-gather-daemonset-6hcck\" (UID: \"df5e1111-4bef-4831-9dda-592a224e96a0\") " pod="openshift-must-gather-dchrv/perf-node-gather-daemonset-6hcck"
Jul 11 08:27:19.583550 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.583520    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/df5e1111-4bef-4831-9dda-592a224e96a0-proc\") pod \"perf-node-gather-daemonset-6hcck\" (UID: \"df5e1111-4bef-4831-9dda-592a224e96a0\") " pod="openshift-must-gather-dchrv/perf-node-gather-daemonset-6hcck"
Jul 11 08:27:19.583731 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.583562    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/df5e1111-4bef-4831-9dda-592a224e96a0-podres\") pod \"perf-node-gather-daemonset-6hcck\" (UID: \"df5e1111-4bef-4831-9dda-592a224e96a0\") " pod="openshift-must-gather-dchrv/perf-node-gather-daemonset-6hcck"
Jul 11 08:27:19.583731 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.583609    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df5e1111-4bef-4831-9dda-592a224e96a0-lib-modules\") pod \"perf-node-gather-daemonset-6hcck\" (UID: \"df5e1111-4bef-4831-9dda-592a224e96a0\") " pod="openshift-must-gather-dchrv/perf-node-gather-daemonset-6hcck"
Jul 11 08:27:19.583731 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.583630    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lwrd\" (UniqueName: \"kubernetes.io/projected/df5e1111-4bef-4831-9dda-592a224e96a0-kube-api-access-2lwrd\") pod \"perf-node-gather-daemonset-6hcck\" (UID: \"df5e1111-4bef-4831-9dda-592a224e96a0\") " pod="openshift-must-gather-dchrv/perf-node-gather-daemonset-6hcck"
Jul 11 08:27:19.583731 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.583651    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df5e1111-4bef-4831-9dda-592a224e96a0-sys\") pod \"perf-node-gather-daemonset-6hcck\" (UID: \"df5e1111-4bef-4831-9dda-592a224e96a0\") " pod="openshift-must-gather-dchrv/perf-node-gather-daemonset-6hcck"
Jul 11 08:27:19.583731 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.583650    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/df5e1111-4bef-4831-9dda-592a224e96a0-proc\") pod \"perf-node-gather-daemonset-6hcck\" (UID: \"df5e1111-4bef-4831-9dda-592a224e96a0\") " pod="openshift-must-gather-dchrv/perf-node-gather-daemonset-6hcck"
Jul 11 08:27:19.583895 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.583742    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df5e1111-4bef-4831-9dda-592a224e96a0-sys\") pod \"perf-node-gather-daemonset-6hcck\" (UID: \"df5e1111-4bef-4831-9dda-592a224e96a0\") " pod="openshift-must-gather-dchrv/perf-node-gather-daemonset-6hcck"
Jul 11 08:27:19.583895 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.583750    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/df5e1111-4bef-4831-9dda-592a224e96a0-podres\") pod \"perf-node-gather-daemonset-6hcck\" (UID: \"df5e1111-4bef-4831-9dda-592a224e96a0\") " pod="openshift-must-gather-dchrv/perf-node-gather-daemonset-6hcck"
Jul 11 08:27:19.583895 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.583762    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df5e1111-4bef-4831-9dda-592a224e96a0-lib-modules\") pod \"perf-node-gather-daemonset-6hcck\" (UID: \"df5e1111-4bef-4831-9dda-592a224e96a0\") " pod="openshift-must-gather-dchrv/perf-node-gather-daemonset-6hcck"
Jul 11 08:27:19.591217 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.591189    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lwrd\" (UniqueName: \"kubernetes.io/projected/df5e1111-4bef-4831-9dda-592a224e96a0-kube-api-access-2lwrd\") pod \"perf-node-gather-daemonset-6hcck\" (UID: \"df5e1111-4bef-4831-9dda-592a224e96a0\") " pod="openshift-must-gather-dchrv/perf-node-gather-daemonset-6hcck"
Jul 11 08:27:19.720492 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.720399    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dchrv/perf-node-gather-daemonset-6hcck"
Jul 11 08:27:19.781441 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.781407    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-rk2t2_e25b4feb-7fb7-44fb-8813-05b08cf87d42/networking-console-plugin/0.log"
Jul 11 08:27:19.858375 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:19.858340    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dchrv/perf-node-gather-daemonset-6hcck"]
Jul 11 08:27:19.862122 ip-10-0-142-153 kubenswrapper[2568]: W0711 08:27:19.862093    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddf5e1111_4bef_4831_9dda_592a224e96a0.slice/crio-b0da53c143ba8b9e4d7bbe7a43ab5d34df953dbe73b31033bc22e0da20c6ef29 WatchSource:0}: Error finding container b0da53c143ba8b9e4d7bbe7a43ab5d34df953dbe73b31033bc22e0da20c6ef29: Status 404 returned error can't find the container with id b0da53c143ba8b9e4d7bbe7a43ab5d34df953dbe73b31033bc22e0da20c6ef29
Jul 11 08:27:20.247155 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:20.247059    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dchrv/perf-node-gather-daemonset-6hcck" event={"ID":"df5e1111-4bef-4831-9dda-592a224e96a0","Type":"ContainerStarted","Data":"2c4d9fcca4e2bdd79b5e63218f571c1c586bbb2a00b3f5af5820a3efe02223c7"}
Jul 11 08:27:20.247155 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:20.247112    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dchrv/perf-node-gather-daemonset-6hcck" event={"ID":"df5e1111-4bef-4831-9dda-592a224e96a0","Type":"ContainerStarted","Data":"b0da53c143ba8b9e4d7bbe7a43ab5d34df953dbe73b31033bc22e0da20c6ef29"}
Jul 11 08:27:20.247373 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:20.247164    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dchrv/perf-node-gather-daemonset-6hcck"
Jul 11 08:27:20.261472 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:20.261415    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dchrv/perf-node-gather-daemonset-6hcck" podStartSLOduration=1.261399862 podStartE2EDuration="1.261399862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 08:27:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 08:27:20.260212626 +0000 UTC m=+2951.744962767" watchObservedRunningTime="2026-07-11 08:27:20.261399862 +0000 UTC m=+2951.746149995"
Jul 11 08:27:22.300755 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:22.300717    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r97bl_740d2467-7c72-4de8-a6dd-28fb00ee23e4/dns/0.log"
Jul 11 08:27:22.318086 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:22.318056    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r97bl_740d2467-7c72-4de8-a6dd-28fb00ee23e4/kube-rbac-proxy/0.log"
Jul 11 08:27:22.380302 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:22.380276    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mm52k_3f2f61be-02eb-4215-ab69-c6dde01a5aa7/dns-node-resolver/0.log"
Jul 11 08:27:22.894270 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:22.894235    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ftfqb_d784a88f-047a-4e1b-9a08-4ff5cdccf048/node-ca/0.log"
Jul 11 08:27:23.965155 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:23.965126    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-8qrbv_af19058a-7458-4333-9508-22aa26648594/discovery/0.log"
Jul 11 08:27:24.004339 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:24.004305    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dd5d4cc95-wh9tz_6f23ab45-4413-4c10-8e7b-a1d41f47c3f9/kube-auth-proxy/0.log"
Jul 11 08:27:24.034125 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:24.034092    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-t2jdj_513e718d-c34e-495e-90b9-e52f6f6d85d9/istio-proxy/0.log"
Jul 11 08:27:24.091128 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:24.091089    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-t2jdj_513e718d-c34e-495e-90b9-e52f6f6d85d9/istio-proxy/1.log"
Jul 11 08:27:24.123713 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:24.123680    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-h5dzn_57513857-d1d2-4eb3-8e97-4e3dd5311e76/payload-pre-processing/0.log"
Jul 11 08:27:24.156517 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:24.156486    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-k5xdh_a3f3b33c-36f6-40dc-9cff-c4eec39f327c/payload-processing/0.log"
Jul 11 08:27:24.891071 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:24.891040    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rtqvv_c199c8aa-2e6e-47f2-b99e-c31bfd6aa25a/serve-healthcheck-canary/0.log"
Jul 11 08:27:25.478789 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:25.478755    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vf4tj_47a5f2c1-314e-4eaf-9914-391133562126/kube-rbac-proxy/0.log"
Jul 11 08:27:25.497261 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:25.497235    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vf4tj_47a5f2c1-314e-4eaf-9914-391133562126/exporter/0.log"
Jul 11 08:27:25.516089 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:25.516061    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vf4tj_47a5f2c1-314e-4eaf-9914-391133562126/extractor/0.log"
Jul 11 08:27:26.260841 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:26.260811    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dchrv/perf-node-gather-daemonset-6hcck"
Jul 11 08:27:27.858586 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:27.858555    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-9c5f5fdd9-csjnx_5331f330-43fa-4495-999b-e7580c09978c/manager/0.log"
Jul 11 08:27:27.998818 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:27.998784    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-p5qwq_59617955-0bf6-4dd8-a4de-cd85e34315a4/manager/0.log"
Jul 11 08:27:28.065241 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:28.065215    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78d8b67ddd-b82c9_20ed54a2-e2e0-4935-b812-f41120e4ea00/manager/0.log"
Jul 11 08:27:28.081813 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:28.081788    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78d8b67ddd-b82c9_20ed54a2-e2e0-4935-b812-f41120e4ea00/copy-manifests/0.log"
Jul 11 08:27:29.718964 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:29.718928    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-8qrbv_af19058a-7458-4333-9508-22aa26648594/discovery/0.log"
Jul 11 08:27:29.742895 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:29.742865    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dd5d4cc95-wh9tz_6f23ab45-4413-4c10-8e7b-a1d41f47c3f9/kube-auth-proxy/0.log"
Jul 11 08:27:29.761983 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:29.761942    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-t2jdj_513e718d-c34e-495e-90b9-e52f6f6d85d9/istio-proxy/0.log"
Jul 11 08:27:29.819395 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:29.819347    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-t2jdj_513e718d-c34e-495e-90b9-e52f6f6d85d9/istio-proxy/1.log"
Jul 11 08:27:29.843925 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:29.843897    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-h5dzn_57513857-d1d2-4eb3-8e97-4e3dd5311e76/payload-pre-processing/0.log"
Jul 11 08:27:29.869805 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:29.869778    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-k5xdh_a3f3b33c-36f6-40dc-9cff-c4eec39f327c/payload-processing/0.log"
Jul 11 08:27:31.288641 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:31.288533    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-8qrbv_af19058a-7458-4333-9508-22aa26648594/discovery/0.log"
Jul 11 08:27:31.315333 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:31.315290    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dd5d4cc95-wh9tz_6f23ab45-4413-4c10-8e7b-a1d41f47c3f9/kube-auth-proxy/0.log"
Jul 11 08:27:31.338304 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:31.338272    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-t2jdj_513e718d-c34e-495e-90b9-e52f6f6d85d9/istio-proxy/0.log"
Jul 11 08:27:31.394997 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:31.394970    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-t2jdj_513e718d-c34e-495e-90b9-e52f6f6d85d9/istio-proxy/1.log"
Jul 11 08:27:31.420215 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:31.420185    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-h5dzn_57513857-d1d2-4eb3-8e97-4e3dd5311e76/payload-pre-processing/0.log"
Jul 11 08:27:31.446138 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:31.446065    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-k5xdh_a3f3b33c-36f6-40dc-9cff-c4eec39f327c/payload-processing/0.log"
Jul 11 08:27:35.695149 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:35.695115    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8vvmz_d70f837c-1485-4db0-ac77-81c13470f6d1/kube-multus-additional-cni-plugins/0.log"
Jul 11 08:27:35.712880 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:35.712851    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8vvmz_d70f837c-1485-4db0-ac77-81c13470f6d1/egress-router-binary-copy/0.log"
Jul 11 08:27:35.730502 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:35.730471    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8vvmz_d70f837c-1485-4db0-ac77-81c13470f6d1/cni-plugins/0.log"
Jul 11 08:27:35.751954 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:35.751931    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8vvmz_d70f837c-1485-4db0-ac77-81c13470f6d1/bond-cni-plugin/0.log"
Jul 11 08:27:35.771970 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:35.771944    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8vvmz_d70f837c-1485-4db0-ac77-81c13470f6d1/routeoverride-cni/0.log"
Jul 11 08:27:35.791294 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:35.791273    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8vvmz_d70f837c-1485-4db0-ac77-81c13470f6d1/whereabouts-cni-bincopy/0.log"
Jul 11 08:27:35.808991 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:35.808971    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8vvmz_d70f837c-1485-4db0-ac77-81c13470f6d1/whereabouts-cni/0.log"
Jul 11 08:27:36.057921 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:36.057884    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zbgln_fc4cb970-b721-43bb-b7e3-4b4cfc971cab/kube-multus/0.log"
Jul 11 08:27:36.117104 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:36.117069    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kwbd7_91da412b-e856-41ed-b4de-78d3eaf95930/network-metrics-daemon/0.log"
Jul 11 08:27:36.134129 ip-10-0-142-153 kubenswrapper[2568]: I0711 08:27:36.134106    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kwbd7_91da412b-e856-41ed-b4de-78d3eaf95930/kube-rbac-proxy/0.log"