Jul 21 04:04:29.994983 ip-10-0-143-205 systemd[1]: Starting Kubernetes Kubelet...
Jul 21 04:04:30.427754 ip-10-0-143-205 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 04:04:30.427754 ip-10-0-143-205 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 21 04:04:30.427754 ip-10-0-143-205 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 04:04:30.427754 ip-10-0-143-205 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 21 04:04:30.427754 ip-10-0-143-205 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 04:04:30.428877 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.428786    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 21 04:04:30.435194 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435177    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 04:04:30.435194 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435194    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 04:04:30.435273 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435209    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 04:04:30.435273 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435213    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 04:04:30.435273 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435216    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 04:04:30.435273 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435223    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 04:04:30.435273 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435228    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 04:04:30.435273 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435232    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 04:04:30.435273 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435235    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 04:04:30.435273 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435238    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 04:04:30.435273 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435241    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 04:04:30.435273 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435244    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 04:04:30.435273 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435247    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 04:04:30.435273 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435250    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 04:04:30.435273 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435264    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 04:04:30.435273 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435267    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 04:04:30.435273 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435270    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 04:04:30.435273 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435272    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 04:04:30.435273 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435275    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 04:04:30.435273 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435278    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 04:04:30.435273 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435282    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 04:04:30.435736 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435285    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 04:04:30.435736 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435288    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 04:04:30.435736 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435291    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 04:04:30.435736 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435294    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 04:04:30.435736 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435296    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 04:04:30.435736 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435299    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 04:04:30.435736 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435302    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 04:04:30.435736 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435305    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 04:04:30.435736 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435308    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 04:04:30.435736 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435310    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 04:04:30.435736 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435313    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 04:04:30.435736 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435316    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 04:04:30.435736 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435319    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 04:04:30.435736 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435321    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 04:04:30.435736 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435324    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 04:04:30.435736 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435327    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 04:04:30.435736 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435329    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 04:04:30.435736 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435332    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 04:04:30.435736 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435335    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 04:04:30.435736 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435338    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 04:04:30.436264 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435340    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 04:04:30.436264 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435343    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 04:04:30.436264 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435346    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 04:04:30.436264 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435349    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 04:04:30.436264 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435351    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 04:04:30.436264 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435354    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 04:04:30.436264 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435356    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 04:04:30.436264 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435359    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 04:04:30.436264 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435361    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 04:04:30.436264 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435364    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 04:04:30.436264 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435367    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 04:04:30.436264 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435369    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 04:04:30.436264 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435373    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 04:04:30.436264 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435376    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 04:04:30.436264 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435378    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 04:04:30.436264 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435382    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 04:04:30.436264 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435385    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 04:04:30.436264 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435388    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 04:04:30.436264 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435392    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 04:04:30.436752 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435396    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 04:04:30.436752 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435399    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 04:04:30.436752 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435402    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 04:04:30.436752 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435404    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 04:04:30.436752 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435407    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 04:04:30.436752 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435410    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 04:04:30.436752 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435412    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 04:04:30.436752 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435417    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 04:04:30.436752 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435419    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 04:04:30.436752 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435422    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 04:04:30.436752 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435425    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 04:04:30.436752 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435428    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 04:04:30.436752 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435431    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 04:04:30.436752 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435433    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 04:04:30.436752 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435436    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 04:04:30.436752 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435439    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 04:04:30.436752 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435442    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 04:04:30.436752 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435445    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 04:04:30.436752 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435447    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 04:04:30.436752 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435450    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 04:04:30.437257 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435453    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 04:04:30.437257 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435455    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 04:04:30.437257 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435458    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 04:04:30.437257 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435461    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 04:04:30.437257 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435463    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 04:04:30.437257 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435467    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 04:04:30.437257 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435470    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 04:04:30.437257 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435473    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 04:04:30.437257 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435476    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 04:04:30.437257 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435479    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 04:04:30.437257 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435481    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 04:04:30.437257 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435484    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 04:04:30.437257 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435487    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 04:04:30.437257 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435490    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 04:04:30.437257 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435492    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 04:04:30.437257 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435497    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 04:04:30.437257 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435502    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 04:04:30.437257 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435505    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 04:04:30.437257 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.435508    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 04:04:30.437745 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437542    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 04:04:30.437745 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437551    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 04:04:30.437745 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437554    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 04:04:30.437745 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437558    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 04:04:30.437745 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437561    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 04:04:30.437745 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437567    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 04:04:30.437745 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437570    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 04:04:30.437745 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437573    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 04:04:30.437745 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437576    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 04:04:30.437745 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437579    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 04:04:30.437745 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437582    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 04:04:30.437745 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437584    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 04:04:30.437745 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437587    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 04:04:30.437745 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437590    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 04:04:30.437745 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437593    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 04:04:30.437745 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437596    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 04:04:30.437745 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437598    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 04:04:30.437745 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437601    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 04:04:30.437745 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437604    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 04:04:30.437745 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437607    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 04:04:30.438294 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437609    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 04:04:30.438294 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437612    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 04:04:30.438294 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437616    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 04:04:30.438294 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437620    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 04:04:30.438294 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437623    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 04:04:30.438294 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437626    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 04:04:30.438294 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437629    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 04:04:30.438294 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437632    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 04:04:30.438294 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437635    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 04:04:30.438294 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437637    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 04:04:30.438294 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437640    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 04:04:30.438294 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437642    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 04:04:30.438294 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437645    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 04:04:30.438294 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437648    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 04:04:30.438294 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437651    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 04:04:30.438294 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437654    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 04:04:30.438294 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437657    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 04:04:30.438294 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437660    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 04:04:30.438294 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437663    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 04:04:30.438294 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437666    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 04:04:30.438810 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437669    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 04:04:30.438810 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437671    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 04:04:30.438810 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437674    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 04:04:30.438810 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437677    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 04:04:30.438810 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437680    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 04:04:30.438810 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437682    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 04:04:30.438810 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437685    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 04:04:30.438810 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437688    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 04:04:30.438810 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437691    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 04:04:30.438810 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437695    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 04:04:30.438810 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437698    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 04:04:30.438810 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437700    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 04:04:30.438810 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437703    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 04:04:30.438810 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437706    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 04:04:30.438810 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437708    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 04:04:30.438810 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437713    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 04:04:30.438810 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437715    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 04:04:30.438810 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437718    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 04:04:30.438810 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437721    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 04:04:30.439325 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437723    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 04:04:30.439325 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437726    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 04:04:30.439325 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437729    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 04:04:30.439325 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437731    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 04:04:30.439325 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437734    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 04:04:30.439325 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437737    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 04:04:30.439325 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437740    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 04:04:30.439325 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437743    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 04:04:30.439325 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437746    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 04:04:30.439325 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437749    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 04:04:30.439325 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437752    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 04:04:30.439325 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437755    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 04:04:30.439325 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437758    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 04:04:30.439325 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437760    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 04:04:30.439325 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437764    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 04:04:30.439325 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437767    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 04:04:30.439325 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437769    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 04:04:30.439325 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437772    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 04:04:30.439325 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437775    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 04:04:30.439325 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437778    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 04:04:30.439841 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437781    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 04:04:30.439841 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437783    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 04:04:30.439841 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437787    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 04:04:30.439841 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437789    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 04:04:30.439841 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437792    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 04:04:30.439841 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437795    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 04:04:30.439841 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437798    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 04:04:30.439841 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437800    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 04:04:30.439841 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437803    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 04:04:30.439841 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437806    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 04:04:30.439841 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437808    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 04:04:30.439841 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437811    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 04:04:30.439841 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437814    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 04:04:30.439841 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437816    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 04:04:30.439841 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437819    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 04:04:30.439841 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437821    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 04:04:30.439841 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437824    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 04:04:30.439841 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437829    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 04:04:30.439841 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437834    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 04:04:30.440353 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.437838    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 04:04:30.440353 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438245    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 04:04:30.440353 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438252    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 04:04:30.440353 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438255    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 04:04:30.440353 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438258    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 04:04:30.440353 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438261    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 04:04:30.440353 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438264    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 04:04:30.440353 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438267    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 04:04:30.440353 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438270    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 04:04:30.440353 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438275    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 04:04:30.440353 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438278    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 04:04:30.440353 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438282    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 04:04:30.440353 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438285    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 04:04:30.440353 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438288    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 04:04:30.440353 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438291    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 04:04:30.440353 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438295    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 04:04:30.440353 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438298    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 04:04:30.440353 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438301    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 04:04:30.440353 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438305    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 04:04:30.440869 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438308    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 04:04:30.440869 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438311    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 04:04:30.440869 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438313    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 04:04:30.440869 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438317    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 04:04:30.440869 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438319    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 04:04:30.440869 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438323    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 04:04:30.440869 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438326    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 04:04:30.440869 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438328    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 04:04:30.440869 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438331    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 04:04:30.440869 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438334    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 04:04:30.440869 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438337    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 04:04:30.440869 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438339    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 04:04:30.440869 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438342    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 04:04:30.440869 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438345    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 04:04:30.440869 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438348    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 04:04:30.440869 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438351    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 04:04:30.440869 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438354    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 04:04:30.440869 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438356    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 04:04:30.440869 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438360    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 04:04:30.440869 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438363    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 04:04:30.441514 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438366    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 04:04:30.441514 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438369    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 04:04:30.441514 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438372    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 04:04:30.441514 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438375    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 04:04:30.441514 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438377    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 04:04:30.441514 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438380    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 04:04:30.441514 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438383    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 04:04:30.441514 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438385    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 04:04:30.441514 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438389    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 04:04:30.441514 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438392    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 04:04:30.441514 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438395    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 04:04:30.441514 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438397    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 04:04:30.441514 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438400    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 04:04:30.441514 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438404    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 04:04:30.441514 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438406    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 04:04:30.441514 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438409    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 04:04:30.441514 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438412    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 04:04:30.441514 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438415    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 04:04:30.441514 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438417    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 04:04:30.442009 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438420    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 04:04:30.442009 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438423    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 04:04:30.442009 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438425    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 04:04:30.442009 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438428    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 04:04:30.442009 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438431    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 04:04:30.442009 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438434    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 04:04:30.442009 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438437    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 04:04:30.442009 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438441    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 04:04:30.442009 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438445    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 04:04:30.442009 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438448    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 04:04:30.442009 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438451    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 04:04:30.442009 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438454    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 04:04:30.442009 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438457    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 04:04:30.442009 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438460    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 04:04:30.442009 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438463    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 04:04:30.442009 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438466    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 04:04:30.442009 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438468    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 04:04:30.442009 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438471    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 04:04:30.442009 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438474    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 04:04:30.442566 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438477    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 04:04:30.442566 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438480    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 04:04:30.442566 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438483    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 04:04:30.442566 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438485    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 04:04:30.442566 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438489    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 04:04:30.442566 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438493    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 04:04:30.442566 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438496    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 04:04:30.442566 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438499    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 04:04:30.442566 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438501    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 04:04:30.442566 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438504    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 04:04:30.442566 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438507    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 04:04:30.442566 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438509    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 04:04:30.442566 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438512    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 04:04:30.442566 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438515    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 04:04:30.442566 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438517    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 04:04:30.442566 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438520    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 04:04:30.442566 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438522    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 04:04:30.442566 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438525    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 04:04:30.442566 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438528    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 04:04:30.442566 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438531    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 04:04:30.443067 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438533    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 04:04:30.443067 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438536    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 04:04:30.443067 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.438539    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 04:04:30.443067 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438618    2580 flags.go:64] FLAG: --address="0.0.0.0"
Jul 21 04:04:30.443067 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438635    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 21 04:04:30.443067 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438645    2580 flags.go:64] FLAG: --anonymous-auth="true"
Jul 21 04:04:30.443067 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438652    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 21 04:04:30.443067 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438657    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 21 04:04:30.443067 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438660    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 21 04:04:30.443067 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438664    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 21 04:04:30.443067 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438668    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 21 04:04:30.443067 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438671    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 21 04:04:30.443067 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438675    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 21 04:04:30.443067 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438679    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 21 04:04:30.443067 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438682    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 21 04:04:30.443067 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438686    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 21 04:04:30.443067 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438689    2580 flags.go:64] FLAG: --cgroup-root=""
Jul 21 04:04:30.443067 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438692    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 21 04:04:30.443067 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438695    2580 flags.go:64] FLAG: --client-ca-file=""
Jul 21 04:04:30.443067 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438698    2580 flags.go:64] FLAG: --cloud-provider="external"
Jul 21 04:04:30.443067 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438702    2580 flags.go:64] FLAG: --cluster-dns="[]"
Jul 21 04:04:30.443067 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438706    2580 flags.go:64] FLAG: --cluster-domain=""
Jul 21 04:04:30.443067 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438709    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 21 04:04:30.443067 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438712    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 21 04:04:30.443728 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438716    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 21 04:04:30.443728 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438719    2580 flags.go:64] FLAG: --container-log-max-files="5"
Jul 21 04:04:30.443728 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438723    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 21 04:04:30.443728 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438726    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 21 04:04:30.443728 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438729    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 21 04:04:30.443728 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438732    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 21 04:04:30.443728 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438736    2580 flags.go:64] FLAG: --contention-profiling="false"
Jul 21 04:04:30.443728 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438739    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 21 04:04:30.443728 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438743    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 21 04:04:30.443728 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438746    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 21 04:04:30.443728 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438750    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 21 04:04:30.443728 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438754    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 21 04:04:30.443728 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438757    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 21 04:04:30.443728 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438761    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 21 04:04:30.443728 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438764    2580 flags.go:64] FLAG: --enable-load-reader="false"
Jul 21 04:04:30.443728 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438767    2580 flags.go:64] FLAG: --enable-server="true"
Jul 21 04:04:30.443728 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438771    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 21 04:04:30.443728 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438776    2580 flags.go:64] FLAG: --event-burst="100"
Jul 21 04:04:30.443728 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438779    2580 flags.go:64] FLAG: --event-qps="50"
Jul 21 04:04:30.443728 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438782    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 21 04:04:30.443728 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438786    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 21 04:04:30.443728 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438789    2580 flags.go:64] FLAG: --eviction-hard=""
Jul 21 04:04:30.443728 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438793    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 21 04:04:30.443728 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438796    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 21 04:04:30.444343 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438799    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 21 04:04:30.444343 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438803    2580 flags.go:64] FLAG: --eviction-soft=""
Jul 21 04:04:30.444343 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438806    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 21 04:04:30.444343 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438809    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 21 04:04:30.444343 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438812    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 21 04:04:30.444343 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438816    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 21 04:04:30.444343 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438819    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 21 04:04:30.444343 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438822    2580 flags.go:64] FLAG: --fail-swap-on="true"
Jul 21 04:04:30.444343 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438826    2580 flags.go:64] FLAG: --feature-gates=""
Jul 21 04:04:30.444343 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438830    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 21 04:04:30.444343 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438833    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 21 04:04:30.444343 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438837    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 21 04:04:30.444343 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438840    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 21 04:04:30.444343 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438843    2580 flags.go:64] FLAG: --healthz-port="10248"
Jul 21 04:04:30.444343 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438846    2580 flags.go:64] FLAG: --help="false"
Jul 21 04:04:30.444343 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438850    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-143-205.ec2.internal"
Jul 21 04:04:30.444343 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438853    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 21 04:04:30.444343 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438856    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 21 04:04:30.444343 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438859    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 21 04:04:30.444343 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438863    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 21 04:04:30.444343 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438867    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 21 04:04:30.444343 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438870    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 21 04:04:30.444343 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438873    2580 flags.go:64] FLAG: --image-service-endpoint=""
Jul 21 04:04:30.444958 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438876    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 21 04:04:30.444958 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438879    2580 flags.go:64] FLAG: --kube-api-burst="100"
Jul 21 04:04:30.444958 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438883    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 21 04:04:30.444958 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438887    2580 flags.go:64] FLAG: --kube-api-qps="50"
Jul 21 04:04:30.444958 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438890    2580 flags.go:64] FLAG: --kube-reserved=""
Jul 21 04:04:30.444958 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438893    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 21 04:04:30.444958 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438896    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 21 04:04:30.444958 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438900    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 21 04:04:30.444958 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438903    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 21 04:04:30.444958 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438906    2580 flags.go:64] FLAG: --lock-file=""
Jul 21 04:04:30.444958 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438909    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 21 04:04:30.444958 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438913    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 21 04:04:30.444958 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438916    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 21 04:04:30.444958 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438921    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 21 04:04:30.444958 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438924    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 21 04:04:30.444958 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438927    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 21 04:04:30.444958 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438930    2580 flags.go:64] FLAG: --logging-format="text"
Jul 21 04:04:30.444958 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438934    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 21 04:04:30.444958 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438937    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 21 04:04:30.444958 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438940    2580 flags.go:64] FLAG: --manifest-url=""
Jul 21 04:04:30.444958 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438943    2580 flags.go:64] FLAG: --manifest-url-header=""
Jul 21 04:04:30.444958 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438947    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 21 04:04:30.444958 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438951    2580 flags.go:64] FLAG: --max-open-files="1000000"
Jul 21 04:04:30.444958 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438955    2580 flags.go:64] FLAG: --max-pods="110"
Jul 21 04:04:30.444958 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438961    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 21 04:04:30.445624 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438964    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 21 04:04:30.445624 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438967    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 21 04:04:30.445624 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438970    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 21 04:04:30.445624 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438974    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 21 04:04:30.445624 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438977    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 21 04:04:30.445624 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438980    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 21 04:04:30.445624 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438987    2580 flags.go:64] FLAG: --node-status-max-images="50"
Jul 21 04:04:30.445624 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438990    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 21 04:04:30.445624 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438993    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 21 04:04:30.445624 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.438996    2580 flags.go:64] FLAG: --pod-cidr=""
Jul 21 04:04:30.445624 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439000    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 21 04:04:30.445624 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439005    2580 flags.go:64] FLAG: --pod-manifest-path=""
Jul 21 04:04:30.445624 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439009    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 21 04:04:30.445624 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439012    2580 flags.go:64] FLAG: --pods-per-core="0"
Jul 21 04:04:30.445624 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439015    2580 flags.go:64] FLAG: --port="10250"
Jul 21 04:04:30.445624 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439018    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 21 04:04:30.445624 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439021    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-003eb0ca9b055528c"
Jul 21 04:04:30.445624 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439024    2580 flags.go:64] FLAG: --qos-reserved=""
Jul 21 04:04:30.445624 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439027    2580 flags.go:64] FLAG: --read-only-port="10255"
Jul 21 04:04:30.445624 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439030    2580 flags.go:64] FLAG: --register-node="true"
Jul 21 04:04:30.445624 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439033    2580 flags.go:64] FLAG: --register-with-taints=""
Jul 21 04:04:30.445624 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439037    2580 flags.go:64] FLAG: --registry-burst="10"
Jul 21 04:04:30.445624 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439040    2580 flags.go:64] FLAG: --registry-qps="5"
Jul 21 04:04:30.445624 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439043    2580 flags.go:64] FLAG: --reserved-cpus=""
Jul 21 04:04:30.446324 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439048    2580 flags.go:64] FLAG: --reserved-memory=""
Jul 21 04:04:30.446324 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439052    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 21 04:04:30.446324 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439055    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 21 04:04:30.446324 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439058    2580 flags.go:64] FLAG: --rotate-certificates="false"
Jul 21 04:04:30.446324 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439061    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 21 04:04:30.446324 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439064    2580 flags.go:64] FLAG: --runonce="false"
Jul 21 04:04:30.446324 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439067    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 21 04:04:30.446324 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439072    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 21 04:04:30.446324 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439075    2580 flags.go:64] FLAG: --seccomp-default="false"
Jul 21 04:04:30.446324 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439078    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 21 04:04:30.446324 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439081    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 21 04:04:30.446324 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439084    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 21 04:04:30.446324 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439087    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 21 04:04:30.446324 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439090    2580 flags.go:64] FLAG: --storage-driver-password="root"
Jul 21 04:04:30.446324 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439093    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 21 04:04:30.446324 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439097    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 21 04:04:30.446324 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439100    2580 flags.go:64] FLAG: --storage-driver-user="root"
Jul 21 04:04:30.446324 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439103    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 21 04:04:30.446324 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439106    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 21 04:04:30.446324 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439110    2580 flags.go:64] FLAG: --system-cgroups=""
Jul 21 04:04:30.446324 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439113    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 21 04:04:30.446324 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439119    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 21 04:04:30.446324 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439122    2580 flags.go:64] FLAG: --tls-cert-file=""
Jul 21 04:04:30.446324 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439124    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 21 04:04:30.446324 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439128    2580 flags.go:64] FLAG: --tls-min-version=""
Jul 21 04:04:30.446970 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439132    2580 flags.go:64] FLAG: --tls-private-key-file=""
Jul 21 04:04:30.446970 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439134    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 21 04:04:30.446970 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439137    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 21 04:04:30.446970 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439140    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 21 04:04:30.446970 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439144    2580 flags.go:64] FLAG: --v="2"
Jul 21 04:04:30.446970 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439148    2580 flags.go:64] FLAG: --version="false"
Jul 21 04:04:30.446970 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439152    2580 flags.go:64] FLAG: --vmodule=""
Jul 21 04:04:30.446970 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439158    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 21 04:04:30.446970 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.439161    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 21 04:04:30.446970 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439295    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 04:04:30.446970 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439299    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 04:04:30.446970 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439303    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 04:04:30.446970 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439307    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 04:04:30.446970 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439310    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 04:04:30.446970 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439315    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 04:04:30.446970 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439318    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 04:04:30.446970 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439321    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 04:04:30.446970 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439324    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 04:04:30.446970 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439327    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 04:04:30.446970 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439330    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 04:04:30.446970 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439333    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 04:04:30.446970 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439336    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 04:04:30.447591 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439339    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 04:04:30.447591 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439342    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 04:04:30.447591 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439345    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 04:04:30.447591 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439347    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 04:04:30.447591 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439350    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 04:04:30.447591 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439353    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 04:04:30.447591 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439356    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 04:04:30.447591 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439359    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 04:04:30.447591 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439362    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 04:04:30.447591 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439365    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 04:04:30.447591 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439368    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 04:04:30.447591 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439371    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 04:04:30.447591 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439373    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 04:04:30.447591 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439377    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 04:04:30.447591 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439382    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 04:04:30.447591 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439385    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 04:04:30.447591 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439387    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 04:04:30.447591 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439391    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 04:04:30.447591 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439394    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 04:04:30.447591 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439397    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 04:04:30.448113 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439400    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 04:04:30.448113 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439402    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 04:04:30.448113 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439405    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 04:04:30.448113 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439408    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 04:04:30.448113 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439412    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 04:04:30.448113 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439415    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 04:04:30.448113 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439418    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 04:04:30.448113 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439421    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 04:04:30.448113 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439424    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 04:04:30.448113 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439426    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 04:04:30.448113 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439429    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 04:04:30.448113 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439432    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 04:04:30.448113 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439434    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 04:04:30.448113 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439437    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 04:04:30.448113 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439440    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 04:04:30.448113 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439443    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 04:04:30.448113 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439445    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 04:04:30.448113 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439449    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 04:04:30.448113 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439456    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 04:04:30.448113 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439460    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 04:04:30.448657 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439463    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 04:04:30.448657 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439467    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 04:04:30.448657 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439470    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 04:04:30.448657 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439473    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 04:04:30.448657 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439475    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 04:04:30.448657 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439480    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 04:04:30.448657 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439483    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 04:04:30.448657 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439486    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 04:04:30.448657 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439489    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 04:04:30.448657 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439494    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 04:04:30.448657 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439497    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 04:04:30.448657 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439500    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 04:04:30.448657 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439503    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 04:04:30.448657 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439506    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 04:04:30.448657 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439508    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 04:04:30.448657 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439511    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 04:04:30.448657 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439516    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 04:04:30.448657 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439518    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 04:04:30.448657 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439521    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 04:04:30.449147 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439524    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 04:04:30.449147 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439526    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 04:04:30.449147 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439529    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 04:04:30.449147 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439532    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 04:04:30.449147 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439535    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 04:04:30.449147 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439538    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 04:04:30.449147 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439541    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 04:04:30.449147 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439543    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 04:04:30.449147 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439546    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 04:04:30.449147 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439550    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 04:04:30.449147 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439552    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 04:04:30.449147 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439555    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 04:04:30.449147 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439558    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 04:04:30.449147 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439561    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 04:04:30.449147 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439564    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 04:04:30.449147 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439566    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 04:04:30.449147 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439569    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 04:04:30.449147 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439572    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 04:04:30.449147 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439575    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 04:04:30.449147 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439577    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 04:04:30.449674 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439580    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 04:04:30.449674 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439583    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 04:04:30.449674 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439588    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 04:04:30.449674 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439591    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 04:04:30.449674 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439593    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 04:04:30.449674 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439596    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 04:04:30.449674 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.439598    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 04:04:30.449674 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.440381    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 04:04:30.449674 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.447408    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 21 04:04:30.449674 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.447425    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 21 04:04:30.449674 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.447447    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 21 04:04:30.449674 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.447453    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 21 04:04:30.449674 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447511    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 04:04:30.449674 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447516    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 04:04:30.450044 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447520    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 04:04:30.450044 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447523    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 04:04:30.450044 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447526    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 04:04:30.450044 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447529    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 04:04:30.450044 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447533    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 04:04:30.450044 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447536    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 04:04:30.450044 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447540    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 04:04:30.450044 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447543    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 04:04:30.450044 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447546    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 04:04:30.450044 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447549    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 04:04:30.450044 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447552    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 04:04:30.450044 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447555    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 04:04:30.450044 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447558    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 04:04:30.450044 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447561    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 04:04:30.450044 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447564    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 04:04:30.450044 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447566    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 04:04:30.450044 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447569    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 04:04:30.450044 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447572    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 04:04:30.450044 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447574    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 04:04:30.450044 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447577    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 04:04:30.450585 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447580    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 04:04:30.450585 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447583    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 04:04:30.450585 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447586    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 04:04:30.450585 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447589    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 04:04:30.450585 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447591    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 04:04:30.450585 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447595    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 04:04:30.450585 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447598    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 04:04:30.450585 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447607    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 04:04:30.450585 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447610    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 04:04:30.450585 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447613    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 04:04:30.450585 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447616    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 04:04:30.450585 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447619    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 04:04:30.450585 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447621    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 04:04:30.450585 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447625    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 04:04:30.450585 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447627    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 04:04:30.450585 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447630    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 04:04:30.450585 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447633    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 04:04:30.450585 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447636    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 04:04:30.450585 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447639    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 04:04:30.451092 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447642    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 04:04:30.451092 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447644    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 04:04:30.451092 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447647    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 04:04:30.451092 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447650    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 04:04:30.451092 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447653    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 04:04:30.451092 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447658    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 04:04:30.451092 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447662    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 04:04:30.451092 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447665    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 04:04:30.451092 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447668    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 04:04:30.451092 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447671    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 04:04:30.451092 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447674    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 04:04:30.451092 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447677    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 04:04:30.451092 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447680    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 04:04:30.451092 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447682    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 04:04:30.451092 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447685    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 04:04:30.451092 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447688    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 04:04:30.451092 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447691    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 04:04:30.451092 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447693    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 04:04:30.451092 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447696    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 04:04:30.451669 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447699    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 04:04:30.451669 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447703    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 04:04:30.451669 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447707    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 04:04:30.451669 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447710    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 04:04:30.451669 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447712    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 04:04:30.451669 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447716    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 04:04:30.451669 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447719    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 04:04:30.451669 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447724    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 04:04:30.451669 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447727    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 04:04:30.451669 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447730    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 04:04:30.451669 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447733    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 04:04:30.451669 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447735    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 04:04:30.451669 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447738    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 04:04:30.451669 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447741    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 04:04:30.451669 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447744    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 04:04:30.451669 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447747    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 04:04:30.451669 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447750    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 04:04:30.451669 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447752    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 04:04:30.451669 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447755    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 04:04:30.451669 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447758    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 04:04:30.452224 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447760    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 04:04:30.452224 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447763    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 04:04:30.452224 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447766    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 04:04:30.452224 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447769    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 04:04:30.452224 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447773    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 04:04:30.452224 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447777    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 04:04:30.452224 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447780    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 04:04:30.452224 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447783    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 04:04:30.452224 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447786    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 04:04:30.452224 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447788    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 04:04:30.452224 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447791    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 04:04:30.452224 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447794    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 04:04:30.452224 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447797    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 04:04:30.452224 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447800    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 04:04:30.452224 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447803    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 04:04:30.452224 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447806    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 04:04:30.452224 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447809    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 04:04:30.452224 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447812    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 04:04:30.452224 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447815    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 04:04:30.452712 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.447821    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 04:04:30.452712 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447938    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 04:04:30.452712 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447943    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 04:04:30.452712 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447946    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 04:04:30.452712 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447950    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 04:04:30.452712 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447953    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 04:04:30.452712 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447956    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 04:04:30.452712 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447959    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 04:04:30.452712 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447962    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 04:04:30.452712 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447965    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 04:04:30.452712 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447968    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 04:04:30.452712 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447970    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 04:04:30.452712 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447973    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 04:04:30.452712 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447976    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 04:04:30.452712 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447979    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 04:04:30.453108 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447982    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 04:04:30.453108 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447986    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 04:04:30.453108 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447990    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 04:04:30.453108 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447993    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 04:04:30.453108 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.447996    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 04:04:30.453108 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448000    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 04:04:30.453108 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448003    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 04:04:30.453108 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448006    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 04:04:30.453108 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448009    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 04:04:30.453108 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448012    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 04:04:30.453108 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448014    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 04:04:30.453108 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448017    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 04:04:30.453108 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448021    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 04:04:30.453108 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448024    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 04:04:30.453108 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448028    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 04:04:30.453108 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448031    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 04:04:30.453108 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448034    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 04:04:30.453108 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448037    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 04:04:30.453108 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448039    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 04:04:30.453108 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448042    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 04:04:30.453631 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448045    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 04:04:30.453631 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448048    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 04:04:30.453631 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448050    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 04:04:30.453631 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448053    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 04:04:30.453631 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448056    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 04:04:30.453631 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448058    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 04:04:30.453631 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448061    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 04:04:30.453631 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448064    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 04:04:30.453631 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448066    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 04:04:30.453631 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448069    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 04:04:30.453631 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448072    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 04:04:30.453631 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448074    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 04:04:30.453631 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448077    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 04:04:30.453631 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448080    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 04:04:30.453631 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448083    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 04:04:30.453631 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448085    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 04:04:30.453631 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448088    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 04:04:30.453631 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448091    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 04:04:30.453631 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448093    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 04:04:30.453631 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448096    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 04:04:30.454133 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448099    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 04:04:30.454133 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448101    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 04:04:30.454133 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448104    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 04:04:30.454133 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448106    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 04:04:30.454133 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448109    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 04:04:30.454133 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448112    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 04:04:30.454133 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448115    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 04:04:30.454133 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448118    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 04:04:30.454133 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448121    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 04:04:30.454133 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448124    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 04:04:30.454133 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448127    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 04:04:30.454133 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448130    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 04:04:30.454133 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448133    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 04:04:30.454133 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448136    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 04:04:30.454133 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448138    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 04:04:30.454133 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448141    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 04:04:30.454133 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448144    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 04:04:30.454133 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448147    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 04:04:30.454133 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448152    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 04:04:30.454646 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448156    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 04:04:30.454646 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448159    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 04:04:30.454646 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448162    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 04:04:30.454646 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448166    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 04:04:30.454646 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448169    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 04:04:30.454646 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448171    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 04:04:30.454646 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448174    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 04:04:30.454646 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448177    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 04:04:30.454646 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448179    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 04:04:30.454646 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448182    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 04:04:30.454646 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448185    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 04:04:30.454646 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448188    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 04:04:30.454646 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448190    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 04:04:30.454646 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448193    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 04:04:30.454646 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448195    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 04:04:30.454646 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448213    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 04:04:30.454646 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448216    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 04:04:30.454646 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448219    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 04:04:30.454646 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448222    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 04:04:30.454646 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448224    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 04:04:30.455161 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448227    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 04:04:30.455161 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448234    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 04:04:30.455161 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448237    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 04:04:30.455161 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448239    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 04:04:30.455161 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448242    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 04:04:30.455161 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:30.448245    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 04:04:30.455161 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.448250    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 04:04:30.455161 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.448355    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 21 04:04:30.455161 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.450445    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 21 04:04:30.455161 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.451974    2580 server.go:1019] "Starting client certificate rotation"
Jul 21 04:04:30.455161 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.452083    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 04:04:30.455161 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.452165    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 04:04:30.455161 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.454702    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 04:04:30.458296 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.458274    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 04:04:30.469690 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.469669    2580 log.go:25] "Validated CRI v1 runtime API"
Jul 21 04:04:30.471727 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.471711    2580 log.go:25] "Validated CRI v1 image API"
Jul 21 04:04:30.473312 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.473294    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 21 04:04:30.476091 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.476066    2580 fs.go:135] Filesystem UUIDs: map[1785beb7-e836-41f9-8dc2-7dccf49c6cc4:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f33d6a9d-76e6-488a-9473-eded9f5d3ef2:/dev/nvme0n1p3]
Jul 21 04:04:30.476202 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.476090    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 21 04:04:30.482017 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.481897    2580 manager.go:216] Machine: {Timestamp:2026-07-21 04:04:30.480126572 +0000 UTC m=+0.369179731 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093607 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c3988326ba014616fb283300c5990 SystemUUID:ec2c3988-326b-a014-616f-b283300c5990 BootID:efdff5ed-b001-4ea1-ad5a-8ca5e7b81dae Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bf:cf:83:1f:7f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bf:cf:83:1f:7f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:0a:9d:02:57:5e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 21 04:04:30.482017 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.482005    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 21 04:04:30.482156 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.482084    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 21 04:04:30.484039 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.484010    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 21 04:04:30.484178 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.484042    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-205.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 21 04:04:30.485275 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.485263    2580 topology_manager.go:138] "Creating topology manager with none policy"
Jul 21 04:04:30.485311 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.485277    2580 container_manager_linux.go:309] "Creating device plugin manager"
Jul 21 04:04:30.485311 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.485286    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 04:04:30.485311 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.485301    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 04:04:30.486562 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.486552    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 21 04:04:30.490265 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.490252    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 04:04:30.490402 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.490391    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 21 04:04:30.490439 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.490423    2580 kubelet.go:486] "Attempting to sync node with API server"
Jul 21 04:04:30.490439 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.490435    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 21 04:04:30.490500 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.490454    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 21 04:04:30.490500 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.490464    2580 kubelet.go:398] "Adding apiserver pod source"
Jul 21 04:04:30.490500 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.490466    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 04:04:30.490632 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.490473    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 21 04:04:30.490959 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.490944    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 04:04:30.491036 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.490973    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 04:04:30.493950 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.493932    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 21 04:04:30.497369 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.497110    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 21 04:04:30.497437 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.497388    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 21 04:04:30.498564 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.498552    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 21 04:04:30.498612 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.498569    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 21 04:04:30.498612 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.498576    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 21 04:04:30.498612 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.498582    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 21 04:04:30.498612 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.498591    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 21 04:04:30.498612 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.498597    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 21 04:04:30.498612 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.498606    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 21 04:04:30.498612 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.498611    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 21 04:04:30.498822 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.498618    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 21 04:04:30.498822 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.498624    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 21 04:04:30.498822 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.498639    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 21 04:04:30.498822 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.498644    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 21 04:04:30.499974 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.499963    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 21 04:04:30.499974 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.499974    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 21 04:04:30.503359 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.503335    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-205.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 21 04:04:30.503498 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.503393    2580 server.go:1268] "Started kubelet"
Jul 21 04:04:30.503498 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:30.503484    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 21 04:04:30.503593 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.503491    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 21 04:04:30.503593 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.503535    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 21 04:04:30.503689 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.503610    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 21 04:04:30.504032 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:30.504010    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-205.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 21 04:04:30.504305 ip-10-0-143-205 systemd[1]: Started Kubernetes Kubelet.
Jul 21 04:04:30.504818 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.504803    2580 server.go:310] "Adding debug handlers to kubelet server"
Jul 21 04:04:30.505605 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.505590    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 21 04:04:30.509157 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:30.509134    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 21 04:04:30.509535 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:30.508501    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-205.ec2.internal.18c4324fc32114b8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-205.ec2.internal,UID:ip-10-0-143-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-205.ec2.internal,},FirstTimestamp:2026-07-21 04:04:30.503089336 +0000 UTC m=+0.392142494,LastTimestamp:2026-07-21 04:04:30.503089336 +0000 UTC m=+0.392142494,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-205.ec2.internal,}"
Jul 21 04:04:30.511427 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.511413    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 21 04:04:30.511484 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.511436    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 21 04:04:30.511548 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:30.511495    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 21 04:04:30.512182 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.512161    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 21 04:04:30.512182 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.512167    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 21 04:04:30.512343 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.512190    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 21 04:04:30.512343 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.512311    2580 reconstruct.go:97] "Volume reconstruction finished"
Jul 21 04:04:30.512343 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.512318    2580 reconciler.go:29] "Reconciler: start to sync state"
Jul 21 04:04:30.512343 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.512325    2580 factory.go:55] Registering systemd factory
Jul 21 04:04:30.512343 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.512342    2580 factory.go:223] Registration of the systemd container factory successfully
Jul 21 04:04:30.512663 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.512647    2580 factory.go:153] Registering CRI-O factory
Jul 21 04:04:30.512663 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.512664    2580 factory.go:223] Registration of the crio container factory successfully
Jul 21 04:04:30.512818 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.512729    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 21 04:04:30.512818 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.512752    2580 factory.go:103] Registering Raw factory
Jul 21 04:04:30.512818 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.512767    2580 manager.go:1196] Started watching for new ooms in manager
Jul 21 04:04:30.513188 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.513142    2580 manager.go:349] Starting recovery of all containers
Jul 21 04:04:30.514670 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:30.514645    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 21 04:04:30.515155 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:30.515119    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-205.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 21 04:04:30.526870 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.526855    2580 manager.go:354] Recovery completed
Jul 21 04:04:30.531372 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.531359    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 04:04:30.533372 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.533353    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 04:04:30.533456 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.533384    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 04:04:30.533456 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.533396    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientPID"
Jul 21 04:04:30.533539 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.533450    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8p8lq"
Jul 21 04:04:30.533911 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.533897    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 21 04:04:30.533911 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.533911    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 21 04:04:30.533978 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.533926    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 04:04:30.533978 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.533948    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 04:04:30.534563 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.534550    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 04:04:30.534614 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.534574    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 04:04:30.534614 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.534585    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientPID"
Jul 21 04:04:30.535603 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:30.535532    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-205.ec2.internal.18c4324fc4ef2fc0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-205.ec2.internal,UID:ip-10-0-143-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-205.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-205.ec2.internal,},FirstTimestamp:2026-07-21 04:04:30.533373888 +0000 UTC m=+0.422427049,LastTimestamp:2026-07-21 04:04:30.533373888 +0000 UTC m=+0.422427049,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-205.ec2.internal,}"
Jul 21 04:04:30.535837 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.535825    2580 policy_none.go:49] "None policy: Start"
Jul 21 04:04:30.535880 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.535843    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 21 04:04:30.535880 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.535853    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 21 04:04:30.537588 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.537577    2580 policy_none.go:47] "Start"
Jul 21 04:04:30.545969 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.545950    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8p8lq"
Jul 21 04:04:30.546785 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:30.546722    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-205.ec2.internal.18c4324fc4ef6de2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-205.ec2.internal,UID:ip-10-0-143-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-205.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-205.ec2.internal,},FirstTimestamp:2026-07-21 04:04:30.533389794 +0000 UTC m=+0.422442955,LastTimestamp:2026-07-21 04:04:30.533389794 +0000 UTC m=+0.422442955,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-205.ec2.internal,}"
Jul 21 04:04:30.570784 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.570770    2580 manager.go:337] "Starting Device Plugin manager"
Jul 21 04:04:30.570857 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:30.570801    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 21 04:04:30.570857 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.570810    2580 server.go:87] "Starting device plugin registration server"
Jul 21 04:04:30.571060 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.571049    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 21 04:04:30.571110 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.571065    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 21 04:04:30.571198 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.571177    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 21 04:04:30.571287 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.571261    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 21 04:04:30.571287 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.571270    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 21 04:04:30.571758 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:30.571733    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 21 04:04:30.571848 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:30.571794    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 21 04:04:30.672896 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.672840    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 04:04:30.675041 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.673664    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 04:04:30.675041 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.673691    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 04:04:30.675041 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.673703    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientPID"
Jul 21 04:04:30.675041 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.673730    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-205.ec2.internal"
Jul 21 04:04:30.683993 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.683968    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-205.ec2.internal"
Jul 21 04:04:30.683993 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:30.683993    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-205.ec2.internal\": node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 21 04:04:30.686071 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.686040    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 21 04:04:30.687506 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.687490    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 21 04:04:30.687568 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.687536    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 21 04:04:30.687568 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.687562    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 21 04:04:30.687666 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:30.687598    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 21 04:04:30.690024 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.690008    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 04:04:30.717729 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:30.717710    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 21 04:04:30.789718 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.789675    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal"]
Jul 21 04:04:30.789830 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.789754    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 04:04:30.790683 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.790667    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 04:04:30.790765 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.790695    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 04:04:30.790765 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.790707    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientPID"
Jul 21 04:04:30.793159 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.793126    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 04:04:30.793252 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.793237    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal"
Jul 21 04:04:30.793293 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.793281    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 04:04:30.793862 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.793844    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 04:04:30.793862 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.793854    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 04:04:30.793969 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.793876    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 04:04:30.793969 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.793888    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientPID"
Jul 21 04:04:30.793969 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.793877    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 04:04:30.794113 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.793983    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientPID"
Jul 21 04:04:30.796144 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.796123    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal"
Jul 21 04:04:30.796250 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.796161    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 04:04:30.796784 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.796769    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 04:04:30.796848 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.796795    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 04:04:30.796848 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.796806    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientPID"
Jul 21 04:04:30.811845 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:30.811823    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-205.ec2.internal\" not found" node="ip-10-0-143-205.ec2.internal"
Jul 21 04:04:30.813385 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.813365    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8e2404177a19e2a3dd7a57eb55b1af0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal\" (UID: \"8e2404177a19e2a3dd7a57eb55b1af0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal"
Jul 21 04:04:30.813465 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.813390    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e2404177a19e2a3dd7a57eb55b1af0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal\" (UID: \"8e2404177a19e2a3dd7a57eb55b1af0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal"
Jul 21 04:04:30.813465 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.813410    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aa1018754edc1c71ee351c98f23c1ba5-config\") pod \"kube-apiserver-proxy-ip-10-0-143-205.ec2.internal\" (UID: \"aa1018754edc1c71ee351c98f23c1ba5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal"
Jul 21 04:04:30.815493 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:30.815478    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-205.ec2.internal\" not found" node="ip-10-0-143-205.ec2.internal"
Jul 21 04:04:30.817914 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:30.817901    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 21 04:04:30.913798 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.913612    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8e2404177a19e2a3dd7a57eb55b1af0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal\" (UID: \"8e2404177a19e2a3dd7a57eb55b1af0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal"
Jul 21 04:04:30.913798 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.913580    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8e2404177a19e2a3dd7a57eb55b1af0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal\" (UID: \"8e2404177a19e2a3dd7a57eb55b1af0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal"
Jul 21 04:04:30.913919 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.913826    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e2404177a19e2a3dd7a57eb55b1af0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal\" (UID: \"8e2404177a19e2a3dd7a57eb55b1af0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal"
Jul 21 04:04:30.913919 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.913843    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aa1018754edc1c71ee351c98f23c1ba5-config\") pod \"kube-apiserver-proxy-ip-10-0-143-205.ec2.internal\" (UID: \"aa1018754edc1c71ee351c98f23c1ba5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal"
Jul 21 04:04:30.913919 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.913898    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aa1018754edc1c71ee351c98f23c1ba5-config\") pod \"kube-apiserver-proxy-ip-10-0-143-205.ec2.internal\" (UID: \"aa1018754edc1c71ee351c98f23c1ba5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal"
Jul 21 04:04:30.913919 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:30.913911    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e2404177a19e2a3dd7a57eb55b1af0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal\" (UID: \"8e2404177a19e2a3dd7a57eb55b1af0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal"
Jul 21 04:04:30.917973 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:30.917953    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 21 04:04:31.019095 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:31.019023    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 21 04:04:31.115024 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:31.114993    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal"
Jul 21 04:04:31.118376 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:31.118360    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal"
Jul 21 04:04:31.120542 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:31.120104    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 21 04:04:31.221253 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:31.221216    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 21 04:04:31.321605 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:31.321530    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 21 04:04:31.322698 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:31.322681    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 04:04:31.422583 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:31.422550    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 21 04:04:31.451537 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:31.451505    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 21 04:04:31.451957 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:31.451630    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 04:04:31.451957 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:31.451674    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 04:04:31.522928 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:31.522900    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 21 04:04:31.550475 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:31.550442    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 03:59:30 +0000 UTC" deadline="2028-01-16 11:55:19.029126834 +0000 UTC"
Jul 21 04:04:31.550475 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:31.550470    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13063h50m47.478660173s"
Jul 21 04:04:31.585375 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:31.585321    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 04:04:31.586927 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:31.586909    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 04:04:31.587018 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:31.586940    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 04:04:31.587018 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:31.586953    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientPID"
Jul 21 04:04:31.623506 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:31.623468    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 21 04:04:31.660440 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:31.660408    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 04:04:31.714349 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:31.714319    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e2404177a19e2a3dd7a57eb55b1af0d.slice/crio-d1e2b668cc899200ecb4867c4f230219b64cbba60ddec8c61ca59699c8a1d2c1 WatchSource:0}: Error finding container d1e2b668cc899200ecb4867c4f230219b64cbba60ddec8c61ca59699c8a1d2c1: Status 404 returned error can't find the container with id d1e2b668cc899200ecb4867c4f230219b64cbba60ddec8c61ca59699c8a1d2c1
Jul 21 04:04:31.718871 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:31.718858    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 04:04:31.723764 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:31.723742    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 21 04:04:31.780150 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:31.780116    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa1018754edc1c71ee351c98f23c1ba5.slice/crio-110c55a80c05b56e915d01db39262e13a007e50f84312958a63ae6be8eaf03e4 WatchSource:0}: Error finding container 110c55a80c05b56e915d01db39262e13a007e50f84312958a63ae6be8eaf03e4: Status 404 returned error can't find the container with id 110c55a80c05b56e915d01db39262e13a007e50f84312958a63ae6be8eaf03e4
Jul 21 04:04:31.824702 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:31.824673    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 21 04:04:31.925029 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:31.925001    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 21 04:04:32.025799 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:32.025768    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 21 04:04:32.047334 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.047317    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 04:04:32.113883 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.113856    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal"
Jul 21 04:04:32.135188 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.135168    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 04:04:32.136473 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.136460    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal"
Jul 21 04:04:32.150256 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.150241    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 04:04:32.491997 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.491966    2580 apiserver.go:52] "Watching apiserver"
Jul 21 04:04:32.500965 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.500936    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 21 04:04:32.501490 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.501461    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-694fk","kube-system/global-pull-secret-syncer-dvcr2","kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bt9br","openshift-multus/multus-2jwvc","openshift-multus/multus-additional-cni-plugins-sqmm7","openshift-multus/network-metrics-daemon-z5xrt","openshift-network-diagnostics/network-check-target-ggzvv","openshift-network-operator/iptables-alerter-ctrfl","kube-system/konnectivity-agent-bgqdw","openshift-cluster-node-tuning-operator/tuned-wl5lw","openshift-dns/node-resolver-5tmw9","openshift-image-registry/node-ca-7xqgm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal"]
Jul 21 04:04:32.504409 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.504377    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:04:32.504515 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:32.504454    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5xrt" podUID="931a86de-fd82-48a4-996f-b39dbc3d5246"
Jul 21 04:04:32.506546 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.506521    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7xqgm"
Jul 21 04:04:32.510171 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.509015    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 21 04:04:32.510171 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.509358    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 21 04:04:32.510171 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.509633    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jnpwg\""
Jul 21 04:04:32.510171 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.509867    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 21 04:04:32.510171 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.510068    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:04:32.510171 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:32.510129    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggzvv" podUID="1a925514-e9a6-4e83-b9a7-7dedbe1040ec"
Jul 21 04:04:32.513503 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.513279    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 21 04:04:32.513503 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.513373    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bt9br"
Jul 21 04:04:32.515577 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.515074    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.516491 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.516436    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 21 04:04:32.517128 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.517020    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 21 04:04:32.517299 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.517281    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2fzw7\""
Jul 21 04:04:32.517894 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.517655    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 21 04:04:32.517894 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.517703    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 21 04:04:32.517894 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.517869    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 21 04:04:32.518416 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.518285    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 21 04:04:32.518510 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.518487    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-65rwg\""
Jul 21 04:04:32.519120 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.518659    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sqmm7"
Jul 21 04:04:32.519120 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.518842    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 21 04:04:32.521672 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.521649    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ctrfl"
Jul 21 04:04:32.523115 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.523091    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-system-cni-dir\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.523235 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.523132    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-multus-socket-dir-parent\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.523235 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.523165    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-hostroot\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.523235 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.523213    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-host-run-multus-certs\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.523389 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.523248    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eeca8e4e-83b8-4f94-9b81-50631582bf15-host\") pod \"node-ca-7xqgm\" (UID: \"eeca8e4e-83b8-4f94-9b81-50631582bf15\") " pod="openshift-image-registry/node-ca-7xqgm"
Jul 21 04:04:32.523389 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.523290    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bt9br\" (UID: \"8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bt9br"
Jul 21 04:04:32.523389 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.523314    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0-socket-dir\") pod \"aws-ebs-csi-driver-node-bt9br\" (UID: \"8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bt9br"
Jul 21 04:04:32.523389 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.523346    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0-device-dir\") pod \"aws-ebs-csi-driver-node-bt9br\" (UID: \"8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bt9br"
Jul 21 04:04:32.523389 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.523378    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0-sys-fs\") pod \"aws-ebs-csi-driver-node-bt9br\" (UID: \"8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bt9br"
Jul 21 04:04:32.523621 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.523409    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-host-var-lib-cni-bin\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.523621 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.523441    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-host-var-lib-cni-multus\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.523621 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.523468    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh4hs\" (UniqueName: \"kubernetes.io/projected/36152972-1f88-4b87-866d-873cef1a36f7-kube-api-access-gh4hs\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.523621 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.523502    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eeca8e4e-83b8-4f94-9b81-50631582bf15-serviceca\") pod \"node-ca-7xqgm\" (UID: \"eeca8e4e-83b8-4f94-9b81-50631582bf15\") " pod="openshift-image-registry/node-ca-7xqgm"
Jul 21 04:04:32.523621 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.523533    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khwsc\" (UniqueName: \"kubernetes.io/projected/eeca8e4e-83b8-4f94-9b81-50631582bf15-kube-api-access-khwsc\") pod \"node-ca-7xqgm\" (UID: \"eeca8e4e-83b8-4f94-9b81-50631582bf15\") " pod="openshift-image-registry/node-ca-7xqgm"
Jul 21 04:04:32.523621 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.523569    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0-etc-selinux\") pod \"aws-ebs-csi-driver-node-bt9br\" (UID: \"8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bt9br"
Jul 21 04:04:32.523621 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.523599    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbgx7\" (UniqueName: \"kubernetes.io/projected/8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0-kube-api-access-vbgx7\") pod \"aws-ebs-csi-driver-node-bt9br\" (UID: \"8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bt9br"
Jul 21 04:04:32.523989 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.523624    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-cnibin\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.523989 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.523667    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-os-release\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.523989 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.523697    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-host-run-netns\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.523989 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.523729    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xtk9\" (UniqueName: \"kubernetes.io/projected/931a86de-fd82-48a4-996f-b39dbc3d5246-kube-api-access-2xtk9\") pod \"network-metrics-daemon-z5xrt\" (UID: \"931a86de-fd82-48a4-996f-b39dbc3d5246\") " pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:04:32.523989 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.523762    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjw5x\" (UniqueName: \"kubernetes.io/projected/1a925514-e9a6-4e83-b9a7-7dedbe1040ec-kube-api-access-jjw5x\") pod \"network-check-target-ggzvv\" (UID: \"1a925514-e9a6-4e83-b9a7-7dedbe1040ec\") " pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:04:32.523989 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.523792    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/36152972-1f88-4b87-866d-873cef1a36f7-cni-binary-copy\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.523989 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.523822    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-multus-conf-dir\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.523989 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.523851    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/36152972-1f88-4b87-866d-873cef1a36f7-multus-daemon-config\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.523989 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.523881    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-etc-kubernetes\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.523989 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.523914    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs\") pod \"network-metrics-daemon-z5xrt\" (UID: \"931a86de-fd82-48a4-996f-b39dbc3d5246\") " pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:04:32.523989 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.523942    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-host-run-k8s-cni-cncf-io\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.523989 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.523974    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-host-var-lib-kubelet\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.524605 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.524011    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0-registration-dir\") pod \"aws-ebs-csi-driver-node-bt9br\" (UID: \"8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bt9br"
Jul 21 04:04:32.524605 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.524042    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-multus-cni-dir\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.524605 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.524424    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.526371 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.526091    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 21 04:04:32.526472 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.526417    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fqqqw\""
Jul 21 04:04:32.526472 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.526442    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 21 04:04:32.528539 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.526607    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 21 04:04:32.528539 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.526739    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-z7hbh\""
Jul 21 04:04:32.528539 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.526905    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 21 04:04:32.528539 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.527006    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 21 04:04:32.528539 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.527026    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 21 04:04:32.528539 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.527490    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 21 04:04:32.528539 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.527732    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kvlh7\""
Jul 21 04:04:32.528539 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.527749    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 21 04:04:32.528539 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.527917    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 21 04:04:32.529179 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.529161    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 21 04:04:32.530171 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.529776    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 21 04:04:32.530752 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.530727    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:04:32.530873 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:32.530809    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvcr2" podUID="f523d1f8-3698-4dd8-8d5d-f5f36251273b"
Jul 21 04:04:32.533830 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.533812    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bgqdw"
Jul 21 04:04:32.536573 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.536374    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fhpm7\""
Jul 21 04:04:32.536573 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.536509    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 21 04:04:32.536573 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.536538    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 21 04:04:32.536835 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.536817    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.539689 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.539546    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5tmw9"
Jul 21 04:04:32.542846 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.541112    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 21 04:04:32.542846 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.541168    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 21 04:04:32.542846 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.541426    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8wnc9\""
Jul 21 04:04:32.542846 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.542174    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dhwkm\""
Jul 21 04:04:32.542846 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.542430    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 21 04:04:32.542846 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.542697    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 04:04:32.543813 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.543790    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 21 04:04:32.580108 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.580083    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9bln7"
Jul 21 04:04:32.594354 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.593967    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9bln7"
Jul 21 04:04:32.613365 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.613344    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 21 04:04:32.624710 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.624688    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f523d1f8-3698-4dd8-8d5d-f5f36251273b-original-pull-secret\") pod \"global-pull-secret-syncer-dvcr2\" (UID: \"f523d1f8-3698-4dd8-8d5d-f5f36251273b\") " pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:04:32.624831 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.624725    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/685e7e2c-f971-4362-bb75-290223ff7d43-agent-certs\") pod \"konnectivity-agent-bgqdw\" (UID: \"685e7e2c-f971-4362-bb75-290223ff7d43\") " pod="kube-system/konnectivity-agent-bgqdw"
Jul 21 04:04:32.624831 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.624754    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-ovnkube-script-lib\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.624831 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.624786    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-multus-cni-dir\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.624831 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.624803    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27cdadea-f6c2-4609-8ffe-668f4126551f-host-slash\") pod \"iptables-alerter-ctrfl\" (UID: \"27cdadea-f6c2-4609-8ffe-668f4126551f\") " pod="openshift-network-operator/iptables-alerter-ctrfl"
Jul 21 04:04:32.624831 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.624822    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-host-slash\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.625060 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.624846    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-var-lib-openvswitch\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.625060 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.624868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-system-cni-dir\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.625060 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.624912    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-host-run-multus-certs\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.625060 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.624935    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-system-cni-dir\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.625060 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.624951    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f523d1f8-3698-4dd8-8d5d-f5f36251273b-dbus\") pod \"global-pull-secret-syncer-dvcr2\" (UID: \"f523d1f8-3698-4dd8-8d5d-f5f36251273b\") " pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:04:32.625060 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.624981    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/685e7e2c-f971-4362-bb75-290223ff7d43-konnectivity-ca\") pod \"konnectivity-agent-bgqdw\" (UID: \"685e7e2c-f971-4362-bb75-290223ff7d43\") " pod="kube-system/konnectivity-agent-bgqdw"
Jul 21 04:04:32.625060 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625014    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-host-run-multus-certs\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.625413 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625063    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqfmh\" (UniqueName: \"kubernetes.io/projected/27cdadea-f6c2-4609-8ffe-668f4126551f-kube-api-access-hqfmh\") pod \"iptables-alerter-ctrfl\" (UID: \"27cdadea-f6c2-4609-8ffe-668f4126551f\") " pod="openshift-network-operator/iptables-alerter-ctrfl"
Jul 21 04:04:32.625413 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625068    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-multus-cni-dir\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.625413 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625091    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-systemd-units\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.625413 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625116    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/94d201ac-f8b7-4ba0-88e0-092179854e7a-etc-tuned\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.625413 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625163    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-log-socket\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.625413 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625192    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eeca8e4e-83b8-4f94-9b81-50631582bf15-host\") pod \"node-ca-7xqgm\" (UID: \"eeca8e4e-83b8-4f94-9b81-50631582bf15\") " pod="openshift-image-registry/node-ca-7xqgm"
Jul 21 04:04:32.625413 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625218    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0-socket-dir\") pod \"aws-ebs-csi-driver-node-bt9br\" (UID: \"8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bt9br"
Jul 21 04:04:32.625413 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625243    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0-device-dir\") pod \"aws-ebs-csi-driver-node-bt9br\" (UID: \"8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bt9br"
Jul 21 04:04:32.625413 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625268    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-host-var-lib-cni-bin\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.625413 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625270    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eeca8e4e-83b8-4f94-9b81-50631582bf15-host\") pod \"node-ca-7xqgm\" (UID: \"eeca8e4e-83b8-4f94-9b81-50631582bf15\") " pod="openshift-image-registry/node-ca-7xqgm"
Jul 21 04:04:32.625413 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625293    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-etc-sysctl-conf\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.625413 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625326    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0-device-dir\") pod \"aws-ebs-csi-driver-node-bt9br\" (UID: \"8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bt9br"
Jul 21 04:04:32.625413 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625318    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-etc-systemd\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.625413 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625386    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-sys\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.625413 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625418    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-host-kubelet\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.626181 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625466    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0-socket-dir\") pod \"aws-ebs-csi-driver-node-bt9br\" (UID: \"8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bt9br"
Jul 21 04:04:32.626181 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625500    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-host-var-lib-cni-bin\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.626181 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625462    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-host-run-netns\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.626181 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625533    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eeca8e4e-83b8-4f94-9b81-50631582bf15-serviceca\") pod \"node-ca-7xqgm\" (UID: \"eeca8e4e-83b8-4f94-9b81-50631582bf15\") " pod="openshift-image-registry/node-ca-7xqgm"
Jul 21 04:04:32.626181 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625550    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0-etc-selinux\") pod \"aws-ebs-csi-driver-node-bt9br\" (UID: \"8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bt9br"
Jul 21 04:04:32.626181 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625568    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbgx7\" (UniqueName: \"kubernetes.io/projected/8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0-kube-api-access-vbgx7\") pod \"aws-ebs-csi-driver-node-bt9br\" (UID: \"8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bt9br"
Jul 21 04:04:32.626181 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625585    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-cnibin\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.626181 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625607    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jx27\" (UniqueName: \"kubernetes.io/projected/d358754d-0321-4914-8b07-65a70f8c58f8-kube-api-access-6jx27\") pod \"multus-additional-cni-plugins-sqmm7\" (UID: \"d358754d-0321-4914-8b07-65a70f8c58f8\") " pod="openshift-multus/multus-additional-cni-plugins-sqmm7"
Jul 21 04:04:32.626181 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625627    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94d201ac-f8b7-4ba0-88e0-092179854e7a-tmp\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.626181 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625666    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-cnibin\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.626181 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625760    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 04:04:32.626181 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625922    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/36152972-1f88-4b87-866d-873cef1a36f7-multus-daemon-config\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.626181 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625961    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-etc-kubernetes\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.626181 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625992    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d358754d-0321-4914-8b07-65a70f8c58f8-cni-binary-copy\") pod \"multus-additional-cni-plugins-sqmm7\" (UID: \"d358754d-0321-4914-8b07-65a70f8c58f8\") " pod="openshift-multus/multus-additional-cni-plugins-sqmm7"
Jul 21 04:04:32.626181 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.625929    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0-etc-selinux\") pod \"aws-ebs-csi-driver-node-bt9br\" (UID: \"8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bt9br"
Jul 21 04:04:32.626181 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626039    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-etc-openvswitch\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.626181 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626053    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-etc-kubernetes\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.626181 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626071    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.627138 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626096    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eeca8e4e-83b8-4f94-9b81-50631582bf15-serviceca\") pod \"node-ca-7xqgm\" (UID: \"eeca8e4e-83b8-4f94-9b81-50631582bf15\") " pod="openshift-image-registry/node-ca-7xqgm"
Jul 21 04:04:32.627138 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626099    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-env-overrides\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.627138 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626144    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-etc-modprobe-d\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.627138 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626193    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jclnr\" (UniqueName: \"kubernetes.io/projected/94d201ac-f8b7-4ba0-88e0-092179854e7a-kube-api-access-jclnr\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.627138 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626239    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-ovnkube-config\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.627138 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626273    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d358754d-0321-4914-8b07-65a70f8c58f8-system-cni-dir\") pod \"multus-additional-cni-plugins-sqmm7\" (UID: \"d358754d-0321-4914-8b07-65a70f8c58f8\") " pod="openshift-multus/multus-additional-cni-plugins-sqmm7"
Jul 21 04:04:32.627138 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626297    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d358754d-0321-4914-8b07-65a70f8c58f8-os-release\") pod \"multus-additional-cni-plugins-sqmm7\" (UID: \"d358754d-0321-4914-8b07-65a70f8c58f8\") " pod="openshift-multus/multus-additional-cni-plugins-sqmm7"
Jul 21 04:04:32.627138 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626332    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d358754d-0321-4914-8b07-65a70f8c58f8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sqmm7\" (UID: \"d358754d-0321-4914-8b07-65a70f8c58f8\") " pod="openshift-multus/multus-additional-cni-plugins-sqmm7"
Jul 21 04:04:32.627138 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626363    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3105d271-61a5-4d68-9b89-9b3ddebbaad6-hosts-file\") pod \"node-resolver-5tmw9\" (UID: \"3105d271-61a5-4d68-9b89-9b3ddebbaad6\") " pod="openshift-dns/node-resolver-5tmw9"
Jul 21 04:04:32.627138 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626391    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3105d271-61a5-4d68-9b89-9b3ddebbaad6-tmp-dir\") pod \"node-resolver-5tmw9\" (UID: \"3105d271-61a5-4d68-9b89-9b3ddebbaad6\") " pod="openshift-dns/node-resolver-5tmw9"
Jul 21 04:04:32.627138 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626415    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgnn8\" (UniqueName: \"kubernetes.io/projected/3105d271-61a5-4d68-9b89-9b3ddebbaad6-kube-api-access-wgnn8\") pod \"node-resolver-5tmw9\" (UID: \"3105d271-61a5-4d68-9b89-9b3ddebbaad6\") " pod="openshift-dns/node-resolver-5tmw9"
Jul 21 04:04:32.627138 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626450    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-host-cni-bin\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.627138 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626473    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldsf7\" (UniqueName: \"kubernetes.io/projected/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-kube-api-access-ldsf7\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.627138 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626503    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0-registration-dir\") pod \"aws-ebs-csi-driver-node-bt9br\" (UID: \"8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bt9br"
Jul 21 04:04:32.627138 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626520    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d358754d-0321-4914-8b07-65a70f8c58f8-cnibin\") pod \"multus-additional-cni-plugins-sqmm7\" (UID: \"d358754d-0321-4914-8b07-65a70f8c58f8\") " pod="openshift-multus/multus-additional-cni-plugins-sqmm7"
Jul 21 04:04:32.627138 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626535    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d358754d-0321-4914-8b07-65a70f8c58f8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sqmm7\" (UID: \"d358754d-0321-4914-8b07-65a70f8c58f8\") " pod="openshift-multus/multus-additional-cni-plugins-sqmm7"
Jul 21 04:04:32.627935 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626551    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f523d1f8-3698-4dd8-8d5d-f5f36251273b-kubelet-config\") pod \"global-pull-secret-syncer-dvcr2\" (UID: \"f523d1f8-3698-4dd8-8d5d-f5f36251273b\") " pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:04:32.627935 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626566    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/27cdadea-f6c2-4609-8ffe-668f4126551f-iptables-alerter-script\") pod \"iptables-alerter-ctrfl\" (UID: \"27cdadea-f6c2-4609-8ffe-668f4126551f\") " pod="openshift-network-operator/iptables-alerter-ctrfl"
Jul 21 04:04:32.627935 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626587    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-lib-modules\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.627935 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626603    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-multus-socket-dir-parent\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.627935 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626603    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0-registration-dir\") pod \"aws-ebs-csi-driver-node-bt9br\" (UID: \"8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bt9br"
Jul 21 04:04:32.627935 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626620    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-hostroot\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.627935 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626653    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d358754d-0321-4914-8b07-65a70f8c58f8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sqmm7\" (UID: \"d358754d-0321-4914-8b07-65a70f8c58f8\") " pod="openshift-multus/multus-additional-cni-plugins-sqmm7"
Jul 21 04:04:32.627935 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626680    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-etc-kubernetes\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.627935 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626697    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-multus-socket-dir-parent\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.627935 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626671    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/36152972-1f88-4b87-866d-873cef1a36f7-multus-daemon-config\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.627935 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626698    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-run\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.627935 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626753    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-hostroot\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.627935 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626762    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-host-cni-netd\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.627935 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626797    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-ovn-node-metrics-cert\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.627935 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626823    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-etc-sysconfig\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.627935 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626850    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-var-lib-kubelet\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.627935 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626883    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-host\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.628863 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626916    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bt9br\" (UID: \"8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bt9br"
Jul 21 04:04:32.628863 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626942    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0-sys-fs\") pod \"aws-ebs-csi-driver-node-bt9br\" (UID: \"8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bt9br"
Jul 21 04:04:32.628863 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.626980    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-host-var-lib-cni-multus\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.628863 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.627014    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh4hs\" (UniqueName: \"kubernetes.io/projected/36152972-1f88-4b87-866d-873cef1a36f7-kube-api-access-gh4hs\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.628863 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.627031    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-host-var-lib-cni-multus\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.628863 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.627048    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-node-log\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.628863 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.627104    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0-sys-fs\") pod \"aws-ebs-csi-driver-node-bt9br\" (UID: \"8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bt9br"
Jul 21 04:04:32.628863 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.627118    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bt9br\" (UID: \"8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bt9br"
Jul 21 04:04:32.628863 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.627162    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khwsc\" (UniqueName: \"kubernetes.io/projected/eeca8e4e-83b8-4f94-9b81-50631582bf15-kube-api-access-khwsc\") pod \"node-ca-7xqgm\" (UID: \"eeca8e4e-83b8-4f94-9b81-50631582bf15\") " pod="openshift-image-registry/node-ca-7xqgm"
Jul 21 04:04:32.628863 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.627281    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-os-release\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.628863 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.627319    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-host-run-netns\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.628863 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.627346    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-multus-conf-dir\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.628863 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.627404    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-multus-conf-dir\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.628863 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.627529    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-host-run-netns\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.628863 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.627536    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-etc-sysctl-d\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.628863 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.627549    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-os-release\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.628863 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.627570    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xtk9\" (UniqueName: \"kubernetes.io/projected/931a86de-fd82-48a4-996f-b39dbc3d5246-kube-api-access-2xtk9\") pod \"network-metrics-daemon-z5xrt\" (UID: \"931a86de-fd82-48a4-996f-b39dbc3d5246\") " pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:04:32.629732 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.627599    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjw5x\" (UniqueName: \"kubernetes.io/projected/1a925514-e9a6-4e83-b9a7-7dedbe1040ec-kube-api-access-jjw5x\") pod \"network-check-target-ggzvv\" (UID: \"1a925514-e9a6-4e83-b9a7-7dedbe1040ec\") " pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:04:32.629732 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.627625    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/36152972-1f88-4b87-866d-873cef1a36f7-cni-binary-copy\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.629732 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.627644    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-run-systemd\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.629732 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.627668    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-run-ovn\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.629732 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.627692    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-run-openvswitch\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.629732 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.627719    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-host-run-ovn-kubernetes\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.629732 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.627769    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs\") pod \"network-metrics-daemon-z5xrt\" (UID: \"931a86de-fd82-48a4-996f-b39dbc3d5246\") " pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:04:32.629732 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.627800    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-host-run-k8s-cni-cncf-io\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.629732 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.627838    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-host-var-lib-kubelet\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.629732 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.627938    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-host-var-lib-kubelet\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.629732 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.628006    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/36152972-1f88-4b87-866d-873cef1a36f7-host-run-k8s-cni-cncf-io\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.629732 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:32.628019    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:32.629732 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:32.628121    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs podName:931a86de-fd82-48a4-996f-b39dbc3d5246 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:33.128084562 +0000 UTC m=+3.017137726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs") pod "network-metrics-daemon-z5xrt" (UID: "931a86de-fd82-48a4-996f-b39dbc3d5246") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:32.629732 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.628137    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/36152972-1f88-4b87-866d-873cef1a36f7-cni-binary-copy\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.643922 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:32.643899    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 04:04:32.643922 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:32.643927    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 04:04:32.644125 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:32.643942    2580 projected.go:196] Error preparing data for projected volume kube-api-access-jjw5x for pod openshift-network-diagnostics/network-check-target-ggzvv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:32.644125 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:32.644009    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a925514-e9a6-4e83-b9a7-7dedbe1040ec-kube-api-access-jjw5x podName:1a925514-e9a6-4e83-b9a7-7dedbe1040ec nodeName:}" failed. No retries permitted until 2026-07-21 04:04:33.143987803 +0000 UTC m=+3.033040981 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jjw5x" (UniqueName: "kubernetes.io/projected/1a925514-e9a6-4e83-b9a7-7dedbe1040ec-kube-api-access-jjw5x") pod "network-check-target-ggzvv" (UID: "1a925514-e9a6-4e83-b9a7-7dedbe1040ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:32.644125 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.644045    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 21 04:04:32.649842 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.649385    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh4hs\" (UniqueName: \"kubernetes.io/projected/36152972-1f88-4b87-866d-873cef1a36f7-kube-api-access-gh4hs\") pod \"multus-2jwvc\" (UID: \"36152972-1f88-4b87-866d-873cef1a36f7\") " pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.649842 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.649464    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xtk9\" (UniqueName: \"kubernetes.io/projected/931a86de-fd82-48a4-996f-b39dbc3d5246-kube-api-access-2xtk9\") pod \"network-metrics-daemon-z5xrt\" (UID: \"931a86de-fd82-48a4-996f-b39dbc3d5246\") " pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:04:32.650033 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.649956    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbgx7\" (UniqueName: \"kubernetes.io/projected/8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0-kube-api-access-vbgx7\") pod \"aws-ebs-csi-driver-node-bt9br\" (UID: \"8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bt9br"
Jul 21 04:04:32.652924 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.652875    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khwsc\" (UniqueName: \"kubernetes.io/projected/eeca8e4e-83b8-4f94-9b81-50631582bf15-kube-api-access-khwsc\") pod \"node-ca-7xqgm\" (UID: \"eeca8e4e-83b8-4f94-9b81-50631582bf15\") " pod="openshift-image-registry/node-ca-7xqgm"
Jul 21 04:04:32.697407 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.697336    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal" event={"ID":"8e2404177a19e2a3dd7a57eb55b1af0d","Type":"ContainerStarted","Data":"d1e2b668cc899200ecb4867c4f230219b64cbba60ddec8c61ca59699c8a1d2c1"}
Jul 21 04:04:32.699840 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.699810    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal" event={"ID":"aa1018754edc1c71ee351c98f23c1ba5","Type":"ContainerStarted","Data":"110c55a80c05b56e915d01db39262e13a007e50f84312958a63ae6be8eaf03e4"}
Jul 21 04:04:32.728219 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728187    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/685e7e2c-f971-4362-bb75-290223ff7d43-agent-certs\") pod \"konnectivity-agent-bgqdw\" (UID: \"685e7e2c-f971-4362-bb75-290223ff7d43\") " pod="kube-system/konnectivity-agent-bgqdw"
Jul 21 04:04:32.728373 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728232    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-ovnkube-script-lib\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.728373 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728263    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27cdadea-f6c2-4609-8ffe-668f4126551f-host-slash\") pod \"iptables-alerter-ctrfl\" (UID: \"27cdadea-f6c2-4609-8ffe-668f4126551f\") " pod="openshift-network-operator/iptables-alerter-ctrfl"
Jul 21 04:04:32.728373 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728287    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-host-slash\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.728373 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728313    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-var-lib-openvswitch\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.728373 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728340    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f523d1f8-3698-4dd8-8d5d-f5f36251273b-dbus\") pod \"global-pull-secret-syncer-dvcr2\" (UID: \"f523d1f8-3698-4dd8-8d5d-f5f36251273b\") " pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:04:32.728373 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728364    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/685e7e2c-f971-4362-bb75-290223ff7d43-konnectivity-ca\") pod \"konnectivity-agent-bgqdw\" (UID: \"685e7e2c-f971-4362-bb75-290223ff7d43\") " pod="kube-system/konnectivity-agent-bgqdw"
Jul 21 04:04:32.728698 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728389    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqfmh\" (UniqueName: \"kubernetes.io/projected/27cdadea-f6c2-4609-8ffe-668f4126551f-kube-api-access-hqfmh\") pod \"iptables-alerter-ctrfl\" (UID: \"27cdadea-f6c2-4609-8ffe-668f4126551f\") " pod="openshift-network-operator/iptables-alerter-ctrfl"
Jul 21 04:04:32.728698 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728413    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-systemd-units\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.728698 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728435    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/94d201ac-f8b7-4ba0-88e0-092179854e7a-etc-tuned\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.728698 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728459    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-log-socket\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.728698 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728486    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-etc-sysctl-conf\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.728698 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728508    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-etc-systemd\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.728698 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728532    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-sys\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.728698 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728559    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-host-kubelet\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.728698 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728585    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-host-run-netns\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.728698 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728615    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jx27\" (UniqueName: \"kubernetes.io/projected/d358754d-0321-4914-8b07-65a70f8c58f8-kube-api-access-6jx27\") pod \"multus-additional-cni-plugins-sqmm7\" (UID: \"d358754d-0321-4914-8b07-65a70f8c58f8\") " pod="openshift-multus/multus-additional-cni-plugins-sqmm7"
Jul 21 04:04:32.728698 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728641    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94d201ac-f8b7-4ba0-88e0-092179854e7a-tmp\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.728698 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728668    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d358754d-0321-4914-8b07-65a70f8c58f8-cni-binary-copy\") pod \"multus-additional-cni-plugins-sqmm7\" (UID: \"d358754d-0321-4914-8b07-65a70f8c58f8\") " pod="openshift-multus/multus-additional-cni-plugins-sqmm7"
Jul 21 04:04:32.728698 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728691    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-etc-openvswitch\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.729355 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728719    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.729355 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728745    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-env-overrides\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.729355 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728771    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-etc-modprobe-d\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.729355 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728796    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jclnr\" (UniqueName: \"kubernetes.io/projected/94d201ac-f8b7-4ba0-88e0-092179854e7a-kube-api-access-jclnr\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.729355 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728824    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-ovnkube-config\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.729355 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728850    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d358754d-0321-4914-8b07-65a70f8c58f8-system-cni-dir\") pod \"multus-additional-cni-plugins-sqmm7\" (UID: \"d358754d-0321-4914-8b07-65a70f8c58f8\") " pod="openshift-multus/multus-additional-cni-plugins-sqmm7"
Jul 21 04:04:32.729355 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728875    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d358754d-0321-4914-8b07-65a70f8c58f8-os-release\") pod \"multus-additional-cni-plugins-sqmm7\" (UID: \"d358754d-0321-4914-8b07-65a70f8c58f8\") " pod="openshift-multus/multus-additional-cni-plugins-sqmm7"
Jul 21 04:04:32.729355 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728902    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d358754d-0321-4914-8b07-65a70f8c58f8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sqmm7\" (UID: \"d358754d-0321-4914-8b07-65a70f8c58f8\") " pod="openshift-multus/multus-additional-cni-plugins-sqmm7"
Jul 21 04:04:32.729355 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728927    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3105d271-61a5-4d68-9b89-9b3ddebbaad6-hosts-file\") pod \"node-resolver-5tmw9\" (UID: \"3105d271-61a5-4d68-9b89-9b3ddebbaad6\") " pod="openshift-dns/node-resolver-5tmw9"
Jul 21 04:04:32.729355 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728951    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3105d271-61a5-4d68-9b89-9b3ddebbaad6-tmp-dir\") pod \"node-resolver-5tmw9\" (UID: \"3105d271-61a5-4d68-9b89-9b3ddebbaad6\") " pod="openshift-dns/node-resolver-5tmw9"
Jul 21 04:04:32.729355 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.728975    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgnn8\" (UniqueName: \"kubernetes.io/projected/3105d271-61a5-4d68-9b89-9b3ddebbaad6-kube-api-access-wgnn8\") pod \"node-resolver-5tmw9\" (UID: \"3105d271-61a5-4d68-9b89-9b3ddebbaad6\") " pod="openshift-dns/node-resolver-5tmw9"
Jul 21 04:04:32.729355 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.729000    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-host-cni-bin\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.729355 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.729029    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldsf7\" (UniqueName: \"kubernetes.io/projected/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-kube-api-access-ldsf7\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.729355 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.729065    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d358754d-0321-4914-8b07-65a70f8c58f8-cnibin\") pod \"multus-additional-cni-plugins-sqmm7\" (UID: \"d358754d-0321-4914-8b07-65a70f8c58f8\") " pod="openshift-multus/multus-additional-cni-plugins-sqmm7"
Jul 21 04:04:32.729355 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.729091    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d358754d-0321-4914-8b07-65a70f8c58f8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sqmm7\" (UID: \"d358754d-0321-4914-8b07-65a70f8c58f8\") " pod="openshift-multus/multus-additional-cni-plugins-sqmm7"
Jul 21 04:04:32.729355 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.729116    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f523d1f8-3698-4dd8-8d5d-f5f36251273b-kubelet-config\") pod \"global-pull-secret-syncer-dvcr2\" (UID: \"f523d1f8-3698-4dd8-8d5d-f5f36251273b\") " pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:04:32.729355 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.729142    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/27cdadea-f6c2-4609-8ffe-668f4126551f-iptables-alerter-script\") pod \"iptables-alerter-ctrfl\" (UID: \"27cdadea-f6c2-4609-8ffe-668f4126551f\") " pod="openshift-network-operator/iptables-alerter-ctrfl"
Jul 21 04:04:32.730190 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.729166    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-lib-modules\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.730190 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.729201    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d358754d-0321-4914-8b07-65a70f8c58f8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sqmm7\" (UID: \"d358754d-0321-4914-8b07-65a70f8c58f8\") " pod="openshift-multus/multus-additional-cni-plugins-sqmm7"
Jul 21 04:04:32.730190 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.729245    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-etc-kubernetes\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.730190 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.729269    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-run\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.730190 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.729292    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-host-cni-netd\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.730190 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.729316    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-ovn-node-metrics-cert\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.730190 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.729340    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-etc-sysconfig\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.730190 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.729366    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-var-lib-kubelet\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.730190 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.729390    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-host\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.730190 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.729421    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-node-log\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.730190 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.729454    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-etc-sysctl-d\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.730190 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.729499    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-run-systemd\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.730190 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.729526    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-run-ovn\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.730190 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.729549    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-run-openvswitch\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.730190 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.729575    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-host-run-ovn-kubernetes\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.730190 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.729618    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f523d1f8-3698-4dd8-8d5d-f5f36251273b-original-pull-secret\") pod \"global-pull-secret-syncer-dvcr2\" (UID: \"f523d1f8-3698-4dd8-8d5d-f5f36251273b\") " pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:04:32.730190 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.729672    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d358754d-0321-4914-8b07-65a70f8c58f8-system-cni-dir\") pod \"multus-additional-cni-plugins-sqmm7\" (UID: \"d358754d-0321-4914-8b07-65a70f8c58f8\") " pod="openshift-multus/multus-additional-cni-plugins-sqmm7"
Jul 21 04:04:32.730190 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:32.729747    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:32.731164 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:32.729807    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f523d1f8-3698-4dd8-8d5d-f5f36251273b-original-pull-secret podName:f523d1f8-3698-4dd8-8d5d-f5f36251273b nodeName:}" failed. No retries permitted until 2026-07-21 04:04:33.229789052 +0000 UTC m=+3.118842213 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f523d1f8-3698-4dd8-8d5d-f5f36251273b-original-pull-secret") pod "global-pull-secret-syncer-dvcr2" (UID: "f523d1f8-3698-4dd8-8d5d-f5f36251273b") : object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:32.731164 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.729817    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d358754d-0321-4914-8b07-65a70f8c58f8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sqmm7\" (UID: \"d358754d-0321-4914-8b07-65a70f8c58f8\") " pod="openshift-multus/multus-additional-cni-plugins-sqmm7"
Jul 21 04:04:32.731164 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.729895    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d358754d-0321-4914-8b07-65a70f8c58f8-os-release\") pod \"multus-additional-cni-plugins-sqmm7\" (UID: \"d358754d-0321-4914-8b07-65a70f8c58f8\") " pod="openshift-multus/multus-additional-cni-plugins-sqmm7"
Jul 21 04:04:32.731164 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.730100    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-systemd-units\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.731164 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.730294    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f523d1f8-3698-4dd8-8d5d-f5f36251273b-kubelet-config\") pod \"global-pull-secret-syncer-dvcr2\" (UID: \"f523d1f8-3698-4dd8-8d5d-f5f36251273b\") " pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:04:32.731164 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.730522    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d358754d-0321-4914-8b07-65a70f8c58f8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sqmm7\" (UID: \"d358754d-0321-4914-8b07-65a70f8c58f8\") " pod="openshift-multus/multus-additional-cni-plugins-sqmm7"
Jul 21 04:04:32.731164 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.730597    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3105d271-61a5-4d68-9b89-9b3ddebbaad6-hosts-file\") pod \"node-resolver-5tmw9\" (UID: \"3105d271-61a5-4d68-9b89-9b3ddebbaad6\") " pod="openshift-dns/node-resolver-5tmw9"
Jul 21 04:04:32.731164 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.730739    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-ovnkube-script-lib\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.731164 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.730804    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27cdadea-f6c2-4609-8ffe-668f4126551f-host-slash\") pod \"iptables-alerter-ctrfl\" (UID: \"27cdadea-f6c2-4609-8ffe-668f4126551f\") " pod="openshift-network-operator/iptables-alerter-ctrfl"
Jul 21 04:04:32.731164 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.730848    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-host-slash\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.731164 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.730853    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/27cdadea-f6c2-4609-8ffe-668f4126551f-iptables-alerter-script\") pod \"iptables-alerter-ctrfl\" (UID: \"27cdadea-f6c2-4609-8ffe-668f4126551f\") " pod="openshift-network-operator/iptables-alerter-ctrfl"
Jul 21 04:04:32.731164 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.730869    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3105d271-61a5-4d68-9b89-9b3ddebbaad6-tmp-dir\") pod \"node-resolver-5tmw9\" (UID: \"3105d271-61a5-4d68-9b89-9b3ddebbaad6\") " pod="openshift-dns/node-resolver-5tmw9"
Jul 21 04:04:32.731164 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.730888    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-var-lib-openvswitch\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.731164 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.730942    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f523d1f8-3698-4dd8-8d5d-f5f36251273b-dbus\") pod \"global-pull-secret-syncer-dvcr2\" (UID: \"f523d1f8-3698-4dd8-8d5d-f5f36251273b\") " pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:04:32.731164 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.730999    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-lib-modules\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.731164 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.731110    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-host-cni-bin\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.732014 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.731360    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d358754d-0321-4914-8b07-65a70f8c58f8-cnibin\") pod \"multus-additional-cni-plugins-sqmm7\" (UID: \"d358754d-0321-4914-8b07-65a70f8c58f8\") " pod="openshift-multus/multus-additional-cni-plugins-sqmm7"
Jul 21 04:04:32.732014 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.731434    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-host\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.732014 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.731490    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-etc-kubernetes\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.732014 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.731515    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/685e7e2c-f971-4362-bb75-290223ff7d43-konnectivity-ca\") pod \"konnectivity-agent-bgqdw\" (UID: \"685e7e2c-f971-4362-bb75-290223ff7d43\") " pod="kube-system/konnectivity-agent-bgqdw"
Jul 21 04:04:32.732014 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.731542    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-run\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.732014 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.731613    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d358754d-0321-4914-8b07-65a70f8c58f8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sqmm7\" (UID: \"d358754d-0321-4914-8b07-65a70f8c58f8\") " pod="openshift-multus/multus-additional-cni-plugins-sqmm7"
Jul 21 04:04:32.732014 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.731669    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-node-log\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.732014 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.731778    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-host-cni-netd\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.732014 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.731816    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-etc-sysctl-d\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.732014 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.731835    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-run-openvswitch\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.732014 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.731866    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-host-run-ovn-kubernetes\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.732014 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.731877    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-run-systemd\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.732014 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.731928    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-run-ovn\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.732014 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.731976    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-etc-systemd\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.732014 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.732016    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-log-socket\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.732785 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.732069    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-etc-sysconfig\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.732785 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.732128    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-host-kubelet\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.732785 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.732177    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-sys\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.732785 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.732467    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-etc-modprobe-d\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.732785 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.732516    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-host-run-netns\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.732785 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.732558    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-etc-openvswitch\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.732785 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.732595    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-env-overrides\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.732785 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.732664    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.733222 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.732809    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-etc-sysctl-conf\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.733222 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.733082    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d358754d-0321-4914-8b07-65a70f8c58f8-cni-binary-copy\") pod \"multus-additional-cni-plugins-sqmm7\" (UID: \"d358754d-0321-4914-8b07-65a70f8c58f8\") " pod="openshift-multus/multus-additional-cni-plugins-sqmm7"
Jul 21 04:04:32.733222 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.733158    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/94d201ac-f8b7-4ba0-88e0-092179854e7a-var-lib-kubelet\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.733384 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.733312    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-ovnkube-config\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.733960 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.733910    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94d201ac-f8b7-4ba0-88e0-092179854e7a-tmp\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.734485 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.734426    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/685e7e2c-f971-4362-bb75-290223ff7d43-agent-certs\") pod \"konnectivity-agent-bgqdw\" (UID: \"685e7e2c-f971-4362-bb75-290223ff7d43\") " pod="kube-system/konnectivity-agent-bgqdw"
Jul 21 04:04:32.735603 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.735579    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/94d201ac-f8b7-4ba0-88e0-092179854e7a-etc-tuned\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.735914 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.735894    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-ovn-node-metrics-cert\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.745149 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.745092    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jx27\" (UniqueName: \"kubernetes.io/projected/d358754d-0321-4914-8b07-65a70f8c58f8-kube-api-access-6jx27\") pod \"multus-additional-cni-plugins-sqmm7\" (UID: \"d358754d-0321-4914-8b07-65a70f8c58f8\") " pod="openshift-multus/multus-additional-cni-plugins-sqmm7"
Jul 21 04:04:32.752420 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.752381    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqfmh\" (UniqueName: \"kubernetes.io/projected/27cdadea-f6c2-4609-8ffe-668f4126551f-kube-api-access-hqfmh\") pod \"iptables-alerter-ctrfl\" (UID: \"27cdadea-f6c2-4609-8ffe-668f4126551f\") " pod="openshift-network-operator/iptables-alerter-ctrfl"
Jul 21 04:04:32.752636 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.752593    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jclnr\" (UniqueName: \"kubernetes.io/projected/94d201ac-f8b7-4ba0-88e0-092179854e7a-kube-api-access-jclnr\") pod \"tuned-wl5lw\" (UID: \"94d201ac-f8b7-4ba0-88e0-092179854e7a\") " pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.753045 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.753024    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldsf7\" (UniqueName: \"kubernetes.io/projected/6f2c16b6-c4e7-480c-b4d7-1312ed5ad130-kube-api-access-ldsf7\") pod \"ovnkube-node-694fk\" (UID: \"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130\") " pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.755157 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.755134    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgnn8\" (UniqueName: \"kubernetes.io/projected/3105d271-61a5-4d68-9b89-9b3ddebbaad6-kube-api-access-wgnn8\") pod \"node-resolver-5tmw9\" (UID: \"3105d271-61a5-4d68-9b89-9b3ddebbaad6\") " pod="openshift-dns/node-resolver-5tmw9"
Jul 21 04:04:32.822077 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.822043    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7xqgm"
Jul 21 04:04:32.832252 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:32.832229    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeca8e4e_83b8_4f94_9b81_50631582bf15.slice/crio-a7e3cd7fa48af2a48be3115a1cf16972857576018b5f11f9e5a810698958766b WatchSource:0}: Error finding container a7e3cd7fa48af2a48be3115a1cf16972857576018b5f11f9e5a810698958766b: Status 404 returned error can't find the container with id a7e3cd7fa48af2a48be3115a1cf16972857576018b5f11f9e5a810698958766b
Jul 21 04:04:32.835746 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.835722    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bt9br"
Jul 21 04:04:32.844530 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.844510    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2jwvc"
Jul 21 04:04:32.844749 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:32.844730    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f4e08f6_7cc3_4e77_b42f_fc56fa23a3a0.slice/crio-73190bb3b9215c1a2c9de8e97bb4482a650d15cf35d3666971394439ad81c2fe WatchSource:0}: Error finding container 73190bb3b9215c1a2c9de8e97bb4482a650d15cf35d3666971394439ad81c2fe: Status 404 returned error can't find the container with id 73190bb3b9215c1a2c9de8e97bb4482a650d15cf35d3666971394439ad81c2fe
Jul 21 04:04:32.852650 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.852628    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sqmm7"
Jul 21 04:04:32.853488 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:32.853452    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36152972_1f88_4b87_866d_873cef1a36f7.slice/crio-3a4f74409a9dbb4a0bf13a979bf3a03d9b5cc23d3648641946c9af1a4578672d WatchSource:0}: Error finding container 3a4f74409a9dbb4a0bf13a979bf3a03d9b5cc23d3648641946c9af1a4578672d: Status 404 returned error can't find the container with id 3a4f74409a9dbb4a0bf13a979bf3a03d9b5cc23d3648641946c9af1a4578672d
Jul 21 04:04:32.862941 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.862918    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ctrfl"
Jul 21 04:04:32.863459 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:32.863437    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd358754d_0321_4914_8b07_65a70f8c58f8.slice/crio-0f2dca636759e2a7350953d2a350640a8a40257cf2f2a7070b1b44dcea866437 WatchSource:0}: Error finding container 0f2dca636759e2a7350953d2a350640a8a40257cf2f2a7070b1b44dcea866437: Status 404 returned error can't find the container with id 0f2dca636759e2a7350953d2a350640a8a40257cf2f2a7070b1b44dcea866437
Jul 21 04:04:32.874039 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:32.874012    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27cdadea_f6c2_4609_8ffe_668f4126551f.slice/crio-9d57541246099cbbff868f9afab43e8ea15b88f8a4549e725a73fa78ba4a732b WatchSource:0}: Error finding container 9d57541246099cbbff868f9afab43e8ea15b88f8a4549e725a73fa78ba4a732b: Status 404 returned error can't find the container with id 9d57541246099cbbff868f9afab43e8ea15b88f8a4549e725a73fa78ba4a732b
Jul 21 04:04:32.879972 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.879950    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:32.889348 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.889292    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bgqdw"
Jul 21 04:04:32.890642 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:32.890614    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f2c16b6_c4e7_480c_b4d7_1312ed5ad130.slice/crio-fd434ec640dde537e258a75fb77f4fdde0476619fcd857fcb8f5fd844bf325c2 WatchSource:0}: Error finding container fd434ec640dde537e258a75fb77f4fdde0476619fcd857fcb8f5fd844bf325c2: Status 404 returned error can't find the container with id fd434ec640dde537e258a75fb77f4fdde0476619fcd857fcb8f5fd844bf325c2
Jul 21 04:04:32.898537 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.898513    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wl5lw"
Jul 21 04:04:32.900497 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:32.900468    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod685e7e2c_f971_4362_bb75_290223ff7d43.slice/crio-f9296434b00f8c7c45cdfc7e88f5a8ba1a97a774cf13feeae3626b1e5cf6ea7b WatchSource:0}: Error finding container f9296434b00f8c7c45cdfc7e88f5a8ba1a97a774cf13feeae3626b1e5cf6ea7b: Status 404 returned error can't find the container with id f9296434b00f8c7c45cdfc7e88f5a8ba1a97a774cf13feeae3626b1e5cf6ea7b
Jul 21 04:04:32.906783 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:32.906677    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5tmw9"
Jul 21 04:04:32.911770 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:32.911744    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94d201ac_f8b7_4ba0_88e0_092179854e7a.slice/crio-00c92cb09655ff5a92a572d40076db708f74ba67a567dce3eef0042b4e8e22f3 WatchSource:0}: Error finding container 00c92cb09655ff5a92a572d40076db708f74ba67a567dce3eef0042b4e8e22f3: Status 404 returned error can't find the container with id 00c92cb09655ff5a92a572d40076db708f74ba67a567dce3eef0042b4e8e22f3
Jul 21 04:04:32.917902 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:04:32.917884    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3105d271_61a5_4d68_9b89_9b3ddebbaad6.slice/crio-208a4095567792145461fa9bf3bc27532f9041dd3dceb3dbadf46f85a12961b9 WatchSource:0}: Error finding container 208a4095567792145461fa9bf3bc27532f9041dd3dceb3dbadf46f85a12961b9: Status 404 returned error can't find the container with id 208a4095567792145461fa9bf3bc27532f9041dd3dceb3dbadf46f85a12961b9
Jul 21 04:04:33.131817 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:33.131780    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs\") pod \"network-metrics-daemon-z5xrt\" (UID: \"931a86de-fd82-48a4-996f-b39dbc3d5246\") " pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:04:33.132013 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:33.131960    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:33.132070 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:33.132039    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs podName:931a86de-fd82-48a4-996f-b39dbc3d5246 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:34.132017182 +0000 UTC m=+4.021070334 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs") pod "network-metrics-daemon-z5xrt" (UID: "931a86de-fd82-48a4-996f-b39dbc3d5246") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:33.232549 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:33.232506    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjw5x\" (UniqueName: \"kubernetes.io/projected/1a925514-e9a6-4e83-b9a7-7dedbe1040ec-kube-api-access-jjw5x\") pod \"network-check-target-ggzvv\" (UID: \"1a925514-e9a6-4e83-b9a7-7dedbe1040ec\") " pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:04:33.232767 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:33.232573    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f523d1f8-3698-4dd8-8d5d-f5f36251273b-original-pull-secret\") pod \"global-pull-secret-syncer-dvcr2\" (UID: \"f523d1f8-3698-4dd8-8d5d-f5f36251273b\") " pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:04:33.232767 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:33.232711    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:33.232767 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:33.232729    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 04:04:33.232767 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:33.232764    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 04:04:33.232999 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:33.232779    2580 projected.go:196] Error preparing data for projected volume kube-api-access-jjw5x for pod openshift-network-diagnostics/network-check-target-ggzvv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:33.232999 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:33.232783    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f523d1f8-3698-4dd8-8d5d-f5f36251273b-original-pull-secret podName:f523d1f8-3698-4dd8-8d5d-f5f36251273b nodeName:}" failed. No retries permitted until 2026-07-21 04:04:34.232766184 +0000 UTC m=+4.121819328 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f523d1f8-3698-4dd8-8d5d-f5f36251273b-original-pull-secret") pod "global-pull-secret-syncer-dvcr2" (UID: "f523d1f8-3698-4dd8-8d5d-f5f36251273b") : object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:33.232999 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:33.232828    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a925514-e9a6-4e83-b9a7-7dedbe1040ec-kube-api-access-jjw5x podName:1a925514-e9a6-4e83-b9a7-7dedbe1040ec nodeName:}" failed. No retries permitted until 2026-07-21 04:04:34.23281587 +0000 UTC m=+4.121869014 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jjw5x" (UniqueName: "kubernetes.io/projected/1a925514-e9a6-4e83-b9a7-7dedbe1040ec-kube-api-access-jjw5x") pod "network-check-target-ggzvv" (UID: "1a925514-e9a6-4e83-b9a7-7dedbe1040ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:33.597274 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:33.597176    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 03:59:32 +0000 UTC" deadline="2028-04-21 09:42:09.810626144 +0000 UTC"
Jul 21 04:04:33.597274 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:33.597216    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15365h37m36.213415625s"
Jul 21 04:04:33.704292 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:33.704251    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2jwvc" event={"ID":"36152972-1f88-4b87-866d-873cef1a36f7","Type":"ContainerStarted","Data":"3a4f74409a9dbb4a0bf13a979bf3a03d9b5cc23d3648641946c9af1a4578672d"}
Jul 21 04:04:33.705857 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:33.705800    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7xqgm" event={"ID":"eeca8e4e-83b8-4f94-9b81-50631582bf15","Type":"ContainerStarted","Data":"a7e3cd7fa48af2a48be3115a1cf16972857576018b5f11f9e5a810698958766b"}
Jul 21 04:04:33.709006 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:33.708923    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wl5lw" event={"ID":"94d201ac-f8b7-4ba0-88e0-092179854e7a","Type":"ContainerStarted","Data":"00c92cb09655ff5a92a572d40076db708f74ba67a567dce3eef0042b4e8e22f3"}
Jul 21 04:04:33.710978 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:33.710864    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-694fk" event={"ID":"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130","Type":"ContainerStarted","Data":"fd434ec640dde537e258a75fb77f4fdde0476619fcd857fcb8f5fd844bf325c2"}
Jul 21 04:04:33.712447 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:33.712367    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ctrfl" event={"ID":"27cdadea-f6c2-4609-8ffe-668f4126551f","Type":"ContainerStarted","Data":"9d57541246099cbbff868f9afab43e8ea15b88f8a4549e725a73fa78ba4a732b"}
Jul 21 04:04:33.713964 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:33.713931    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sqmm7" event={"ID":"d358754d-0321-4914-8b07-65a70f8c58f8","Type":"ContainerStarted","Data":"0f2dca636759e2a7350953d2a350640a8a40257cf2f2a7070b1b44dcea866437"}
Jul 21 04:04:33.715755 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:33.715730    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bt9br" event={"ID":"8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0","Type":"ContainerStarted","Data":"73190bb3b9215c1a2c9de8e97bb4482a650d15cf35d3666971394439ad81c2fe"}
Jul 21 04:04:33.717173 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:33.717148    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5tmw9" event={"ID":"3105d271-61a5-4d68-9b89-9b3ddebbaad6","Type":"ContainerStarted","Data":"208a4095567792145461fa9bf3bc27532f9041dd3dceb3dbadf46f85a12961b9"}
Jul 21 04:04:33.718626 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:33.718602    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bgqdw" event={"ID":"685e7e2c-f971-4362-bb75-290223ff7d43","Type":"ContainerStarted","Data":"f9296434b00f8c7c45cdfc7e88f5a8ba1a97a774cf13feeae3626b1e5cf6ea7b"}
Jul 21 04:04:34.112257 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:34.112224    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 04:04:34.141306 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:34.140668    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs\") pod \"network-metrics-daemon-z5xrt\" (UID: \"931a86de-fd82-48a4-996f-b39dbc3d5246\") " pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:04:34.141306 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:34.140851    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:34.141306 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:34.140917    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs podName:931a86de-fd82-48a4-996f-b39dbc3d5246 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:36.140896593 +0000 UTC m=+6.029949744 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs") pod "network-metrics-daemon-z5xrt" (UID: "931a86de-fd82-48a4-996f-b39dbc3d5246") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:34.242198 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:34.241373    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f523d1f8-3698-4dd8-8d5d-f5f36251273b-original-pull-secret\") pod \"global-pull-secret-syncer-dvcr2\" (UID: \"f523d1f8-3698-4dd8-8d5d-f5f36251273b\") " pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:04:34.242198 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:34.241470    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjw5x\" (UniqueName: \"kubernetes.io/projected/1a925514-e9a6-4e83-b9a7-7dedbe1040ec-kube-api-access-jjw5x\") pod \"network-check-target-ggzvv\" (UID: \"1a925514-e9a6-4e83-b9a7-7dedbe1040ec\") " pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:04:34.242198 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:34.241618    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 04:04:34.242198 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:34.241640    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 04:04:34.242198 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:34.241653    2580 projected.go:196] Error preparing data for projected volume kube-api-access-jjw5x for pod openshift-network-diagnostics/network-check-target-ggzvv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:34.242198 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:34.241712    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a925514-e9a6-4e83-b9a7-7dedbe1040ec-kube-api-access-jjw5x podName:1a925514-e9a6-4e83-b9a7-7dedbe1040ec nodeName:}" failed. No retries permitted until 2026-07-21 04:04:36.241693276 +0000 UTC m=+6.130746434 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jjw5x" (UniqueName: "kubernetes.io/projected/1a925514-e9a6-4e83-b9a7-7dedbe1040ec-kube-api-access-jjw5x") pod "network-check-target-ggzvv" (UID: "1a925514-e9a6-4e83-b9a7-7dedbe1040ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:34.242198 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:34.242112    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:34.242198 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:34.242163    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f523d1f8-3698-4dd8-8d5d-f5f36251273b-original-pull-secret podName:f523d1f8-3698-4dd8-8d5d-f5f36251273b nodeName:}" failed. No retries permitted until 2026-07-21 04:04:36.242147407 +0000 UTC m=+6.131200556 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f523d1f8-3698-4dd8-8d5d-f5f36251273b-original-pull-secret") pod "global-pull-secret-syncer-dvcr2" (UID: "f523d1f8-3698-4dd8-8d5d-f5f36251273b") : object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:34.597821 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:34.597753    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 03:59:32 +0000 UTC" deadline="2028-01-01 16:03:54.04208034 +0000 UTC"
Jul 21 04:04:34.597821 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:34.597820    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12707h59m19.44426571s"
Jul 21 04:04:34.689439 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:34.689384    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:04:34.689643 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:34.689534    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5xrt" podUID="931a86de-fd82-48a4-996f-b39dbc3d5246"
Jul 21 04:04:34.690018 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:34.689985    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:04:34.690117 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:34.690093    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvcr2" podUID="f523d1f8-3698-4dd8-8d5d-f5f36251273b"
Jul 21 04:04:34.692019 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:34.691995    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:04:34.692126 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:34.692095    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggzvv" podUID="1a925514-e9a6-4e83-b9a7-7dedbe1040ec"
Jul 21 04:04:35.732843 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:35.732433    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal" event={"ID":"aa1018754edc1c71ee351c98f23c1ba5","Type":"ContainerStarted","Data":"40476dcb9e0a3954e2959412c7886e1d8c08ac72892c2205ade36a532ae4f4f1"}
Jul 21 04:04:35.735215 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:35.735183    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal" event={"ID":"8e2404177a19e2a3dd7a57eb55b1af0d","Type":"ContainerStarted","Data":"e84a83e0fb3f61705b61b998f183f6487e388cbc36b3b99d9316636ad2ee289c"}
Jul 21 04:04:35.783005 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:35.782819    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal" podStartSLOduration=3.782797495 podStartE2EDuration="3.782797495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:35.754468106 +0000 UTC m=+5.643521271" watchObservedRunningTime="2026-07-21 04:04:35.782797495 +0000 UTC m=+5.671850677"
Jul 21 04:04:36.158788 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:36.158697    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs\") pod \"network-metrics-daemon-z5xrt\" (UID: \"931a86de-fd82-48a4-996f-b39dbc3d5246\") " pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:04:36.158953 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:36.158864    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:36.158953 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:36.158923    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs podName:931a86de-fd82-48a4-996f-b39dbc3d5246 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:40.158905598 +0000 UTC m=+10.047958749 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs") pod "network-metrics-daemon-z5xrt" (UID: "931a86de-fd82-48a4-996f-b39dbc3d5246") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:36.260552 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:36.259774    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f523d1f8-3698-4dd8-8d5d-f5f36251273b-original-pull-secret\") pod \"global-pull-secret-syncer-dvcr2\" (UID: \"f523d1f8-3698-4dd8-8d5d-f5f36251273b\") " pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:04:36.260552 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:36.259873    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjw5x\" (UniqueName: \"kubernetes.io/projected/1a925514-e9a6-4e83-b9a7-7dedbe1040ec-kube-api-access-jjw5x\") pod \"network-check-target-ggzvv\" (UID: \"1a925514-e9a6-4e83-b9a7-7dedbe1040ec\") " pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:04:36.260552 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:36.260016    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 04:04:36.260552 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:36.260034    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 04:04:36.260552 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:36.260046    2580 projected.go:196] Error preparing data for projected volume kube-api-access-jjw5x for pod openshift-network-diagnostics/network-check-target-ggzvv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:36.260552 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:36.260098    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a925514-e9a6-4e83-b9a7-7dedbe1040ec-kube-api-access-jjw5x podName:1a925514-e9a6-4e83-b9a7-7dedbe1040ec nodeName:}" failed. No retries permitted until 2026-07-21 04:04:40.260080522 +0000 UTC m=+10.149133669 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jjw5x" (UniqueName: "kubernetes.io/projected/1a925514-e9a6-4e83-b9a7-7dedbe1040ec-kube-api-access-jjw5x") pod "network-check-target-ggzvv" (UID: "1a925514-e9a6-4e83-b9a7-7dedbe1040ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:36.260552 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:36.260474    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:36.260552 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:36.260517    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f523d1f8-3698-4dd8-8d5d-f5f36251273b-original-pull-secret podName:f523d1f8-3698-4dd8-8d5d-f5f36251273b nodeName:}" failed. No retries permitted until 2026-07-21 04:04:40.260502581 +0000 UTC m=+10.149555728 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f523d1f8-3698-4dd8-8d5d-f5f36251273b-original-pull-secret") pod "global-pull-secret-syncer-dvcr2" (UID: "f523d1f8-3698-4dd8-8d5d-f5f36251273b") : object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:36.694350 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:36.693616    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:04:36.694350 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:36.693729    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggzvv" podUID="1a925514-e9a6-4e83-b9a7-7dedbe1040ec"
Jul 21 04:04:36.694350 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:36.694067    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:04:36.694350 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:36.694192    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5xrt" podUID="931a86de-fd82-48a4-996f-b39dbc3d5246"
Jul 21 04:04:36.694350 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:36.694239    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:04:36.694350 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:36.694313    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvcr2" podUID="f523d1f8-3698-4dd8-8d5d-f5f36251273b"
Jul 21 04:04:38.688599 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:38.688216    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:04:38.688599 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:38.688232    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:04:38.688599 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:38.688354    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggzvv" podUID="1a925514-e9a6-4e83-b9a7-7dedbe1040ec"
Jul 21 04:04:38.688599 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:38.688371    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:04:38.688599 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:38.688492    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5xrt" podUID="931a86de-fd82-48a4-996f-b39dbc3d5246"
Jul 21 04:04:38.688599 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:38.688597    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvcr2" podUID="f523d1f8-3698-4dd8-8d5d-f5f36251273b"
Jul 21 04:04:39.747822 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:39.747782    2580 generic.go:356] "Generic (PLEG): container finished" podID="8e2404177a19e2a3dd7a57eb55b1af0d" containerID="e84a83e0fb3f61705b61b998f183f6487e388cbc36b3b99d9316636ad2ee289c" exitCode=0
Jul 21 04:04:39.748277 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:39.747831    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal" event={"ID":"8e2404177a19e2a3dd7a57eb55b1af0d","Type":"ContainerDied","Data":"e84a83e0fb3f61705b61b998f183f6487e388cbc36b3b99d9316636ad2ee289c"}
Jul 21 04:04:40.191242 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:40.191208    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs\") pod \"network-metrics-daemon-z5xrt\" (UID: \"931a86de-fd82-48a4-996f-b39dbc3d5246\") " pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:04:40.191415 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:40.191402    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:40.191472 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:40.191466    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs podName:931a86de-fd82-48a4-996f-b39dbc3d5246 nodeName:}" failed. No retries permitted until 2026-07-21 04:04:48.191446211 +0000 UTC m=+18.080499359 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs") pod "network-metrics-daemon-z5xrt" (UID: "931a86de-fd82-48a4-996f-b39dbc3d5246") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:40.293182 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:40.292332    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f523d1f8-3698-4dd8-8d5d-f5f36251273b-original-pull-secret\") pod \"global-pull-secret-syncer-dvcr2\" (UID: \"f523d1f8-3698-4dd8-8d5d-f5f36251273b\") " pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:04:40.293182 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:40.292436    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjw5x\" (UniqueName: \"kubernetes.io/projected/1a925514-e9a6-4e83-b9a7-7dedbe1040ec-kube-api-access-jjw5x\") pod \"network-check-target-ggzvv\" (UID: \"1a925514-e9a6-4e83-b9a7-7dedbe1040ec\") " pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:04:40.293182 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:40.292582    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 04:04:40.293182 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:40.292602    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 04:04:40.293182 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:40.292616    2580 projected.go:196] Error preparing data for projected volume kube-api-access-jjw5x for pod openshift-network-diagnostics/network-check-target-ggzvv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:40.293182 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:40.292673    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a925514-e9a6-4e83-b9a7-7dedbe1040ec-kube-api-access-jjw5x podName:1a925514-e9a6-4e83-b9a7-7dedbe1040ec nodeName:}" failed. No retries permitted until 2026-07-21 04:04:48.292654116 +0000 UTC m=+18.181707280 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jjw5x" (UniqueName: "kubernetes.io/projected/1a925514-e9a6-4e83-b9a7-7dedbe1040ec-kube-api-access-jjw5x") pod "network-check-target-ggzvv" (UID: "1a925514-e9a6-4e83-b9a7-7dedbe1040ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:40.293182 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:40.293072    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:40.293182 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:40.293148    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f523d1f8-3698-4dd8-8d5d-f5f36251273b-original-pull-secret podName:f523d1f8-3698-4dd8-8d5d-f5f36251273b nodeName:}" failed. No retries permitted until 2026-07-21 04:04:48.293109339 +0000 UTC m=+18.182162482 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f523d1f8-3698-4dd8-8d5d-f5f36251273b-original-pull-secret") pod "global-pull-secret-syncer-dvcr2" (UID: "f523d1f8-3698-4dd8-8d5d-f5f36251273b") : object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:40.689943 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:40.689482    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:04:40.689943 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:40.689502    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:04:40.689943 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:40.689599    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggzvv" podUID="1a925514-e9a6-4e83-b9a7-7dedbe1040ec"
Jul 21 04:04:40.689943 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:40.689658    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:04:40.689943 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:40.689790    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5xrt" podUID="931a86de-fd82-48a4-996f-b39dbc3d5246"
Jul 21 04:04:40.689943 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:40.689874    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvcr2" podUID="f523d1f8-3698-4dd8-8d5d-f5f36251273b"
Jul 21 04:04:42.688615 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:42.688580    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:04:42.689109 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:42.688586    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:04:42.689109 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:42.688710    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggzvv" podUID="1a925514-e9a6-4e83-b9a7-7dedbe1040ec"
Jul 21 04:04:42.689109 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:42.688594    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:04:42.689574 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:42.689526    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5xrt" podUID="931a86de-fd82-48a4-996f-b39dbc3d5246"
Jul 21 04:04:42.689704 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:42.689603    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvcr2" podUID="f523d1f8-3698-4dd8-8d5d-f5f36251273b"
Jul 21 04:04:44.688435 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:44.688401    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:04:44.688903 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:44.688524    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:04:44.688903 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:44.688540    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggzvv" podUID="1a925514-e9a6-4e83-b9a7-7dedbe1040ec"
Jul 21 04:04:44.688903 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:44.688628    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvcr2" podUID="f523d1f8-3698-4dd8-8d5d-f5f36251273b"
Jul 21 04:04:44.688903 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:44.688682    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:04:44.688903 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:44.688746    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5xrt" podUID="931a86de-fd82-48a4-996f-b39dbc3d5246"
Jul 21 04:04:46.688214 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:46.688180    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:04:46.688646 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:46.688189    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:04:46.688646 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:46.688325    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5xrt" podUID="931a86de-fd82-48a4-996f-b39dbc3d5246"
Jul 21 04:04:46.688646 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:46.688189    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:04:46.688646 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:46.688395    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggzvv" podUID="1a925514-e9a6-4e83-b9a7-7dedbe1040ec"
Jul 21 04:04:46.688646 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:46.688497    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvcr2" podUID="f523d1f8-3698-4dd8-8d5d-f5f36251273b"
Jul 21 04:04:48.250088 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:48.250050    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs\") pod \"network-metrics-daemon-z5xrt\" (UID: \"931a86de-fd82-48a4-996f-b39dbc3d5246\") " pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:04:48.250490 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:48.250263    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:48.250490 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:48.250343    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs podName:931a86de-fd82-48a4-996f-b39dbc3d5246 nodeName:}" failed. No retries permitted until 2026-07-21 04:05:04.250321361 +0000 UTC m=+34.139374506 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs") pod "network-metrics-daemon-z5xrt" (UID: "931a86de-fd82-48a4-996f-b39dbc3d5246") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:04:48.351324 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:48.351290    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjw5x\" (UniqueName: \"kubernetes.io/projected/1a925514-e9a6-4e83-b9a7-7dedbe1040ec-kube-api-access-jjw5x\") pod \"network-check-target-ggzvv\" (UID: \"1a925514-e9a6-4e83-b9a7-7dedbe1040ec\") " pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:04:48.351324 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:48.351339    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f523d1f8-3698-4dd8-8d5d-f5f36251273b-original-pull-secret\") pod \"global-pull-secret-syncer-dvcr2\" (UID: \"f523d1f8-3698-4dd8-8d5d-f5f36251273b\") " pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:04:48.351533 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:48.351443    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:48.351533 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:48.351461    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 04:04:48.351533 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:48.351487    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 04:04:48.351533 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:48.351501    2580 projected.go:196] Error preparing data for projected volume kube-api-access-jjw5x for pod openshift-network-diagnostics/network-check-target-ggzvv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:48.351533 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:48.351505    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f523d1f8-3698-4dd8-8d5d-f5f36251273b-original-pull-secret podName:f523d1f8-3698-4dd8-8d5d-f5f36251273b nodeName:}" failed. No retries permitted until 2026-07-21 04:05:04.351489867 +0000 UTC m=+34.240543012 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f523d1f8-3698-4dd8-8d5d-f5f36251273b-original-pull-secret") pod "global-pull-secret-syncer-dvcr2" (UID: "f523d1f8-3698-4dd8-8d5d-f5f36251273b") : object "kube-system"/"original-pull-secret" not registered
Jul 21 04:04:48.351743 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:48.351548    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a925514-e9a6-4e83-b9a7-7dedbe1040ec-kube-api-access-jjw5x podName:1a925514-e9a6-4e83-b9a7-7dedbe1040ec nodeName:}" failed. No retries permitted until 2026-07-21 04:05:04.35153384 +0000 UTC m=+34.240586982 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jjw5x" (UniqueName: "kubernetes.io/projected/1a925514-e9a6-4e83-b9a7-7dedbe1040ec-kube-api-access-jjw5x") pod "network-check-target-ggzvv" (UID: "1a925514-e9a6-4e83-b9a7-7dedbe1040ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:04:48.688307 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:48.688272    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:04:48.688497 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:48.688310    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:04:48.688497 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:48.688287    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:04:48.688497 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:48.688401    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5xrt" podUID="931a86de-fd82-48a4-996f-b39dbc3d5246"
Jul 21 04:04:48.688645 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:48.688515    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggzvv" podUID="1a925514-e9a6-4e83-b9a7-7dedbe1040ec"
Jul 21 04:04:48.688645 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:48.688616    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvcr2" podUID="f523d1f8-3698-4dd8-8d5d-f5f36251273b"
Jul 21 04:04:50.689309 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:50.689270    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:04:50.689750 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:50.689367    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5xrt" podUID="931a86de-fd82-48a4-996f-b39dbc3d5246"
Jul 21 04:04:50.689750 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:50.689410    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:04:50.689750 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:50.689409    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:04:50.689750 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:50.689548    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvcr2" podUID="f523d1f8-3698-4dd8-8d5d-f5f36251273b"
Jul 21 04:04:50.689750 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:50.689583    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggzvv" podUID="1a925514-e9a6-4e83-b9a7-7dedbe1040ec"
Jul 21 04:04:52.688639 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:52.688457    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:04:52.688959 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:52.688464    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:04:52.688959 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:52.688728    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggzvv" podUID="1a925514-e9a6-4e83-b9a7-7dedbe1040ec"
Jul 21 04:04:52.688959 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:52.688526    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:04:52.688959 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:52.688794    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5xrt" podUID="931a86de-fd82-48a4-996f-b39dbc3d5246"
Jul 21 04:04:52.688959 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:52.688903    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvcr2" podUID="f523d1f8-3698-4dd8-8d5d-f5f36251273b"
Jul 21 04:04:52.773834 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:52.773805    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal" event={"ID":"8e2404177a19e2a3dd7a57eb55b1af0d","Type":"ContainerStarted","Data":"3727f77599e88cc8d7364b0f643d59bd83c0e5566ef9fbf50727a2b2f9038a4b"}
Jul 21 04:04:52.775117 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:52.775095    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5tmw9" event={"ID":"3105d271-61a5-4d68-9b89-9b3ddebbaad6","Type":"ContainerStarted","Data":"08f6c968bd59fba775780b06085503f9531844f9dc97f4ff4a62fa8ca288bc08"}
Jul 21 04:04:52.776365 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:52.776344    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bgqdw" event={"ID":"685e7e2c-f971-4362-bb75-290223ff7d43","Type":"ContainerStarted","Data":"13d16729a85d55c0853a4860e823f6687227de00f92d9ae20c73994a64b2a543"}
Jul 21 04:04:52.777571 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:52.777551    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7xqgm" event={"ID":"eeca8e4e-83b8-4f94-9b81-50631582bf15","Type":"ContainerStarted","Data":"ad93fd656f938055c9ab156c6a08d57e6004c1997cb8db99032441c06ee11c9b"}
Jul 21 04:04:52.778992 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:52.778967    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wl5lw" event={"ID":"94d201ac-f8b7-4ba0-88e0-092179854e7a","Type":"ContainerStarted","Data":"a1479ec6fa25728a347f03dff6504c69f17d29d75fb1f90fe549e4bcc8b73828"}
Jul 21 04:04:52.781062 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:52.781045    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-694fk_6f2c16b6-c4e7-480c-b4d7-1312ed5ad130/ovn-acl-logging/0.log"
Jul 21 04:04:52.781522 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:52.781498    2580 generic.go:356] "Generic (PLEG): container finished" podID="6f2c16b6-c4e7-480c-b4d7-1312ed5ad130" containerID="2e4940cc6823f91c098a54624c525450152d6ee9826e36ef77843d695f7cec64" exitCode=1
Jul 21 04:04:52.781607 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:52.781570    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-694fk" event={"ID":"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130","Type":"ContainerStarted","Data":"9e3b0c501039fd0f132b455f2f9f6302a1bab3576c530e67f62b825b7c8f4b5a"}
Jul 21 04:04:52.781667 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:52.781656    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-694fk" event={"ID":"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130","Type":"ContainerDied","Data":"2e4940cc6823f91c098a54624c525450152d6ee9826e36ef77843d695f7cec64"}
Jul 21 04:04:52.781731 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:52.781713    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-694fk" event={"ID":"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130","Type":"ContainerStarted","Data":"03daea6ad7d6733112c87bfb5dbbf0ab02f92d3eb7b2226c7ecf03bc01777cc9"}
Jul 21 04:04:52.783180 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:52.783157    2580 generic.go:356] "Generic (PLEG): container finished" podID="d358754d-0321-4914-8b07-65a70f8c58f8" containerID="14d565401fd799108400b5780c0cf41f76d4e612628a4248293abf3dd39f3c88" exitCode=0
Jul 21 04:04:52.783267 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:52.783219    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sqmm7" event={"ID":"d358754d-0321-4914-8b07-65a70f8c58f8","Type":"ContainerDied","Data":"14d565401fd799108400b5780c0cf41f76d4e612628a4248293abf3dd39f3c88"}
Jul 21 04:04:52.784888 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:52.784867    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bt9br" event={"ID":"8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0","Type":"ContainerStarted","Data":"b0821eefe22b3deb30d7e5949bb4ec60cf805c61a307ab738dcf24f86dfa79ae"}
Jul 21 04:04:52.800483 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:52.800433    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bgqdw" podStartSLOduration=2.411609185 podStartE2EDuration="21.800418749s" totalImagesPullingTime="19.388809564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:04:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:52.800167417 +0000 UTC m=+22.689220580" watchObservedRunningTime="2026-07-21 04:04:52.800418749 +0000 UTC m=+22.689471947"
Jul 21 04:04:52.817919 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:52.817878    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5tmw9" podStartSLOduration=2.419089128 podStartE2EDuration="21.817862577s" totalImagesPullingTime="19.398773449s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:52.817291304 +0000 UTC m=+22.706344470" watchObservedRunningTime="2026-07-21 04:04:52.817862577 +0000 UTC m=+22.706915741"
Jul 21 04:04:52.863389 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:52.863162    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7xqgm" podStartSLOduration=6.5111014879999995 podStartE2EDuration="21.863140801s" totalImagesPullingTime="15.352039313s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:52.862343363 +0000 UTC m=+22.751396528" watchObservedRunningTime="2026-07-21 04:04:52.863140801 +0000 UTC m=+22.752193960"
Jul 21 04:04:52.895805 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:52.895765    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wl5lw" podStartSLOduration=2.491416824 podStartE2EDuration="21.895750011s" totalImagesPullingTime="19.404333187s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:52.895608383 +0000 UTC m=+22.784661546" watchObservedRunningTime="2026-07-21 04:04:52.895750011 +0000 UTC m=+22.784803207"
Jul 21 04:04:52.929814 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:52.929756    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal" podStartSLOduration=20.929735017 podStartE2EDuration="20.929735017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:52.928643056 +0000 UTC m=+22.817696214" watchObservedRunningTime="2026-07-21 04:04:52.929735017 +0000 UTC m=+22.818788242"
Jul 21 04:04:53.789354 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:53.789316    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2jwvc" event={"ID":"36152972-1f88-4b87-866d-873cef1a36f7","Type":"ContainerStarted","Data":"78a51d62dd479634963b8bd3c1abe177a71be66c4873d065d760ee2e8b739018"}
Jul 21 04:04:53.792396 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:53.792373    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-694fk_6f2c16b6-c4e7-480c-b4d7-1312ed5ad130/ovn-acl-logging/0.log"
Jul 21 04:04:53.792778 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:53.792748    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-694fk" event={"ID":"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130","Type":"ContainerStarted","Data":"7834440d57681d19053f416297bef840a8f96958a04cf5927784f494d6ea005a"}
Jul 21 04:04:53.792878 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:53.792833    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-694fk" event={"ID":"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130","Type":"ContainerStarted","Data":"8494f7650db531b9e4693d6824ae0b1f5ce8e650bd9fa2f0499ebf1296e3fbe7"}
Jul 21 04:04:53.792936 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:53.792887    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-694fk" event={"ID":"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130","Type":"ContainerStarted","Data":"e75a475a8ad432a01e20e77bdcd038a17ec24562047ace031466e899bf37a92d"}
Jul 21 04:04:53.794356 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:53.794333    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ctrfl" event={"ID":"27cdadea-f6c2-4609-8ffe-668f4126551f","Type":"ContainerStarted","Data":"4c30fb88405e864e00a05302b9631cc155f834a793ded8b599396b803263b350"}
Jul 21 04:04:53.810973 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:53.810926    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2jwvc" podStartSLOduration=2.84156195 podStartE2EDuration="22.810910438s" totalImagesPullingTime="19.969348488s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:53.810656873 +0000 UTC m=+23.699710037" watchObservedRunningTime="2026-07-21 04:04:53.810910438 +0000 UTC m=+23.699963604"
Jul 21 04:04:53.826500 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:53.826444    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ctrfl" podStartSLOduration=3.406947292 podStartE2EDuration="22.826425058s" totalImagesPullingTime="19.419477766s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:53.826089433 +0000 UTC m=+23.715142611" watchObservedRunningTime="2026-07-21 04:04:53.826425058 +0000 UTC m=+23.715478223"
Jul 21 04:04:54.007618 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:54.007516    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 21 04:04:54.586197 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:54.586013    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T04:04:54.007535345Z","UUID":"ea1efa46-f652-4633-b33a-ac5d4e952364","Handler":null,"Name":"","Endpoint":""}
Jul 21 04:04:54.588012 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:54.587950    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 21 04:04:54.588162 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:54.588032    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 21 04:04:54.688006 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:54.687975    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:04:54.688186 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:54.688104    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvcr2" podUID="f523d1f8-3698-4dd8-8d5d-f5f36251273b"
Jul 21 04:04:54.688186 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:54.687977    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:04:54.688319 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:54.687981    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:04:54.688319 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:54.688249    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggzvv" podUID="1a925514-e9a6-4e83-b9a7-7dedbe1040ec"
Jul 21 04:04:54.688408 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:54.688373    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5xrt" podUID="931a86de-fd82-48a4-996f-b39dbc3d5246"
Jul 21 04:04:54.799500 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:54.799456    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bt9br" event={"ID":"8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0","Type":"ContainerStarted","Data":"06c674d646e0df05291f3c98bb28c21448e2d59e65d96863f1dd992b670df056"}
Jul 21 04:04:55.804652 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:55.804625    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-694fk_6f2c16b6-c4e7-480c-b4d7-1312ed5ad130/ovn-acl-logging/0.log"
Jul 21 04:04:55.805098 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:55.805018    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-694fk" event={"ID":"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130","Type":"ContainerStarted","Data":"5baa0b03f74ce3360fd80263cfd125b41b7c5000ca4c198d16fbfee5e8125b9a"}
Jul 21 04:04:55.807294 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:55.807261    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bt9br" event={"ID":"8f4e08f6-7cc3-4e77-b42f-fc56fa23a3a0","Type":"ContainerStarted","Data":"d19c74fb52df3001bbb4f3444e6b4e4903fc4e483a4a4810db96ed451002c824"}
Jul 21 04:04:55.829042 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:55.828992    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bt9br" podStartSLOduration=2.919374173 podStartE2EDuration="24.828979534s" totalImagesPullingTime="21.909605361s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:55.828856428 +0000 UTC m=+25.717909622" watchObservedRunningTime="2026-07-21 04:04:55.828979534 +0000 UTC m=+25.718032698"
Jul 21 04:04:56.688504 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:56.688472    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:04:56.688698 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:56.688472    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:04:56.688698 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:56.688606    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5xrt" podUID="931a86de-fd82-48a4-996f-b39dbc3d5246"
Jul 21 04:04:56.688698 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:56.688484    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:04:56.688698 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:56.688683    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvcr2" podUID="f523d1f8-3698-4dd8-8d5d-f5f36251273b"
Jul 21 04:04:56.688927 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:56.688738    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggzvv" podUID="1a925514-e9a6-4e83-b9a7-7dedbe1040ec"
Jul 21 04:04:57.354966 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:57.354771    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bgqdw"
Jul 21 04:04:57.355486 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:57.355315    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bgqdw"
Jul 21 04:04:57.812622 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:57.812540    2580 generic.go:356] "Generic (PLEG): container finished" podID="d358754d-0321-4914-8b07-65a70f8c58f8" containerID="89a04d5b285d9fce0deead13de09d005c926ce4f68888144a96d3a27d029e385" exitCode=0
Jul 21 04:04:57.812622 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:57.812609    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sqmm7" event={"ID":"d358754d-0321-4914-8b07-65a70f8c58f8","Type":"ContainerDied","Data":"89a04d5b285d9fce0deead13de09d005c926ce4f68888144a96d3a27d029e385"}
Jul 21 04:04:57.816169 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:57.816155    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-694fk_6f2c16b6-c4e7-480c-b4d7-1312ed5ad130/ovn-acl-logging/0.log"
Jul 21 04:04:57.816517 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:57.816489    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-694fk" event={"ID":"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130","Type":"ContainerStarted","Data":"9fde5a81136a7a3fca47b4357786df26115be8a5c566f5c5c9ca0cc9fb453d3b"}
Jul 21 04:04:57.816742 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:57.816724    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bgqdw"
Jul 21 04:04:57.816975 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:57.816955    2580 scope.go:117] "RemoveContainer" containerID="2e4940cc6823f91c098a54624c525450152d6ee9826e36ef77843d695f7cec64"
Jul 21 04:04:57.817195 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:57.817180    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bgqdw"
Jul 21 04:04:58.688068 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:58.688037    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:04:58.688751 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:58.688044    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:04:58.688751 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:58.688164    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:04:58.688751 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:58.688162    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggzvv" podUID="1a925514-e9a6-4e83-b9a7-7dedbe1040ec"
Jul 21 04:04:58.688751 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:58.688256    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5xrt" podUID="931a86de-fd82-48a4-996f-b39dbc3d5246"
Jul 21 04:04:58.688751 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:58.688397    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvcr2" podUID="f523d1f8-3698-4dd8-8d5d-f5f36251273b"
Jul 21 04:04:58.822191 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:58.822168    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-694fk_6f2c16b6-c4e7-480c-b4d7-1312ed5ad130/ovn-acl-logging/0.log"
Jul 21 04:04:58.822658 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:58.822631    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-694fk" event={"ID":"6f2c16b6-c4e7-480c-b4d7-1312ed5ad130","Type":"ContainerStarted","Data":"e8c2a7c121050c2a0123f8ee9a561436ec762683c3cecf9a94c51156190ec7e3"}
Jul 21 04:04:58.823260 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:58.822994    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:58.823260 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:58.823086    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:58.823260 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:58.823153    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:58.838521 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:58.838488    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:58.838733 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:58.838721    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:04:58.902266 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:58.902219    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-694fk" podStartSLOduration=8.430919889 podStartE2EDuration="27.902200614s" totalImagesPullingTime="19.471280725s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:04:58.866718002 +0000 UTC m=+28.755771166" watchObservedRunningTime="2026-07-21 04:04:58.902200614 +0000 UTC m=+28.791253778"
Jul 21 04:04:59.341932 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:59.341842    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ggzvv"]
Jul 21 04:04:59.342108 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:59.341957    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:04:59.342108 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:59.342039    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggzvv" podUID="1a925514-e9a6-4e83-b9a7-7dedbe1040ec"
Jul 21 04:04:59.347680 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:59.347653    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z5xrt"]
Jul 21 04:04:59.347853 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:59.347760    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:04:59.347894 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:59.347854    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5xrt" podUID="931a86de-fd82-48a4-996f-b39dbc3d5246"
Jul 21 04:04:59.355263 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:59.355235    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dvcr2"]
Jul 21 04:04:59.355401 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:59.355330    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:04:59.355476 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:04:59.355456    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvcr2" podUID="f523d1f8-3698-4dd8-8d5d-f5f36251273b"
Jul 21 04:04:59.827197 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:59.827164    2580 generic.go:356] "Generic (PLEG): container finished" podID="d358754d-0321-4914-8b07-65a70f8c58f8" containerID="168314390d70fbd9156d566545877a5dd4cf4fa5e3df3bce66cb86daacc665a1" exitCode=0
Jul 21 04:04:59.827661 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:04:59.827259    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sqmm7" event={"ID":"d358754d-0321-4914-8b07-65a70f8c58f8","Type":"ContainerDied","Data":"168314390d70fbd9156d566545877a5dd4cf4fa5e3df3bce66cb86daacc665a1"}
Jul 21 04:05:00.688696 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:00.688661    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:05:00.688863 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:00.688781    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:05:00.688863 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:00.688776    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5xrt" podUID="931a86de-fd82-48a4-996f-b39dbc3d5246"
Jul 21 04:05:00.688930 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:00.688871    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggzvv" podUID="1a925514-e9a6-4e83-b9a7-7dedbe1040ec"
Jul 21 04:05:00.688930 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:00.688898    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:05:00.688997 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:00.688966    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvcr2" podUID="f523d1f8-3698-4dd8-8d5d-f5f36251273b"
Jul 21 04:05:01.834799 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:01.834623    2580 generic.go:356] "Generic (PLEG): container finished" podID="d358754d-0321-4914-8b07-65a70f8c58f8" containerID="19d6a6ccca276d99e84f4e9239ca1ea02f10b911e7e9d3f1c4b0b7147de2f402" exitCode=0
Jul 21 04:05:01.834799 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:01.834699    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sqmm7" event={"ID":"d358754d-0321-4914-8b07-65a70f8c58f8","Type":"ContainerDied","Data":"19d6a6ccca276d99e84f4e9239ca1ea02f10b911e7e9d3f1c4b0b7147de2f402"}
Jul 21 04:05:02.688916 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:02.688874    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:05:02.688916 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:02.688913    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:05:02.689192 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:02.688882    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:05:02.689192 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:02.689028    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggzvv" podUID="1a925514-e9a6-4e83-b9a7-7dedbe1040ec"
Jul 21 04:05:02.689192 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:02.689161    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvcr2" podUID="f523d1f8-3698-4dd8-8d5d-f5f36251273b"
Jul 21 04:05:02.689349 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:02.689232    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5xrt" podUID="931a86de-fd82-48a4-996f-b39dbc3d5246"
Jul 21 04:05:04.269044 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:04.269003    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs\") pod \"network-metrics-daemon-z5xrt\" (UID: \"931a86de-fd82-48a4-996f-b39dbc3d5246\") " pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:05:04.269510 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:04.269192    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:05:04.269510 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:04.269273    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs podName:931a86de-fd82-48a4-996f-b39dbc3d5246 nodeName:}" failed. No retries permitted until 2026-07-21 04:05:36.269251442 +0000 UTC m=+66.158304587 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs") pod "network-metrics-daemon-z5xrt" (UID: "931a86de-fd82-48a4-996f-b39dbc3d5246") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:05:04.370047 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:04.370009    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjw5x\" (UniqueName: \"kubernetes.io/projected/1a925514-e9a6-4e83-b9a7-7dedbe1040ec-kube-api-access-jjw5x\") pod \"network-check-target-ggzvv\" (UID: \"1a925514-e9a6-4e83-b9a7-7dedbe1040ec\") " pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:05:04.370240 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:04.370073    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f523d1f8-3698-4dd8-8d5d-f5f36251273b-original-pull-secret\") pod \"global-pull-secret-syncer-dvcr2\" (UID: \"f523d1f8-3698-4dd8-8d5d-f5f36251273b\") " pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:05:04.370377 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:04.370362    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 04:05:04.370425 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:04.370335    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 04:05:04.370425 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:04.370420    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 04:05:04.370499 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:04.370433    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f523d1f8-3698-4dd8-8d5d-f5f36251273b-original-pull-secret podName:f523d1f8-3698-4dd8-8d5d-f5f36251273b nodeName:}" failed. No retries permitted until 2026-07-21 04:05:36.370415325 +0000 UTC m=+66.259468468 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f523d1f8-3698-4dd8-8d5d-f5f36251273b-original-pull-secret") pod "global-pull-secret-syncer-dvcr2" (UID: "f523d1f8-3698-4dd8-8d5d-f5f36251273b") : object "kube-system"/"original-pull-secret" not registered
Jul 21 04:05:04.370499 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:04.370436    2580 projected.go:196] Error preparing data for projected volume kube-api-access-jjw5x for pod openshift-network-diagnostics/network-check-target-ggzvv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:05:04.370582 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:04.370515    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a925514-e9a6-4e83-b9a7-7dedbe1040ec-kube-api-access-jjw5x podName:1a925514-e9a6-4e83-b9a7-7dedbe1040ec nodeName:}" failed. No retries permitted until 2026-07-21 04:05:36.370503049 +0000 UTC m=+66.259556190 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jjw5x" (UniqueName: "kubernetes.io/projected/1a925514-e9a6-4e83-b9a7-7dedbe1040ec-kube-api-access-jjw5x") pod "network-check-target-ggzvv" (UID: "1a925514-e9a6-4e83-b9a7-7dedbe1040ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:05:04.687890 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:04.687862    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:05:04.688072 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:04.687869    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:05:04.688072 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:04.687989    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvcr2" podUID="f523d1f8-3698-4dd8-8d5d-f5f36251273b"
Jul 21 04:05:04.688201 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:04.688097    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggzvv" podUID="1a925514-e9a6-4e83-b9a7-7dedbe1040ec"
Jul 21 04:05:04.688201 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:04.688146    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:05:04.688269 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:04.688235    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z5xrt" podUID="931a86de-fd82-48a4-996f-b39dbc3d5246"
Jul 21 04:05:05.340802 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.340761    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeReady"
Jul 21 04:05:05.341350 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.340945    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 21 04:05:05.409456 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.409420    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8lpj2"]
Jul 21 04:05:05.442914 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.442830    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-84nxz"]
Jul 21 04:05:05.443074 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.442986    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8lpj2"
Jul 21 04:05:05.446357 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.446329    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m9r9d\""
Jul 21 04:05:05.446887 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.446864    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 21 04:05:05.447020 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.446998    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 21 04:05:05.456987 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.456962    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8lpj2"]
Jul 21 04:05:05.457107 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.457008    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-84nxz"]
Jul 21 04:05:05.457107 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.457099    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-84nxz"
Jul 21 04:05:05.461764 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.461739    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 21 04:05:05.461887 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.461792    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p2vsr\""
Jul 21 04:05:05.462107 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.462090    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 21 04:05:05.463153 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.463110    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 21 04:05:05.578686 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.578642    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klvjg\" (UniqueName: \"kubernetes.io/projected/5f1f7378-bc63-4332-907c-f3c74a346e1e-kube-api-access-klvjg\") pod \"dns-default-8lpj2\" (UID: \"5f1f7378-bc63-4332-907c-f3c74a346e1e\") " pod="openshift-dns/dns-default-8lpj2"
Jul 21 04:05:05.578872 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.578716    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g945g\" (UniqueName: \"kubernetes.io/projected/5d302476-aea9-4a64-9923-fc9fe74a315e-kube-api-access-g945g\") pod \"ingress-canary-84nxz\" (UID: \"5d302476-aea9-4a64-9923-fc9fe74a315e\") " pod="openshift-ingress-canary/ingress-canary-84nxz"
Jul 21 04:05:05.578872 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.578766    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5f1f7378-bc63-4332-907c-f3c74a346e1e-config-volume\") pod \"dns-default-8lpj2\" (UID: \"5f1f7378-bc63-4332-907c-f3c74a346e1e\") " pod="openshift-dns/dns-default-8lpj2"
Jul 21 04:05:05.578872 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.578802    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f1f7378-bc63-4332-907c-f3c74a346e1e-metrics-tls\") pod \"dns-default-8lpj2\" (UID: \"5f1f7378-bc63-4332-907c-f3c74a346e1e\") " pod="openshift-dns/dns-default-8lpj2"
Jul 21 04:05:05.578872 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.578829    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f1f7378-bc63-4332-907c-f3c74a346e1e-tmp-dir\") pod \"dns-default-8lpj2\" (UID: \"5f1f7378-bc63-4332-907c-f3c74a346e1e\") " pod="openshift-dns/dns-default-8lpj2"
Jul 21 04:05:05.578872 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.578850    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d302476-aea9-4a64-9923-fc9fe74a315e-cert\") pod \"ingress-canary-84nxz\" (UID: \"5d302476-aea9-4a64-9923-fc9fe74a315e\") " pod="openshift-ingress-canary/ingress-canary-84nxz"
Jul 21 04:05:05.679703 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.679670    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g945g\" (UniqueName: \"kubernetes.io/projected/5d302476-aea9-4a64-9923-fc9fe74a315e-kube-api-access-g945g\") pod \"ingress-canary-84nxz\" (UID: \"5d302476-aea9-4a64-9923-fc9fe74a315e\") " pod="openshift-ingress-canary/ingress-canary-84nxz"
Jul 21 04:05:05.679894 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.679720    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5f1f7378-bc63-4332-907c-f3c74a346e1e-config-volume\") pod \"dns-default-8lpj2\" (UID: \"5f1f7378-bc63-4332-907c-f3c74a346e1e\") " pod="openshift-dns/dns-default-8lpj2"
Jul 21 04:05:05.679894 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.679747    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f1f7378-bc63-4332-907c-f3c74a346e1e-metrics-tls\") pod \"dns-default-8lpj2\" (UID: \"5f1f7378-bc63-4332-907c-f3c74a346e1e\") " pod="openshift-dns/dns-default-8lpj2"
Jul 21 04:05:05.679894 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.679772    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f1f7378-bc63-4332-907c-f3c74a346e1e-tmp-dir\") pod \"dns-default-8lpj2\" (UID: \"5f1f7378-bc63-4332-907c-f3c74a346e1e\") " pod="openshift-dns/dns-default-8lpj2"
Jul 21 04:05:05.679894 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.679787    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d302476-aea9-4a64-9923-fc9fe74a315e-cert\") pod \"ingress-canary-84nxz\" (UID: \"5d302476-aea9-4a64-9923-fc9fe74a315e\") " pod="openshift-ingress-canary/ingress-canary-84nxz"
Jul 21 04:05:05.679894 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.679828    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klvjg\" (UniqueName: \"kubernetes.io/projected/5f1f7378-bc63-4332-907c-f3c74a346e1e-kube-api-access-klvjg\") pod \"dns-default-8lpj2\" (UID: \"5f1f7378-bc63-4332-907c-f3c74a346e1e\") " pod="openshift-dns/dns-default-8lpj2"
Jul 21 04:05:05.680162 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:05.679911    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:05:05.680162 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:05.679986    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1f7378-bc63-4332-907c-f3c74a346e1e-metrics-tls podName:5f1f7378-bc63-4332-907c-f3c74a346e1e nodeName:}" failed. No retries permitted until 2026-07-21 04:05:06.17996329 +0000 UTC m=+36.069016435 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f1f7378-bc63-4332-907c-f3c74a346e1e-metrics-tls") pod "dns-default-8lpj2" (UID: "5f1f7378-bc63-4332-907c-f3c74a346e1e") : secret "dns-default-metrics-tls" not found
Jul 21 04:05:05.680268 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.680185    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f1f7378-bc63-4332-907c-f3c74a346e1e-tmp-dir\") pod \"dns-default-8lpj2\" (UID: \"5f1f7378-bc63-4332-907c-f3c74a346e1e\") " pod="openshift-dns/dns-default-8lpj2"
Jul 21 04:05:05.680394 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.680364    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5f1f7378-bc63-4332-907c-f3c74a346e1e-config-volume\") pod \"dns-default-8lpj2\" (UID: \"5f1f7378-bc63-4332-907c-f3c74a346e1e\") " pod="openshift-dns/dns-default-8lpj2"
Jul 21 04:05:05.684580 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.684558    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d302476-aea9-4a64-9923-fc9fe74a315e-cert\") pod \"ingress-canary-84nxz\" (UID: \"5d302476-aea9-4a64-9923-fc9fe74a315e\") " pod="openshift-ingress-canary/ingress-canary-84nxz"
Jul 21 04:05:05.690138 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.690096    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klvjg\" (UniqueName: \"kubernetes.io/projected/5f1f7378-bc63-4332-907c-f3c74a346e1e-kube-api-access-klvjg\") pod \"dns-default-8lpj2\" (UID: \"5f1f7378-bc63-4332-907c-f3c74a346e1e\") " pod="openshift-dns/dns-default-8lpj2"
Jul 21 04:05:05.690362 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.690334    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g945g\" (UniqueName: \"kubernetes.io/projected/5d302476-aea9-4a64-9923-fc9fe74a315e-kube-api-access-g945g\") pod \"ingress-canary-84nxz\" (UID: \"5d302476-aea9-4a64-9923-fc9fe74a315e\") " pod="openshift-ingress-canary/ingress-canary-84nxz"
Jul 21 04:05:05.766757 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:05.766664    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-84nxz"
Jul 21 04:05:06.184859 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:06.184823    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f1f7378-bc63-4332-907c-f3c74a346e1e-metrics-tls\") pod \"dns-default-8lpj2\" (UID: \"5f1f7378-bc63-4332-907c-f3c74a346e1e\") " pod="openshift-dns/dns-default-8lpj2"
Jul 21 04:05:06.185042 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:06.184992    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:05:06.185093 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:06.185061    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1f7378-bc63-4332-907c-f3c74a346e1e-metrics-tls podName:5f1f7378-bc63-4332-907c-f3c74a346e1e nodeName:}" failed. No retries permitted until 2026-07-21 04:05:07.185043787 +0000 UTC m=+37.074096929 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f1f7378-bc63-4332-907c-f3c74a346e1e-metrics-tls") pod "dns-default-8lpj2" (UID: "5f1f7378-bc63-4332-907c-f3c74a346e1e") : secret "dns-default-metrics-tls" not found
Jul 21 04:05:06.371370 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:06.371336    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-84nxz"]
Jul 21 04:05:06.429925 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:05:06.429893    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d302476_aea9_4a64_9923_fc9fe74a315e.slice/crio-a31bce4193e6b9891abfc0fda9f183d3880270803eb8526e1db43cdc48b2db5a WatchSource:0}: Error finding container a31bce4193e6b9891abfc0fda9f183d3880270803eb8526e1db43cdc48b2db5a: Status 404 returned error can't find the container with id a31bce4193e6b9891abfc0fda9f183d3880270803eb8526e1db43cdc48b2db5a
Jul 21 04:05:06.688143 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:06.687866    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:05:06.688143 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:06.687867    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:05:06.688361 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:06.687902    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:05:06.691909 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:06.691890    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 04:05:06.692031 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:06.691952    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 04:05:06.692031 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:06.691988    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 04:05:06.692714 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:06.692701    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vvkm7\""
Jul 21 04:05:06.692850 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:06.692834    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 04:05:06.693288 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:06.693272    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-q5j6n\""
Jul 21 04:05:06.851775 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:06.851738    2580 generic.go:356] "Generic (PLEG): container finished" podID="d358754d-0321-4914-8b07-65a70f8c58f8" containerID="7853f19f09325bd700aee44490d4de562def3a66262c8a532aeb63c5e4171c2e" exitCode=0
Jul 21 04:05:06.851960 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:06.851807    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sqmm7" event={"ID":"d358754d-0321-4914-8b07-65a70f8c58f8","Type":"ContainerDied","Data":"7853f19f09325bd700aee44490d4de562def3a66262c8a532aeb63c5e4171c2e"}
Jul 21 04:05:06.853152 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:06.853106    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-84nxz" event={"ID":"5d302476-aea9-4a64-9923-fc9fe74a315e","Type":"ContainerStarted","Data":"a31bce4193e6b9891abfc0fda9f183d3880270803eb8526e1db43cdc48b2db5a"}
Jul 21 04:05:07.197919 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:07.197835    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f1f7378-bc63-4332-907c-f3c74a346e1e-metrics-tls\") pod \"dns-default-8lpj2\" (UID: \"5f1f7378-bc63-4332-907c-f3c74a346e1e\") " pod="openshift-dns/dns-default-8lpj2"
Jul 21 04:05:07.198066 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:07.197952    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:05:07.198066 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:07.198011    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1f7378-bc63-4332-907c-f3c74a346e1e-metrics-tls podName:5f1f7378-bc63-4332-907c-f3c74a346e1e nodeName:}" failed. No retries permitted until 2026-07-21 04:05:09.197993251 +0000 UTC m=+39.087046415 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f1f7378-bc63-4332-907c-f3c74a346e1e-metrics-tls") pod "dns-default-8lpj2" (UID: "5f1f7378-bc63-4332-907c-f3c74a346e1e") : secret "dns-default-metrics-tls" not found
Jul 21 04:05:07.858519 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:07.858486    2580 generic.go:356] "Generic (PLEG): container finished" podID="d358754d-0321-4914-8b07-65a70f8c58f8" containerID="a608863b3a4ed71dd71a303e136512752c9897ada988d0c58cce047acd299224" exitCode=0
Jul 21 04:05:07.858870 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:07.858539    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sqmm7" event={"ID":"d358754d-0321-4914-8b07-65a70f8c58f8","Type":"ContainerDied","Data":"a608863b3a4ed71dd71a303e136512752c9897ada988d0c58cce047acd299224"}
Jul 21 04:05:08.865383 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:08.865343    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sqmm7" event={"ID":"d358754d-0321-4914-8b07-65a70f8c58f8","Type":"ContainerStarted","Data":"3a5c38c49c5105e5cdff640ac130eac4e6cb28f2eeace886c116740b78a328ec"}
Jul 21 04:05:08.907821 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:08.907770    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sqmm7" podStartSLOduration=6.73493927 podStartE2EDuration="37.907751581s" totalImagesPullingTime="31.172812311s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:05:08.907372769 +0000 UTC m=+38.796425941" watchObservedRunningTime="2026-07-21 04:05:08.907751581 +0000 UTC m=+38.796804799"
Jul 21 04:05:09.215489 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:09.215289    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f1f7378-bc63-4332-907c-f3c74a346e1e-metrics-tls\") pod \"dns-default-8lpj2\" (UID: \"5f1f7378-bc63-4332-907c-f3c74a346e1e\") " pod="openshift-dns/dns-default-8lpj2"
Jul 21 04:05:09.215639 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:09.215443    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:05:09.215639 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:09.215578    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1f7378-bc63-4332-907c-f3c74a346e1e-metrics-tls podName:5f1f7378-bc63-4332-907c-f3c74a346e1e nodeName:}" failed. No retries permitted until 2026-07-21 04:05:13.215562749 +0000 UTC m=+43.104615891 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f1f7378-bc63-4332-907c-f3c74a346e1e-metrics-tls") pod "dns-default-8lpj2" (UID: "5f1f7378-bc63-4332-907c-f3c74a346e1e") : secret "dns-default-metrics-tls" not found
Jul 21 04:05:09.869089 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:09.869048    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-84nxz" event={"ID":"5d302476-aea9-4a64-9923-fc9fe74a315e","Type":"ContainerStarted","Data":"02c81eed3ebf00c4c54f76305933b7e0c0da3913579cbddde9fad2fd0aa06dc7"}
Jul 21 04:05:09.902541 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:09.902487    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-84nxz" podStartSLOduration=2.404262582 podStartE2EDuration="4.90246851s" totalImagesPullingTime="2.498205928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:05:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:05:09.902155273 +0000 UTC m=+39.791208438" watchObservedRunningTime="2026-07-21 04:05:09.90246851 +0000 UTC m=+39.791521673"
Jul 21 04:05:13.244584 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:13.244542    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f1f7378-bc63-4332-907c-f3c74a346e1e-metrics-tls\") pod \"dns-default-8lpj2\" (UID: \"5f1f7378-bc63-4332-907c-f3c74a346e1e\") " pod="openshift-dns/dns-default-8lpj2"
Jul 21 04:05:13.244973 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:13.244657    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:05:13.244973 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:13.244709    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1f7378-bc63-4332-907c-f3c74a346e1e-metrics-tls podName:5f1f7378-bc63-4332-907c-f3c74a346e1e nodeName:}" failed. No retries permitted until 2026-07-21 04:05:21.244696224 +0000 UTC m=+51.133749366 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f1f7378-bc63-4332-907c-f3c74a346e1e-metrics-tls") pod "dns-default-8lpj2" (UID: "5f1f7378-bc63-4332-907c-f3c74a346e1e") : secret "dns-default-metrics-tls" not found
Jul 21 04:05:21.300322 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:21.300289    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f1f7378-bc63-4332-907c-f3c74a346e1e-metrics-tls\") pod \"dns-default-8lpj2\" (UID: \"5f1f7378-bc63-4332-907c-f3c74a346e1e\") " pod="openshift-dns/dns-default-8lpj2"
Jul 21 04:05:21.300784 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:21.300408    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:05:21.300784 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:21.300465    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1f7378-bc63-4332-907c-f3c74a346e1e-metrics-tls podName:5f1f7378-bc63-4332-907c-f3c74a346e1e nodeName:}" failed. No retries permitted until 2026-07-21 04:05:37.300451255 +0000 UTC m=+67.189504396 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f1f7378-bc63-4332-907c-f3c74a346e1e-metrics-tls") pod "dns-default-8lpj2" (UID: "5f1f7378-bc63-4332-907c-f3c74a346e1e") : secret "dns-default-metrics-tls" not found
Jul 21 04:05:30.840564 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:30.840537    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-694fk"
Jul 21 04:05:36.305380 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:36.305339    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs\") pod \"network-metrics-daemon-z5xrt\" (UID: \"931a86de-fd82-48a4-996f-b39dbc3d5246\") " pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:05:36.308302 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:36.308279    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 04:05:36.315706 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:36.315683    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 04:05:36.315795 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:36.315767    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs podName:931a86de-fd82-48a4-996f-b39dbc3d5246 nodeName:}" failed. No retries permitted until 2026-07-21 04:06:40.315745609 +0000 UTC m=+130.204798752 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs") pod "network-metrics-daemon-z5xrt" (UID: "931a86de-fd82-48a4-996f-b39dbc3d5246") : secret "metrics-daemon-secret" not found
Jul 21 04:05:36.406059 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:36.406025    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjw5x\" (UniqueName: \"kubernetes.io/projected/1a925514-e9a6-4e83-b9a7-7dedbe1040ec-kube-api-access-jjw5x\") pod \"network-check-target-ggzvv\" (UID: \"1a925514-e9a6-4e83-b9a7-7dedbe1040ec\") " pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:05:36.406184 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:36.406072    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f523d1f8-3698-4dd8-8d5d-f5f36251273b-original-pull-secret\") pod \"global-pull-secret-syncer-dvcr2\" (UID: \"f523d1f8-3698-4dd8-8d5d-f5f36251273b\") " pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:05:36.410238 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:36.410220    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 04:05:36.410238 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:36.410228    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 04:05:36.420388 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:36.420370    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 04:05:36.420816 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:36.420791    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f523d1f8-3698-4dd8-8d5d-f5f36251273b-original-pull-secret\") pod \"global-pull-secret-syncer-dvcr2\" (UID: \"f523d1f8-3698-4dd8-8d5d-f5f36251273b\") " pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:05:36.422739 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:36.422724    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvcr2"
Jul 21 04:05:36.430474 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:36.430448    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjw5x\" (UniqueName: \"kubernetes.io/projected/1a925514-e9a6-4e83-b9a7-7dedbe1040ec-kube-api-access-jjw5x\") pod \"network-check-target-ggzvv\" (UID: \"1a925514-e9a6-4e83-b9a7-7dedbe1040ec\") " pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:05:36.544329 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:36.544306    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dvcr2"]
Jul 21 04:05:36.546949 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:05:36.546918    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf523d1f8_3698_4dd8_8d5d_f5f36251273b.slice/crio-30c45be768d4619d4c070520e64bdc12fa4a8a152d4a7c96dcdb9682e47c76ae WatchSource:0}: Error finding container 30c45be768d4619d4c070520e64bdc12fa4a8a152d4a7c96dcdb9682e47c76ae: Status 404 returned error can't find the container with id 30c45be768d4619d4c070520e64bdc12fa4a8a152d4a7c96dcdb9682e47c76ae
Jul 21 04:05:36.720712 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:36.720687    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vvkm7\""
Jul 21 04:05:36.728894 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:36.728880    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:05:36.857836 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:36.857759    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ggzvv"]
Jul 21 04:05:36.861302 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:05:36.861278    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a925514_e9a6_4e83_b9a7_7dedbe1040ec.slice/crio-26600ff3a3f524015f3db491712e40cf78c659800d4b153556b859d6e5737de2 WatchSource:0}: Error finding container 26600ff3a3f524015f3db491712e40cf78c659800d4b153556b859d6e5737de2: Status 404 returned error can't find the container with id 26600ff3a3f524015f3db491712e40cf78c659800d4b153556b859d6e5737de2
Jul 21 04:05:36.931102 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:36.931070    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dvcr2" event={"ID":"f523d1f8-3698-4dd8-8d5d-f5f36251273b","Type":"ContainerStarted","Data":"30c45be768d4619d4c070520e64bdc12fa4a8a152d4a7c96dcdb9682e47c76ae"}
Jul 21 04:05:36.932145 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:36.932106    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ggzvv" event={"ID":"1a925514-e9a6-4e83-b9a7-7dedbe1040ec","Type":"ContainerStarted","Data":"26600ff3a3f524015f3db491712e40cf78c659800d4b153556b859d6e5737de2"}
Jul 21 04:05:37.312771 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:37.312721    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f1f7378-bc63-4332-907c-f3c74a346e1e-metrics-tls\") pod \"dns-default-8lpj2\" (UID: \"5f1f7378-bc63-4332-907c-f3c74a346e1e\") " pod="openshift-dns/dns-default-8lpj2"
Jul 21 04:05:37.313242 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:37.312867    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:05:37.313242 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:05:37.312926    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1f7378-bc63-4332-907c-f3c74a346e1e-metrics-tls podName:5f1f7378-bc63-4332-907c-f3c74a346e1e nodeName:}" failed. No retries permitted until 2026-07-21 04:06:09.312909398 +0000 UTC m=+99.201962542 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f1f7378-bc63-4332-907c-f3c74a346e1e-metrics-tls") pod "dns-default-8lpj2" (UID: "5f1f7378-bc63-4332-907c-f3c74a346e1e") : secret "dns-default-metrics-tls" not found
Jul 21 04:05:41.946335 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:41.946292    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ggzvv" event={"ID":"1a925514-e9a6-4e83-b9a7-7dedbe1040ec","Type":"ContainerStarted","Data":"948ad15f9b71e52c112b5d04ed5bed2d0a6beeb2ee589725e39d16a386c564a5"}
Jul 21 04:05:41.946786 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:41.946367    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:05:41.947884 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:41.947857    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dvcr2" event={"ID":"f523d1f8-3698-4dd8-8d5d-f5f36251273b","Type":"ContainerStarted","Data":"b571b4ef9b28c0a29a2f269df5368dca6b644a06369a83a47ef4847be4dc3ea4"}
Jul 21 04:05:41.984900 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:41.984851    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ggzvv" podStartSLOduration=66.079490765 podStartE2EDuration="1m10.984835259s" totalImagesPullingTime="4.905344494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:04:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:05:41.984669796 +0000 UTC m=+71.873722963" watchObservedRunningTime="2026-07-21 04:05:41.984835259 +0000 UTC m=+71.873888448"
Jul 21 04:05:42.004223 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:42.004180    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dvcr2" podStartSLOduration=65.76997168 podStartE2EDuration="1m11.004166674s" totalImagesPullingTime="5.234194994s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:04:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:05:42.002809907 +0000 UTC m=+71.891863071" watchObservedRunningTime="2026-07-21 04:05:42.004166674 +0000 UTC m=+71.893219838"
Jul 21 04:05:57.724222 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.724092    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77d456b59d-hkvfd"]
Jul 21 04:05:57.728412 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.728391    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77d456b59d-hkvfd"
Jul 21 04:05:57.730872 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.730853    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 21 04:05:57.731107 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.731091    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 21 04:05:57.731846 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.731824    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 21 04:05:57.731947 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.731871    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 21 04:05:57.731947 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.731927    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-94fcl\""
Jul 21 04:05:57.735825 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.735797    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g"]
Jul 21 04:05:57.739461 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.739440    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77d456b59d-hkvfd"]
Jul 21 04:05:57.739551 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.739524    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g"
Jul 21 04:05:57.742444 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.742427    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 21 04:05:57.742773 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.742753    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 21 04:05:57.743163 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.743149    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 21 04:05:57.743219 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.743200    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 21 04:05:57.756862 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.756844    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g"]
Jul 21 04:05:57.843351 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.843320    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2dd58074-551b-48aa-a990-d68f9cfa7dbc-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-77d456b59d-hkvfd\" (UID: \"2dd58074-551b-48aa-a990-d68f9cfa7dbc\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77d456b59d-hkvfd"
Jul 21 04:05:57.843535 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.843357    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6c9af825-1ed1-48f1-a01b-2903fa47f8cf-ca\") pod \"cluster-proxy-proxy-agent-66dd66d678-7wm2g\" (UID: \"6c9af825-1ed1-48f1-a01b-2903fa47f8cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g"
Jul 21 04:05:57.843535 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.843384    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6c9af825-1ed1-48f1-a01b-2903fa47f8cf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66dd66d678-7wm2g\" (UID: \"6c9af825-1ed1-48f1-a01b-2903fa47f8cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g"
Jul 21 04:05:57.843535 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.843422    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c9af825-1ed1-48f1-a01b-2903fa47f8cf-additional-service-ca\") pod \"cluster-proxy-proxy-agent-66dd66d678-7wm2g\" (UID: \"6c9af825-1ed1-48f1-a01b-2903fa47f8cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g"
Jul 21 04:05:57.843535 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.843439    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcscg\" (UniqueName: \"kubernetes.io/projected/6c9af825-1ed1-48f1-a01b-2903fa47f8cf-kube-api-access-rcscg\") pod \"cluster-proxy-proxy-agent-66dd66d678-7wm2g\" (UID: \"6c9af825-1ed1-48f1-a01b-2903fa47f8cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g"
Jul 21 04:05:57.843535 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.843458    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6c9af825-1ed1-48f1-a01b-2903fa47f8cf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66dd66d678-7wm2g\" (UID: \"6c9af825-1ed1-48f1-a01b-2903fa47f8cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g"
Jul 21 04:05:57.843535 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.843477    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkmfp\" (UniqueName: \"kubernetes.io/projected/2dd58074-551b-48aa-a990-d68f9cfa7dbc-kube-api-access-hkmfp\") pod \"managed-serviceaccount-addon-agent-77d456b59d-hkvfd\" (UID: \"2dd58074-551b-48aa-a990-d68f9cfa7dbc\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77d456b59d-hkvfd"
Jul 21 04:05:57.843773 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.843530    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6c9af825-1ed1-48f1-a01b-2903fa47f8cf-hub\") pod \"cluster-proxy-proxy-agent-66dd66d678-7wm2g\" (UID: \"6c9af825-1ed1-48f1-a01b-2903fa47f8cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g"
Jul 21 04:05:57.944025 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.943985    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2dd58074-551b-48aa-a990-d68f9cfa7dbc-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-77d456b59d-hkvfd\" (UID: \"2dd58074-551b-48aa-a990-d68f9cfa7dbc\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77d456b59d-hkvfd"
Jul 21 04:05:57.944025 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.944028    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6c9af825-1ed1-48f1-a01b-2903fa47f8cf-ca\") pod \"cluster-proxy-proxy-agent-66dd66d678-7wm2g\" (UID: \"6c9af825-1ed1-48f1-a01b-2903fa47f8cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g"
Jul 21 04:05:57.944316 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.944047    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6c9af825-1ed1-48f1-a01b-2903fa47f8cf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66dd66d678-7wm2g\" (UID: \"6c9af825-1ed1-48f1-a01b-2903fa47f8cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g"
Jul 21 04:05:57.944316 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.944071    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c9af825-1ed1-48f1-a01b-2903fa47f8cf-additional-service-ca\") pod \"cluster-proxy-proxy-agent-66dd66d678-7wm2g\" (UID: \"6c9af825-1ed1-48f1-a01b-2903fa47f8cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g"
Jul 21 04:05:57.944316 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.944091    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcscg\" (UniqueName: \"kubernetes.io/projected/6c9af825-1ed1-48f1-a01b-2903fa47f8cf-kube-api-access-rcscg\") pod \"cluster-proxy-proxy-agent-66dd66d678-7wm2g\" (UID: \"6c9af825-1ed1-48f1-a01b-2903fa47f8cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g"
Jul 21 04:05:57.944316 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.944119    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6c9af825-1ed1-48f1-a01b-2903fa47f8cf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66dd66d678-7wm2g\" (UID: \"6c9af825-1ed1-48f1-a01b-2903fa47f8cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g"
Jul 21 04:05:57.944316 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.944167    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkmfp\" (UniqueName: \"kubernetes.io/projected/2dd58074-551b-48aa-a990-d68f9cfa7dbc-kube-api-access-hkmfp\") pod \"managed-serviceaccount-addon-agent-77d456b59d-hkvfd\" (UID: \"2dd58074-551b-48aa-a990-d68f9cfa7dbc\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77d456b59d-hkvfd"
Jul 21 04:05:57.944316 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.944193    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6c9af825-1ed1-48f1-a01b-2903fa47f8cf-hub\") pod \"cluster-proxy-proxy-agent-66dd66d678-7wm2g\" (UID: \"6c9af825-1ed1-48f1-a01b-2903fa47f8cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g"
Jul 21 04:05:57.944905 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.944879    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c9af825-1ed1-48f1-a01b-2903fa47f8cf-additional-service-ca\") pod \"cluster-proxy-proxy-agent-66dd66d678-7wm2g\" (UID: \"6c9af825-1ed1-48f1-a01b-2903fa47f8cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g"
Jul 21 04:05:57.946832 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.946801    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6c9af825-1ed1-48f1-a01b-2903fa47f8cf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66dd66d678-7wm2g\" (UID: \"6c9af825-1ed1-48f1-a01b-2903fa47f8cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g"
Jul 21 04:05:57.946972 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.946953    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6c9af825-1ed1-48f1-a01b-2903fa47f8cf-ca\") pod \"cluster-proxy-proxy-agent-66dd66d678-7wm2g\" (UID: \"6c9af825-1ed1-48f1-a01b-2903fa47f8cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g"
Jul 21 04:05:57.947068 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.947045    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6c9af825-1ed1-48f1-a01b-2903fa47f8cf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66dd66d678-7wm2g\" (UID: \"6c9af825-1ed1-48f1-a01b-2903fa47f8cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g"
Jul 21 04:05:57.947282 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.947263    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2dd58074-551b-48aa-a990-d68f9cfa7dbc-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-77d456b59d-hkvfd\" (UID: \"2dd58074-551b-48aa-a990-d68f9cfa7dbc\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77d456b59d-hkvfd"
Jul 21 04:05:57.951392 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.951372    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkmfp\" (UniqueName: \"kubernetes.io/projected/2dd58074-551b-48aa-a990-d68f9cfa7dbc-kube-api-access-hkmfp\") pod \"managed-serviceaccount-addon-agent-77d456b59d-hkvfd\" (UID: \"2dd58074-551b-48aa-a990-d68f9cfa7dbc\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77d456b59d-hkvfd"
Jul 21 04:05:57.953531 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.953511    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6c9af825-1ed1-48f1-a01b-2903fa47f8cf-hub\") pod \"cluster-proxy-proxy-agent-66dd66d678-7wm2g\" (UID: \"6c9af825-1ed1-48f1-a01b-2903fa47f8cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g"
Jul 21 04:05:57.955306 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:57.955281    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcscg\" (UniqueName: \"kubernetes.io/projected/6c9af825-1ed1-48f1-a01b-2903fa47f8cf-kube-api-access-rcscg\") pod \"cluster-proxy-proxy-agent-66dd66d678-7wm2g\" (UID: \"6c9af825-1ed1-48f1-a01b-2903fa47f8cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g"
Jul 21 04:05:58.048144 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:58.048056    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77d456b59d-hkvfd"
Jul 21 04:05:58.054991 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:58.054977    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g"
Jul 21 04:05:58.197623 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:58.197524    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77d456b59d-hkvfd"]
Jul 21 04:05:58.199868 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:05:58.199842    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2dd58074_551b_48aa_a990_d68f9cfa7dbc.slice/crio-3607479695b151d6740930cb4a1caf45c2f1b6181b5b6b1bd8e07ebb5bde5b91 WatchSource:0}: Error finding container 3607479695b151d6740930cb4a1caf45c2f1b6181b5b6b1bd8e07ebb5bde5b91: Status 404 returned error can't find the container with id 3607479695b151d6740930cb4a1caf45c2f1b6181b5b6b1bd8e07ebb5bde5b91
Jul 21 04:05:58.207487 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:58.207466    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g"]
Jul 21 04:05:58.209979 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:05:58.209957    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c9af825_1ed1_48f1_a01b_2903fa47f8cf.slice/crio-93ef859b8d25d2785527c8c08192d3acabb17f536ac6e263f23af6d0c2a71c50 WatchSource:0}: Error finding container 93ef859b8d25d2785527c8c08192d3acabb17f536ac6e263f23af6d0c2a71c50: Status 404 returned error can't find the container with id 93ef859b8d25d2785527c8c08192d3acabb17f536ac6e263f23af6d0c2a71c50
Jul 21 04:05:58.988390 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:58.988346    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g" event={"ID":"6c9af825-1ed1-48f1-a01b-2903fa47f8cf","Type":"ContainerStarted","Data":"93ef859b8d25d2785527c8c08192d3acabb17f536ac6e263f23af6d0c2a71c50"}
Jul 21 04:05:58.990142 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:05:58.990098    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77d456b59d-hkvfd" event={"ID":"2dd58074-551b-48aa-a990-d68f9cfa7dbc","Type":"ContainerStarted","Data":"3607479695b151d6740930cb4a1caf45c2f1b6181b5b6b1bd8e07ebb5bde5b91"}
Jul 21 04:06:03.005947 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:06:03.005907    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g" event={"ID":"6c9af825-1ed1-48f1-a01b-2903fa47f8cf","Type":"ContainerStarted","Data":"7f9cf112e01c870d6284c83f7551be5cdfbb3339890ae28e6c50ad7b9daa7be3"}
Jul 21 04:06:03.006407 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:06:03.005959    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g" event={"ID":"6c9af825-1ed1-48f1-a01b-2903fa47f8cf","Type":"ContainerStarted","Data":"7daa33bbd959f14ea273843f8401c758ced1613e49982ef9d5835397b771906c"}
Jul 21 04:06:03.006407 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:06:03.005976    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g" event={"ID":"6c9af825-1ed1-48f1-a01b-2903fa47f8cf","Type":"ContainerStarted","Data":"805f30eec422a4fd5c43b0b682129c4d97266e0ed2eff96d73d5bf0a5c1afbb6"}
Jul 21 04:06:03.007305 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:06:03.007285    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77d456b59d-hkvfd" event={"ID":"2dd58074-551b-48aa-a990-d68f9cfa7dbc","Type":"ContainerStarted","Data":"f2250e7e048118d5e14b08a66e547b02f9d8dca14f7b87e919b7e395dbbfc0cb"}
Jul 21 04:06:03.031958 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:06:03.031911    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g" podStartSLOduration=2.231794917 podStartE2EDuration="6.031897724s" totalImagesPullingTime="3.800102807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:05:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:06:03.030435891 +0000 UTC m=+92.919489052" watchObservedRunningTime="2026-07-21 04:06:03.031897724 +0000 UTC m=+92.920950888"
Jul 21 04:06:03.045704 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:06:03.045661    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77d456b59d-hkvfd" podStartSLOduration=2.247241676 podStartE2EDuration="6.045646976s" totalImagesPullingTime="3.7984053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:05:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:06:03.045428961 +0000 UTC m=+92.934482138" watchObservedRunningTime="2026-07-21 04:06:03.045646976 +0000 UTC m=+92.934700141"
Jul 21 04:06:09.320912 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:06:09.320807    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f1f7378-bc63-4332-907c-f3c74a346e1e-metrics-tls\") pod \"dns-default-8lpj2\" (UID: \"5f1f7378-bc63-4332-907c-f3c74a346e1e\") " pod="openshift-dns/dns-default-8lpj2"
Jul 21 04:06:09.321361 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:06:09.320964    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:06:09.321361 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:06:09.321040    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1f7378-bc63-4332-907c-f3c74a346e1e-metrics-tls podName:5f1f7378-bc63-4332-907c-f3c74a346e1e nodeName:}" failed. No retries permitted until 2026-07-21 04:07:13.321021934 +0000 UTC m=+163.210075080 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f1f7378-bc63-4332-907c-f3c74a346e1e-metrics-tls") pod "dns-default-8lpj2" (UID: "5f1f7378-bc63-4332-907c-f3c74a346e1e") : secret "dns-default-metrics-tls" not found
Jul 21 04:06:12.953532 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:06:12.953501    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ggzvv"
Jul 21 04:06:40.330620 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:06:40.330585    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs\") pod \"network-metrics-daemon-z5xrt\" (UID: \"931a86de-fd82-48a4-996f-b39dbc3d5246\") " pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:06:40.331092 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:06:40.330701    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 04:06:40.331092 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:06:40.330762    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs podName:931a86de-fd82-48a4-996f-b39dbc3d5246 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:42.330746073 +0000 UTC m=+252.219799214 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs") pod "network-metrics-daemon-z5xrt" (UID: "931a86de-fd82-48a4-996f-b39dbc3d5246") : secret "metrics-daemon-secret" not found
Jul 21 04:07:08.454289 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:07:08.454244    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8lpj2" podUID="5f1f7378-bc63-4332-907c-f3c74a346e1e"
Jul 21 04:07:09.191770 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:07:09.191692    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8lpj2"
Jul 21 04:07:09.711953 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:07:09.711917    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-z5xrt" podUID="931a86de-fd82-48a4-996f-b39dbc3d5246"
Jul 21 04:07:13.368968 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:07:13.368922    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f1f7378-bc63-4332-907c-f3c74a346e1e-metrics-tls\") pod \"dns-default-8lpj2\" (UID: \"5f1f7378-bc63-4332-907c-f3c74a346e1e\") " pod="openshift-dns/dns-default-8lpj2"
Jul 21 04:07:13.369509 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:07:13.369090    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:07:13.369509 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:07:13.369193    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1f7378-bc63-4332-907c-f3c74a346e1e-metrics-tls podName:5f1f7378-bc63-4332-907c-f3c74a346e1e nodeName:}" failed. No retries permitted until 2026-07-21 04:09:15.369176535 +0000 UTC m=+285.258229676 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f1f7378-bc63-4332-907c-f3c74a346e1e-metrics-tls") pod "dns-default-8lpj2" (UID: "5f1f7378-bc63-4332-907c-f3c74a346e1e") : secret "dns-default-metrics-tls" not found
Jul 21 04:07:22.688185 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:07:22.688101    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:08:02.342480 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:02.342443    2580 generic.go:356] "Generic (PLEG): container finished" podID="2dd58074-551b-48aa-a990-d68f9cfa7dbc" containerID="f2250e7e048118d5e14b08a66e547b02f9d8dca14f7b87e919b7e395dbbfc0cb" exitCode=255
Jul 21 04:08:02.342862 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:02.342505    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77d456b59d-hkvfd" event={"ID":"2dd58074-551b-48aa-a990-d68f9cfa7dbc","Type":"ContainerDied","Data":"f2250e7e048118d5e14b08a66e547b02f9d8dca14f7b87e919b7e395dbbfc0cb"}
Jul 21 04:08:02.342862 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:02.342754    2580 scope.go:117] "RemoveContainer" containerID="f2250e7e048118d5e14b08a66e547b02f9d8dca14f7b87e919b7e395dbbfc0cb"
Jul 21 04:08:03.346723 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:03.346687    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77d456b59d-hkvfd" event={"ID":"2dd58074-551b-48aa-a990-d68f9cfa7dbc","Type":"ContainerStarted","Data":"1acf8bf71500f26d74e04902d93911085aa0bddb057efe411c7516b48a003d7e"}
Jul 21 04:08:31.519935 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:31.519896    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jcnzc"]
Jul 21 04:08:31.522823 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:31.522808    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jcnzc"
Jul 21 04:08:31.525079 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:31.525052    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 21 04:08:31.525079 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:31.525071    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 21 04:08:31.525273 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:31.525117    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nz9gm\""
Jul 21 04:08:31.525273 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:31.525191    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 21 04:08:31.525897 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:31.525883    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 21 04:08:31.537508 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:31.537484    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jcnzc"]
Jul 21 04:08:31.708751 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:31.708704    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-data-volume\") pod \"insights-runtime-extractor-jcnzc\" (UID: \"7991c063-6fd8-44d1-93e1-2424d9a6f6f6\") " pod="openshift-insights/insights-runtime-extractor-jcnzc"
Jul 21 04:08:31.708944 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:31.708785    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jcnzc\" (UID: \"7991c063-6fd8-44d1-93e1-2424d9a6f6f6\") " pod="openshift-insights/insights-runtime-extractor-jcnzc"
Jul 21 04:08:31.708944 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:31.708820    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-crio-socket\") pod \"insights-runtime-extractor-jcnzc\" (UID: \"7991c063-6fd8-44d1-93e1-2424d9a6f6f6\") " pod="openshift-insights/insights-runtime-extractor-jcnzc"
Jul 21 04:08:31.708944 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:31.708853    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjzlp\" (UniqueName: \"kubernetes.io/projected/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-kube-api-access-zjzlp\") pod \"insights-runtime-extractor-jcnzc\" (UID: \"7991c063-6fd8-44d1-93e1-2424d9a6f6f6\") " pod="openshift-insights/insights-runtime-extractor-jcnzc"
Jul 21 04:08:31.708944 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:31.708898    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jcnzc\" (UID: \"7991c063-6fd8-44d1-93e1-2424d9a6f6f6\") " pod="openshift-insights/insights-runtime-extractor-jcnzc"
Jul 21 04:08:31.810162 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:31.810062    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-data-volume\") pod \"insights-runtime-extractor-jcnzc\" (UID: \"7991c063-6fd8-44d1-93e1-2424d9a6f6f6\") " pod="openshift-insights/insights-runtime-extractor-jcnzc"
Jul 21 04:08:31.810162 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:31.810161    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jcnzc\" (UID: \"7991c063-6fd8-44d1-93e1-2424d9a6f6f6\") " pod="openshift-insights/insights-runtime-extractor-jcnzc"
Jul 21 04:08:31.810337 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:31.810202    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-crio-socket\") pod \"insights-runtime-extractor-jcnzc\" (UID: \"7991c063-6fd8-44d1-93e1-2424d9a6f6f6\") " pod="openshift-insights/insights-runtime-extractor-jcnzc"
Jul 21 04:08:31.810337 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:31.810237    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjzlp\" (UniqueName: \"kubernetes.io/projected/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-kube-api-access-zjzlp\") pod \"insights-runtime-extractor-jcnzc\" (UID: \"7991c063-6fd8-44d1-93e1-2424d9a6f6f6\") " pod="openshift-insights/insights-runtime-extractor-jcnzc"
Jul 21 04:08:31.810337 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:31.810273    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jcnzc\" (UID: \"7991c063-6fd8-44d1-93e1-2424d9a6f6f6\") " pod="openshift-insights/insights-runtime-extractor-jcnzc"
Jul 21 04:08:31.810337 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:31.810303    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-crio-socket\") pod \"insights-runtime-extractor-jcnzc\" (UID: \"7991c063-6fd8-44d1-93e1-2424d9a6f6f6\") " pod="openshift-insights/insights-runtime-extractor-jcnzc"
Jul 21 04:08:31.810337 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:08:31.810324    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:31.810535 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:08:31.810369    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 04:08:31.810535 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:08:31.810397    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-insights-runtime-extractor-tls podName:7991c063-6fd8-44d1-93e1-2424d9a6f6f6 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:32.310378185 +0000 UTC m=+242.199431328 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jcnzc" (UID: "7991c063-6fd8-44d1-93e1-2424d9a6f6f6") : secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:31.810535 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:31.810400    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-data-volume\") pod \"insights-runtime-extractor-jcnzc\" (UID: \"7991c063-6fd8-44d1-93e1-2424d9a6f6f6\") " pod="openshift-insights/insights-runtime-extractor-jcnzc"
Jul 21 04:08:31.810535 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:08:31.810428    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-kube-rbac-proxy-cm podName:7991c063-6fd8-44d1-93e1-2424d9a6f6f6 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:32.310411818 +0000 UTC m=+242.199464964 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jcnzc" (UID: "7991c063-6fd8-44d1-93e1-2424d9a6f6f6") : configmap "kube-rbac-proxy" not found
Jul 21 04:08:31.822241 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:31.822223    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjzlp\" (UniqueName: \"kubernetes.io/projected/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-kube-api-access-zjzlp\") pod \"insights-runtime-extractor-jcnzc\" (UID: \"7991c063-6fd8-44d1-93e1-2424d9a6f6f6\") " pod="openshift-insights/insights-runtime-extractor-jcnzc"
Jul 21 04:08:32.313206 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:32.313167    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jcnzc\" (UID: \"7991c063-6fd8-44d1-93e1-2424d9a6f6f6\") " pod="openshift-insights/insights-runtime-extractor-jcnzc"
Jul 21 04:08:32.313403 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:32.313244    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jcnzc\" (UID: \"7991c063-6fd8-44d1-93e1-2424d9a6f6f6\") " pod="openshift-insights/insights-runtime-extractor-jcnzc"
Jul 21 04:08:32.313403 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:08:32.313259    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 04:08:32.313403 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:08:32.313317    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-kube-rbac-proxy-cm podName:7991c063-6fd8-44d1-93e1-2424d9a6f6f6 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:33.31330288 +0000 UTC m=+243.202356023 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jcnzc" (UID: "7991c063-6fd8-44d1-93e1-2424d9a6f6f6") : configmap "kube-rbac-proxy" not found
Jul 21 04:08:32.313403 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:08:32.313334    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:32.313403 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:08:32.313392    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-insights-runtime-extractor-tls podName:7991c063-6fd8-44d1-93e1-2424d9a6f6f6 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:33.313380533 +0000 UTC m=+243.202433677 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jcnzc" (UID: "7991c063-6fd8-44d1-93e1-2424d9a6f6f6") : secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:33.319243 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:33.319208    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jcnzc\" (UID: \"7991c063-6fd8-44d1-93e1-2424d9a6f6f6\") " pod="openshift-insights/insights-runtime-extractor-jcnzc"
Jul 21 04:08:33.319623 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:33.319272    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jcnzc\" (UID: \"7991c063-6fd8-44d1-93e1-2424d9a6f6f6\") " pod="openshift-insights/insights-runtime-extractor-jcnzc"
Jul 21 04:08:33.319623 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:08:33.319355    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 04:08:33.319623 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:08:33.319368    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:33.319623 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:08:33.319407    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-kube-rbac-proxy-cm podName:7991c063-6fd8-44d1-93e1-2424d9a6f6f6 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:35.319393294 +0000 UTC m=+245.208446437 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jcnzc" (UID: "7991c063-6fd8-44d1-93e1-2424d9a6f6f6") : configmap "kube-rbac-proxy" not found
Jul 21 04:08:33.319623 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:08:33.319419    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-insights-runtime-extractor-tls podName:7991c063-6fd8-44d1-93e1-2424d9a6f6f6 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:35.319413898 +0000 UTC m=+245.208467039 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jcnzc" (UID: "7991c063-6fd8-44d1-93e1-2424d9a6f6f6") : secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:33.600014 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:33.599922    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-nf87k"]
Jul 21 04:08:33.602969 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:33.602948    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-nf87k"
Jul 21 04:08:33.605298 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:33.605277    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 21 04:08:33.605465 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:33.605449    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 21 04:08:33.605545 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:33.605478    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 21 04:08:33.606195 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:33.606176    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-jl6w7\""
Jul 21 04:08:33.606284 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:33.606204    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 21 04:08:33.610183 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:33.610156    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-nf87k"]
Jul 21 04:08:33.721988 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:33.721960    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9a36fb8d-6cc9-4b58-9010-4fda2972bc4b-signing-cabundle\") pod \"service-ca-58598695f7-nf87k\" (UID: \"9a36fb8d-6cc9-4b58-9010-4fda2972bc4b\") " pod="openshift-service-ca/service-ca-58598695f7-nf87k"
Jul 21 04:08:33.722168 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:33.721996    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9a36fb8d-6cc9-4b58-9010-4fda2972bc4b-signing-key\") pod \"service-ca-58598695f7-nf87k\" (UID: \"9a36fb8d-6cc9-4b58-9010-4fda2972bc4b\") " pod="openshift-service-ca/service-ca-58598695f7-nf87k"
Jul 21 04:08:33.722168 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:33.722079    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz78n\" (UniqueName: \"kubernetes.io/projected/9a36fb8d-6cc9-4b58-9010-4fda2972bc4b-kube-api-access-xz78n\") pod \"service-ca-58598695f7-nf87k\" (UID: \"9a36fb8d-6cc9-4b58-9010-4fda2972bc4b\") " pod="openshift-service-ca/service-ca-58598695f7-nf87k"
Jul 21 04:08:33.822955 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:33.822919    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz78n\" (UniqueName: \"kubernetes.io/projected/9a36fb8d-6cc9-4b58-9010-4fda2972bc4b-kube-api-access-xz78n\") pod \"service-ca-58598695f7-nf87k\" (UID: \"9a36fb8d-6cc9-4b58-9010-4fda2972bc4b\") " pod="openshift-service-ca/service-ca-58598695f7-nf87k"
Jul 21 04:08:33.823099 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:33.822982    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9a36fb8d-6cc9-4b58-9010-4fda2972bc4b-signing-cabundle\") pod \"service-ca-58598695f7-nf87k\" (UID: \"9a36fb8d-6cc9-4b58-9010-4fda2972bc4b\") " pod="openshift-service-ca/service-ca-58598695f7-nf87k"
Jul 21 04:08:33.823213 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:33.823169    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9a36fb8d-6cc9-4b58-9010-4fda2972bc4b-signing-key\") pod \"service-ca-58598695f7-nf87k\" (UID: \"9a36fb8d-6cc9-4b58-9010-4fda2972bc4b\") " pod="openshift-service-ca/service-ca-58598695f7-nf87k"
Jul 21 04:08:33.823538 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:33.823518    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9a36fb8d-6cc9-4b58-9010-4fda2972bc4b-signing-cabundle\") pod \"service-ca-58598695f7-nf87k\" (UID: \"9a36fb8d-6cc9-4b58-9010-4fda2972bc4b\") " pod="openshift-service-ca/service-ca-58598695f7-nf87k"
Jul 21 04:08:33.825420 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:33.825405    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9a36fb8d-6cc9-4b58-9010-4fda2972bc4b-signing-key\") pod \"service-ca-58598695f7-nf87k\" (UID: \"9a36fb8d-6cc9-4b58-9010-4fda2972bc4b\") " pod="openshift-service-ca/service-ca-58598695f7-nf87k"
Jul 21 04:08:33.833298 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:33.833272    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz78n\" (UniqueName: \"kubernetes.io/projected/9a36fb8d-6cc9-4b58-9010-4fda2972bc4b-kube-api-access-xz78n\") pod \"service-ca-58598695f7-nf87k\" (UID: \"9a36fb8d-6cc9-4b58-9010-4fda2972bc4b\") " pod="openshift-service-ca/service-ca-58598695f7-nf87k"
Jul 21 04:08:33.912808 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:33.912769    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-nf87k"
Jul 21 04:08:34.030935 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:34.030904    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-nf87k"]
Jul 21 04:08:34.034072 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:08:34.034047    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a36fb8d_6cc9_4b58_9010_4fda2972bc4b.slice/crio-0415f740b92a9cffd99396f0637cc0f1e192cf4586f541f468899694be056741 WatchSource:0}: Error finding container 0415f740b92a9cffd99396f0637cc0f1e192cf4586f541f468899694be056741: Status 404 returned error can't find the container with id 0415f740b92a9cffd99396f0637cc0f1e192cf4586f541f468899694be056741
Jul 21 04:08:34.292825 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:34.292754    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5tmw9_3105d271-61a5-4d68-9b89-9b3ddebbaad6/dns-node-resolver/0.log"
Jul 21 04:08:34.431785 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:34.431753    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-nf87k" event={"ID":"9a36fb8d-6cc9-4b58-9010-4fda2972bc4b","Type":"ContainerStarted","Data":"0415f740b92a9cffd99396f0637cc0f1e192cf4586f541f468899694be056741"}
Jul 21 04:08:35.292142 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:35.292099    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7xqgm_eeca8e4e-83b8-4f94-9b81-50631582bf15/node-ca/0.log"
Jul 21 04:08:35.333411 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:35.333376    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jcnzc\" (UID: \"7991c063-6fd8-44d1-93e1-2424d9a6f6f6\") " pod="openshift-insights/insights-runtime-extractor-jcnzc"
Jul 21 04:08:35.333579 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:35.333448    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jcnzc\" (UID: \"7991c063-6fd8-44d1-93e1-2424d9a6f6f6\") " pod="openshift-insights/insights-runtime-extractor-jcnzc"
Jul 21 04:08:35.333579 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:08:35.333540    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 04:08:35.333579 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:08:35.333565    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:35.333738 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:08:35.333606    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-kube-rbac-proxy-cm podName:7991c063-6fd8-44d1-93e1-2424d9a6f6f6 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:39.333587038 +0000 UTC m=+249.222640201 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jcnzc" (UID: "7991c063-6fd8-44d1-93e1-2424d9a6f6f6") : configmap "kube-rbac-proxy" not found
Jul 21 04:08:35.333738 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:08:35.333627    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-insights-runtime-extractor-tls podName:7991c063-6fd8-44d1-93e1-2424d9a6f6f6 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:39.333615482 +0000 UTC m=+249.222668627 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jcnzc" (UID: "7991c063-6fd8-44d1-93e1-2424d9a6f6f6") : secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:35.893304 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:35.893277    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-84nxz_5d302476-aea9-4a64-9923-fc9fe74a315e/serve-healthcheck-canary/0.log"
Jul 21 04:08:36.438976 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:36.438940    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-nf87k" event={"ID":"9a36fb8d-6cc9-4b58-9010-4fda2972bc4b","Type":"ContainerStarted","Data":"ea228978a64081e198765699bb11656a5e2be701916ece990be847830c0c0a1d"}
Jul 21 04:08:36.460473 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:36.460418    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-nf87k" podStartSLOduration=1.657324301 podStartE2EDuration="3.460400425s" totalImagesPullingTime="1.803076124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:08:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:08:36.459679605 +0000 UTC m=+246.348732769" watchObservedRunningTime="2026-07-21 04:08:36.460400425 +0000 UTC m=+246.349453591"
Jul 21 04:08:39.364251 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:39.364211    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jcnzc\" (UID: \"7991c063-6fd8-44d1-93e1-2424d9a6f6f6\") " pod="openshift-insights/insights-runtime-extractor-jcnzc"
Jul 21 04:08:39.364694 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:08:39.364340    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 04:08:39.364694 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:39.364391    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jcnzc\" (UID: \"7991c063-6fd8-44d1-93e1-2424d9a6f6f6\") " pod="openshift-insights/insights-runtime-extractor-jcnzc"
Jul 21 04:08:39.364694 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:08:39.364416    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-kube-rbac-proxy-cm podName:7991c063-6fd8-44d1-93e1-2424d9a6f6f6 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:47.364395894 +0000 UTC m=+257.253449038 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jcnzc" (UID: "7991c063-6fd8-44d1-93e1-2424d9a6f6f6") : configmap "kube-rbac-proxy" not found
Jul 21 04:08:39.364694 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:08:39.364502    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:39.364694 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:08:39.364562    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-insights-runtime-extractor-tls podName:7991c063-6fd8-44d1-93e1-2424d9a6f6f6 nodeName:}" failed. No retries permitted until 2026-07-21 04:08:47.364540539 +0000 UTC m=+257.253593689 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jcnzc" (UID: "7991c063-6fd8-44d1-93e1-2424d9a6f6f6") : secret "insights-runtime-extractor-tls" not found
Jul 21 04:08:42.386735 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:42.386699    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs\") pod \"network-metrics-daemon-z5xrt\" (UID: \"931a86de-fd82-48a4-996f-b39dbc3d5246\") " pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:08:42.387210 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:08:42.386873    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 04:08:42.387210 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:08:42.386954    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs podName:931a86de-fd82-48a4-996f-b39dbc3d5246 nodeName:}" failed. No retries permitted until 2026-07-21 04:10:44.386933019 +0000 UTC m=+374.275986178 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs") pod "network-metrics-daemon-z5xrt" (UID: "931a86de-fd82-48a4-996f-b39dbc3d5246") : secret "metrics-daemon-secret" not found
Jul 21 04:08:47.418961 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:47.418927    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jcnzc\" (UID: \"7991c063-6fd8-44d1-93e1-2424d9a6f6f6\") " pod="openshift-insights/insights-runtime-extractor-jcnzc"
Jul 21 04:08:47.419460 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:47.418995    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jcnzc\" (UID: \"7991c063-6fd8-44d1-93e1-2424d9a6f6f6\") " pod="openshift-insights/insights-runtime-extractor-jcnzc"
Jul 21 04:08:47.419589 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:47.419565    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jcnzc\" (UID: \"7991c063-6fd8-44d1-93e1-2424d9a6f6f6\") " pod="openshift-insights/insights-runtime-extractor-jcnzc"
Jul 21 04:08:47.421274 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:47.421258    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7991c063-6fd8-44d1-93e1-2424d9a6f6f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jcnzc\" (UID: \"7991c063-6fd8-44d1-93e1-2424d9a6f6f6\") " pod="openshift-insights/insights-runtime-extractor-jcnzc"
Jul 21 04:08:47.431226 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:47.431208    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jcnzc"
Jul 21 04:08:47.554139 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:47.554094    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jcnzc"]
Jul 21 04:08:47.556966 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:08:47.556930    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7991c063_6fd8_44d1_93e1_2424d9a6f6f6.slice/crio-6710008a8d968c0bf10c9c0277fc360bd497015f734b9a71e1b297d4020b5b78 WatchSource:0}: Error finding container 6710008a8d968c0bf10c9c0277fc360bd497015f734b9a71e1b297d4020b5b78: Status 404 returned error can't find the container with id 6710008a8d968c0bf10c9c0277fc360bd497015f734b9a71e1b297d4020b5b78
Jul 21 04:08:48.474265 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:48.474223    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jcnzc" event={"ID":"7991c063-6fd8-44d1-93e1-2424d9a6f6f6","Type":"ContainerStarted","Data":"6710008a8d968c0bf10c9c0277fc360bd497015f734b9a71e1b297d4020b5b78"}
Jul 21 04:08:53.490803 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:53.490714    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jcnzc" event={"ID":"7991c063-6fd8-44d1-93e1-2424d9a6f6f6","Type":"ContainerStarted","Data":"5e6468b0c1dedda01ccf7026946cb3a58398c3d89ae841cf72c204500ba1c4f7"}
Jul 21 04:08:57.506329 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:08:57.506297    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jcnzc" event={"ID":"7991c063-6fd8-44d1-93e1-2424d9a6f6f6","Type":"ContainerStarted","Data":"78688a063bbf8fc70317b875c8f00c2601c1bdbee199d58c8570c3672eff8aa5"}
Jul 21 04:09:01.521005 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:01.520965    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jcnzc" event={"ID":"7991c063-6fd8-44d1-93e1-2424d9a6f6f6","Type":"ContainerStarted","Data":"8f6cad266a9f1dbc908c2f718c0bc8ab7f978f44ab1469eeef29f01d7f16e60e"}
Jul 21 04:09:01.540836 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:01.540792    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jcnzc" podStartSLOduration=16.897334849 podStartE2EDuration="30.540777678s" totalImagesPullingTime="13.643442829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:08:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:01.539679282 +0000 UTC m=+271.428732446" watchObservedRunningTime="2026-07-21 04:09:01.540777678 +0000 UTC m=+271.429830842"
Jul 21 04:09:08.056656 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:08.056613    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g" podUID="6c9af825-1ed1-48f1-a01b-2903fa47f8cf" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 21 04:09:12.192688 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:09:12.192648    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8lpj2" podUID="5f1f7378-bc63-4332-907c-f3c74a346e1e"
Jul 21 04:09:12.550378 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:12.550301    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8lpj2"
Jul 21 04:09:14.494067 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.494027    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lz5nl"]
Jul 21 04:09:14.496965 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.496944    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lz5nl"
Jul 21 04:09:14.499463 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.499439    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 21 04:09:14.499582 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.499449    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rxcv9\""
Jul 21 04:09:14.499853 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.499834    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 21 04:09:14.500042 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.500022    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 21 04:09:14.500167 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.500088    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 21 04:09:14.500234 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.500214    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 21 04:09:14.500394 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.500379    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 21 04:09:14.625877 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.625845    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aea6b452-a33c-4773-939a-34ff95ffd8f1-root\") pod \"node-exporter-lz5nl\" (UID: \"aea6b452-a33c-4773-939a-34ff95ffd8f1\") " pod="openshift-monitoring/node-exporter-lz5nl"
Jul 21 04:09:14.626078 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.625887    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aea6b452-a33c-4773-939a-34ff95ffd8f1-node-exporter-tls\") pod \"node-exporter-lz5nl\" (UID: \"aea6b452-a33c-4773-939a-34ff95ffd8f1\") " pod="openshift-monitoring/node-exporter-lz5nl"
Jul 21 04:09:14.626078 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.625940    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aea6b452-a33c-4773-939a-34ff95ffd8f1-sys\") pod \"node-exporter-lz5nl\" (UID: \"aea6b452-a33c-4773-939a-34ff95ffd8f1\") " pod="openshift-monitoring/node-exporter-lz5nl"
Jul 21 04:09:14.626078 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.626000    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsfqg\" (UniqueName: \"kubernetes.io/projected/aea6b452-a33c-4773-939a-34ff95ffd8f1-kube-api-access-rsfqg\") pod \"node-exporter-lz5nl\" (UID: \"aea6b452-a33c-4773-939a-34ff95ffd8f1\") " pod="openshift-monitoring/node-exporter-lz5nl"
Jul 21 04:09:14.626277 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.626092    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aea6b452-a33c-4773-939a-34ff95ffd8f1-metrics-client-ca\") pod \"node-exporter-lz5nl\" (UID: \"aea6b452-a33c-4773-939a-34ff95ffd8f1\") " pod="openshift-monitoring/node-exporter-lz5nl"
Jul 21 04:09:14.626277 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.626144    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aea6b452-a33c-4773-939a-34ff95ffd8f1-node-exporter-textfile\") pod \"node-exporter-lz5nl\" (UID: \"aea6b452-a33c-4773-939a-34ff95ffd8f1\") " pod="openshift-monitoring/node-exporter-lz5nl"
Jul 21 04:09:14.626277 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.626176    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aea6b452-a33c-4773-939a-34ff95ffd8f1-node-exporter-accelerators-collector-config\") pod \"node-exporter-lz5nl\" (UID: \"aea6b452-a33c-4773-939a-34ff95ffd8f1\") " pod="openshift-monitoring/node-exporter-lz5nl"
Jul 21 04:09:14.626277 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.626212    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aea6b452-a33c-4773-939a-34ff95ffd8f1-node-exporter-wtmp\") pod \"node-exporter-lz5nl\" (UID: \"aea6b452-a33c-4773-939a-34ff95ffd8f1\") " pod="openshift-monitoring/node-exporter-lz5nl"
Jul 21 04:09:14.626277 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.626236    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aea6b452-a33c-4773-939a-34ff95ffd8f1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lz5nl\" (UID: \"aea6b452-a33c-4773-939a-34ff95ffd8f1\") " pod="openshift-monitoring/node-exporter-lz5nl"
Jul 21 04:09:14.727548 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.727512    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aea6b452-a33c-4773-939a-34ff95ffd8f1-sys\") pod \"node-exporter-lz5nl\" (UID: \"aea6b452-a33c-4773-939a-34ff95ffd8f1\") " pod="openshift-monitoring/node-exporter-lz5nl"
Jul 21 04:09:14.727744 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.727569    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsfqg\" (UniqueName: \"kubernetes.io/projected/aea6b452-a33c-4773-939a-34ff95ffd8f1-kube-api-access-rsfqg\") pod \"node-exporter-lz5nl\" (UID: \"aea6b452-a33c-4773-939a-34ff95ffd8f1\") " pod="openshift-monitoring/node-exporter-lz5nl"
Jul 21 04:09:14.727744 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.727629    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aea6b452-a33c-4773-939a-34ff95ffd8f1-sys\") pod \"node-exporter-lz5nl\" (UID: \"aea6b452-a33c-4773-939a-34ff95ffd8f1\") " pod="openshift-monitoring/node-exporter-lz5nl"
Jul 21 04:09:14.727744 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.727635    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aea6b452-a33c-4773-939a-34ff95ffd8f1-metrics-client-ca\") pod \"node-exporter-lz5nl\" (UID: \"aea6b452-a33c-4773-939a-34ff95ffd8f1\") " pod="openshift-monitoring/node-exporter-lz5nl"
Jul 21 04:09:14.727744 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.727689    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aea6b452-a33c-4773-939a-34ff95ffd8f1-node-exporter-textfile\") pod \"node-exporter-lz5nl\" (UID: \"aea6b452-a33c-4773-939a-34ff95ffd8f1\") " pod="openshift-monitoring/node-exporter-lz5nl"
Jul 21 04:09:14.727744 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.727721    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aea6b452-a33c-4773-939a-34ff95ffd8f1-node-exporter-accelerators-collector-config\") pod \"node-exporter-lz5nl\" (UID: \"aea6b452-a33c-4773-939a-34ff95ffd8f1\") " pod="openshift-monitoring/node-exporter-lz5nl"
Jul 21 04:09:14.727997 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.727753    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aea6b452-a33c-4773-939a-34ff95ffd8f1-node-exporter-wtmp\") pod \"node-exporter-lz5nl\" (UID: \"aea6b452-a33c-4773-939a-34ff95ffd8f1\") " pod="openshift-monitoring/node-exporter-lz5nl"
Jul 21 04:09:14.727997 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.727779    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aea6b452-a33c-4773-939a-34ff95ffd8f1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lz5nl\" (UID: \"aea6b452-a33c-4773-939a-34ff95ffd8f1\") " pod="openshift-monitoring/node-exporter-lz5nl"
Jul 21 04:09:14.728096 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.728006    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aea6b452-a33c-4773-939a-34ff95ffd8f1-root\") pod \"node-exporter-lz5nl\" (UID: \"aea6b452-a33c-4773-939a-34ff95ffd8f1\") " pod="openshift-monitoring/node-exporter-lz5nl"
Jul 21 04:09:14.728096 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.728030    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aea6b452-a33c-4773-939a-34ff95ffd8f1-node-exporter-wtmp\") pod \"node-exporter-lz5nl\" (UID: \"aea6b452-a33c-4773-939a-34ff95ffd8f1\") " pod="openshift-monitoring/node-exporter-lz5nl"
Jul 21 04:09:14.728096 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.728038    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aea6b452-a33c-4773-939a-34ff95ffd8f1-node-exporter-tls\") pod \"node-exporter-lz5nl\" (UID: \"aea6b452-a33c-4773-939a-34ff95ffd8f1\") " pod="openshift-monitoring/node-exporter-lz5nl"
Jul 21 04:09:14.728096 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.728047    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aea6b452-a33c-4773-939a-34ff95ffd8f1-node-exporter-textfile\") pod \"node-exporter-lz5nl\" (UID: \"aea6b452-a33c-4773-939a-34ff95ffd8f1\") " pod="openshift-monitoring/node-exporter-lz5nl"
Jul 21 04:09:14.728309 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.728117    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aea6b452-a33c-4773-939a-34ff95ffd8f1-root\") pod \"node-exporter-lz5nl\" (UID: \"aea6b452-a33c-4773-939a-34ff95ffd8f1\") " pod="openshift-monitoring/node-exporter-lz5nl"
Jul 21 04:09:14.728309 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:09:14.728144    2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 21 04:09:14.728309 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:09:14.728204    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aea6b452-a33c-4773-939a-34ff95ffd8f1-node-exporter-tls podName:aea6b452-a33c-4773-939a-34ff95ffd8f1 nodeName:}" failed. No retries permitted until 2026-07-21 04:09:15.22818593 +0000 UTC m=+285.117239079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/aea6b452-a33c-4773-939a-34ff95ffd8f1-node-exporter-tls") pod "node-exporter-lz5nl" (UID: "aea6b452-a33c-4773-939a-34ff95ffd8f1") : secret "node-exporter-tls" not found
Jul 21 04:09:14.728664 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.728644    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aea6b452-a33c-4773-939a-34ff95ffd8f1-metrics-client-ca\") pod \"node-exporter-lz5nl\" (UID: \"aea6b452-a33c-4773-939a-34ff95ffd8f1\") " pod="openshift-monitoring/node-exporter-lz5nl"
Jul 21 04:09:14.728782 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.728680    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aea6b452-a33c-4773-939a-34ff95ffd8f1-node-exporter-accelerators-collector-config\") pod \"node-exporter-lz5nl\" (UID: \"aea6b452-a33c-4773-939a-34ff95ffd8f1\") " pod="openshift-monitoring/node-exporter-lz5nl"
Jul 21 04:09:14.730287 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.730263    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aea6b452-a33c-4773-939a-34ff95ffd8f1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lz5nl\" (UID: \"aea6b452-a33c-4773-939a-34ff95ffd8f1\") " pod="openshift-monitoring/node-exporter-lz5nl"
Jul 21 04:09:14.736484 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:14.736462    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsfqg\" (UniqueName: \"kubernetes.io/projected/aea6b452-a33c-4773-939a-34ff95ffd8f1-kube-api-access-rsfqg\") pod \"node-exporter-lz5nl\" (UID: \"aea6b452-a33c-4773-939a-34ff95ffd8f1\") " pod="openshift-monitoring/node-exporter-lz5nl"
Jul 21 04:09:15.231524 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.231490    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aea6b452-a33c-4773-939a-34ff95ffd8f1-node-exporter-tls\") pod \"node-exporter-lz5nl\" (UID: \"aea6b452-a33c-4773-939a-34ff95ffd8f1\") " pod="openshift-monitoring/node-exporter-lz5nl"
Jul 21 04:09:15.233730 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.233700    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aea6b452-a33c-4773-939a-34ff95ffd8f1-node-exporter-tls\") pod \"node-exporter-lz5nl\" (UID: \"aea6b452-a33c-4773-939a-34ff95ffd8f1\") " pod="openshift-monitoring/node-exporter-lz5nl"
Jul 21 04:09:15.409915 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.409878    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lz5nl"
Jul 21 04:09:15.429504 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:09:15.429473    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaea6b452_a33c_4773_939a_34ff95ffd8f1.slice/crio-1f41f85b4211a034cd69cbaad0701c13482c9443e66df1c4382800cccaaf87d4 WatchSource:0}: Error finding container 1f41f85b4211a034cd69cbaad0701c13482c9443e66df1c4382800cccaaf87d4: Status 404 returned error can't find the container with id 1f41f85b4211a034cd69cbaad0701c13482c9443e66df1c4382800cccaaf87d4
Jul 21 04:09:15.432112 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.432088    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f1f7378-bc63-4332-907c-f3c74a346e1e-metrics-tls\") pod \"dns-default-8lpj2\" (UID: \"5f1f7378-bc63-4332-907c-f3c74a346e1e\") " pod="openshift-dns/dns-default-8lpj2"
Jul 21 04:09:15.434370 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.434347    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f1f7378-bc63-4332-907c-f3c74a346e1e-metrics-tls\") pod \"dns-default-8lpj2\" (UID: \"5f1f7378-bc63-4332-907c-f3c74a346e1e\") " pod="openshift-dns/dns-default-8lpj2"
Jul 21 04:09:15.537157 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.537066    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 04:09:15.539936 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.539919    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.542273 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.542251    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 21 04:09:15.542422 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.542403    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 21 04:09:15.542968 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.542530    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-d7bfs\""
Jul 21 04:09:15.542968 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.542531    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 21 04:09:15.542968 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.542570    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 21 04:09:15.542968 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.542591    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 21 04:09:15.542968 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.542602    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 21 04:09:15.542968 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.542775    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 21 04:09:15.542968 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.542835    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 21 04:09:15.542968 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.542854    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 21 04:09:15.553224 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.553191    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m9r9d\""
Jul 21 04:09:15.554848 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.554816    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 04:09:15.565666 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.564922    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8lpj2"
Jul 21 04:09:15.566630 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.566603    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lz5nl" event={"ID":"aea6b452-a33c-4773-939a-34ff95ffd8f1","Type":"ContainerStarted","Data":"1f41f85b4211a034cd69cbaad0701c13482c9443e66df1c4382800cccaaf87d4"}
Jul 21 04:09:15.633546 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.633328    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.633546 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.633374    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.633546 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.633400    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.633546 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.633445    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d113daec-8fc2-49fc-b631-91fffe6dc0fc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.633546 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.633471    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l56t\" (UniqueName: \"kubernetes.io/projected/d113daec-8fc2-49fc-b631-91fffe6dc0fc-kube-api-access-6l56t\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.633546 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.633507    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d113daec-8fc2-49fc-b631-91fffe6dc0fc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.633546 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.633549    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.633855 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.633572    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-web-config\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.633855 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.633595    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d113daec-8fc2-49fc-b631-91fffe6dc0fc-config-out\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.633855 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.633617    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d113daec-8fc2-49fc-b631-91fffe6dc0fc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.633855 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.633645    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-config-volume\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.633855 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.633672    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.633855 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.633717    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d113daec-8fc2-49fc-b631-91fffe6dc0fc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.698320 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.698288    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8lpj2"]
Jul 21 04:09:15.700930 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:09:15.700899    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1f7378_bc63_4332_907c_f3c74a346e1e.slice/crio-e35f15637d4e4b18245a8025113f7605663f1ae3032241fa81da41120a90f399 WatchSource:0}: Error finding container e35f15637d4e4b18245a8025113f7605663f1ae3032241fa81da41120a90f399: Status 404 returned error can't find the container with id e35f15637d4e4b18245a8025113f7605663f1ae3032241fa81da41120a90f399
Jul 21 04:09:15.734897 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.734867    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d113daec-8fc2-49fc-b631-91fffe6dc0fc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.735033 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.734903    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.735033 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.734921    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.735033 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.734939    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.735033 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.734965    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d113daec-8fc2-49fc-b631-91fffe6dc0fc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.735033 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.734989    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l56t\" (UniqueName: \"kubernetes.io/projected/d113daec-8fc2-49fc-b631-91fffe6dc0fc-kube-api-access-6l56t\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.735033 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.735026    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d113daec-8fc2-49fc-b631-91fffe6dc0fc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.735351 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.735066    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.735351 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.735091    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-web-config\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.735351 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.735115    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d113daec-8fc2-49fc-b631-91fffe6dc0fc-config-out\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.735351 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.735159    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d113daec-8fc2-49fc-b631-91fffe6dc0fc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.735351 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.735181    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-config-volume\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.735351 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.735201    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.736154 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.735718    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d113daec-8fc2-49fc-b631-91fffe6dc0fc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.736154 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.736003    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d113daec-8fc2-49fc-b631-91fffe6dc0fc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.736328 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.736243    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d113daec-8fc2-49fc-b631-91fffe6dc0fc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.738116 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.738089    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.738237 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.738214    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.738595 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.738553    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d113daec-8fc2-49fc-b631-91fffe6dc0fc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.738726 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.738701    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.738928 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.738899    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.739231 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.739209    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-web-config\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.739940 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.739921    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.740020 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.739939    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d113daec-8fc2-49fc-b631-91fffe6dc0fc-config-out\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.740069 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.740048    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-config-volume\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.744769 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.744750    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l56t\" (UniqueName: \"kubernetes.io/projected/d113daec-8fc2-49fc-b631-91fffe6dc0fc-kube-api-access-6l56t\") pod \"alertmanager-main-0\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:15.850226 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:15.850160    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:09:16.001458 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:16.001435    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 04:09:16.002222 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:09:16.002186    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd113daec_8fc2_49fc_b631_91fffe6dc0fc.slice/crio-d023bc68a5cdaedfd2769a4f3de260c9f69017df9eaa3ce6a85181aecb7182ba WatchSource:0}: Error finding container d023bc68a5cdaedfd2769a4f3de260c9f69017df9eaa3ce6a85181aecb7182ba: Status 404 returned error can't find the container with id d023bc68a5cdaedfd2769a4f3de260c9f69017df9eaa3ce6a85181aecb7182ba
Jul 21 04:09:16.571982 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:16.571931    2580 generic.go:356] "Generic (PLEG): container finished" podID="aea6b452-a33c-4773-939a-34ff95ffd8f1" containerID="31c690d24d77d7d64d9f35f0e8e48e7e1f4d4d0582e30b63b5b6920e1effdc74" exitCode=0
Jul 21 04:09:16.572371 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:16.572019    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lz5nl" event={"ID":"aea6b452-a33c-4773-939a-34ff95ffd8f1","Type":"ContainerDied","Data":"31c690d24d77d7d64d9f35f0e8e48e7e1f4d4d0582e30b63b5b6920e1effdc74"}
Jul 21 04:09:16.573911 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:16.573875    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d113daec-8fc2-49fc-b631-91fffe6dc0fc","Type":"ContainerStarted","Data":"d023bc68a5cdaedfd2769a4f3de260c9f69017df9eaa3ce6a85181aecb7182ba"}
Jul 21 04:09:16.575105 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:16.575083    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8lpj2" event={"ID":"5f1f7378-bc63-4332-907c-f3c74a346e1e","Type":"ContainerStarted","Data":"e35f15637d4e4b18245a8025113f7605663f1ae3032241fa81da41120a90f399"}
Jul 21 04:09:17.582307 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:17.582271    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lz5nl" event={"ID":"aea6b452-a33c-4773-939a-34ff95ffd8f1","Type":"ContainerStarted","Data":"adc9ed751e98a6e7dc61c1fdedf0d62870b3cddba95e05b73d56395042daa151"}
Jul 21 04:09:17.582743 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:17.582335    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lz5nl" event={"ID":"aea6b452-a33c-4773-939a-34ff95ffd8f1","Type":"ContainerStarted","Data":"87767981fa911be1fb0151e266339f1d4cdae8bf51982fed10c3e4259287f3a3"}
Jul 21 04:09:17.605419 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:17.605359    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lz5nl" podStartSLOduration=2.58036555 podStartE2EDuration="3.605338886s" totalImagesPullingTime="951.201705ms" totalInitContainerRuntime="73.771631ms" isStatefulPod=true podCreationTimestamp="2026-07-21 04:09:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:17.603826778 +0000 UTC m=+287.492879943" watchObservedRunningTime="2026-07-21 04:09:17.605338886 +0000 UTC m=+287.494392054"
Jul 21 04:09:18.055987 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:18.055953    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g" podUID="6c9af825-1ed1-48f1-a01b-2903fa47f8cf" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 21 04:09:18.587064 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:18.587034    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8lpj2" event={"ID":"5f1f7378-bc63-4332-907c-f3c74a346e1e","Type":"ContainerStarted","Data":"0e0519ce89b264f3f2ed0bedaf3a59e0ad3923eafb39c50ccbf196147cc5678a"}
Jul 21 04:09:18.587534 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:18.587155    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8lpj2"
Jul 21 04:09:18.587534 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:18.587193    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8lpj2" event={"ID":"5f1f7378-bc63-4332-907c-f3c74a346e1e","Type":"ContainerStarted","Data":"88cbcb689b0689800ee94c5fb690265633b01f0ffc4fc66dd2ab41670ea44d51"}
Jul 21 04:09:18.588498 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:18.588474    2580 generic.go:356] "Generic (PLEG): container finished" podID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerID="bc604bb0f69ddfecd52ba1378a9497aeb8ba58070e766734798ad9dfb91c2405" exitCode=0
Jul 21 04:09:18.588596 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:18.588563    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d113daec-8fc2-49fc-b631-91fffe6dc0fc","Type":"ContainerDied","Data":"bc604bb0f69ddfecd52ba1378a9497aeb8ba58070e766734798ad9dfb91c2405"}
Jul 21 04:09:18.604987 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:18.604939    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8lpj2" podStartSLOduration=251.520040676 podStartE2EDuration="4m13.604920129s" totalImagesPullingTime="2.084879453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:05:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:18.604103208 +0000 UTC m=+288.493156384" watchObservedRunningTime="2026-07-21 04:09:18.604920129 +0000 UTC m=+288.493973294"
Jul 21 04:09:20.597020 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:20.596992    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d113daec-8fc2-49fc-b631-91fffe6dc0fc","Type":"ContainerStarted","Data":"3f25d55d2f15b296e1f58d44f72f78902c40b8213cf568ed82dd34c908a54551"}
Jul 21 04:09:20.597380 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:20.597057    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d113daec-8fc2-49fc-b631-91fffe6dc0fc","Type":"ContainerStarted","Data":"4a7cafc786662d802d08d678ca9383ef06db7b891edae89caac8ce63f011fa93"}
Jul 21 04:09:20.597380 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:20.597088    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d113daec-8fc2-49fc-b631-91fffe6dc0fc","Type":"ContainerStarted","Data":"944643d0d34a2ca998ee742d37aba90313bdff094edf6612a23a5a54046098d0"}
Jul 21 04:09:21.605712 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:21.605680    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d113daec-8fc2-49fc-b631-91fffe6dc0fc","Type":"ContainerStarted","Data":"3ec8bafcc46cbc17c6ecc0913603b2d1ea5f3e07189ea2b86f1d2b0b05ec299e"}
Jul 21 04:09:21.606058 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:21.605748    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d113daec-8fc2-49fc-b631-91fffe6dc0fc","Type":"ContainerStarted","Data":"939b45f834be1370c03b49dedec4cb03374b295e9a7d02871a46452b46e4f97a"}
Jul 21 04:09:22.611875 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:22.611841    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d113daec-8fc2-49fc-b631-91fffe6dc0fc","Type":"ContainerStarted","Data":"a3342ad576f4d136f4dbc6d4a7b439b45ff068290d8fc455cb5af735aa93a633"}
Jul 21 04:09:22.650897 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:22.650836    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.9765983350000003 podStartE2EDuration="7.650816212s" totalImagesPullingTime="4.652954488s" totalInitContainerRuntime="21.263389ms" isStatefulPod=false podCreationTimestamp="2026-07-21 04:09:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:22.650279563 +0000 UTC m=+292.539332727" watchObservedRunningTime="2026-07-21 04:09:22.650816212 +0000 UTC m=+292.539869377"
Jul 21 04:09:23.923280 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:23.923247    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-nxdhw"]
Jul 21 04:09:23.926315 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:23.926300    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-nxdhw"
Jul 21 04:09:23.928833 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:23.928814    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 21 04:09:23.928833 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:23.928815    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 21 04:09:23.929074 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:23.929057    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-cdv6b\""
Jul 21 04:09:23.938251 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:23.938230    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-nxdhw"]
Jul 21 04:09:24.005319 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:24.005285    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlq7v\" (UniqueName: \"kubernetes.io/projected/c7cd692b-6a9d-4e16-82c8-103b3bd155ee-kube-api-access-xlq7v\") pod \"downloads-5bc67dcd46-nxdhw\" (UID: \"c7cd692b-6a9d-4e16-82c8-103b3bd155ee\") " pod="openshift-console/downloads-5bc67dcd46-nxdhw"
Jul 21 04:09:24.106551 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:24.106517    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlq7v\" (UniqueName: \"kubernetes.io/projected/c7cd692b-6a9d-4e16-82c8-103b3bd155ee-kube-api-access-xlq7v\") pod \"downloads-5bc67dcd46-nxdhw\" (UID: \"c7cd692b-6a9d-4e16-82c8-103b3bd155ee\") " pod="openshift-console/downloads-5bc67dcd46-nxdhw"
Jul 21 04:09:24.114897 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:24.114867    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlq7v\" (UniqueName: \"kubernetes.io/projected/c7cd692b-6a9d-4e16-82c8-103b3bd155ee-kube-api-access-xlq7v\") pod \"downloads-5bc67dcd46-nxdhw\" (UID: \"c7cd692b-6a9d-4e16-82c8-103b3bd155ee\") " pod="openshift-console/downloads-5bc67dcd46-nxdhw"
Jul 21 04:09:24.235080 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:24.234993    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-nxdhw"
Jul 21 04:09:24.370589 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:24.370554    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-nxdhw"]
Jul 21 04:09:24.372937 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:09:24.372894    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7cd692b_6a9d_4e16_82c8_103b3bd155ee.slice/crio-e63d64c3f965a6be9ff8f3ff3d315b42e9c1fe8e68c5b563a8e551e0f0468b38 WatchSource:0}: Error finding container e63d64c3f965a6be9ff8f3ff3d315b42e9c1fe8e68c5b563a8e551e0f0468b38: Status 404 returned error can't find the container with id e63d64c3f965a6be9ff8f3ff3d315b42e9c1fe8e68c5b563a8e551e0f0468b38
Jul 21 04:09:24.620851 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:24.620774    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-nxdhw" event={"ID":"c7cd692b-6a9d-4e16-82c8-103b3bd155ee","Type":"ContainerStarted","Data":"e63d64c3f965a6be9ff8f3ff3d315b42e9c1fe8e68c5b563a8e551e0f0468b38"}
Jul 21 04:09:25.689079 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:09:25.689030    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-z5xrt" podUID="931a86de-fd82-48a4-996f-b39dbc3d5246"
Jul 21 04:09:28.056390 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:28.056353    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g" podUID="6c9af825-1ed1-48f1-a01b-2903fa47f8cf" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 21 04:09:28.056863 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:28.056560    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g"
Jul 21 04:09:28.057177 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:28.057114    2580 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"7f9cf112e01c870d6284c83f7551be5cdfbb3339890ae28e6c50ad7b9daa7be3"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 21 04:09:28.057283 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:28.057209    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g" podUID="6c9af825-1ed1-48f1-a01b-2903fa47f8cf" containerName="service-proxy" containerID="cri-o://7f9cf112e01c870d6284c83f7551be5cdfbb3339890ae28e6c50ad7b9daa7be3" gracePeriod=30
Jul 21 04:09:28.593259 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:28.593230    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8lpj2"
Jul 21 04:09:28.640745 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:28.640714    2580 generic.go:356] "Generic (PLEG): container finished" podID="6c9af825-1ed1-48f1-a01b-2903fa47f8cf" containerID="7f9cf112e01c870d6284c83f7551be5cdfbb3339890ae28e6c50ad7b9daa7be3" exitCode=2
Jul 21 04:09:28.640898 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:28.640788    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g" event={"ID":"6c9af825-1ed1-48f1-a01b-2903fa47f8cf","Type":"ContainerDied","Data":"7f9cf112e01c870d6284c83f7551be5cdfbb3339890ae28e6c50ad7b9daa7be3"}
Jul 21 04:09:29.648891 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:29.648850    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66dd66d678-7wm2g" event={"ID":"6c9af825-1ed1-48f1-a01b-2903fa47f8cf","Type":"ContainerStarted","Data":"957075561dc29fcd984d6062ea49a598ebb96854b89d99d638421508d1b5373b"}
Jul 21 04:09:30.535748 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:30.535720    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-694fk_6f2c16b6-c4e7-480c-b4d7-1312ed5ad130/ovn-acl-logging/0.log"
Jul 21 04:09:30.536726 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:30.536704    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-694fk_6f2c16b6-c4e7-480c-b4d7-1312ed5ad130/ovn-acl-logging/0.log"
Jul 21 04:09:30.543345 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:30.543325    2580 kubelet.go:1648] "Image garbage collection succeeded"
Jul 21 04:09:39.688687 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:39.688653    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:09:42.700296 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:42.700256    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-nxdhw" event={"ID":"c7cd692b-6a9d-4e16-82c8-103b3bd155ee","Type":"ContainerStarted","Data":"d31cabe1b9055ef3d02a7da36fe536c84b21d45df08afe3c35a0a37efdcac48b"}
Jul 21 04:09:42.700756 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:42.700461    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-nxdhw"
Jul 21 04:09:42.717060 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:42.717030    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-nxdhw"
Jul 21 04:09:42.721631 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:09:42.721577    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-nxdhw" podStartSLOduration=1.978373628 podStartE2EDuration="19.721560208s" totalImagesPullingTime="17.74318658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:09:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:42.71994438 +0000 UTC m=+312.608997544" watchObservedRunningTime="2026-07-21 04:09:42.721560208 +0000 UTC m=+312.610613371"
Jul 21 04:10:34.789728 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:34.789654    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 04:10:34.790251 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:34.789918    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerName="alertmanager" containerID="cri-o://944643d0d34a2ca998ee742d37aba90313bdff094edf6612a23a5a54046098d0" gracePeriod=120
Jul 21 04:10:34.790251 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:34.790008    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerName="kube-rbac-proxy-web" containerID="cri-o://3f25d55d2f15b296e1f58d44f72f78902c40b8213cf568ed82dd34c908a54551" gracePeriod=120
Jul 21 04:10:34.790251 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:34.790036    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerName="prom-label-proxy" containerID="cri-o://a3342ad576f4d136f4dbc6d4a7b439b45ff068290d8fc455cb5af735aa93a633" gracePeriod=120
Jul 21 04:10:34.790251 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:34.789993    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerName="kube-rbac-proxy-metric" containerID="cri-o://3ec8bafcc46cbc17c6ecc0913603b2d1ea5f3e07189ea2b86f1d2b0b05ec299e" gracePeriod=120
Jul 21 04:10:34.790251 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:34.790076    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerName="config-reloader" containerID="cri-o://4a7cafc786662d802d08d678ca9383ef06db7b891edae89caac8ce63f011fa93" gracePeriod=120
Jul 21 04:10:34.790251 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:34.790078    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerName="kube-rbac-proxy" containerID="cri-o://939b45f834be1370c03b49dedec4cb03374b295e9a7d02871a46452b46e4f97a" gracePeriod=120
Jul 21 04:10:35.895019 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:35.894989    2580 generic.go:356] "Generic (PLEG): container finished" podID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerID="a3342ad576f4d136f4dbc6d4a7b439b45ff068290d8fc455cb5af735aa93a633" exitCode=0
Jul 21 04:10:35.895019 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:35.895017    2580 generic.go:356] "Generic (PLEG): container finished" podID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerID="3ec8bafcc46cbc17c6ecc0913603b2d1ea5f3e07189ea2b86f1d2b0b05ec299e" exitCode=0
Jul 21 04:10:35.895019 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:35.895027    2580 generic.go:356] "Generic (PLEG): container finished" podID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerID="939b45f834be1370c03b49dedec4cb03374b295e9a7d02871a46452b46e4f97a" exitCode=0
Jul 21 04:10:35.895019 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:35.895033    2580 generic.go:356] "Generic (PLEG): container finished" podID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerID="4a7cafc786662d802d08d678ca9383ef06db7b891edae89caac8ce63f011fa93" exitCode=0
Jul 21 04:10:35.895468 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:35.895038    2580 generic.go:356] "Generic (PLEG): container finished" podID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerID="944643d0d34a2ca998ee742d37aba90313bdff094edf6612a23a5a54046098d0" exitCode=0
Jul 21 04:10:35.895468 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:35.895061    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d113daec-8fc2-49fc-b631-91fffe6dc0fc","Type":"ContainerDied","Data":"a3342ad576f4d136f4dbc6d4a7b439b45ff068290d8fc455cb5af735aa93a633"}
Jul 21 04:10:35.895468 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:35.895150    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d113daec-8fc2-49fc-b631-91fffe6dc0fc","Type":"ContainerDied","Data":"3ec8bafcc46cbc17c6ecc0913603b2d1ea5f3e07189ea2b86f1d2b0b05ec299e"}
Jul 21 04:10:35.895468 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:35.895179    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d113daec-8fc2-49fc-b631-91fffe6dc0fc","Type":"ContainerDied","Data":"939b45f834be1370c03b49dedec4cb03374b295e9a7d02871a46452b46e4f97a"}
Jul 21 04:10:35.895468 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:35.895210    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d113daec-8fc2-49fc-b631-91fffe6dc0fc","Type":"ContainerDied","Data":"4a7cafc786662d802d08d678ca9383ef06db7b891edae89caac8ce63f011fa93"}
Jul 21 04:10:35.895468 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:35.895234    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d113daec-8fc2-49fc-b631-91fffe6dc0fc","Type":"ContainerDied","Data":"944643d0d34a2ca998ee742d37aba90313bdff094edf6612a23a5a54046098d0"}
Jul 21 04:10:36.026737 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.026709    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:36.093922 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.093844    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d113daec-8fc2-49fc-b631-91fffe6dc0fc-tls-assets\") pod \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") "
Jul 21 04:10:36.093922 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.093879    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-secret-alertmanager-kube-rbac-proxy-web\") pod \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") "
Jul 21 04:10:36.093922 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.093900    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-secret-alertmanager-kube-rbac-proxy\") pod \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") "
Jul 21 04:10:36.093922 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.093923    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-config-volume\") pod \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") "
Jul 21 04:10:36.094263 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.094155    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-cluster-tls-config\") pod \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") "
Jul 21 04:10:36.094263 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.094198    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d113daec-8fc2-49fc-b631-91fffe6dc0fc-config-out\") pod \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") "
Jul 21 04:10:36.094263 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.094225    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") "
Jul 21 04:10:36.094412 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.094266    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6l56t\" (UniqueName: \"kubernetes.io/projected/d113daec-8fc2-49fc-b631-91fffe6dc0fc-kube-api-access-6l56t\") pod \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") "
Jul 21 04:10:36.094412 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.094292    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d113daec-8fc2-49fc-b631-91fffe6dc0fc-alertmanager-trusted-ca-bundle\") pod \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") "
Jul 21 04:10:36.094412 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.094331    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-secret-alertmanager-main-tls\") pod \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") "
Jul 21 04:10:36.094412 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.094369    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d113daec-8fc2-49fc-b631-91fffe6dc0fc-alertmanager-main-db\") pod \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") "
Jul 21 04:10:36.094412 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.094403    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-web-config\") pod \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") "
Jul 21 04:10:36.094647 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.094429    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d113daec-8fc2-49fc-b631-91fffe6dc0fc-metrics-client-ca\") pod \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\" (UID: \"d113daec-8fc2-49fc-b631-91fffe6dc0fc\") "
Jul 21 04:10:36.095245 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.094983    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d113daec-8fc2-49fc-b631-91fffe6dc0fc-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "d113daec-8fc2-49fc-b631-91fffe6dc0fc" (UID: "d113daec-8fc2-49fc-b631-91fffe6dc0fc"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:10:36.095245 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.095152    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d113daec-8fc2-49fc-b631-91fffe6dc0fc-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "d113daec-8fc2-49fc-b631-91fffe6dc0fc" (UID: "d113daec-8fc2-49fc-b631-91fffe6dc0fc"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:10:36.095836 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.095784    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d113daec-8fc2-49fc-b631-91fffe6dc0fc-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "d113daec-8fc2-49fc-b631-91fffe6dc0fc" (UID: "d113daec-8fc2-49fc-b631-91fffe6dc0fc"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:10:36.097580 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.097541    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-config-volume" (OuterVolumeSpecName: "config-volume") pod "d113daec-8fc2-49fc-b631-91fffe6dc0fc" (UID: "d113daec-8fc2-49fc-b631-91fffe6dc0fc"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:10:36.098096 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.098003    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "d113daec-8fc2-49fc-b631-91fffe6dc0fc" (UID: "d113daec-8fc2-49fc-b631-91fffe6dc0fc"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:10:36.098096 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.098036    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d113daec-8fc2-49fc-b631-91fffe6dc0fc-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d113daec-8fc2-49fc-b631-91fffe6dc0fc" (UID: "d113daec-8fc2-49fc-b631-91fffe6dc0fc"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:10:36.098344 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.098309    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "d113daec-8fc2-49fc-b631-91fffe6dc0fc" (UID: "d113daec-8fc2-49fc-b631-91fffe6dc0fc"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:10:36.098412 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.098369    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "d113daec-8fc2-49fc-b631-91fffe6dc0fc" (UID: "d113daec-8fc2-49fc-b631-91fffe6dc0fc"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:10:36.098476 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.098433    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "d113daec-8fc2-49fc-b631-91fffe6dc0fc" (UID: "d113daec-8fc2-49fc-b631-91fffe6dc0fc"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:10:36.099465 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.099439    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d113daec-8fc2-49fc-b631-91fffe6dc0fc-config-out" (OuterVolumeSpecName: "config-out") pod "d113daec-8fc2-49fc-b631-91fffe6dc0fc" (UID: "d113daec-8fc2-49fc-b631-91fffe6dc0fc"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:10:36.099923 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.099886    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d113daec-8fc2-49fc-b631-91fffe6dc0fc-kube-api-access-6l56t" (OuterVolumeSpecName: "kube-api-access-6l56t") pod "d113daec-8fc2-49fc-b631-91fffe6dc0fc" (UID: "d113daec-8fc2-49fc-b631-91fffe6dc0fc"). InnerVolumeSpecName "kube-api-access-6l56t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:10:36.102168 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.102143    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "d113daec-8fc2-49fc-b631-91fffe6dc0fc" (UID: "d113daec-8fc2-49fc-b631-91fffe6dc0fc"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:10:36.107564 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.107545    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-web-config" (OuterVolumeSpecName: "web-config") pod "d113daec-8fc2-49fc-b631-91fffe6dc0fc" (UID: "d113daec-8fc2-49fc-b631-91fffe6dc0fc"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:10:36.195662 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.195615    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6l56t\" (UniqueName: \"kubernetes.io/projected/d113daec-8fc2-49fc-b631-91fffe6dc0fc-kube-api-access-6l56t\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:10:36.195662 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.195656    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d113daec-8fc2-49fc-b631-91fffe6dc0fc-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:10:36.195662 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.195668    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-secret-alertmanager-main-tls\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:10:36.195662 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.195678    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d113daec-8fc2-49fc-b631-91fffe6dc0fc-alertmanager-main-db\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:10:36.195925 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.195687    2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-web-config\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:10:36.195925 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.195696    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d113daec-8fc2-49fc-b631-91fffe6dc0fc-metrics-client-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:10:36.195925 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.195705    2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d113daec-8fc2-49fc-b631-91fffe6dc0fc-tls-assets\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:10:36.195925 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.195714    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:10:36.195925 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.195722    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:10:36.195925 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.195730    2580 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-config-volume\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:10:36.195925 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.195739    2580 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-cluster-tls-config\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:10:36.195925 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.195747    2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d113daec-8fc2-49fc-b631-91fffe6dc0fc-config-out\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:10:36.195925 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.195756    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d113daec-8fc2-49fc-b631-91fffe6dc0fc-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:10:36.901474 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.901439    2580 generic.go:356] "Generic (PLEG): container finished" podID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerID="3f25d55d2f15b296e1f58d44f72f78902c40b8213cf568ed82dd34c908a54551" exitCode=0
Jul 21 04:10:36.901921 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.901525    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d113daec-8fc2-49fc-b631-91fffe6dc0fc","Type":"ContainerDied","Data":"3f25d55d2f15b296e1f58d44f72f78902c40b8213cf568ed82dd34c908a54551"}
Jul 21 04:10:36.901921 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.901533    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:36.901921 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.901588    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d113daec-8fc2-49fc-b631-91fffe6dc0fc","Type":"ContainerDied","Data":"d023bc68a5cdaedfd2769a4f3de260c9f69017df9eaa3ce6a85181aecb7182ba"}
Jul 21 04:10:36.901921 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.901633    2580 scope.go:117] "RemoveContainer" containerID="a3342ad576f4d136f4dbc6d4a7b439b45ff068290d8fc455cb5af735aa93a633"
Jul 21 04:10:36.912107 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.912082    2580 scope.go:117] "RemoveContainer" containerID="3ec8bafcc46cbc17c6ecc0913603b2d1ea5f3e07189ea2b86f1d2b0b05ec299e"
Jul 21 04:10:36.918795 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.918779    2580 scope.go:117] "RemoveContainer" containerID="939b45f834be1370c03b49dedec4cb03374b295e9a7d02871a46452b46e4f97a"
Jul 21 04:10:36.925268 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.925247    2580 scope.go:117] "RemoveContainer" containerID="3f25d55d2f15b296e1f58d44f72f78902c40b8213cf568ed82dd34c908a54551"
Jul 21 04:10:36.925619 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.925602    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 04:10:36.930004 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.929984    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 04:10:36.932040 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.932023    2580 scope.go:117] "RemoveContainer" containerID="4a7cafc786662d802d08d678ca9383ef06db7b891edae89caac8ce63f011fa93"
Jul 21 04:10:36.938519 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.938495    2580 scope.go:117] "RemoveContainer" containerID="944643d0d34a2ca998ee742d37aba90313bdff094edf6612a23a5a54046098d0"
Jul 21 04:10:36.945065 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.945048    2580 scope.go:117] "RemoveContainer" containerID="bc604bb0f69ddfecd52ba1378a9497aeb8ba58070e766734798ad9dfb91c2405"
Jul 21 04:10:36.951397 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.951379    2580 scope.go:117] "RemoveContainer" containerID="a3342ad576f4d136f4dbc6d4a7b439b45ff068290d8fc455cb5af735aa93a633"
Jul 21 04:10:36.951686 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:10:36.951655    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3342ad576f4d136f4dbc6d4a7b439b45ff068290d8fc455cb5af735aa93a633\": container with ID starting with a3342ad576f4d136f4dbc6d4a7b439b45ff068290d8fc455cb5af735aa93a633 not found: ID does not exist" containerID="a3342ad576f4d136f4dbc6d4a7b439b45ff068290d8fc455cb5af735aa93a633"
Jul 21 04:10:36.951746 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.951698    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3342ad576f4d136f4dbc6d4a7b439b45ff068290d8fc455cb5af735aa93a633"} err="failed to get container status \"a3342ad576f4d136f4dbc6d4a7b439b45ff068290d8fc455cb5af735aa93a633\": rpc error: code = NotFound desc = could not find container \"a3342ad576f4d136f4dbc6d4a7b439b45ff068290d8fc455cb5af735aa93a633\": container with ID starting with a3342ad576f4d136f4dbc6d4a7b439b45ff068290d8fc455cb5af735aa93a633 not found: ID does not exist"
Jul 21 04:10:36.951746 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.951718    2580 scope.go:117] "RemoveContainer" containerID="3ec8bafcc46cbc17c6ecc0913603b2d1ea5f3e07189ea2b86f1d2b0b05ec299e"
Jul 21 04:10:36.951981 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:10:36.951965    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ec8bafcc46cbc17c6ecc0913603b2d1ea5f3e07189ea2b86f1d2b0b05ec299e\": container with ID starting with 3ec8bafcc46cbc17c6ecc0913603b2d1ea5f3e07189ea2b86f1d2b0b05ec299e not found: ID does not exist" containerID="3ec8bafcc46cbc17c6ecc0913603b2d1ea5f3e07189ea2b86f1d2b0b05ec299e"
Jul 21 04:10:36.952020 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.951987    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ec8bafcc46cbc17c6ecc0913603b2d1ea5f3e07189ea2b86f1d2b0b05ec299e"} err="failed to get container status \"3ec8bafcc46cbc17c6ecc0913603b2d1ea5f3e07189ea2b86f1d2b0b05ec299e\": rpc error: code = NotFound desc = could not find container \"3ec8bafcc46cbc17c6ecc0913603b2d1ea5f3e07189ea2b86f1d2b0b05ec299e\": container with ID starting with 3ec8bafcc46cbc17c6ecc0913603b2d1ea5f3e07189ea2b86f1d2b0b05ec299e not found: ID does not exist"
Jul 21 04:10:36.952020 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.952003    2580 scope.go:117] "RemoveContainer" containerID="939b45f834be1370c03b49dedec4cb03374b295e9a7d02871a46452b46e4f97a"
Jul 21 04:10:36.952247 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:10:36.952227    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"939b45f834be1370c03b49dedec4cb03374b295e9a7d02871a46452b46e4f97a\": container with ID starting with 939b45f834be1370c03b49dedec4cb03374b295e9a7d02871a46452b46e4f97a not found: ID does not exist" containerID="939b45f834be1370c03b49dedec4cb03374b295e9a7d02871a46452b46e4f97a"
Jul 21 04:10:36.952344 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.952253    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"939b45f834be1370c03b49dedec4cb03374b295e9a7d02871a46452b46e4f97a"} err="failed to get container status \"939b45f834be1370c03b49dedec4cb03374b295e9a7d02871a46452b46e4f97a\": rpc error: code = NotFound desc = could not find container \"939b45f834be1370c03b49dedec4cb03374b295e9a7d02871a46452b46e4f97a\": container with ID starting with 939b45f834be1370c03b49dedec4cb03374b295e9a7d02871a46452b46e4f97a not found: ID does not exist"
Jul 21 04:10:36.952344 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.952267    2580 scope.go:117] "RemoveContainer" containerID="3f25d55d2f15b296e1f58d44f72f78902c40b8213cf568ed82dd34c908a54551"
Jul 21 04:10:36.952521 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:10:36.952487    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f25d55d2f15b296e1f58d44f72f78902c40b8213cf568ed82dd34c908a54551\": container with ID starting with 3f25d55d2f15b296e1f58d44f72f78902c40b8213cf568ed82dd34c908a54551 not found: ID does not exist" containerID="3f25d55d2f15b296e1f58d44f72f78902c40b8213cf568ed82dd34c908a54551"
Jul 21 04:10:36.952521 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.952504    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f25d55d2f15b296e1f58d44f72f78902c40b8213cf568ed82dd34c908a54551"} err="failed to get container status \"3f25d55d2f15b296e1f58d44f72f78902c40b8213cf568ed82dd34c908a54551\": rpc error: code = NotFound desc = could not find container \"3f25d55d2f15b296e1f58d44f72f78902c40b8213cf568ed82dd34c908a54551\": container with ID starting with 3f25d55d2f15b296e1f58d44f72f78902c40b8213cf568ed82dd34c908a54551 not found: ID does not exist"
Jul 21 04:10:36.952521 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.952516    2580 scope.go:117] "RemoveContainer" containerID="4a7cafc786662d802d08d678ca9383ef06db7b891edae89caac8ce63f011fa93"
Jul 21 04:10:36.952722 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:10:36.952707    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a7cafc786662d802d08d678ca9383ef06db7b891edae89caac8ce63f011fa93\": container with ID starting with 4a7cafc786662d802d08d678ca9383ef06db7b891edae89caac8ce63f011fa93 not found: ID does not exist" containerID="4a7cafc786662d802d08d678ca9383ef06db7b891edae89caac8ce63f011fa93"
Jul 21 04:10:36.952758 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.952725    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a7cafc786662d802d08d678ca9383ef06db7b891edae89caac8ce63f011fa93"} err="failed to get container status \"4a7cafc786662d802d08d678ca9383ef06db7b891edae89caac8ce63f011fa93\": rpc error: code = NotFound desc = could not find container \"4a7cafc786662d802d08d678ca9383ef06db7b891edae89caac8ce63f011fa93\": container with ID starting with 4a7cafc786662d802d08d678ca9383ef06db7b891edae89caac8ce63f011fa93 not found: ID does not exist"
Jul 21 04:10:36.952758 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.952737    2580 scope.go:117] "RemoveContainer" containerID="944643d0d34a2ca998ee742d37aba90313bdff094edf6612a23a5a54046098d0"
Jul 21 04:10:36.952921 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:10:36.952907    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"944643d0d34a2ca998ee742d37aba90313bdff094edf6612a23a5a54046098d0\": container with ID starting with 944643d0d34a2ca998ee742d37aba90313bdff094edf6612a23a5a54046098d0 not found: ID does not exist" containerID="944643d0d34a2ca998ee742d37aba90313bdff094edf6612a23a5a54046098d0"
Jul 21 04:10:36.952966 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.952924    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"944643d0d34a2ca998ee742d37aba90313bdff094edf6612a23a5a54046098d0"} err="failed to get container status \"944643d0d34a2ca998ee742d37aba90313bdff094edf6612a23a5a54046098d0\": rpc error: code = NotFound desc = could not find container \"944643d0d34a2ca998ee742d37aba90313bdff094edf6612a23a5a54046098d0\": container with ID starting with 944643d0d34a2ca998ee742d37aba90313bdff094edf6612a23a5a54046098d0 not found: ID does not exist"
Jul 21 04:10:36.952966 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.952936    2580 scope.go:117] "RemoveContainer" containerID="bc604bb0f69ddfecd52ba1378a9497aeb8ba58070e766734798ad9dfb91c2405"
Jul 21 04:10:36.953137 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:10:36.953109    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc604bb0f69ddfecd52ba1378a9497aeb8ba58070e766734798ad9dfb91c2405\": container with ID starting with bc604bb0f69ddfecd52ba1378a9497aeb8ba58070e766734798ad9dfb91c2405 not found: ID does not exist" containerID="bc604bb0f69ddfecd52ba1378a9497aeb8ba58070e766734798ad9dfb91c2405"
Jul 21 04:10:36.953198 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.953142    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc604bb0f69ddfecd52ba1378a9497aeb8ba58070e766734798ad9dfb91c2405"} err="failed to get container status \"bc604bb0f69ddfecd52ba1378a9497aeb8ba58070e766734798ad9dfb91c2405\": rpc error: code = NotFound desc = could not find container \"bc604bb0f69ddfecd52ba1378a9497aeb8ba58070e766734798ad9dfb91c2405\": container with ID starting with bc604bb0f69ddfecd52ba1378a9497aeb8ba58070e766734798ad9dfb91c2405 not found: ID does not exist"
Jul 21 04:10:36.956745 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.956726    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 04:10:36.956974 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.956964    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerName="init-config-reloader"
Jul 21 04:10:36.957012 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.956977    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerName="init-config-reloader"
Jul 21 04:10:36.957012 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.956987    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerName="alertmanager"
Jul 21 04:10:36.957012 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.956992    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerName="alertmanager"
Jul 21 04:10:36.957012 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.956999    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerName="kube-rbac-proxy-web"
Jul 21 04:10:36.957012 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.957004    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerName="kube-rbac-proxy-web"
Jul 21 04:10:36.957012 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.957009    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerName="kube-rbac-proxy"
Jul 21 04:10:36.957012 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.957014    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerName="kube-rbac-proxy"
Jul 21 04:10:36.957226 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.957026    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerName="kube-rbac-proxy-metric"
Jul 21 04:10:36.957226 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.957031    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerName="kube-rbac-proxy-metric"
Jul 21 04:10:36.957226 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.957036    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerName="prom-label-proxy"
Jul 21 04:10:36.957226 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.957042    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerName="prom-label-proxy"
Jul 21 04:10:36.957226 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.957049    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerName="config-reloader"
Jul 21 04:10:36.957226 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.957055    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerName="config-reloader"
Jul 21 04:10:36.957226 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.957090    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerName="kube-rbac-proxy-metric"
Jul 21 04:10:36.957226 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.957097    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerName="kube-rbac-proxy-web"
Jul 21 04:10:36.957226 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.957103    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerName="prom-label-proxy"
Jul 21 04:10:36.957226 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.957110    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerName="kube-rbac-proxy"
Jul 21 04:10:36.957226 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.957114    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerName="alertmanager"
Jul 21 04:10:36.957226 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.957118    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" containerName="config-reloader"
Jul 21 04:10:36.960418 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.960402    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:36.963198 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.963175    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 21 04:10:36.963285 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.963222    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 21 04:10:36.963348 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.963334    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 21 04:10:36.963393 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.963334    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 21 04:10:36.963445 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.963406    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 21 04:10:36.963694 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.963674    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 21 04:10:36.963765 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.963716    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-d7bfs\""
Jul 21 04:10:36.963829 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.963759    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 21 04:10:36.963829 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.963719    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 21 04:10:36.969825 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.969807    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 21 04:10:36.978621 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.978603    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 04:10:36.999607 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.999583    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/557dd272-45a2-4cc3-8863-5acc230a8f36-web-config\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:36.999692 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.999610    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/557dd272-45a2-4cc3-8863-5acc230a8f36-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:36.999692 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.999628    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/557dd272-45a2-4cc3-8863-5acc230a8f36-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:36.999692 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.999646    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjl48\" (UniqueName: \"kubernetes.io/projected/557dd272-45a2-4cc3-8863-5acc230a8f36-kube-api-access-zjl48\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:36.999809 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.999734    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/557dd272-45a2-4cc3-8863-5acc230a8f36-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:36.999809 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.999767    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/557dd272-45a2-4cc3-8863-5acc230a8f36-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:36.999868 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.999828    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/557dd272-45a2-4cc3-8863-5acc230a8f36-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:36.999900 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.999863    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/557dd272-45a2-4cc3-8863-5acc230a8f36-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:36.999900 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.999890    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/557dd272-45a2-4cc3-8863-5acc230a8f36-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:36.999960 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.999915    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/557dd272-45a2-4cc3-8863-5acc230a8f36-config-volume\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:36.999960 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.999937    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/557dd272-45a2-4cc3-8863-5acc230a8f36-config-out\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:37.000016 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:36.999973    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/557dd272-45a2-4cc3-8863-5acc230a8f36-tls-assets\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:37.000046 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.000036    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/557dd272-45a2-4cc3-8863-5acc230a8f36-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:37.100796 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.100766    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/557dd272-45a2-4cc3-8863-5acc230a8f36-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:37.100913 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.100798    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/557dd272-45a2-4cc3-8863-5acc230a8f36-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:37.100913 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.100829    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/557dd272-45a2-4cc3-8863-5acc230a8f36-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:37.100913 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.100850    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/557dd272-45a2-4cc3-8863-5acc230a8f36-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:37.100913 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.100872    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/557dd272-45a2-4cc3-8863-5acc230a8f36-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:37.100913 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.100893    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/557dd272-45a2-4cc3-8863-5acc230a8f36-config-volume\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:37.100913 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.100907    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/557dd272-45a2-4cc3-8863-5acc230a8f36-config-out\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:37.101196 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.100931    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/557dd272-45a2-4cc3-8863-5acc230a8f36-tls-assets\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:37.101196 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.100973    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/557dd272-45a2-4cc3-8863-5acc230a8f36-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:37.101196 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.101009    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/557dd272-45a2-4cc3-8863-5acc230a8f36-web-config\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:37.101196 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.101030    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/557dd272-45a2-4cc3-8863-5acc230a8f36-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:37.101196 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.101056    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/557dd272-45a2-4cc3-8863-5acc230a8f36-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:37.101196 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.101076    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjl48\" (UniqueName: \"kubernetes.io/projected/557dd272-45a2-4cc3-8863-5acc230a8f36-kube-api-access-zjl48\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:37.101471 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.101240    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/557dd272-45a2-4cc3-8863-5acc230a8f36-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:37.101838 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.101811    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/557dd272-45a2-4cc3-8863-5acc230a8f36-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:37.102223 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.102196    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/557dd272-45a2-4cc3-8863-5acc230a8f36-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:37.104210 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.104187    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/557dd272-45a2-4cc3-8863-5acc230a8f36-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:37.104307 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.104238    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/557dd272-45a2-4cc3-8863-5acc230a8f36-config-volume\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:37.104624 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.104466    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/557dd272-45a2-4cc3-8863-5acc230a8f36-config-out\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:37.104624 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.104576    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/557dd272-45a2-4cc3-8863-5acc230a8f36-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:37.104782 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.104667    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/557dd272-45a2-4cc3-8863-5acc230a8f36-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:37.104782 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.104757    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/557dd272-45a2-4cc3-8863-5acc230a8f36-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:37.104885 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.104806    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/557dd272-45a2-4cc3-8863-5acc230a8f36-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:37.105089 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.105070    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/557dd272-45a2-4cc3-8863-5acc230a8f36-tls-assets\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:37.105406 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.105389    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/557dd272-45a2-4cc3-8863-5acc230a8f36-web-config\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:37.110829 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.110813    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjl48\" (UniqueName: \"kubernetes.io/projected/557dd272-45a2-4cc3-8863-5acc230a8f36-kube-api-access-zjl48\") pod \"alertmanager-main-0\" (UID: \"557dd272-45a2-4cc3-8863-5acc230a8f36\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:37.269897 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.269812    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 04:10:37.405721 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.405697    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 04:10:37.407641 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:10:37.407615    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod557dd272_45a2_4cc3_8863_5acc230a8f36.slice/crio-385bc0dc0bb4f1edf781b547aa7c101ada459bab4622dafa52c9f21a8f833255 WatchSource:0}: Error finding container 385bc0dc0bb4f1edf781b547aa7c101ada459bab4622dafa52c9f21a8f833255: Status 404 returned error can't find the container with id 385bc0dc0bb4f1edf781b547aa7c101ada459bab4622dafa52c9f21a8f833255
Jul 21 04:10:37.905826 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.905789    2580 generic.go:356] "Generic (PLEG): container finished" podID="557dd272-45a2-4cc3-8863-5acc230a8f36" containerID="221b13915b3f9ffda9ecd7dc37fb14284cb4a03cffc1f9b56e6e0f7e6efc81f0" exitCode=0
Jul 21 04:10:37.906267 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.905877    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"557dd272-45a2-4cc3-8863-5acc230a8f36","Type":"ContainerDied","Data":"221b13915b3f9ffda9ecd7dc37fb14284cb4a03cffc1f9b56e6e0f7e6efc81f0"}
Jul 21 04:10:37.906267 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:37.905939    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"557dd272-45a2-4cc3-8863-5acc230a8f36","Type":"ContainerStarted","Data":"385bc0dc0bb4f1edf781b547aa7c101ada459bab4622dafa52c9f21a8f833255"}
Jul 21 04:10:38.695588 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:38.695558    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d113daec-8fc2-49fc-b631-91fffe6dc0fc" path="/var/lib/kubelet/pods/d113daec-8fc2-49fc-b631-91fffe6dc0fc/volumes"
Jul 21 04:10:38.812616 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:38.812582    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7b475d7d59-g7nqc"]
Jul 21 04:10:38.814838 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:38.814822    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc"
Jul 21 04:10:38.817252 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:38.817226    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-8gs2s\""
Jul 21 04:10:38.817364 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:38.817252    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 21 04:10:38.817364 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:38.817252    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 21 04:10:38.817364 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:38.817281    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 21 04:10:38.817509 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:38.817367    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 21 04:10:38.817548 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:38.817537    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 21 04:10:38.822690 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:38.822668    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 21 04:10:38.830423 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:38.830403    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b475d7d59-g7nqc"]
Jul 21 04:10:38.913862 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:38.913835    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/caf6bdf0-915a-4fd3-bc7f-2864df11bd57-telemeter-client-tls\") pod \"telemeter-client-7b475d7d59-g7nqc\" (UID: \"caf6bdf0-915a-4fd3-bc7f-2864df11bd57\") " pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc"
Jul 21 04:10:38.914261 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:38.913901    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caf6bdf0-915a-4fd3-bc7f-2864df11bd57-metrics-client-ca\") pod \"telemeter-client-7b475d7d59-g7nqc\" (UID: \"caf6bdf0-915a-4fd3-bc7f-2864df11bd57\") " pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc"
Jul 21 04:10:38.914261 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:38.913944    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caf6bdf0-915a-4fd3-bc7f-2864df11bd57-serving-certs-ca-bundle\") pod \"telemeter-client-7b475d7d59-g7nqc\" (UID: \"caf6bdf0-915a-4fd3-bc7f-2864df11bd57\") " pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc"
Jul 21 04:10:38.914261 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:38.913982    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/caf6bdf0-915a-4fd3-bc7f-2864df11bd57-secret-telemeter-client\") pod \"telemeter-client-7b475d7d59-g7nqc\" (UID: \"caf6bdf0-915a-4fd3-bc7f-2864df11bd57\") " pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc"
Jul 21 04:10:38.914261 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:38.914040    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caf6bdf0-915a-4fd3-bc7f-2864df11bd57-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b475d7d59-g7nqc\" (UID: \"caf6bdf0-915a-4fd3-bc7f-2864df11bd57\") " pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc"
Jul 21 04:10:38.914261 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:38.914065    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfrl5\" (UniqueName: \"kubernetes.io/projected/caf6bdf0-915a-4fd3-bc7f-2864df11bd57-kube-api-access-xfrl5\") pod \"telemeter-client-7b475d7d59-g7nqc\" (UID: \"caf6bdf0-915a-4fd3-bc7f-2864df11bd57\") " pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc"
Jul 21 04:10:38.914261 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:38.914102    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/caf6bdf0-915a-4fd3-bc7f-2864df11bd57-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b475d7d59-g7nqc\" (UID: \"caf6bdf0-915a-4fd3-bc7f-2864df11bd57\") " pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc"
Jul 21 04:10:38.914261 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:38.914231    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/caf6bdf0-915a-4fd3-bc7f-2864df11bd57-federate-client-tls\") pod \"telemeter-client-7b475d7d59-g7nqc\" (UID: \"caf6bdf0-915a-4fd3-bc7f-2864df11bd57\") " pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc"
Jul 21 04:10:38.914604 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:38.914310    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"557dd272-45a2-4cc3-8863-5acc230a8f36","Type":"ContainerStarted","Data":"dff9fef82c207f49f3a10349ad1e951869a61002584dc9cfa2e752ac03c591fd"}
Jul 21 04:10:38.914604 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:38.914362    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"557dd272-45a2-4cc3-8863-5acc230a8f36","Type":"ContainerStarted","Data":"d2d2692e30c1161dd07e860406a7a091f0fa721076106f19bce896f4f38eb706"}
Jul 21 04:10:38.914604 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:38.914388    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"557dd272-45a2-4cc3-8863-5acc230a8f36","Type":"ContainerStarted","Data":"d23027bc5cb82085adf070f6ee3c6b096ed64617ed934e07994acecaa73d2dbf"}
Jul 21 04:10:38.914604 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:38.914412    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"557dd272-45a2-4cc3-8863-5acc230a8f36","Type":"ContainerStarted","Data":"d93e23e4999f4cd0a753cee3f810441a069f28c5573103c2a099ffccb24fa898"}
Jul 21 04:10:38.914604 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:38.914434    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"557dd272-45a2-4cc3-8863-5acc230a8f36","Type":"ContainerStarted","Data":"ac81f1136211b6df937a677e5dab34b523acfdc977928ca9dba97497245722e6"}
Jul 21 04:10:38.914604 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:38.914455    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"557dd272-45a2-4cc3-8863-5acc230a8f36","Type":"ContainerStarted","Data":"717d55dfb73ba5d70f8c755c87a6ae3c1525d828e33f62454b0c3c9c8e900dfc"}
Jul 21 04:10:38.939068 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:38.939028    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.9222864509999997 podStartE2EDuration="2.939015076s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.728625ms" isStatefulPod=false podCreationTimestamp="2026-07-21 04:10:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:10:38.937773454 +0000 UTC m=+368.826826619" watchObservedRunningTime="2026-07-21 04:10:38.939015076 +0000 UTC m=+368.828068239"
Jul 21 04:10:39.014829 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:39.014748    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/caf6bdf0-915a-4fd3-bc7f-2864df11bd57-telemeter-client-tls\") pod \"telemeter-client-7b475d7d59-g7nqc\" (UID: \"caf6bdf0-915a-4fd3-bc7f-2864df11bd57\") " pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc"
Jul 21 04:10:39.014978 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:39.014839    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caf6bdf0-915a-4fd3-bc7f-2864df11bd57-metrics-client-ca\") pod \"telemeter-client-7b475d7d59-g7nqc\" (UID: \"caf6bdf0-915a-4fd3-bc7f-2864df11bd57\") " pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc"
Jul 21 04:10:39.014978 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:39.014856    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caf6bdf0-915a-4fd3-bc7f-2864df11bd57-serving-certs-ca-bundle\") pod \"telemeter-client-7b475d7d59-g7nqc\" (UID: \"caf6bdf0-915a-4fd3-bc7f-2864df11bd57\") " pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc"
Jul 21 04:10:39.014978 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:39.014877    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/caf6bdf0-915a-4fd3-bc7f-2864df11bd57-secret-telemeter-client\") pod \"telemeter-client-7b475d7d59-g7nqc\" (UID: \"caf6bdf0-915a-4fd3-bc7f-2864df11bd57\") " pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc"
Jul 21 04:10:39.015165 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:39.014989    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caf6bdf0-915a-4fd3-bc7f-2864df11bd57-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b475d7d59-g7nqc\" (UID: \"caf6bdf0-915a-4fd3-bc7f-2864df11bd57\") " pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc"
Jul 21 04:10:39.015165 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:39.015026    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfrl5\" (UniqueName: \"kubernetes.io/projected/caf6bdf0-915a-4fd3-bc7f-2864df11bd57-kube-api-access-xfrl5\") pod \"telemeter-client-7b475d7d59-g7nqc\" (UID: \"caf6bdf0-915a-4fd3-bc7f-2864df11bd57\") " pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc"
Jul 21 04:10:39.015165 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:39.015087    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/caf6bdf0-915a-4fd3-bc7f-2864df11bd57-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b475d7d59-g7nqc\" (UID: \"caf6bdf0-915a-4fd3-bc7f-2864df11bd57\") " pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc"
Jul 21 04:10:39.015318 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:39.015204    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/caf6bdf0-915a-4fd3-bc7f-2864df11bd57-federate-client-tls\") pod \"telemeter-client-7b475d7d59-g7nqc\" (UID: \"caf6bdf0-915a-4fd3-bc7f-2864df11bd57\") " pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc"
Jul 21 04:10:39.015843 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:39.015666    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caf6bdf0-915a-4fd3-bc7f-2864df11bd57-serving-certs-ca-bundle\") pod \"telemeter-client-7b475d7d59-g7nqc\" (UID: \"caf6bdf0-915a-4fd3-bc7f-2864df11bd57\") " pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc"
Jul 21 04:10:39.016111 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:39.016092    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caf6bdf0-915a-4fd3-bc7f-2864df11bd57-metrics-client-ca\") pod \"telemeter-client-7b475d7d59-g7nqc\" (UID: \"caf6bdf0-915a-4fd3-bc7f-2864df11bd57\") " pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc"
Jul 21 04:10:39.016979 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:39.016954    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caf6bdf0-915a-4fd3-bc7f-2864df11bd57-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b475d7d59-g7nqc\" (UID: \"caf6bdf0-915a-4fd3-bc7f-2864df11bd57\") " pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc"
Jul 21 04:10:39.017649 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:39.017624    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/caf6bdf0-915a-4fd3-bc7f-2864df11bd57-federate-client-tls\") pod \"telemeter-client-7b475d7d59-g7nqc\" (UID: \"caf6bdf0-915a-4fd3-bc7f-2864df11bd57\") " pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc"
Jul 21 04:10:39.017724 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:39.017703    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/caf6bdf0-915a-4fd3-bc7f-2864df11bd57-secret-telemeter-client\") pod \"telemeter-client-7b475d7d59-g7nqc\" (UID: \"caf6bdf0-915a-4fd3-bc7f-2864df11bd57\") " pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc"
Jul 21 04:10:39.017835 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:39.017819    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/caf6bdf0-915a-4fd3-bc7f-2864df11bd57-telemeter-client-tls\") pod \"telemeter-client-7b475d7d59-g7nqc\" (UID: \"caf6bdf0-915a-4fd3-bc7f-2864df11bd57\") " pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc"
Jul 21 04:10:39.017874 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:39.017861    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/caf6bdf0-915a-4fd3-bc7f-2864df11bd57-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b475d7d59-g7nqc\" (UID: \"caf6bdf0-915a-4fd3-bc7f-2864df11bd57\") " pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc"
Jul 21 04:10:39.023097 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:39.023080    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfrl5\" (UniqueName: \"kubernetes.io/projected/caf6bdf0-915a-4fd3-bc7f-2864df11bd57-kube-api-access-xfrl5\") pod \"telemeter-client-7b475d7d59-g7nqc\" (UID: \"caf6bdf0-915a-4fd3-bc7f-2864df11bd57\") " pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc"
Jul 21 04:10:39.123924 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:39.123902    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc"
Jul 21 04:10:39.249013 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:39.248986    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b475d7d59-g7nqc"]
Jul 21 04:10:39.251118 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:10:39.251091    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaf6bdf0_915a_4fd3_bc7f_2864df11bd57.slice/crio-979de080e544d032d4892a84af3aec4cdb3f4977357c4090655022e032bfd95d WatchSource:0}: Error finding container 979de080e544d032d4892a84af3aec4cdb3f4977357c4090655022e032bfd95d: Status 404 returned error can't find the container with id 979de080e544d032d4892a84af3aec4cdb3f4977357c4090655022e032bfd95d
Jul 21 04:10:39.253063 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:39.253048    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 04:10:39.919615 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:39.919582    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc" event={"ID":"caf6bdf0-915a-4fd3-bc7f-2864df11bd57","Type":"ContainerStarted","Data":"979de080e544d032d4892a84af3aec4cdb3f4977357c4090655022e032bfd95d"}
Jul 21 04:10:41.928166 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:41.928135    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc" event={"ID":"caf6bdf0-915a-4fd3-bc7f-2864df11bd57","Type":"ContainerStarted","Data":"6b2f21826eb7f2a3cfa41ee6ca3ecd3c631c215b47a3e63dce93ac11941fa271"}
Jul 21 04:10:41.928582 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:41.928190    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc" event={"ID":"caf6bdf0-915a-4fd3-bc7f-2864df11bd57","Type":"ContainerStarted","Data":"36a5c0f5fe0a5298c3b60e3448964633341d3fa1da4ef4a923758fe26947de12"}
Jul 21 04:10:41.928582 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:41.928212    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc" event={"ID":"caf6bdf0-915a-4fd3-bc7f-2864df11bd57","Type":"ContainerStarted","Data":"04102f5ac1101ada6cf5982068cefc2603e3fd6af6d39213eeed1d1ab8da367d"}
Jul 21 04:10:41.951901 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:41.951854    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7b475d7d59-g7nqc" podStartSLOduration=1.477466688 podStartE2EDuration="3.951838616s" totalImagesPullingTime="2.474371928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:10:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:10:41.950678215 +0000 UTC m=+371.839731382" watchObservedRunningTime="2026-07-21 04:10:41.951838616 +0000 UTC m=+371.840891780"
Jul 21 04:10:44.451436 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:44.451386    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs\") pod \"network-metrics-daemon-z5xrt\" (UID: \"931a86de-fd82-48a4-996f-b39dbc3d5246\") " pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:10:44.453626 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:44.453608    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/931a86de-fd82-48a4-996f-b39dbc3d5246-metrics-certs\") pod \"network-metrics-daemon-z5xrt\" (UID: \"931a86de-fd82-48a4-996f-b39dbc3d5246\") " pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:10:44.492035 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:44.492005    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-q5j6n\""
Jul 21 04:10:44.500765 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:44.500743    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z5xrt"
Jul 21 04:10:44.624131 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:44.624094    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z5xrt"]
Jul 21 04:10:44.636939 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:10:44.636911    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod931a86de_fd82_48a4_996f_b39dbc3d5246.slice/crio-d78d8c148f52b22a4d3e6a88340e1c920c78c8e7f6e72c24a84fb3c6378b0583 WatchSource:0}: Error finding container d78d8c148f52b22a4d3e6a88340e1c920c78c8e7f6e72c24a84fb3c6378b0583: Status 404 returned error can't find the container with id d78d8c148f52b22a4d3e6a88340e1c920c78c8e7f6e72c24a84fb3c6378b0583
Jul 21 04:10:44.940754 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:44.940719    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z5xrt" event={"ID":"931a86de-fd82-48a4-996f-b39dbc3d5246","Type":"ContainerStarted","Data":"d78d8c148f52b22a4d3e6a88340e1c920c78c8e7f6e72c24a84fb3c6378b0583"}
Jul 21 04:10:46.949397 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:46.949364    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z5xrt" event={"ID":"931a86de-fd82-48a4-996f-b39dbc3d5246","Type":"ContainerStarted","Data":"6584c71e7d1b9608ad157165608d21b003ccf0a83495a21288111fff8e674fb8"}
Jul 21 04:10:46.949740 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:46.949415    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z5xrt" event={"ID":"931a86de-fd82-48a4-996f-b39dbc3d5246","Type":"ContainerStarted","Data":"8e2157b753783d1655cc9b97ececa520b6709329b42447cd74309a5366c48fde"}
Jul 21 04:10:46.967110 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:10:46.967061    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-z5xrt" podStartSLOduration=374.493051854 podStartE2EDuration="6m15.967039679s" totalImagesPullingTime="1.473987825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:04:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:10:46.965446354 +0000 UTC m=+376.854499519" watchObservedRunningTime="2026-07-21 04:10:46.967039679 +0000 UTC m=+376.856092845"
Jul 21 04:13:19.747195 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:19.747153    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nspsm"]
Jul 21 04:13:19.750278 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:19.750252    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-nspsm"
Jul 21 04:13:19.752605 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:19.752575    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-dlc58\""
Jul 21 04:13:19.752722 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:19.752632    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 21 04:13:19.752722 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:19.752632    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 21 04:13:19.763389 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:19.763370    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nspsm"]
Jul 21 04:13:19.873397 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:19.873352    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97c5591f-8b02-483c-8c17-66fe92e05761-bound-sa-token\") pod \"cert-manager-55b4d954d5-nspsm\" (UID: \"97c5591f-8b02-483c-8c17-66fe92e05761\") " pod="cert-manager/cert-manager-55b4d954d5-nspsm"
Jul 21 04:13:19.873397 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:19.873402    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gr9t\" (UniqueName: \"kubernetes.io/projected/97c5591f-8b02-483c-8c17-66fe92e05761-kube-api-access-6gr9t\") pod \"cert-manager-55b4d954d5-nspsm\" (UID: \"97c5591f-8b02-483c-8c17-66fe92e05761\") " pod="cert-manager/cert-manager-55b4d954d5-nspsm"
Jul 21 04:13:19.974472 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:19.974434    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gr9t\" (UniqueName: \"kubernetes.io/projected/97c5591f-8b02-483c-8c17-66fe92e05761-kube-api-access-6gr9t\") pod \"cert-manager-55b4d954d5-nspsm\" (UID: \"97c5591f-8b02-483c-8c17-66fe92e05761\") " pod="cert-manager/cert-manager-55b4d954d5-nspsm"
Jul 21 04:13:19.974647 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:19.974508    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97c5591f-8b02-483c-8c17-66fe92e05761-bound-sa-token\") pod \"cert-manager-55b4d954d5-nspsm\" (UID: \"97c5591f-8b02-483c-8c17-66fe92e05761\") " pod="cert-manager/cert-manager-55b4d954d5-nspsm"
Jul 21 04:13:19.982747 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:19.982716    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97c5591f-8b02-483c-8c17-66fe92e05761-bound-sa-token\") pod \"cert-manager-55b4d954d5-nspsm\" (UID: \"97c5591f-8b02-483c-8c17-66fe92e05761\") " pod="cert-manager/cert-manager-55b4d954d5-nspsm"
Jul 21 04:13:19.982869 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:19.982823    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gr9t\" (UniqueName: \"kubernetes.io/projected/97c5591f-8b02-483c-8c17-66fe92e05761-kube-api-access-6gr9t\") pod \"cert-manager-55b4d954d5-nspsm\" (UID: \"97c5591f-8b02-483c-8c17-66fe92e05761\") " pod="cert-manager/cert-manager-55b4d954d5-nspsm"
Jul 21 04:13:20.058878 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:20.058796    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-nspsm"
Jul 21 04:13:20.185209 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:20.185173    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nspsm"]
Jul 21 04:13:20.188069 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:13:20.188041    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97c5591f_8b02_483c_8c17_66fe92e05761.slice/crio-3e18b7fe1d9127e554bb313496b18561eda1cdb2553130d84ab460b985c714f1 WatchSource:0}: Error finding container 3e18b7fe1d9127e554bb313496b18561eda1cdb2553130d84ab460b985c714f1: Status 404 returned error can't find the container with id 3e18b7fe1d9127e554bb313496b18561eda1cdb2553130d84ab460b985c714f1
Jul 21 04:13:20.483238 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:20.483206    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-nspsm" event={"ID":"97c5591f-8b02-483c-8c17-66fe92e05761","Type":"ContainerStarted","Data":"3e18b7fe1d9127e554bb313496b18561eda1cdb2553130d84ab460b985c714f1"}
Jul 21 04:13:23.496194 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:23.496102    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-nspsm" event={"ID":"97c5591f-8b02-483c-8c17-66fe92e05761","Type":"ContainerStarted","Data":"76af9feb124a5694f0cee19afdcdd689dfe667e666d1c29a550b6fb87e030858"}
Jul 21 04:13:23.512372 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:23.512320    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-nspsm" podStartSLOduration=1.5306775350000001 podStartE2EDuration="4.512304332s" totalImagesPullingTime="2.981626797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:13:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:13:23.511986202 +0000 UTC m=+533.401039396" watchObservedRunningTime="2026-07-21 04:13:23.512304332 +0000 UTC m=+533.401357495"
Jul 21 04:13:44.889481 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:44.889446    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-595b8bf6d6-xbtvl"]
Jul 21 04:13:44.892631 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:44.892615    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-xbtvl"
Jul 21 04:13:44.895139 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:44.895101    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 21 04:13:44.895749 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:44.895734    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-x252j\""
Jul 21 04:13:44.895947 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:44.895924    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 21 04:13:44.896048 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:44.895949    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 21 04:13:44.896048 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:44.895959    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 21 04:13:44.896048 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:44.896036    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 21 04:13:44.905150 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:44.905115    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-595b8bf6d6-xbtvl"]
Jul 21 04:13:44.957885 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:44.957852    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6923f6e4-56a0-4dc5-b05d-7d56196da7fe-cert\") pod \"lws-controller-manager-595b8bf6d6-xbtvl\" (UID: \"6923f6e4-56a0-4dc5-b05d-7d56196da7fe\") " pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-xbtvl"
Jul 21 04:13:44.957885 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:44.957890    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6923f6e4-56a0-4dc5-b05d-7d56196da7fe-manager-config\") pod \"lws-controller-manager-595b8bf6d6-xbtvl\" (UID: \"6923f6e4-56a0-4dc5-b05d-7d56196da7fe\") " pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-xbtvl"
Jul 21 04:13:44.958181 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:44.957914    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8m2z\" (UniqueName: \"kubernetes.io/projected/6923f6e4-56a0-4dc5-b05d-7d56196da7fe-kube-api-access-j8m2z\") pod \"lws-controller-manager-595b8bf6d6-xbtvl\" (UID: \"6923f6e4-56a0-4dc5-b05d-7d56196da7fe\") " pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-xbtvl"
Jul 21 04:13:44.958181 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:44.957986    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6923f6e4-56a0-4dc5-b05d-7d56196da7fe-metrics-cert\") pod \"lws-controller-manager-595b8bf6d6-xbtvl\" (UID: \"6923f6e4-56a0-4dc5-b05d-7d56196da7fe\") " pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-xbtvl"
Jul 21 04:13:45.059406 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:45.059346    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8m2z\" (UniqueName: \"kubernetes.io/projected/6923f6e4-56a0-4dc5-b05d-7d56196da7fe-kube-api-access-j8m2z\") pod \"lws-controller-manager-595b8bf6d6-xbtvl\" (UID: \"6923f6e4-56a0-4dc5-b05d-7d56196da7fe\") " pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-xbtvl"
Jul 21 04:13:45.059625 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:45.059420    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6923f6e4-56a0-4dc5-b05d-7d56196da7fe-metrics-cert\") pod \"lws-controller-manager-595b8bf6d6-xbtvl\" (UID: \"6923f6e4-56a0-4dc5-b05d-7d56196da7fe\") " pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-xbtvl"
Jul 21 04:13:45.059625 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:45.059487    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6923f6e4-56a0-4dc5-b05d-7d56196da7fe-cert\") pod \"lws-controller-manager-595b8bf6d6-xbtvl\" (UID: \"6923f6e4-56a0-4dc5-b05d-7d56196da7fe\") " pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-xbtvl"
Jul 21 04:13:45.059625 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:45.059518    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6923f6e4-56a0-4dc5-b05d-7d56196da7fe-manager-config\") pod \"lws-controller-manager-595b8bf6d6-xbtvl\" (UID: \"6923f6e4-56a0-4dc5-b05d-7d56196da7fe\") " pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-xbtvl"
Jul 21 04:13:45.060220 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:45.060199    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6923f6e4-56a0-4dc5-b05d-7d56196da7fe-manager-config\") pod \"lws-controller-manager-595b8bf6d6-xbtvl\" (UID: \"6923f6e4-56a0-4dc5-b05d-7d56196da7fe\") " pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-xbtvl"
Jul 21 04:13:45.061920 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:45.061892    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6923f6e4-56a0-4dc5-b05d-7d56196da7fe-metrics-cert\") pod \"lws-controller-manager-595b8bf6d6-xbtvl\" (UID: \"6923f6e4-56a0-4dc5-b05d-7d56196da7fe\") " pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-xbtvl"
Jul 21 04:13:45.062014 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:45.061938    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6923f6e4-56a0-4dc5-b05d-7d56196da7fe-cert\") pod \"lws-controller-manager-595b8bf6d6-xbtvl\" (UID: \"6923f6e4-56a0-4dc5-b05d-7d56196da7fe\") " pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-xbtvl"
Jul 21 04:13:45.072515 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:45.072493    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8m2z\" (UniqueName: \"kubernetes.io/projected/6923f6e4-56a0-4dc5-b05d-7d56196da7fe-kube-api-access-j8m2z\") pod \"lws-controller-manager-595b8bf6d6-xbtvl\" (UID: \"6923f6e4-56a0-4dc5-b05d-7d56196da7fe\") " pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-xbtvl"
Jul 21 04:13:45.202297 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:45.202206    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-xbtvl"
Jul 21 04:13:45.332216 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:45.332182    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-595b8bf6d6-xbtvl"]
Jul 21 04:13:45.335204 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:13:45.335180    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6923f6e4_56a0_4dc5_b05d_7d56196da7fe.slice/crio-8594474a388de290166ee23000670f8f9955a9308458a46861a1822aefc9764b WatchSource:0}: Error finding container 8594474a388de290166ee23000670f8f9955a9308458a46861a1822aefc9764b: Status 404 returned error can't find the container with id 8594474a388de290166ee23000670f8f9955a9308458a46861a1822aefc9764b
Jul 21 04:13:45.574743 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:45.574657    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-xbtvl" event={"ID":"6923f6e4-56a0-4dc5-b05d-7d56196da7fe","Type":"ContainerStarted","Data":"8594474a388de290166ee23000670f8f9955a9308458a46861a1822aefc9764b"}
Jul 21 04:13:48.189010 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:48.188980    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-8lg85"]
Jul 21 04:13:48.192177 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:48.192161    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-8lg85"
Jul 21 04:13:48.194492 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:48.194467    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 21 04:13:48.194601 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:48.194555    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 21 04:13:48.194770 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:48.194755    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 21 04:13:48.195901 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:48.195885    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-k7b2b\""
Jul 21 04:13:48.196168 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:48.196154    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 21 04:13:48.213374 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:48.213346    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-8lg85"]
Jul 21 04:13:48.284347 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:48.284265    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d1fd5901-e47c-450d-ba2d-37e37a7dee30-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-8lg85\" (UID: \"d1fd5901-e47c-450d-ba2d-37e37a7dee30\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-8lg85"
Jul 21 04:13:48.284347 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:48.284309    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d1fd5901-e47c-450d-ba2d-37e37a7dee30-manifests\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-8lg85\" (UID: \"d1fd5901-e47c-450d-ba2d-37e37a7dee30\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-8lg85"
Jul 21 04:13:48.284530 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:48.284396    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s7nr\" (UniqueName: \"kubernetes.io/projected/d1fd5901-e47c-450d-ba2d-37e37a7dee30-kube-api-access-8s7nr\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-8lg85\" (UID: \"d1fd5901-e47c-450d-ba2d-37e37a7dee30\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-8lg85"
Jul 21 04:13:48.284530 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:48.284454    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1fd5901-e47c-450d-ba2d-37e37a7dee30-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-8lg85\" (UID: \"d1fd5901-e47c-450d-ba2d-37e37a7dee30\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-8lg85"
Jul 21 04:13:48.284530 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:48.284475    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1fd5901-e47c-450d-ba2d-37e37a7dee30-tmp\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-8lg85\" (UID: \"d1fd5901-e47c-450d-ba2d-37e37a7dee30\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-8lg85"
Jul 21 04:13:48.385056 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:48.385025    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1fd5901-e47c-450d-ba2d-37e37a7dee30-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-8lg85\" (UID: \"d1fd5901-e47c-450d-ba2d-37e37a7dee30\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-8lg85"
Jul 21 04:13:48.385056 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:48.385058    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1fd5901-e47c-450d-ba2d-37e37a7dee30-tmp\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-8lg85\" (UID: \"d1fd5901-e47c-450d-ba2d-37e37a7dee30\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-8lg85"
Jul 21 04:13:48.385240 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:48.385090    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d1fd5901-e47c-450d-ba2d-37e37a7dee30-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-8lg85\" (UID: \"d1fd5901-e47c-450d-ba2d-37e37a7dee30\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-8lg85"
Jul 21 04:13:48.385240 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:48.385118    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d1fd5901-e47c-450d-ba2d-37e37a7dee30-manifests\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-8lg85\" (UID: \"d1fd5901-e47c-450d-ba2d-37e37a7dee30\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-8lg85"
Jul 21 04:13:48.385240 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:48.385185    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s7nr\" (UniqueName: \"kubernetes.io/projected/d1fd5901-e47c-450d-ba2d-37e37a7dee30-kube-api-access-8s7nr\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-8lg85\" (UID: \"d1fd5901-e47c-450d-ba2d-37e37a7dee30\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-8lg85"
Jul 21 04:13:48.385586 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:48.385565    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d1fd5901-e47c-450d-ba2d-37e37a7dee30-manifests\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-8lg85\" (UID: \"d1fd5901-e47c-450d-ba2d-37e37a7dee30\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-8lg85"
Jul 21 04:13:48.387296 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:48.387268    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1fd5901-e47c-450d-ba2d-37e37a7dee30-tmp\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-8lg85\" (UID: \"d1fd5901-e47c-450d-ba2d-37e37a7dee30\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-8lg85"
Jul 21 04:13:48.387578 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:48.387559    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1fd5901-e47c-450d-ba2d-37e37a7dee30-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-8lg85\" (UID: \"d1fd5901-e47c-450d-ba2d-37e37a7dee30\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-8lg85"
Jul 21 04:13:48.387651 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:48.387560    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d1fd5901-e47c-450d-ba2d-37e37a7dee30-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-8lg85\" (UID: \"d1fd5901-e47c-450d-ba2d-37e37a7dee30\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-8lg85"
Jul 21 04:13:48.393495 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:48.393474    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s7nr\" (UniqueName: \"kubernetes.io/projected/d1fd5901-e47c-450d-ba2d-37e37a7dee30-kube-api-access-8s7nr\") pod \"opendatahub-operator-controller-manager-6d6b969ff8-8lg85\" (UID: \"d1fd5901-e47c-450d-ba2d-37e37a7dee30\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-8lg85"
Jul 21 04:13:48.502005 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:48.501971    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-8lg85"
Jul 21 04:13:48.592534 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:48.592499    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-xbtvl" event={"ID":"6923f6e4-56a0-4dc5-b05d-7d56196da7fe","Type":"ContainerStarted","Data":"f7b396dab1e6fdeae84d61bfd00a08f3a787782db54f90d4ade95328e5c9b3a7"}
Jul 21 04:13:48.592724 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:48.592592    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-xbtvl"
Jul 21 04:13:48.611368 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:48.611319    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-xbtvl" podStartSLOduration=1.966843033 podStartE2EDuration="4.611304378s" totalImagesPullingTime="2.644461345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:13:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:13:48.610016757 +0000 UTC m=+558.499069934" watchObservedRunningTime="2026-07-21 04:13:48.611304378 +0000 UTC m=+558.500357542"
Jul 21 04:13:48.636585 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:48.636557    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-8lg85"]
Jul 21 04:13:48.640689 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:13:48.640668    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1fd5901_e47c_450d_ba2d_37e37a7dee30.slice/crio-a1e7aa8268d18df84d593c1c408c2fa8e817867f7be34193e68c56b05effc11c WatchSource:0}: Error finding container a1e7aa8268d18df84d593c1c408c2fa8e817867f7be34193e68c56b05effc11c: Status 404 returned error can't find the container with id a1e7aa8268d18df84d593c1c408c2fa8e817867f7be34193e68c56b05effc11c
Jul 21 04:13:49.599579 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:49.599543    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-8lg85" event={"ID":"d1fd5901-e47c-450d-ba2d-37e37a7dee30","Type":"ContainerStarted","Data":"a1e7aa8268d18df84d593c1c408c2fa8e817867f7be34193e68c56b05effc11c"}
Jul 21 04:13:52.614263 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:52.614222    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-8lg85" event={"ID":"d1fd5901-e47c-450d-ba2d-37e37a7dee30","Type":"ContainerStarted","Data":"45f239d3bee7af2e361fb2ee5d884ba26bfed59fbfd6d970394604380abbd8b5"}
Jul 21 04:13:53.619373 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:53.619343    2580 generic.go:356] "Generic (PLEG): container finished" podID="d1fd5901-e47c-450d-ba2d-37e37a7dee30" containerID="45f239d3bee7af2e361fb2ee5d884ba26bfed59fbfd6d970394604380abbd8b5" exitCode=0
Jul 21 04:13:53.619721 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:53.619384    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-8lg85" event={"ID":"d1fd5901-e47c-450d-ba2d-37e37a7dee30","Type":"ContainerDied","Data":"45f239d3bee7af2e361fb2ee5d884ba26bfed59fbfd6d970394604380abbd8b5"}
Jul 21 04:13:54.624543 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:54.624503    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-8lg85" event={"ID":"d1fd5901-e47c-450d-ba2d-37e37a7dee30","Type":"ContainerStarted","Data":"46e092ed39cbfa34d5ce3af738e49ddfb7da20d339ffb99abc9159bbccbd708d"}
Jul 21 04:13:54.625101 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:54.625084    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-8lg85"
Jul 21 04:13:54.647737 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:54.647688    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-8lg85" podStartSLOduration=1.9770955510000001 podStartE2EDuration="6.647670839s" totalImagesPullingTime="3.649513306s" totalInitContainerRuntime="1.021061982s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:13:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:13:54.646448062 +0000 UTC m=+564.535501226" watchObservedRunningTime="2026-07-21 04:13:54.647670839 +0000 UTC m=+564.536724005"
Jul 21 04:13:59.601768 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:13:59.601732    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-595b8bf6d6-xbtvl"
Jul 21 04:14:06.634256 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:06.634226    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d6b969ff8-8lg85"
Jul 21 04:14:16.752232 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:16.752196    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"]
Jul 21 04:14:16.760583 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:16.760559    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:16.764549 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:16.764521    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-mxp69\""
Jul 21 04:14:16.765067 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:16.765051    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 21 04:14:16.765295 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:16.765281    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 21 04:14:16.765474 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:16.765460    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 21 04:14:16.790735 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:16.790707    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"]
Jul 21 04:14:16.839115 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:16.839084    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"]
Jul 21 04:14:16.842360 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:16.842340    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:16.859076 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:16.859053    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"]
Jul 21 04:14:16.924916 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:16.924881    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc1e39c7-364d-47b3-9efb-592249fa648e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-spcsq\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:16.925085 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:16.924927    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc1e39c7-364d-47b3-9efb-592249fa648e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-spcsq\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:16.925085 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:16.924948    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc1e39c7-364d-47b3-9efb-592249fa648e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-spcsq\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:16.925085 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:16.924996    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc1e39c7-364d-47b3-9efb-592249fa648e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-spcsq\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:16.925085 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:16.925028    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6q5b\" (UniqueName: \"kubernetes.io/projected/dc1e39c7-364d-47b3-9efb-592249fa648e-kube-api-access-b6q5b\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-spcsq\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:16.925085 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:16.925067    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc1e39c7-364d-47b3-9efb-592249fa648e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-spcsq\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:16.925085 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:16.925084    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc1e39c7-364d-47b3-9efb-592249fa648e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-spcsq\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:16.925329 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:16.925182    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc1e39c7-364d-47b3-9efb-592249fa648e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-spcsq\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:16.925329 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:16.925216    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc1e39c7-364d-47b3-9efb-592249fa648e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-spcsq\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:17.026106 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.026036    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc1e39c7-364d-47b3-9efb-592249fa648e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-spcsq\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:17.026106 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.026070    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/985caf99-95d1-4450-a030-b81ed05cf0eb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgcws\" (UID: \"985caf99-95d1-4450-a030-b81ed05cf0eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:17.026106 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.026097    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlfjq\" (UniqueName: \"kubernetes.io/projected/985caf99-95d1-4450-a030-b81ed05cf0eb-kube-api-access-zlfjq\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgcws\" (UID: \"985caf99-95d1-4450-a030-b81ed05cf0eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:17.026352 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.026137    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc1e39c7-364d-47b3-9efb-592249fa648e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-spcsq\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:17.026352 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.026166    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc1e39c7-364d-47b3-9efb-592249fa648e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-spcsq\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:17.026352 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.026189    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/985caf99-95d1-4450-a030-b81ed05cf0eb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgcws\" (UID: \"985caf99-95d1-4450-a030-b81ed05cf0eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:17.026352 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.026221    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/985caf99-95d1-4450-a030-b81ed05cf0eb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgcws\" (UID: \"985caf99-95d1-4450-a030-b81ed05cf0eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:17.026352 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.026252    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc1e39c7-364d-47b3-9efb-592249fa648e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-spcsq\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:17.026352 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.026269    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/985caf99-95d1-4450-a030-b81ed05cf0eb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgcws\" (UID: \"985caf99-95d1-4450-a030-b81ed05cf0eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:17.026352 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.026299    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc1e39c7-364d-47b3-9efb-592249fa648e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-spcsq\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:17.026688 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.026424    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc1e39c7-364d-47b3-9efb-592249fa648e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-spcsq\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:17.026688 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.026463    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc1e39c7-364d-47b3-9efb-592249fa648e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-spcsq\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:17.026688 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.026509    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6q5b\" (UniqueName: \"kubernetes.io/projected/dc1e39c7-364d-47b3-9efb-592249fa648e-kube-api-access-b6q5b\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-spcsq\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:17.026688 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.026543    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc1e39c7-364d-47b3-9efb-592249fa648e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-spcsq\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:17.026688 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.026549    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc1e39c7-364d-47b3-9efb-592249fa648e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-spcsq\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:17.026688 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.026589    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/985caf99-95d1-4450-a030-b81ed05cf0eb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgcws\" (UID: \"985caf99-95d1-4450-a030-b81ed05cf0eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:17.026688 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.026662    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc1e39c7-364d-47b3-9efb-592249fa648e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-spcsq\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:17.026991 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.026690    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc1e39c7-364d-47b3-9efb-592249fa648e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-spcsq\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:17.026991 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.026723    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/985caf99-95d1-4450-a030-b81ed05cf0eb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgcws\" (UID: \"985caf99-95d1-4450-a030-b81ed05cf0eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:17.026991 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.026760    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/985caf99-95d1-4450-a030-b81ed05cf0eb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgcws\" (UID: \"985caf99-95d1-4450-a030-b81ed05cf0eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:17.026991 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.026810    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/985caf99-95d1-4450-a030-b81ed05cf0eb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgcws\" (UID: \"985caf99-95d1-4450-a030-b81ed05cf0eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:17.026991 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.026933    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc1e39c7-364d-47b3-9efb-592249fa648e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-spcsq\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:17.027489 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.027467    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc1e39c7-364d-47b3-9efb-592249fa648e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-spcsq\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:17.028723 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.028693    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc1e39c7-364d-47b3-9efb-592249fa648e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-spcsq\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:17.028896 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.028879    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc1e39c7-364d-47b3-9efb-592249fa648e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-spcsq\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:17.034936 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.034914    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc1e39c7-364d-47b3-9efb-592249fa648e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-spcsq\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:17.035260 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.035236    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6q5b\" (UniqueName: \"kubernetes.io/projected/dc1e39c7-364d-47b3-9efb-592249fa648e-kube-api-access-b6q5b\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-spcsq\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:17.070393 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.070369    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:17.128361 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.127939    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/985caf99-95d1-4450-a030-b81ed05cf0eb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgcws\" (UID: \"985caf99-95d1-4450-a030-b81ed05cf0eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:17.128361 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.127994    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/985caf99-95d1-4450-a030-b81ed05cf0eb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgcws\" (UID: \"985caf99-95d1-4450-a030-b81ed05cf0eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:17.128361 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.128028    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/985caf99-95d1-4450-a030-b81ed05cf0eb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgcws\" (UID: \"985caf99-95d1-4450-a030-b81ed05cf0eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:17.128361 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.128064    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/985caf99-95d1-4450-a030-b81ed05cf0eb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgcws\" (UID: \"985caf99-95d1-4450-a030-b81ed05cf0eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:17.128361 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.128095    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/985caf99-95d1-4450-a030-b81ed05cf0eb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgcws\" (UID: \"985caf99-95d1-4450-a030-b81ed05cf0eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:17.128361 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.128148    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlfjq\" (UniqueName: \"kubernetes.io/projected/985caf99-95d1-4450-a030-b81ed05cf0eb-kube-api-access-zlfjq\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgcws\" (UID: \"985caf99-95d1-4450-a030-b81ed05cf0eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:17.128361 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.128191    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/985caf99-95d1-4450-a030-b81ed05cf0eb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgcws\" (UID: \"985caf99-95d1-4450-a030-b81ed05cf0eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:17.128361 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.128225    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/985caf99-95d1-4450-a030-b81ed05cf0eb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgcws\" (UID: \"985caf99-95d1-4450-a030-b81ed05cf0eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:17.128361 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.128255    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/985caf99-95d1-4450-a030-b81ed05cf0eb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgcws\" (UID: \"985caf99-95d1-4450-a030-b81ed05cf0eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:17.128901 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.128433    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/985caf99-95d1-4450-a030-b81ed05cf0eb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgcws\" (UID: \"985caf99-95d1-4450-a030-b81ed05cf0eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:17.129394 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.129087    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/985caf99-95d1-4450-a030-b81ed05cf0eb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgcws\" (UID: \"985caf99-95d1-4450-a030-b81ed05cf0eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:17.129394 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.129092    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/985caf99-95d1-4450-a030-b81ed05cf0eb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgcws\" (UID: \"985caf99-95d1-4450-a030-b81ed05cf0eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:17.129394 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.129341    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/985caf99-95d1-4450-a030-b81ed05cf0eb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgcws\" (UID: \"985caf99-95d1-4450-a030-b81ed05cf0eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:17.129606 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.129453    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/985caf99-95d1-4450-a030-b81ed05cf0eb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgcws\" (UID: \"985caf99-95d1-4450-a030-b81ed05cf0eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:17.131708 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.131667    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/985caf99-95d1-4450-a030-b81ed05cf0eb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgcws\" (UID: \"985caf99-95d1-4450-a030-b81ed05cf0eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:17.132939 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.132883    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/985caf99-95d1-4450-a030-b81ed05cf0eb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgcws\" (UID: \"985caf99-95d1-4450-a030-b81ed05cf0eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:17.137290 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.137114    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/985caf99-95d1-4450-a030-b81ed05cf0eb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgcws\" (UID: \"985caf99-95d1-4450-a030-b81ed05cf0eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:17.138193 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.138150    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlfjq\" (UniqueName: \"kubernetes.io/projected/985caf99-95d1-4450-a030-b81ed05cf0eb-kube-api-access-zlfjq\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qgcws\" (UID: \"985caf99-95d1-4450-a030-b81ed05cf0eb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:17.152814 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.152784    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:17.211730 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.211646    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"]
Jul 21 04:14:17.216511 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:14:17.216481    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc1e39c7_364d_47b3_9efb_592249fa648e.slice/crio-86c6096e8ff869dd36575cab9babfacf0a7afacc753f981a96439d310fec9676 WatchSource:0}: Error finding container 86c6096e8ff869dd36575cab9babfacf0a7afacc753f981a96439d310fec9676: Status 404 returned error can't find the container with id 86c6096e8ff869dd36575cab9babfacf0a7afacc753f981a96439d310fec9676
Jul 21 04:14:17.299733 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.299609    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"]
Jul 21 04:14:17.302212 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:14:17.302186    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod985caf99_95d1_4450_a030_b81ed05cf0eb.slice/crio-0c29e7e20810cfe0244b785c70afbb13b2238e3c542a5fd7fe3d6ad7ca5eb635 WatchSource:0}: Error finding container 0c29e7e20810cfe0244b785c70afbb13b2238e3c542a5fd7fe3d6ad7ca5eb635: Status 404 returned error can't find the container with id 0c29e7e20810cfe0244b785c70afbb13b2238e3c542a5fd7fe3d6ad7ca5eb635
Jul 21 04:14:17.707293 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.707262    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws" event={"ID":"985caf99-95d1-4450-a030-b81ed05cf0eb","Type":"ContainerStarted","Data":"0c29e7e20810cfe0244b785c70afbb13b2238e3c542a5fd7fe3d6ad7ca5eb635"}
Jul 21 04:14:17.708375 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:17.708350    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq" event={"ID":"dc1e39c7-364d-47b3-9efb-592249fa648e","Type":"ContainerStarted","Data":"86c6096e8ff869dd36575cab9babfacf0a7afacc753f981a96439d310fec9676"}
Jul 21 04:14:19.450546 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:19.450510    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h"]
Jul 21 04:14:19.457584 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:19.457561    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h"
Jul 21 04:14:19.460015 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:19.459990    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 21 04:14:19.460283 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:19.460264    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 21 04:14:19.460386 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:19.460292    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 21 04:14:19.460386 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:19.460294    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-w4qmw\""
Jul 21 04:14:19.466154 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:19.466099    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h"]
Jul 21 04:14:19.649826 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:19.649791    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/66402a62-9562-46fb-a06c-5906f5df9ef3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-82d8h\" (UID: \"66402a62-9562-46fb-a06c-5906f5df9ef3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h"
Jul 21 04:14:19.650006 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:19.649834    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/66402a62-9562-46fb-a06c-5906f5df9ef3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-82d8h\" (UID: \"66402a62-9562-46fb-a06c-5906f5df9ef3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h"
Jul 21 04:14:19.650006 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:19.649870    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w4vx\" (UniqueName: \"kubernetes.io/projected/66402a62-9562-46fb-a06c-5906f5df9ef3-kube-api-access-9w4vx\") pod \"istiod-openshift-gateway-94bb8fbfd-82d8h\" (UID: \"66402a62-9562-46fb-a06c-5906f5df9ef3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h"
Jul 21 04:14:19.650006 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:19.649955    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/66402a62-9562-46fb-a06c-5906f5df9ef3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-82d8h\" (UID: \"66402a62-9562-46fb-a06c-5906f5df9ef3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h"
Jul 21 04:14:19.650006 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:19.649975    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66402a62-9562-46fb-a06c-5906f5df9ef3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-82d8h\" (UID: \"66402a62-9562-46fb-a06c-5906f5df9ef3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h"
Jul 21 04:14:19.650006 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:19.649999    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/66402a62-9562-46fb-a06c-5906f5df9ef3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-82d8h\" (UID: \"66402a62-9562-46fb-a06c-5906f5df9ef3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h"
Jul 21 04:14:19.650261 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:19.650033    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/66402a62-9562-46fb-a06c-5906f5df9ef3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-82d8h\" (UID: \"66402a62-9562-46fb-a06c-5906f5df9ef3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h"
Jul 21 04:14:19.750893 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:19.750820    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/66402a62-9562-46fb-a06c-5906f5df9ef3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-82d8h\" (UID: \"66402a62-9562-46fb-a06c-5906f5df9ef3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h"
Jul 21 04:14:19.750893 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:19.750856    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66402a62-9562-46fb-a06c-5906f5df9ef3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-82d8h\" (UID: \"66402a62-9562-46fb-a06c-5906f5df9ef3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h"
Jul 21 04:14:19.750893 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:19.750881    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/66402a62-9562-46fb-a06c-5906f5df9ef3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-82d8h\" (UID: \"66402a62-9562-46fb-a06c-5906f5df9ef3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h"
Jul 21 04:14:19.751194 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:19.750927    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/66402a62-9562-46fb-a06c-5906f5df9ef3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-82d8h\" (UID: \"66402a62-9562-46fb-a06c-5906f5df9ef3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h"
Jul 21 04:14:19.751194 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:19.750967    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/66402a62-9562-46fb-a06c-5906f5df9ef3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-82d8h\" (UID: \"66402a62-9562-46fb-a06c-5906f5df9ef3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h"
Jul 21 04:14:19.751194 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:19.750994    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/66402a62-9562-46fb-a06c-5906f5df9ef3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-82d8h\" (UID: \"66402a62-9562-46fb-a06c-5906f5df9ef3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h"
Jul 21 04:14:19.751194 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:19.751028    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w4vx\" (UniqueName: \"kubernetes.io/projected/66402a62-9562-46fb-a06c-5906f5df9ef3-kube-api-access-9w4vx\") pod \"istiod-openshift-gateway-94bb8fbfd-82d8h\" (UID: \"66402a62-9562-46fb-a06c-5906f5df9ef3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h"
Jul 21 04:14:19.751961 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:19.751934    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/66402a62-9562-46fb-a06c-5906f5df9ef3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-82d8h\" (UID: \"66402a62-9562-46fb-a06c-5906f5df9ef3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h"
Jul 21 04:14:19.753713 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:19.753691    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/66402a62-9562-46fb-a06c-5906f5df9ef3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-82d8h\" (UID: \"66402a62-9562-46fb-a06c-5906f5df9ef3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h"
Jul 21 04:14:19.753842 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:19.753741    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/66402a62-9562-46fb-a06c-5906f5df9ef3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-82d8h\" (UID: \"66402a62-9562-46fb-a06c-5906f5df9ef3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h"
Jul 21 04:14:19.753907 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:19.753888    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/66402a62-9562-46fb-a06c-5906f5df9ef3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-82d8h\" (UID: \"66402a62-9562-46fb-a06c-5906f5df9ef3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h"
Jul 21 04:14:19.754074 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:19.754052    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/66402a62-9562-46fb-a06c-5906f5df9ef3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-82d8h\" (UID: \"66402a62-9562-46fb-a06c-5906f5df9ef3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h"
Jul 21 04:14:19.759520 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:19.759498    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66402a62-9562-46fb-a06c-5906f5df9ef3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-82d8h\" (UID: \"66402a62-9562-46fb-a06c-5906f5df9ef3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h"
Jul 21 04:14:19.759671 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:19.759652    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w4vx\" (UniqueName: \"kubernetes.io/projected/66402a62-9562-46fb-a06c-5906f5df9ef3-kube-api-access-9w4vx\") pod \"istiod-openshift-gateway-94bb8fbfd-82d8h\" (UID: \"66402a62-9562-46fb-a06c-5906f5df9ef3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h"
Jul 21 04:14:19.770052 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:19.769968    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h"
Jul 21 04:14:20.129302 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:20.129255    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:14:20.129413 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:20.129355    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:14:20.129413 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:20.129403    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:14:20.136634 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:20.136598    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:14:20.136739 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:20.136668    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:14:20.136739 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:20.136715    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:14:20.210793 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:20.209841    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h"]
Jul 21 04:14:20.726575 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:20.726540    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq" event={"ID":"dc1e39c7-364d-47b3-9efb-592249fa648e","Type":"ContainerStarted","Data":"cf5cdb1ae902c985b17925568f4fad3b8921f5a13a8c994b2ad20abe3734d99d"}
Jul 21 04:14:20.728469 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:20.728439    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h" event={"ID":"66402a62-9562-46fb-a06c-5906f5df9ef3","Type":"ContainerStarted","Data":"dbc69bde5e9a7a0763209d9aaa027b8c6f7eec073d9f3470c93e03e68d941906"}
Jul 21 04:14:20.730286 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:20.730257    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws" event={"ID":"985caf99-95d1-4450-a030-b81ed05cf0eb","Type":"ContainerStarted","Data":"7d52ac3681a881c79613288f79bac29132952e2601bf3895fd39937847aa2aaf"}
Jul 21 04:14:20.769391 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:20.769331    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq" podStartSLOduration=1.8515687490000001 podStartE2EDuration="4.769285155s" totalImagesPullingTime="2.917716406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:14:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:14:20.7665116 +0000 UTC m=+590.655564769" watchObservedRunningTime="2026-07-21 04:14:20.769285155 +0000 UTC m=+590.658338320"
Jul 21 04:14:20.805308 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:20.805248    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws" podStartSLOduration=1.9809353889999999 podStartE2EDuration="4.805226729s" totalImagesPullingTime="2.82429134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:14:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:14:20.804351534 +0000 UTC m=+590.693404699" watchObservedRunningTime="2026-07-21 04:14:20.805226729 +0000 UTC m=+590.694279913"
Jul 21 04:14:21.071264 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:21.071175    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:21.072868 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:21.072835    2580 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.19:15021/healthz/ready\": dial tcp 10.134.0.19:15021: connect: connection refused" start-of-body=
Jul 21 04:14:21.073002 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:21.072896    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq" podUID="dc1e39c7-364d-47b3-9efb-592249fa648e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.19:15021/healthz/ready\": dial tcp 10.134.0.19:15021: connect: connection refused"
Jul 21 04:14:21.153417 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:21.153360    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:21.158890 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:21.158870    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:21.735470 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:21.735434    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:21.736711 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:21.736687    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qgcws"
Jul 21 04:14:21.807608 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:21.807578    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"]
Jul 21 04:14:22.070901 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:22.070818    2580 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.19:15021/healthz/ready\": dial tcp 10.134.0.19:15021: connect: connection refused" start-of-body=
Jul 21 04:14:22.070901 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:22.070888    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq" podUID="dc1e39c7-364d-47b3-9efb-592249fa648e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.19:15021/healthz/ready\": dial tcp 10.134.0.19:15021: connect: connection refused"
Jul 21 04:14:22.346010 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:22.345978    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:14:22.346102 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:22.346044    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:14:22.742310 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:22.742259    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h" event={"ID":"66402a62-9562-46fb-a06c-5906f5df9ef3","Type":"ContainerStarted","Data":"7b2bf6804d9d77945fe24f11135a46f6fef0fec54ae7946ed8be32bf472ac145"}
Jul 21 04:14:22.742813 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:22.742795    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h"
Jul 21 04:14:22.771620 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:22.771561    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h" podStartSLOduration=1.638590357 podStartE2EDuration="3.771543403s" totalImagesPullingTime="2.132953046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:14:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:14:22.769326466 +0000 UTC m=+592.658379653" watchObservedRunningTime="2026-07-21 04:14:22.771543403 +0000 UTC m=+592.660596567"
Jul 21 04:14:23.071109 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:23.071022    2580 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.19:15021/healthz/ready\": dial tcp 10.134.0.19:15021: connect: connection refused" start-of-body=
Jul 21 04:14:23.071109 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:23.071078    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq" podUID="dc1e39c7-364d-47b3-9efb-592249fa648e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.19:15021/healthz/ready\": dial tcp 10.134.0.19:15021: connect: connection refused"
Jul 21 04:14:23.746547 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:23.746505    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq" podUID="dc1e39c7-364d-47b3-9efb-592249fa648e" containerName="istio-proxy" containerID="cri-o://cf5cdb1ae902c985b17925568f4fad3b8921f5a13a8c994b2ad20abe3734d99d" gracePeriod=30
Jul 21 04:14:23.748236 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:23.748211    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-82d8h"
Jul 21 04:14:28.986691 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:28.986667    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:29.029655 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.029594    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc1e39c7-364d-47b3-9efb-592249fa648e-istiod-ca-cert\") pod \"dc1e39c7-364d-47b3-9efb-592249fa648e\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") "
Jul 21 04:14:29.029655 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.029630    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc1e39c7-364d-47b3-9efb-592249fa648e-credential-socket\") pod \"dc1e39c7-364d-47b3-9efb-592249fa648e\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") "
Jul 21 04:14:29.029833 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.029677    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc1e39c7-364d-47b3-9efb-592249fa648e-workload-socket\") pod \"dc1e39c7-364d-47b3-9efb-592249fa648e\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") "
Jul 21 04:14:29.029833 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.029706    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6q5b\" (UniqueName: \"kubernetes.io/projected/dc1e39c7-364d-47b3-9efb-592249fa648e-kube-api-access-b6q5b\") pod \"dc1e39c7-364d-47b3-9efb-592249fa648e\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") "
Jul 21 04:14:29.029833 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.029768    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc1e39c7-364d-47b3-9efb-592249fa648e-istio-envoy\") pod \"dc1e39c7-364d-47b3-9efb-592249fa648e\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") "
Jul 21 04:14:29.029833 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.029807    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc1e39c7-364d-47b3-9efb-592249fa648e-istio-podinfo\") pod \"dc1e39c7-364d-47b3-9efb-592249fa648e\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") "
Jul 21 04:14:29.029833 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.029832    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc1e39c7-364d-47b3-9efb-592249fa648e-workload-certs\") pod \"dc1e39c7-364d-47b3-9efb-592249fa648e\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") "
Jul 21 04:14:29.030073 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.029861    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc1e39c7-364d-47b3-9efb-592249fa648e-istio-token\") pod \"dc1e39c7-364d-47b3-9efb-592249fa648e\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") "
Jul 21 04:14:29.030073 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.029890    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc1e39c7-364d-47b3-9efb-592249fa648e-istio-data\") pod \"dc1e39c7-364d-47b3-9efb-592249fa648e\" (UID: \"dc1e39c7-364d-47b3-9efb-592249fa648e\") "
Jul 21 04:14:29.030073 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.029935    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc1e39c7-364d-47b3-9efb-592249fa648e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dc1e39c7-364d-47b3-9efb-592249fa648e" (UID: "dc1e39c7-364d-47b3-9efb-592249fa648e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:14:29.030073 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.029984    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc1e39c7-364d-47b3-9efb-592249fa648e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dc1e39c7-364d-47b3-9efb-592249fa648e" (UID: "dc1e39c7-364d-47b3-9efb-592249fa648e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:14:29.030299 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.030091    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc1e39c7-364d-47b3-9efb-592249fa648e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dc1e39c7-364d-47b3-9efb-592249fa648e" (UID: "dc1e39c7-364d-47b3-9efb-592249fa648e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:14:29.030299 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.030143    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc1e39c7-364d-47b3-9efb-592249fa648e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dc1e39c7-364d-47b3-9efb-592249fa648e" (UID: "dc1e39c7-364d-47b3-9efb-592249fa648e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:14:29.030299 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.030206    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc1e39c7-364d-47b3-9efb-592249fa648e-workload-certs\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:14:29.030299 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.030246    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc1e39c7-364d-47b3-9efb-592249fa648e-istiod-ca-cert\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:14:29.030299 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.030261    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc1e39c7-364d-47b3-9efb-592249fa648e-credential-socket\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:14:29.030299 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.030269    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc1e39c7-364d-47b3-9efb-592249fa648e-workload-socket\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:14:29.030299 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.030276    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc1e39c7-364d-47b3-9efb-592249fa648e-istio-data" (OuterVolumeSpecName: "istio-data") pod "dc1e39c7-364d-47b3-9efb-592249fa648e" (UID: "dc1e39c7-364d-47b3-9efb-592249fa648e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:14:29.032116 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.032086    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc1e39c7-364d-47b3-9efb-592249fa648e-istio-token" (OuterVolumeSpecName: "istio-token") pod "dc1e39c7-364d-47b3-9efb-592249fa648e" (UID: "dc1e39c7-364d-47b3-9efb-592249fa648e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:14:29.032232 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.032143    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dc1e39c7-364d-47b3-9efb-592249fa648e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dc1e39c7-364d-47b3-9efb-592249fa648e" (UID: "dc1e39c7-364d-47b3-9efb-592249fa648e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 04:14:29.032344 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.032326    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc1e39c7-364d-47b3-9efb-592249fa648e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dc1e39c7-364d-47b3-9efb-592249fa648e" (UID: "dc1e39c7-364d-47b3-9efb-592249fa648e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:14:29.032402 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.032361    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc1e39c7-364d-47b3-9efb-592249fa648e-kube-api-access-b6q5b" (OuterVolumeSpecName: "kube-api-access-b6q5b") pod "dc1e39c7-364d-47b3-9efb-592249fa648e" (UID: "dc1e39c7-364d-47b3-9efb-592249fa648e"). InnerVolumeSpecName "kube-api-access-b6q5b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:14:29.130970 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.130939    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6q5b\" (UniqueName: \"kubernetes.io/projected/dc1e39c7-364d-47b3-9efb-592249fa648e-kube-api-access-b6q5b\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:14:29.130970 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.130964    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc1e39c7-364d-47b3-9efb-592249fa648e-istio-envoy\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:14:29.130970 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.130974    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc1e39c7-364d-47b3-9efb-592249fa648e-istio-podinfo\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:14:29.131247 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.130981    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc1e39c7-364d-47b3-9efb-592249fa648e-istio-token\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:14:29.131247 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.130990    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc1e39c7-364d-47b3-9efb-592249fa648e-istio-data\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:14:29.772656 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.772616    2580 generic.go:356] "Generic (PLEG): container finished" podID="dc1e39c7-364d-47b3-9efb-592249fa648e" containerID="cf5cdb1ae902c985b17925568f4fad3b8921f5a13a8c994b2ad20abe3734d99d" exitCode=0
Jul 21 04:14:29.772822 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.772683    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq" event={"ID":"dc1e39c7-364d-47b3-9efb-592249fa648e","Type":"ContainerDied","Data":"cf5cdb1ae902c985b17925568f4fad3b8921f5a13a8c994b2ad20abe3734d99d"}
Jul 21 04:14:29.772822 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.772695    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"
Jul 21 04:14:29.772822 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.772733    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq" event={"ID":"dc1e39c7-364d-47b3-9efb-592249fa648e","Type":"ContainerDied","Data":"86c6096e8ff869dd36575cab9babfacf0a7afacc753f981a96439d310fec9676"}
Jul 21 04:14:29.772822 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.772763    2580 scope.go:117] "RemoveContainer" containerID="cf5cdb1ae902c985b17925568f4fad3b8921f5a13a8c994b2ad20abe3734d99d"
Jul 21 04:14:29.781793 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.781774    2580 scope.go:117] "RemoveContainer" containerID="cf5cdb1ae902c985b17925568f4fad3b8921f5a13a8c994b2ad20abe3734d99d"
Jul 21 04:14:29.782054 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:14:29.782034    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf5cdb1ae902c985b17925568f4fad3b8921f5a13a8c994b2ad20abe3734d99d\": container with ID starting with cf5cdb1ae902c985b17925568f4fad3b8921f5a13a8c994b2ad20abe3734d99d not found: ID does not exist" containerID="cf5cdb1ae902c985b17925568f4fad3b8921f5a13a8c994b2ad20abe3734d99d"
Jul 21 04:14:29.782120 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.782061    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf5cdb1ae902c985b17925568f4fad3b8921f5a13a8c994b2ad20abe3734d99d"} err="failed to get container status \"cf5cdb1ae902c985b17925568f4fad3b8921f5a13a8c994b2ad20abe3734d99d\": rpc error: code = NotFound desc = could not find container \"cf5cdb1ae902c985b17925568f4fad3b8921f5a13a8c994b2ad20abe3734d99d\": container with ID starting with cf5cdb1ae902c985b17925568f4fad3b8921f5a13a8c994b2ad20abe3734d99d not found: ID does not exist"
Jul 21 04:14:29.793767 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.793747    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"]
Jul 21 04:14:29.798005 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:29.797981    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-spcsq"]
Jul 21 04:14:30.563392 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:30.563371    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-694fk_6f2c16b6-c4e7-480c-b4d7-1312ed5ad130/ovn-acl-logging/0.log"
Jul 21 04:14:30.563697 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:30.563421    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-694fk_6f2c16b6-c4e7-480c-b4d7-1312ed5ad130/ovn-acl-logging/0.log"
Jul 21 04:14:30.692626 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:14:30.692596    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc1e39c7-364d-47b3-9efb-592249fa648e" path="/var/lib/kubelet/pods/dc1e39c7-364d-47b3-9efb-592249fa648e/volumes"
Jul 21 04:18:11.657576 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:11.657496    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5d6dcd6f44-s4jfs"]
Jul 21 04:18:11.658024 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:11.657788    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc1e39c7-364d-47b3-9efb-592249fa648e" containerName="istio-proxy"
Jul 21 04:18:11.658024 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:11.657798    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc1e39c7-364d-47b3-9efb-592249fa648e" containerName="istio-proxy"
Jul 21 04:18:11.658024 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:11.657846    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc1e39c7-364d-47b3-9efb-592249fa648e" containerName="istio-proxy"
Jul 21 04:18:11.660628 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:11.660612    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5d6dcd6f44-s4jfs"
Jul 21 04:18:11.664586 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:11.664562    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 04:18:11.665066 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:11.665052    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 04:18:11.665166 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:11.665147    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-j67t5\""
Jul 21 04:18:11.665209 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:11.665191    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 21 04:18:11.684613 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:11.684590    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5d6dcd6f44-s4jfs"]
Jul 21 04:18:11.757234 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:11.757201    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz7k9\" (UniqueName: \"kubernetes.io/projected/769f3842-8113-425d-8e2a-2f55ebe3536c-kube-api-access-jz7k9\") pod \"maas-api-5d6dcd6f44-s4jfs\" (UID: \"769f3842-8113-425d-8e2a-2f55ebe3536c\") " pod="odh-ai-gateway-infra/maas-api-5d6dcd6f44-s4jfs"
Jul 21 04:18:11.757430 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:11.757264    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/769f3842-8113-425d-8e2a-2f55ebe3536c-maas-api-tls\") pod \"maas-api-5d6dcd6f44-s4jfs\" (UID: \"769f3842-8113-425d-8e2a-2f55ebe3536c\") " pod="odh-ai-gateway-infra/maas-api-5d6dcd6f44-s4jfs"
Jul 21 04:18:11.757430 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:11.757358    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/769f3842-8113-425d-8e2a-2f55ebe3536c-openshift-service-ca\") pod \"maas-api-5d6dcd6f44-s4jfs\" (UID: \"769f3842-8113-425d-8e2a-2f55ebe3536c\") " pod="odh-ai-gateway-infra/maas-api-5d6dcd6f44-s4jfs"
Jul 21 04:18:11.858038 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:11.858005    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/769f3842-8113-425d-8e2a-2f55ebe3536c-maas-api-tls\") pod \"maas-api-5d6dcd6f44-s4jfs\" (UID: \"769f3842-8113-425d-8e2a-2f55ebe3536c\") " pod="odh-ai-gateway-infra/maas-api-5d6dcd6f44-s4jfs"
Jul 21 04:18:11.858234 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:11.858058    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/769f3842-8113-425d-8e2a-2f55ebe3536c-openshift-service-ca\") pod \"maas-api-5d6dcd6f44-s4jfs\" (UID: \"769f3842-8113-425d-8e2a-2f55ebe3536c\") " pod="odh-ai-gateway-infra/maas-api-5d6dcd6f44-s4jfs"
Jul 21 04:18:11.858234 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:11.858080    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz7k9\" (UniqueName: \"kubernetes.io/projected/769f3842-8113-425d-8e2a-2f55ebe3536c-kube-api-access-jz7k9\") pod \"maas-api-5d6dcd6f44-s4jfs\" (UID: \"769f3842-8113-425d-8e2a-2f55ebe3536c\") " pod="odh-ai-gateway-infra/maas-api-5d6dcd6f44-s4jfs"
Jul 21 04:18:11.858772 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:11.858746    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/769f3842-8113-425d-8e2a-2f55ebe3536c-openshift-service-ca\") pod \"maas-api-5d6dcd6f44-s4jfs\" (UID: \"769f3842-8113-425d-8e2a-2f55ebe3536c\") " pod="odh-ai-gateway-infra/maas-api-5d6dcd6f44-s4jfs"
Jul 21 04:18:11.860360 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:11.860343    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/769f3842-8113-425d-8e2a-2f55ebe3536c-maas-api-tls\") pod \"maas-api-5d6dcd6f44-s4jfs\" (UID: \"769f3842-8113-425d-8e2a-2f55ebe3536c\") " pod="odh-ai-gateway-infra/maas-api-5d6dcd6f44-s4jfs"
Jul 21 04:18:11.869031 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:11.869011    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz7k9\" (UniqueName: \"kubernetes.io/projected/769f3842-8113-425d-8e2a-2f55ebe3536c-kube-api-access-jz7k9\") pod \"maas-api-5d6dcd6f44-s4jfs\" (UID: \"769f3842-8113-425d-8e2a-2f55ebe3536c\") " pod="odh-ai-gateway-infra/maas-api-5d6dcd6f44-s4jfs"
Jul 21 04:18:11.970535 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:11.970454    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5d6dcd6f44-s4jfs"
Jul 21 04:18:12.106627 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:12.106600    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5d6dcd6f44-s4jfs"]
Jul 21 04:18:12.107945 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:18:12.107918    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod769f3842_8113_425d_8e2a_2f55ebe3536c.slice/crio-fbc0ce8de601d1adaa2f4c9024ed1f1982965865d474be2225ef94377c208c83 WatchSource:0}: Error finding container fbc0ce8de601d1adaa2f4c9024ed1f1982965865d474be2225ef94377c208c83: Status 404 returned error can't find the container with id fbc0ce8de601d1adaa2f4c9024ed1f1982965865d474be2225ef94377c208c83
Jul 21 04:18:12.109335 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:12.109317    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 04:18:12.681871 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:12.681835    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5d6dcd6f44-s4jfs" event={"ID":"769f3842-8113-425d-8e2a-2f55ebe3536c","Type":"ContainerStarted","Data":"fbc0ce8de601d1adaa2f4c9024ed1f1982965865d474be2225ef94377c208c83"}
Jul 21 04:18:14.694337 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:14.694303    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5d6dcd6f44-s4jfs" event={"ID":"769f3842-8113-425d-8e2a-2f55ebe3536c","Type":"ContainerStarted","Data":"ba8efc656b45671c5699a0c60176188b657a336aa8c91f5acbe335b443a74776"}
Jul 21 04:18:14.694705 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:14.694430    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5d6dcd6f44-s4jfs"
Jul 21 04:18:14.711437 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:14.711380    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5d6dcd6f44-s4jfs" podStartSLOduration=1.5434885820000002 podStartE2EDuration="3.711362431s" totalImagesPullingTime="2.167873849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:18:14.71041637 +0000 UTC m=+824.599469560" watchObservedRunningTime="2026-07-21 04:18:14.711362431 +0000 UTC m=+824.600415595"
Jul 21 04:18:20.704229 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:20.704200    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5d6dcd6f44-s4jfs"
Jul 21 04:18:44.134456 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:44.134423    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2vfwm"]
Jul 21 04:18:44.137710 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:44.137693    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vfwm"
Jul 21 04:18:44.140096 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:44.140065    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 21 04:18:44.140221 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:44.140155    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 21 04:18:44.140967 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:44.140953    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-s7zhr\""
Jul 21 04:18:44.141015 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:44.140995    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 21 04:18:44.146744 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:44.146723    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2vfwm"]
Jul 21 04:18:44.219665 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:44.219638    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f34f399f-687a-4bfb-863b-ad702cfa3806-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vfwm\" (UID: \"f34f399f-687a-4bfb-863b-ad702cfa3806\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vfwm"
Jul 21 04:18:44.219805 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:44.219671    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f34f399f-687a-4bfb-863b-ad702cfa3806-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vfwm\" (UID: \"f34f399f-687a-4bfb-863b-ad702cfa3806\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vfwm"
Jul 21 04:18:44.219805 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:44.219692    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twsph\" (UniqueName: \"kubernetes.io/projected/f34f399f-687a-4bfb-863b-ad702cfa3806-kube-api-access-twsph\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vfwm\" (UID: \"f34f399f-687a-4bfb-863b-ad702cfa3806\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vfwm"
Jul 21 04:18:44.219805 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:44.219754    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f34f399f-687a-4bfb-863b-ad702cfa3806-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vfwm\" (UID: \"f34f399f-687a-4bfb-863b-ad702cfa3806\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vfwm"
Jul 21 04:18:44.219805 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:44.219802    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f34f399f-687a-4bfb-863b-ad702cfa3806-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vfwm\" (UID: \"f34f399f-687a-4bfb-863b-ad702cfa3806\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vfwm"
Jul 21 04:18:44.219934 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:44.219827    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f34f399f-687a-4bfb-863b-ad702cfa3806-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vfwm\" (UID: \"f34f399f-687a-4bfb-863b-ad702cfa3806\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vfwm"
Jul 21 04:18:44.321105 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:44.321069    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f34f399f-687a-4bfb-863b-ad702cfa3806-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vfwm\" (UID: \"f34f399f-687a-4bfb-863b-ad702cfa3806\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vfwm"
Jul 21 04:18:44.325823 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:44.325798    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f34f399f-687a-4bfb-863b-ad702cfa3806-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vfwm\" (UID: \"f34f399f-687a-4bfb-863b-ad702cfa3806\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vfwm"
Jul 21 04:18:44.325969 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:44.325844    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twsph\" (UniqueName: \"kubernetes.io/projected/f34f399f-687a-4bfb-863b-ad702cfa3806-kube-api-access-twsph\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vfwm\" (UID: \"f34f399f-687a-4bfb-863b-ad702cfa3806\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vfwm"
Jul 21 04:18:44.325969 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:44.325907    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f34f399f-687a-4bfb-863b-ad702cfa3806-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vfwm\" (UID: \"f34f399f-687a-4bfb-863b-ad702cfa3806\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vfwm"
Jul 21 04:18:44.326077 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:44.325980    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f34f399f-687a-4bfb-863b-ad702cfa3806-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vfwm\" (UID: \"f34f399f-687a-4bfb-863b-ad702cfa3806\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vfwm"
Jul 21 04:18:44.326077 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:44.326018    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f34f399f-687a-4bfb-863b-ad702cfa3806-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vfwm\" (UID: \"f34f399f-687a-4bfb-863b-ad702cfa3806\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vfwm"
Jul 21 04:18:44.326204 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:44.326183    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f34f399f-687a-4bfb-863b-ad702cfa3806-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vfwm\" (UID: \"f34f399f-687a-4bfb-863b-ad702cfa3806\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vfwm"
Jul 21 04:18:44.326373 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:44.326353    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f34f399f-687a-4bfb-863b-ad702cfa3806-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vfwm\" (UID: \"f34f399f-687a-4bfb-863b-ad702cfa3806\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vfwm"
Jul 21 04:18:44.326426 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:44.326364    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f34f399f-687a-4bfb-863b-ad702cfa3806-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vfwm\" (UID: \"f34f399f-687a-4bfb-863b-ad702cfa3806\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vfwm"
Jul 21 04:18:44.328186 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:44.328164    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f34f399f-687a-4bfb-863b-ad702cfa3806-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vfwm\" (UID: \"f34f399f-687a-4bfb-863b-ad702cfa3806\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vfwm"
Jul 21 04:18:44.328472 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:44.328455    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f34f399f-687a-4bfb-863b-ad702cfa3806-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vfwm\" (UID: \"f34f399f-687a-4bfb-863b-ad702cfa3806\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vfwm"
Jul 21 04:18:44.333325 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:44.333306    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twsph\" (UniqueName: \"kubernetes.io/projected/f34f399f-687a-4bfb-863b-ad702cfa3806-kube-api-access-twsph\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vfwm\" (UID: \"f34f399f-687a-4bfb-863b-ad702cfa3806\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vfwm"
Jul 21 04:18:44.448472 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:44.448395    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vfwm"
Jul 21 04:18:44.574223 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:44.574166    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2vfwm"]
Jul 21 04:18:44.576844 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:18:44.576819    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf34f399f_687a_4bfb_863b_ad702cfa3806.slice/crio-b9bbc77f43d40d5dbec9ecafd4729bede73d6804cbec6cc6b75cbd291a35b0e5 WatchSource:0}: Error finding container b9bbc77f43d40d5dbec9ecafd4729bede73d6804cbec6cc6b75cbd291a35b0e5: Status 404 returned error can't find the container with id b9bbc77f43d40d5dbec9ecafd4729bede73d6804cbec6cc6b75cbd291a35b0e5
Jul 21 04:18:44.818443 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:44.818333    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vfwm" event={"ID":"f34f399f-687a-4bfb-863b-ad702cfa3806","Type":"ContainerStarted","Data":"b9bbc77f43d40d5dbec9ecafd4729bede73d6804cbec6cc6b75cbd291a35b0e5"}
Jul 21 04:18:45.829631 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:45.829543    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vfwm" event={"ID":"f34f399f-687a-4bfb-863b-ad702cfa3806","Type":"ContainerStarted","Data":"ceb63f672f21c1186b9349615d7d91b3d9b33e417b15e97fabc640c40be0e779"}
Jul 21 04:18:45.848528 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:45.848476    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vfwm" podStartSLOduration=0.864257952 podStartE2EDuration="1.848461573s" totalImagesPullingTime="984.203621ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:18:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:18:45.846546544 +0000 UTC m=+855.735599721" watchObservedRunningTime="2026-07-21 04:18:45.848461573 +0000 UTC m=+855.737514737"
Jul 21 04:18:54.448874 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:54.448829    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vfwm"
Jul 21 04:18:54.449353 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:54.448895    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vfwm"
Jul 21 04:18:54.461492 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:54.461467    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vfwm"
Jul 21 04:18:54.876743 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:18:54.876665    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vfwm"
Jul 21 04:19:10.146608 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:10.146577    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dhc5b"]
Jul 21 04:19:10.150004 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:10.149981    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dhc5b"
Jul 21 04:19:10.152342 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:10.152322    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 21 04:19:10.160006 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:10.159976    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dhc5b"]
Jul 21 04:19:10.244087 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:10.244053    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8984c50b-c906-4ad0-b751-ad2d1b18559a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dhc5b\" (UID: \"8984c50b-c906-4ad0-b751-ad2d1b18559a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dhc5b"
Jul 21 04:19:10.244087 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:10.244089    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8984c50b-c906-4ad0-b751-ad2d1b18559a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dhc5b\" (UID: \"8984c50b-c906-4ad0-b751-ad2d1b18559a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dhc5b"
Jul 21 04:19:10.244283 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:10.244107    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8984c50b-c906-4ad0-b751-ad2d1b18559a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dhc5b\" (UID: \"8984c50b-c906-4ad0-b751-ad2d1b18559a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dhc5b"
Jul 21 04:19:10.244283 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:10.244142    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8984c50b-c906-4ad0-b751-ad2d1b18559a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dhc5b\" (UID: \"8984c50b-c906-4ad0-b751-ad2d1b18559a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dhc5b"
Jul 21 04:19:10.244283 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:10.244216    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6stcj\" (UniqueName: \"kubernetes.io/projected/8984c50b-c906-4ad0-b751-ad2d1b18559a-kube-api-access-6stcj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dhc5b\" (UID: \"8984c50b-c906-4ad0-b751-ad2d1b18559a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dhc5b"
Jul 21 04:19:10.244283 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:10.244251    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8984c50b-c906-4ad0-b751-ad2d1b18559a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dhc5b\" (UID: \"8984c50b-c906-4ad0-b751-ad2d1b18559a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dhc5b"
Jul 21 04:19:10.345241 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:10.345210    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8984c50b-c906-4ad0-b751-ad2d1b18559a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dhc5b\" (UID: \"8984c50b-c906-4ad0-b751-ad2d1b18559a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dhc5b"
Jul 21 04:19:10.345241 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:10.345242    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8984c50b-c906-4ad0-b751-ad2d1b18559a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dhc5b\" (UID: \"8984c50b-c906-4ad0-b751-ad2d1b18559a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dhc5b"
Jul 21 04:19:10.345436 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:10.345260    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8984c50b-c906-4ad0-b751-ad2d1b18559a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dhc5b\" (UID: \"8984c50b-c906-4ad0-b751-ad2d1b18559a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dhc5b"
Jul 21 04:19:10.345436 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:10.345331    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6stcj\" (UniqueName: \"kubernetes.io/projected/8984c50b-c906-4ad0-b751-ad2d1b18559a-kube-api-access-6stcj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dhc5b\" (UID: \"8984c50b-c906-4ad0-b751-ad2d1b18559a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dhc5b"
Jul 21 04:19:10.345436 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:10.345350    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8984c50b-c906-4ad0-b751-ad2d1b18559a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dhc5b\" (UID: \"8984c50b-c906-4ad0-b751-ad2d1b18559a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dhc5b"
Jul 21 04:19:10.345436 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:10.345368    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8984c50b-c906-4ad0-b751-ad2d1b18559a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dhc5b\" (UID: \"8984c50b-c906-4ad0-b751-ad2d1b18559a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dhc5b"
Jul 21 04:19:10.345635 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:10.345587    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8984c50b-c906-4ad0-b751-ad2d1b18559a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dhc5b\" (UID: \"8984c50b-c906-4ad0-b751-ad2d1b18559a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dhc5b"
Jul 21 04:19:10.345737 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:10.345714    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8984c50b-c906-4ad0-b751-ad2d1b18559a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dhc5b\" (UID: \"8984c50b-c906-4ad0-b751-ad2d1b18559a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dhc5b"
Jul 21 04:19:10.345794 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:10.345739    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8984c50b-c906-4ad0-b751-ad2d1b18559a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dhc5b\" (UID: \"8984c50b-c906-4ad0-b751-ad2d1b18559a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dhc5b"
Jul 21 04:19:10.347554 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:10.347528    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8984c50b-c906-4ad0-b751-ad2d1b18559a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dhc5b\" (UID: \"8984c50b-c906-4ad0-b751-ad2d1b18559a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dhc5b"
Jul 21 04:19:10.347710 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:10.347682    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8984c50b-c906-4ad0-b751-ad2d1b18559a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dhc5b\" (UID: \"8984c50b-c906-4ad0-b751-ad2d1b18559a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dhc5b"
Jul 21 04:19:10.352640 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:10.352619    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6stcj\" (UniqueName: \"kubernetes.io/projected/8984c50b-c906-4ad0-b751-ad2d1b18559a-kube-api-access-6stcj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dhc5b\" (UID: \"8984c50b-c906-4ad0-b751-ad2d1b18559a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dhc5b"
Jul 21 04:19:10.460203 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:10.460091    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dhc5b"
Jul 21 04:19:10.587395 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:10.587369    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dhc5b"]
Jul 21 04:19:10.589606 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:19:10.589577    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8984c50b_c906_4ad0_b751_ad2d1b18559a.slice/crio-0dacf2dec4eb1c0692cb043165d5a75841161047f7b39698f34a45bdeb1ad2cb WatchSource:0}: Error finding container 0dacf2dec4eb1c0692cb043165d5a75841161047f7b39698f34a45bdeb1ad2cb: Status 404 returned error can't find the container with id 0dacf2dec4eb1c0692cb043165d5a75841161047f7b39698f34a45bdeb1ad2cb
Jul 21 04:19:10.930113 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:10.930083    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dhc5b" event={"ID":"8984c50b-c906-4ad0-b751-ad2d1b18559a","Type":"ContainerStarted","Data":"a986ebb905436eb0e47200771422e0b8caef40d663de2a1101c59ca90d328f7a"}
Jul 21 04:19:10.930264 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:10.930155    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dhc5b" event={"ID":"8984c50b-c906-4ad0-b751-ad2d1b18559a","Type":"ContainerStarted","Data":"0dacf2dec4eb1c0692cb043165d5a75841161047f7b39698f34a45bdeb1ad2cb"}
Jul 21 04:19:10.947480 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:10.947430    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dhc5b" podStartSLOduration=0.76244476 podStartE2EDuration="947.414799ms" totalImagesPullingTime="184.970039ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:19:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:19:10.946257489 +0000 UTC m=+880.835310644" watchObservedRunningTime="2026-07-21 04:19:10.947414799 +0000 UTC m=+880.836467962"
Jul 21 04:19:20.460743 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:20.460685    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dhc5b"
Jul 21 04:19:20.461221 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:20.460771    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dhc5b"
Jul 21 04:19:20.473233 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:20.473207    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dhc5b"
Jul 21 04:19:20.981289 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:20.981260    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dhc5b"
Jul 21 04:19:30.587543 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:30.587464    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-694fk_6f2c16b6-c4e7-480c-b4d7-1312ed5ad130/ovn-acl-logging/0.log"
Jul 21 04:19:30.588473 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:19:30.588449    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-694fk_6f2c16b6-c4e7-480c-b4d7-1312ed5ad130/ovn-acl-logging/0.log"
Jul 21 04:24:30.611790 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:24:30.611760    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-694fk_6f2c16b6-c4e7-480c-b4d7-1312ed5ad130/ovn-acl-logging/0.log"
Jul 21 04:24:30.614461 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:24:30.614440    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-694fk_6f2c16b6-c4e7-480c-b4d7-1312ed5ad130/ovn-acl-logging/0.log"
Jul 21 04:29:30.638082 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:29:30.638057    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-694fk_6f2c16b6-c4e7-480c-b4d7-1312ed5ad130/ovn-acl-logging/0.log"
Jul 21 04:29:30.641012 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:29:30.640989    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-694fk_6f2c16b6-c4e7-480c-b4d7-1312ed5ad130/ovn-acl-logging/0.log"
Jul 21 04:30:00.148109 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:30:00.145652    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743470-c56wd"]
Jul 21 04:30:00.151701 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:30:00.151670    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743470-c56wd"
Jul 21 04:30:00.153951 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:30:00.153927    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-k4z5s\""
Jul 21 04:30:00.154088 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:30:00.154033    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743470-c56wd"]
Jul 21 04:30:00.162639 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:30:00.162618    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743470-c56wd"
Jul 21 04:30:00.287666 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:30:00.287642    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743470-c56wd"]
Jul 21 04:30:00.290301 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:30:00.290274    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75f5619a_c27f_4a0b_8de8_5e83b881cc84.slice/crio-786874e2256b67309ffa5ce2920da400a4ec5e9ff270658071e8074bb025f671 WatchSource:0}: Error finding container 786874e2256b67309ffa5ce2920da400a4ec5e9ff270658071e8074bb025f671: Status 404 returned error can't find the container with id 786874e2256b67309ffa5ce2920da400a4ec5e9ff270658071e8074bb025f671
Jul 21 04:30:00.292560 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:30:00.292539    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 04:30:00.642019 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:30:00.641984    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743470-c56wd" event={"ID":"75f5619a-c27f-4a0b-8de8-5e83b881cc84","Type":"ContainerStarted","Data":"786874e2256b67309ffa5ce2920da400a4ec5e9ff270658071e8074bb025f671"}
Jul 21 04:30:03.656934 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:30:03.656898    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743470-c56wd" event={"ID":"75f5619a-c27f-4a0b-8de8-5e83b881cc84","Type":"ContainerStarted","Data":"c19e5ae4ac6d07379027df9e6d2e1818d7ba7e76816b79556f1612d878a5d0d8"}
Jul 21 04:30:03.674650 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:30:03.674601    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743470-c56wd" podStartSLOduration=0.910608929 podStartE2EDuration="3.674585125s" totalImagesPullingTime="2.763976196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:30:03.673023999 +0000 UTC m=+1533.562077161" watchObservedRunningTime="2026-07-21 04:30:03.674585125 +0000 UTC m=+1533.563638290"
Jul 21 04:30:04.663472 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:30:04.663441    2580 generic.go:356] "Generic (PLEG): container finished" podID="75f5619a-c27f-4a0b-8de8-5e83b881cc84" containerID="c19e5ae4ac6d07379027df9e6d2e1818d7ba7e76816b79556f1612d878a5d0d8" exitCode=0
Jul 21 04:30:04.663856 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:30:04.663527    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743470-c56wd" event={"ID":"75f5619a-c27f-4a0b-8de8-5e83b881cc84","Type":"ContainerDied","Data":"c19e5ae4ac6d07379027df9e6d2e1818d7ba7e76816b79556f1612d878a5d0d8"}
Jul 21 04:30:05.796386 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:30:05.796355    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743470-c56wd"
Jul 21 04:30:06.674724 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:30:06.674690    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743470-c56wd" event={"ID":"75f5619a-c27f-4a0b-8de8-5e83b881cc84","Type":"ContainerDied","Data":"786874e2256b67309ffa5ce2920da400a4ec5e9ff270658071e8074bb025f671"}
Jul 21 04:30:06.674724 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:30:06.674715    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743470-c56wd"
Jul 21 04:30:06.674936 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:30:06.674775    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="786874e2256b67309ffa5ce2920da400a4ec5e9ff270658071e8074bb025f671"
Jul 21 04:34:30.663608 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:34:30.663575    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-694fk_6f2c16b6-c4e7-480c-b4d7-1312ed5ad130/ovn-acl-logging/0.log"
Jul 21 04:34:30.666878 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:34:30.666853    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-694fk_6f2c16b6-c4e7-480c-b4d7-1312ed5ad130/ovn-acl-logging/0.log"
Jul 21 04:35:22.780346 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:22.780308    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"]
Jul 21 04:35:22.780844 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:22.780757    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75f5619a-c27f-4a0b-8de8-5e83b881cc84" containerName="cleanup"
Jul 21 04:35:22.780844 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:22.780775    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="75f5619a-c27f-4a0b-8de8-5e83b881cc84" containerName="cleanup"
Jul 21 04:35:22.780928 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:22.780877    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="75f5619a-c27f-4a0b-8de8-5e83b881cc84" containerName="cleanup"
Jul 21 04:35:22.783980 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:22.783963    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:22.786096 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:22.786063    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e9c65d45-openshift-default-dockercfg-skslf\""
Jul 21 04:35:22.803944 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:22.803918    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"]
Jul 21 04:35:22.922394 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:22.922359    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71ced2f4-9600-439e-9f0c-d71008261920-istio-data\") pod \"e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") " pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:22.922564 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:22.922421    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71ced2f4-9600-439e-9f0c-d71008261920-istio-podinfo\") pod \"e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") " pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:22.922564 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:22.922460    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ced2f4-9600-439e-9f0c-d71008261920-istio-token\") pod \"e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") " pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:22.922564 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:22.922522    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ced2f4-9600-439e-9f0c-d71008261920-workload-certs\") pod \"e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") " pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:22.922564 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:22.922548    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ced2f4-9600-439e-9f0c-d71008261920-credential-socket\") pod \"e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") " pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:22.922711 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:22.922567    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ced2f4-9600-439e-9f0c-d71008261920-workload-socket\") pod \"e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") " pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:22.922711 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:22.922584    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71ced2f4-9600-439e-9f0c-d71008261920-istiod-ca-cert\") pod \"e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") " pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:22.922711 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:22.922637    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71ced2f4-9600-439e-9f0c-d71008261920-istio-envoy\") pod \"e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") " pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:22.922711 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:22.922669    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqtpk\" (UniqueName: \"kubernetes.io/projected/71ced2f4-9600-439e-9f0c-d71008261920-kube-api-access-pqtpk\") pod \"e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") " pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:23.023783 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:23.023749    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71ced2f4-9600-439e-9f0c-d71008261920-istio-data\") pod \"e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") " pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:23.023953 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:23.023790    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71ced2f4-9600-439e-9f0c-d71008261920-istio-podinfo\") pod \"e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") " pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:23.023953 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:23.023811    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ced2f4-9600-439e-9f0c-d71008261920-istio-token\") pod \"e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") " pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:23.023953 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:23.023847    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ced2f4-9600-439e-9f0c-d71008261920-workload-certs\") pod \"e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") " pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:23.023953 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:23.023878    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ced2f4-9600-439e-9f0c-d71008261920-credential-socket\") pod \"e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") " pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:23.023953 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:23.023905    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ced2f4-9600-439e-9f0c-d71008261920-workload-socket\") pod \"e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") " pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:23.023953 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:23.023932    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71ced2f4-9600-439e-9f0c-d71008261920-istiod-ca-cert\") pod \"e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") " pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:23.024300 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:23.023957    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71ced2f4-9600-439e-9f0c-d71008261920-istio-envoy\") pod \"e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") " pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:23.024300 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:23.023984    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqtpk\" (UniqueName: \"kubernetes.io/projected/71ced2f4-9600-439e-9f0c-d71008261920-kube-api-access-pqtpk\") pod \"e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") " pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:23.024300 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:23.024199    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71ced2f4-9600-439e-9f0c-d71008261920-istio-data\") pod \"e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") " pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:23.024300 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:23.024248    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ced2f4-9600-439e-9f0c-d71008261920-workload-certs\") pod \"e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") " pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:23.024507 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:23.024404    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ced2f4-9600-439e-9f0c-d71008261920-workload-socket\") pod \"e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") " pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:23.024507 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:23.024425    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ced2f4-9600-439e-9f0c-d71008261920-credential-socket\") pod \"e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") " pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:23.024645 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:23.024627    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71ced2f4-9600-439e-9f0c-d71008261920-istiod-ca-cert\") pod \"e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") " pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:23.026190 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:23.026170    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71ced2f4-9600-439e-9f0c-d71008261920-istio-envoy\") pod \"e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") " pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:23.026295 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:23.026253    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71ced2f4-9600-439e-9f0c-d71008261920-istio-podinfo\") pod \"e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") " pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:23.031312 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:23.031262    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ced2f4-9600-439e-9f0c-d71008261920-istio-token\") pod \"e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") " pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:23.031387 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:23.031353    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqtpk\" (UniqueName: \"kubernetes.io/projected/71ced2f4-9600-439e-9f0c-d71008261920-kube-api-access-pqtpk\") pod \"e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") " pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:23.094338 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:23.094307    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:23.225203 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:23.225179    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"]
Jul 21 04:35:23.226955 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:35:23.226926    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71ced2f4_9600_439e_9f0c_d71008261920.slice/crio-24ee45579a1060fc1604326253c1e422ee4f0a7a4ab27dba08aa0ef454d98b8c WatchSource:0}: Error finding container 24ee45579a1060fc1604326253c1e422ee4f0a7a4ab27dba08aa0ef454d98b8c: Status 404 returned error can't find the container with id 24ee45579a1060fc1604326253c1e422ee4f0a7a4ab27dba08aa0ef454d98b8c
Jul 21 04:35:23.229136 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:23.229087    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:35:23.229224 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:23.229190    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:35:23.229261 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:23.229233    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:35:24.009626 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:24.009581    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f" event={"ID":"71ced2f4-9600-439e-9f0c-d71008261920","Type":"ContainerStarted","Data":"841b46c7120ce4af959620c64eb7b0a8b3b2c65b2f568a2aa12b162eb8899a59"}
Jul 21 04:35:24.010038 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:24.009656    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f" event={"ID":"71ced2f4-9600-439e-9f0c-d71008261920","Type":"ContainerStarted","Data":"24ee45579a1060fc1604326253c1e422ee4f0a7a4ab27dba08aa0ef454d98b8c"}
Jul 21 04:35:24.031191 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:24.031116    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f" podStartSLOduration=2.0310999 podStartE2EDuration="2.0310999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:35:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:35:24.030182821 +0000 UTC m=+1853.919235981" watchObservedRunningTime="2026-07-21 04:35:24.0310999 +0000 UTC m=+1853.920153082"
Jul 21 04:35:24.095107 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:24.095076    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:24.099875 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:24.099849    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:25.013806 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:25.013778    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:25.014630 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:25.014611    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:25.547634 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:25.547598    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv"]
Jul 21 04:35:25.550945 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:25.550922    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv"
Jul 21 04:35:25.552987 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:25.552957    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-e9c65d45-serving-cert\""
Jul 21 04:35:25.570976 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:25.570947    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv"]
Jul 21 04:35:25.647315 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:25.647005    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42v7p\" (UniqueName: \"kubernetes.io/projected/df4c6da2-8a95-4b72-a93d-325437b56fe7-kube-api-access-42v7p\") pod \"maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv\" (UID: \"df4c6da2-8a95-4b72-a93d-325437b56fe7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv"
Jul 21 04:35:25.647315 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:25.647107    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df4c6da2-8a95-4b72-a93d-325437b56fe7-maas-api-tls\") pod \"maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv\" (UID: \"df4c6da2-8a95-4b72-a93d-325437b56fe7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv"
Jul 21 04:35:25.647315 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:25.647190    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df4c6da2-8a95-4b72-a93d-325437b56fe7-openshift-service-ca\") pod \"maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv\" (UID: \"df4c6da2-8a95-4b72-a93d-325437b56fe7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv"
Jul 21 04:35:25.747917 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:25.747877    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42v7p\" (UniqueName: \"kubernetes.io/projected/df4c6da2-8a95-4b72-a93d-325437b56fe7-kube-api-access-42v7p\") pod \"maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv\" (UID: \"df4c6da2-8a95-4b72-a93d-325437b56fe7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv"
Jul 21 04:35:25.748307 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:25.748005    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df4c6da2-8a95-4b72-a93d-325437b56fe7-maas-api-tls\") pod \"maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv\" (UID: \"df4c6da2-8a95-4b72-a93d-325437b56fe7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv"
Jul 21 04:35:25.748417 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:35:25.748333    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-e9c65d45-serving-cert: secret "maas-api-e2e-ait-e9c65d45-serving-cert" not found
Jul 21 04:35:25.748417 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:25.748378    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df4c6da2-8a95-4b72-a93d-325437b56fe7-openshift-service-ca\") pod \"maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv\" (UID: \"df4c6da2-8a95-4b72-a93d-325437b56fe7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv"
Jul 21 04:35:25.748417 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:35:25.748393    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df4c6da2-8a95-4b72-a93d-325437b56fe7-maas-api-tls podName:df4c6da2-8a95-4b72-a93d-325437b56fe7 nodeName:}" failed. No retries permitted until 2026-07-21 04:35:26.248379279 +0000 UTC m=+1856.137432424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/df4c6da2-8a95-4b72-a93d-325437b56fe7-maas-api-tls") pod "maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv" (UID: "df4c6da2-8a95-4b72-a93d-325437b56fe7") : secret "maas-api-e2e-ait-e9c65d45-serving-cert" not found
Jul 21 04:35:25.748950 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:25.748933    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df4c6da2-8a95-4b72-a93d-325437b56fe7-openshift-service-ca\") pod \"maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv\" (UID: \"df4c6da2-8a95-4b72-a93d-325437b56fe7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv"
Jul 21 04:35:25.758856 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:25.758835    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42v7p\" (UniqueName: \"kubernetes.io/projected/df4c6da2-8a95-4b72-a93d-325437b56fe7-kube-api-access-42v7p\") pod \"maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv\" (UID: \"df4c6da2-8a95-4b72-a93d-325437b56fe7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv"
Jul 21 04:35:26.252848 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:26.252811    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df4c6da2-8a95-4b72-a93d-325437b56fe7-maas-api-tls\") pod \"maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv\" (UID: \"df4c6da2-8a95-4b72-a93d-325437b56fe7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv"
Jul 21 04:35:26.255324 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:26.255299    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df4c6da2-8a95-4b72-a93d-325437b56fe7-maas-api-tls\") pod \"maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv\" (UID: \"df4c6da2-8a95-4b72-a93d-325437b56fe7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv"
Jul 21 04:35:26.463896 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:26.463861    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv"
Jul 21 04:35:26.590526 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:26.590503    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv"]
Jul 21 04:35:26.592581 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:35:26.592555    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf4c6da2_8a95_4b72_a93d_325437b56fe7.slice/crio-c82714fcbb23249a29d2345fe416e3b0f03e9c38d5ace9c5c045c1616eaac5bf WatchSource:0}: Error finding container c82714fcbb23249a29d2345fe416e3b0f03e9c38d5ace9c5c045c1616eaac5bf: Status 404 returned error can't find the container with id c82714fcbb23249a29d2345fe416e3b0f03e9c38d5ace9c5c045c1616eaac5bf
Jul 21 04:35:26.594021 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:26.594001    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 04:35:27.023321 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:27.023289    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv" event={"ID":"df4c6da2-8a95-4b72-a93d-325437b56fe7","Type":"ContainerStarted","Data":"c82714fcbb23249a29d2345fe416e3b0f03e9c38d5ace9c5c045c1616eaac5bf"}
Jul 21 04:35:28.029058 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:28.029024    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv" event={"ID":"df4c6da2-8a95-4b72-a93d-325437b56fe7","Type":"ContainerStarted","Data":"1114c1cb56986254605c0be064642d84d883cebfa41c6e66694a5fb78927ae86"}
Jul 21 04:35:28.029590 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:28.029087    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv"
Jul 21 04:35:28.044177 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:28.044109    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv" podStartSLOduration=2.5385744470000002 podStartE2EDuration="3.044090927s" totalImagesPullingTime="505.51648ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:35:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:35:28.043615377 +0000 UTC m=+1857.932668564" watchObservedRunningTime="2026-07-21 04:35:28.044090927 +0000 UTC m=+1857.933144092"
Jul 21 04:35:34.039144 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:34.039092    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv"
Jul 21 04:35:39.078114 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:39.078016    2580 generic.go:356] "Generic (PLEG): container finished" podID="71ced2f4-9600-439e-9f0c-d71008261920" containerID="841b46c7120ce4af959620c64eb7b0a8b3b2c65b2f568a2aa12b162eb8899a59" exitCode=0
Jul 21 04:35:39.078114 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:39.078091    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f" event={"ID":"71ced2f4-9600-439e-9f0c-d71008261920","Type":"ContainerDied","Data":"841b46c7120ce4af959620c64eb7b0a8b3b2c65b2f568a2aa12b162eb8899a59"}
Jul 21 04:35:39.078544 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:39.078499    2580 scope.go:117] "RemoveContainer" containerID="841b46c7120ce4af959620c64eb7b0a8b3b2c65b2f568a2aa12b162eb8899a59"
Jul 21 04:35:39.079505 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:39.079479    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:35:39.079572 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:39.079542    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:35:39.079610 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:39.079573    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:35:40.013980 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:40.013944    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:40.084280 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:40.084243    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f" event={"ID":"71ced2f4-9600-439e-9f0c-d71008261920","Type":"ContainerStarted","Data":"f01a36a24f2d71874398b94e6c02247f36a5291a19485d47f759c246295be9d6"}
Jul 21 04:35:40.095372 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:40.095352    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:40.096182 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:40.096161    2580 patch_prober.go:28] interesting pod/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 21 04:35:40.096227 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:40.096210    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f" podUID="71ced2f4-9600-439e-9f0c-d71008261920" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 21 04:35:41.095646 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:41.095609    2580 patch_prober.go:28] interesting pod/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 21 04:35:41.096036 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:41.095660    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f" podUID="71ced2f4-9600-439e-9f0c-d71008261920" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 21 04:35:42.094926 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:42.094895    2580 patch_prober.go:28] interesting pod/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 21 04:35:42.095102 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:42.094946    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f" podUID="71ced2f4-9600-439e-9f0c-d71008261920" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 21 04:35:43.094763 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:43.094726    2580 patch_prober.go:28] interesting pod/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 21 04:35:43.095197 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:43.094792    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f" podUID="71ced2f4-9600-439e-9f0c-d71008261920" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 21 04:35:44.095377 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:44.095338    2580 patch_prober.go:28] interesting pod/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 21 04:35:44.095766 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:44.095401    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f" podUID="71ced2f4-9600-439e-9f0c-d71008261920" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 21 04:35:45.098423 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:45.098394    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:45.098793 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:45.098655    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:35:45.099331 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:35:45.099311    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:36:01.387577 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:01.387485    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv"]
Jul 21 04:36:01.388171 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:01.387764    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv" podUID="df4c6da2-8a95-4b72-a93d-325437b56fe7" containerName="maas-api" containerID="cri-o://1114c1cb56986254605c0be064642d84d883cebfa41c6e66694a5fb78927ae86" gracePeriod=30
Jul 21 04:36:01.635316 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:01.635291    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv"
Jul 21 04:36:01.659297 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:01.659229    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df4c6da2-8a95-4b72-a93d-325437b56fe7-openshift-service-ca\") pod \"df4c6da2-8a95-4b72-a93d-325437b56fe7\" (UID: \"df4c6da2-8a95-4b72-a93d-325437b56fe7\") "
Jul 21 04:36:01.659297 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:01.659287    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df4c6da2-8a95-4b72-a93d-325437b56fe7-maas-api-tls\") pod \"df4c6da2-8a95-4b72-a93d-325437b56fe7\" (UID: \"df4c6da2-8a95-4b72-a93d-325437b56fe7\") "
Jul 21 04:36:01.659469 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:01.659317    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42v7p\" (UniqueName: \"kubernetes.io/projected/df4c6da2-8a95-4b72-a93d-325437b56fe7-kube-api-access-42v7p\") pod \"df4c6da2-8a95-4b72-a93d-325437b56fe7\" (UID: \"df4c6da2-8a95-4b72-a93d-325437b56fe7\") "
Jul 21 04:36:01.659620 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:01.659594    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df4c6da2-8a95-4b72-a93d-325437b56fe7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "df4c6da2-8a95-4b72-a93d-325437b56fe7" (UID: "df4c6da2-8a95-4b72-a93d-325437b56fe7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:36:01.661601 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:01.661575    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df4c6da2-8a95-4b72-a93d-325437b56fe7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "df4c6da2-8a95-4b72-a93d-325437b56fe7" (UID: "df4c6da2-8a95-4b72-a93d-325437b56fe7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:36:01.661710 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:01.661601    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df4c6da2-8a95-4b72-a93d-325437b56fe7-kube-api-access-42v7p" (OuterVolumeSpecName: "kube-api-access-42v7p") pod "df4c6da2-8a95-4b72-a93d-325437b56fe7" (UID: "df4c6da2-8a95-4b72-a93d-325437b56fe7"). InnerVolumeSpecName "kube-api-access-42v7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:36:01.760231 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:01.760193    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df4c6da2-8a95-4b72-a93d-325437b56fe7-openshift-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:36:01.760354 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:01.760249    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df4c6da2-8a95-4b72-a93d-325437b56fe7-maas-api-tls\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:36:01.760354 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:01.760258    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42v7p\" (UniqueName: \"kubernetes.io/projected/df4c6da2-8a95-4b72-a93d-325437b56fe7-kube-api-access-42v7p\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:36:02.186212 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:02.186182    2580 generic.go:356] "Generic (PLEG): container finished" podID="df4c6da2-8a95-4b72-a93d-325437b56fe7" containerID="1114c1cb56986254605c0be064642d84d883cebfa41c6e66694a5fb78927ae86" exitCode=0
Jul 21 04:36:02.186382 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:02.186220    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv" event={"ID":"df4c6da2-8a95-4b72-a93d-325437b56fe7","Type":"ContainerDied","Data":"1114c1cb56986254605c0be064642d84d883cebfa41c6e66694a5fb78927ae86"}
Jul 21 04:36:02.186382 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:02.186225    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv"
Jul 21 04:36:02.186382 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:02.186265    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv" event={"ID":"df4c6da2-8a95-4b72-a93d-325437b56fe7","Type":"ContainerDied","Data":"c82714fcbb23249a29d2345fe416e3b0f03e9c38d5ace9c5c045c1616eaac5bf"}
Jul 21 04:36:02.186382 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:02.186287    2580 scope.go:117] "RemoveContainer" containerID="1114c1cb56986254605c0be064642d84d883cebfa41c6e66694a5fb78927ae86"
Jul 21 04:36:02.194918 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:02.194898    2580 scope.go:117] "RemoveContainer" containerID="1114c1cb56986254605c0be064642d84d883cebfa41c6e66694a5fb78927ae86"
Jul 21 04:36:02.195179 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:36:02.195160    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1114c1cb56986254605c0be064642d84d883cebfa41c6e66694a5fb78927ae86\": container with ID starting with 1114c1cb56986254605c0be064642d84d883cebfa41c6e66694a5fb78927ae86 not found: ID does not exist" containerID="1114c1cb56986254605c0be064642d84d883cebfa41c6e66694a5fb78927ae86"
Jul 21 04:36:02.195228 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:02.195187    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1114c1cb56986254605c0be064642d84d883cebfa41c6e66694a5fb78927ae86"} err="failed to get container status \"1114c1cb56986254605c0be064642d84d883cebfa41c6e66694a5fb78927ae86\": rpc error: code = NotFound desc = could not find container \"1114c1cb56986254605c0be064642d84d883cebfa41c6e66694a5fb78927ae86\": container with ID starting with 1114c1cb56986254605c0be064642d84d883cebfa41c6e66694a5fb78927ae86 not found: ID does not exist"
Jul 21 04:36:02.206326 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:02.206305    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv"]
Jul 21 04:36:02.209715 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:02.209695    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e9c65d45-6b854f4998-zmtnv"]
Jul 21 04:36:02.693189 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:02.693159    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df4c6da2-8a95-4b72-a93d-325437b56fe7" path="/var/lib/kubelet/pods/df4c6da2-8a95-4b72-a93d-325437b56fe7/volumes"
Jul 21 04:36:06.225799 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:06.225769    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"]
Jul 21 04:36:06.226233 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:06.225960    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f" podUID="71ced2f4-9600-439e-9f0c-d71008261920" containerName="istio-proxy" containerID="cri-o://f01a36a24f2d71874398b94e6c02247f36a5291a19485d47f759c246295be9d6" gracePeriod=30
Jul 21 04:36:09.546044 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:09.546004    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq"]
Jul 21 04:36:09.546549 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:09.546523    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df4c6da2-8a95-4b72-a93d-325437b56fe7" containerName="maas-api"
Jul 21 04:36:09.546549 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:09.546541    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="df4c6da2-8a95-4b72-a93d-325437b56fe7" containerName="maas-api"
Jul 21 04:36:09.546681 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:09.546630    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="df4c6da2-8a95-4b72-a93d-325437b56fe7" containerName="maas-api"
Jul 21 04:36:09.551150 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:09.551113    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq"
Jul 21 04:36:09.553371 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:09.553345    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-75c76546-serving-cert\""
Jul 21 04:36:09.559504 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:09.559207    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq"]
Jul 21 04:36:09.629885 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:09.629857    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06600d24-c2fb-47c0-96b5-fcdd804b2eb1-openshift-service-ca\") pod \"maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq\" (UID: \"06600d24-c2fb-47c0-96b5-fcdd804b2eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq"
Jul 21 04:36:09.630029 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:09.629895    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trgg2\" (UniqueName: \"kubernetes.io/projected/06600d24-c2fb-47c0-96b5-fcdd804b2eb1-kube-api-access-trgg2\") pod \"maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq\" (UID: \"06600d24-c2fb-47c0-96b5-fcdd804b2eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq"
Jul 21 04:36:09.630029 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:09.630010    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06600d24-c2fb-47c0-96b5-fcdd804b2eb1-maas-api-tls\") pod \"maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq\" (UID: \"06600d24-c2fb-47c0-96b5-fcdd804b2eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq"
Jul 21 04:36:09.730799 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:09.730768    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06600d24-c2fb-47c0-96b5-fcdd804b2eb1-maas-api-tls\") pod \"maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq\" (UID: \"06600d24-c2fb-47c0-96b5-fcdd804b2eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq"
Jul 21 04:36:09.730973 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:09.730809    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06600d24-c2fb-47c0-96b5-fcdd804b2eb1-openshift-service-ca\") pod \"maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq\" (UID: \"06600d24-c2fb-47c0-96b5-fcdd804b2eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq"
Jul 21 04:36:09.730973 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:09.730831    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trgg2\" (UniqueName: \"kubernetes.io/projected/06600d24-c2fb-47c0-96b5-fcdd804b2eb1-kube-api-access-trgg2\") pod \"maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq\" (UID: \"06600d24-c2fb-47c0-96b5-fcdd804b2eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq"
Jul 21 04:36:09.730973 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:36:09.730932    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-75c76546-serving-cert: secret "maas-api-e2e-migrate-75c76546-serving-cert" not found
Jul 21 04:36:09.731086 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:36:09.731012    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06600d24-c2fb-47c0-96b5-fcdd804b2eb1-maas-api-tls podName:06600d24-c2fb-47c0-96b5-fcdd804b2eb1 nodeName:}" failed. No retries permitted until 2026-07-21 04:36:10.230990506 +0000 UTC m=+1900.120043666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/06600d24-c2fb-47c0-96b5-fcdd804b2eb1-maas-api-tls") pod "maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq" (UID: "06600d24-c2fb-47c0-96b5-fcdd804b2eb1") : secret "maas-api-e2e-migrate-75c76546-serving-cert" not found
Jul 21 04:36:09.731455 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:09.731436    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06600d24-c2fb-47c0-96b5-fcdd804b2eb1-openshift-service-ca\") pod \"maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq\" (UID: \"06600d24-c2fb-47c0-96b5-fcdd804b2eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq"
Jul 21 04:36:09.741096 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:09.741076    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trgg2\" (UniqueName: \"kubernetes.io/projected/06600d24-c2fb-47c0-96b5-fcdd804b2eb1-kube-api-access-trgg2\") pod \"maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq\" (UID: \"06600d24-c2fb-47c0-96b5-fcdd804b2eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq"
Jul 21 04:36:10.234891 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:10.234861    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06600d24-c2fb-47c0-96b5-fcdd804b2eb1-maas-api-tls\") pod \"maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq\" (UID: \"06600d24-c2fb-47c0-96b5-fcdd804b2eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq"
Jul 21 04:36:10.237337 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:10.237318    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06600d24-c2fb-47c0-96b5-fcdd804b2eb1-maas-api-tls\") pod \"maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq\" (UID: \"06600d24-c2fb-47c0-96b5-fcdd804b2eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq"
Jul 21 04:36:10.463141 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:10.463098    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq"
Jul 21 04:36:10.585083 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:10.585060    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq"]
Jul 21 04:36:10.587112 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:36:10.587080    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06600d24_c2fb_47c0_96b5_fcdd804b2eb1.slice/crio-501d982c1b6f49e0dd02763526d937f255f58b29d214e97d09ca2a48e4d7fc20 WatchSource:0}: Error finding container 501d982c1b6f49e0dd02763526d937f255f58b29d214e97d09ca2a48e4d7fc20: Status 404 returned error can't find the container with id 501d982c1b6f49e0dd02763526d937f255f58b29d214e97d09ca2a48e4d7fc20
Jul 21 04:36:11.226529 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.226437    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq" event={"ID":"06600d24-c2fb-47c0-96b5-fcdd804b2eb1","Type":"ContainerStarted","Data":"a142f87e5c6c205ad7f45c641022035b47c2eb3b08621fc80ee308b07bf7db5d"}
Jul 21 04:36:11.226529 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.226517    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq" event={"ID":"06600d24-c2fb-47c0-96b5-fcdd804b2eb1","Type":"ContainerStarted","Data":"501d982c1b6f49e0dd02763526d937f255f58b29d214e97d09ca2a48e4d7fc20"}
Jul 21 04:36:11.226741 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.226573    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq"
Jul 21 04:36:11.243459 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.243404    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq" podStartSLOduration=1.911958421 podStartE2EDuration="2.243385927s" totalImagesPullingTime="331.427506ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:36:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:36:11.24189581 +0000 UTC m=+1901.130948974" watchObservedRunningTime="2026-07-21 04:36:11.243385927 +0000 UTC m=+1901.132439093"
Jul 21 04:36:11.471652 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.471629    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:36:11.547168 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.547073    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71ced2f4-9600-439e-9f0c-d71008261920-istio-data\") pod \"71ced2f4-9600-439e-9f0c-d71008261920\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") "
Jul 21 04:36:11.547168 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.547110    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71ced2f4-9600-439e-9f0c-d71008261920-istio-podinfo\") pod \"71ced2f4-9600-439e-9f0c-d71008261920\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") "
Jul 21 04:36:11.547347 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.547172    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71ced2f4-9600-439e-9f0c-d71008261920-istiod-ca-cert\") pod \"71ced2f4-9600-439e-9f0c-d71008261920\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") "
Jul 21 04:36:11.547347 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.547202    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71ced2f4-9600-439e-9f0c-d71008261920-istio-envoy\") pod \"71ced2f4-9600-439e-9f0c-d71008261920\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") "
Jul 21 04:36:11.547347 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.547226    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ced2f4-9600-439e-9f0c-d71008261920-credential-socket\") pod \"71ced2f4-9600-439e-9f0c-d71008261920\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") "
Jul 21 04:36:11.547347 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.547279    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ced2f4-9600-439e-9f0c-d71008261920-workload-certs\") pod \"71ced2f4-9600-439e-9f0c-d71008261920\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") "
Jul 21 04:36:11.547347 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.547305    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ced2f4-9600-439e-9f0c-d71008261920-workload-socket\") pod \"71ced2f4-9600-439e-9f0c-d71008261920\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") "
Jul 21 04:36:11.547562 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.547348    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqtpk\" (UniqueName: \"kubernetes.io/projected/71ced2f4-9600-439e-9f0c-d71008261920-kube-api-access-pqtpk\") pod \"71ced2f4-9600-439e-9f0c-d71008261920\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") "
Jul 21 04:36:11.547562 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.547378    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ced2f4-9600-439e-9f0c-d71008261920-istio-token\") pod \"71ced2f4-9600-439e-9f0c-d71008261920\" (UID: \"71ced2f4-9600-439e-9f0c-d71008261920\") "
Jul 21 04:36:11.547685 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.547644    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ced2f4-9600-439e-9f0c-d71008261920-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "71ced2f4-9600-439e-9f0c-d71008261920" (UID: "71ced2f4-9600-439e-9f0c-d71008261920"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:36:11.547742 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.547672    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ced2f4-9600-439e-9f0c-d71008261920-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "71ced2f4-9600-439e-9f0c-d71008261920" (UID: "71ced2f4-9600-439e-9f0c-d71008261920"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:36:11.547742 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.547649    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ced2f4-9600-439e-9f0c-d71008261920-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "71ced2f4-9600-439e-9f0c-d71008261920" (UID: "71ced2f4-9600-439e-9f0c-d71008261920"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:36:11.547742 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.547712    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71ced2f4-9600-439e-9f0c-d71008261920-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "71ced2f4-9600-439e-9f0c-d71008261920" (UID: "71ced2f4-9600-439e-9f0c-d71008261920"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:36:11.548395 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.548365    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ced2f4-9600-439e-9f0c-d71008261920-istio-data" (OuterVolumeSpecName: "istio-data") pod "71ced2f4-9600-439e-9f0c-d71008261920" (UID: "71ced2f4-9600-439e-9f0c-d71008261920"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:36:11.549393 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.549367    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/71ced2f4-9600-439e-9f0c-d71008261920-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "71ced2f4-9600-439e-9f0c-d71008261920" (UID: "71ced2f4-9600-439e-9f0c-d71008261920"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 04:36:11.549468 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.549428    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ced2f4-9600-439e-9f0c-d71008261920-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "71ced2f4-9600-439e-9f0c-d71008261920" (UID: "71ced2f4-9600-439e-9f0c-d71008261920"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:36:11.549552 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.549534    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71ced2f4-9600-439e-9f0c-d71008261920-kube-api-access-pqtpk" (OuterVolumeSpecName: "kube-api-access-pqtpk") pod "71ced2f4-9600-439e-9f0c-d71008261920" (UID: "71ced2f4-9600-439e-9f0c-d71008261920"). InnerVolumeSpecName "kube-api-access-pqtpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:36:11.549738 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.549724    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71ced2f4-9600-439e-9f0c-d71008261920-istio-token" (OuterVolumeSpecName: "istio-token") pod "71ced2f4-9600-439e-9f0c-d71008261920" (UID: "71ced2f4-9600-439e-9f0c-d71008261920"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:36:11.648283 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.648243    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ced2f4-9600-439e-9f0c-d71008261920-workload-certs\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:36:11.648283 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.648279    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ced2f4-9600-439e-9f0c-d71008261920-workload-socket\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:36:11.648283 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.648288    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqtpk\" (UniqueName: \"kubernetes.io/projected/71ced2f4-9600-439e-9f0c-d71008261920-kube-api-access-pqtpk\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:36:11.648731 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.648298    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ced2f4-9600-439e-9f0c-d71008261920-istio-token\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:36:11.648731 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.648307    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71ced2f4-9600-439e-9f0c-d71008261920-istio-data\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:36:11.648731 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.648314    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71ced2f4-9600-439e-9f0c-d71008261920-istio-podinfo\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:36:11.648731 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.648321    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71ced2f4-9600-439e-9f0c-d71008261920-istiod-ca-cert\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:36:11.648731 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.648330    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71ced2f4-9600-439e-9f0c-d71008261920-istio-envoy\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:36:11.648731 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:11.648337    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ced2f4-9600-439e-9f0c-d71008261920-credential-socket\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:36:12.232454 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:12.232423    2580 generic.go:356] "Generic (PLEG): container finished" podID="71ced2f4-9600-439e-9f0c-d71008261920" containerID="f01a36a24f2d71874398b94e6c02247f36a5291a19485d47f759c246295be9d6" exitCode=0
Jul 21 04:36:12.232603 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:12.232470    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"
Jul 21 04:36:12.232603 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:12.232503    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f" event={"ID":"71ced2f4-9600-439e-9f0c-d71008261920","Type":"ContainerDied","Data":"f01a36a24f2d71874398b94e6c02247f36a5291a19485d47f759c246295be9d6"}
Jul 21 04:36:12.232603 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:12.232560    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f" event={"ID":"71ced2f4-9600-439e-9f0c-d71008261920","Type":"ContainerDied","Data":"24ee45579a1060fc1604326253c1e422ee4f0a7a4ab27dba08aa0ef454d98b8c"}
Jul 21 04:36:12.232603 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:12.232582    2580 scope.go:117] "RemoveContainer" containerID="f01a36a24f2d71874398b94e6c02247f36a5291a19485d47f759c246295be9d6"
Jul 21 04:36:12.241429 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:12.241414    2580 scope.go:117] "RemoveContainer" containerID="841b46c7120ce4af959620c64eb7b0a8b3b2c65b2f568a2aa12b162eb8899a59"
Jul 21 04:36:12.249196 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:12.249175    2580 scope.go:117] "RemoveContainer" containerID="f01a36a24f2d71874398b94e6c02247f36a5291a19485d47f759c246295be9d6"
Jul 21 04:36:12.249423 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:36:12.249405    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f01a36a24f2d71874398b94e6c02247f36a5291a19485d47f759c246295be9d6\": container with ID starting with f01a36a24f2d71874398b94e6c02247f36a5291a19485d47f759c246295be9d6 not found: ID does not exist" containerID="f01a36a24f2d71874398b94e6c02247f36a5291a19485d47f759c246295be9d6"
Jul 21 04:36:12.249480 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:12.249431    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f01a36a24f2d71874398b94e6c02247f36a5291a19485d47f759c246295be9d6"} err="failed to get container status \"f01a36a24f2d71874398b94e6c02247f36a5291a19485d47f759c246295be9d6\": rpc error: code = NotFound desc = could not find container \"f01a36a24f2d71874398b94e6c02247f36a5291a19485d47f759c246295be9d6\": container with ID starting with f01a36a24f2d71874398b94e6c02247f36a5291a19485d47f759c246295be9d6 not found: ID does not exist"
Jul 21 04:36:12.249480 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:12.249447    2580 scope.go:117] "RemoveContainer" containerID="841b46c7120ce4af959620c64eb7b0a8b3b2c65b2f568a2aa12b162eb8899a59"
Jul 21 04:36:12.249662 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:36:12.249643    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"841b46c7120ce4af959620c64eb7b0a8b3b2c65b2f568a2aa12b162eb8899a59\": container with ID starting with 841b46c7120ce4af959620c64eb7b0a8b3b2c65b2f568a2aa12b162eb8899a59 not found: ID does not exist" containerID="841b46c7120ce4af959620c64eb7b0a8b3b2c65b2f568a2aa12b162eb8899a59"
Jul 21 04:36:12.249701 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:12.249668    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"841b46c7120ce4af959620c64eb7b0a8b3b2c65b2f568a2aa12b162eb8899a59"} err="failed to get container status \"841b46c7120ce4af959620c64eb7b0a8b3b2c65b2f568a2aa12b162eb8899a59\": rpc error: code = NotFound desc = could not find container \"841b46c7120ce4af959620c64eb7b0a8b3b2c65b2f568a2aa12b162eb8899a59\": container with ID starting with 841b46c7120ce4af959620c64eb7b0a8b3b2c65b2f568a2aa12b162eb8899a59 not found: ID does not exist"
Jul 21 04:36:12.252427 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:12.252384    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"]
Jul 21 04:36:12.254697 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:12.254676    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e9c65d45-openshift-default-b457b595c-6rt2f"]
Jul 21 04:36:12.693657 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:12.693621    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71ced2f4-9600-439e-9f0c-d71008261920" path="/var/lib/kubelet/pods/71ced2f4-9600-439e-9f0c-d71008261920/volumes"
Jul 21 04:36:17.238260 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:17.238228    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq"
Jul 21 04:36:34.378294 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:34.378263    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-75c76546-wvf2m"]
Jul 21 04:36:34.378649 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:34.378556    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71ced2f4-9600-439e-9f0c-d71008261920" containerName="istio-proxy"
Jul 21 04:36:34.378649 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:34.378567    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="71ced2f4-9600-439e-9f0c-d71008261920" containerName="istio-proxy"
Jul 21 04:36:34.378649 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:34.378645    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="71ced2f4-9600-439e-9f0c-d71008261920" containerName="istio-proxy"
Jul 21 04:36:34.381518 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:34.381502    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-75c76546-wvf2m"
Jul 21 04:36:34.383568 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:34.383547    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-k4z5s\""
Jul 21 04:36:34.391346 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:34.391310    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-75c76546-wvf2m"]
Jul 21 04:36:34.546490 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:34.546454    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29de54d5-5064-4955-9ac1-afbd28adbd65-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-75c76546-wvf2m\" (UID: \"29de54d5-5064-4955-9ac1-afbd28adbd65\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-75c76546-wvf2m"
Jul 21 04:36:34.646899 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:34.646867    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29de54d5-5064-4955-9ac1-afbd28adbd65-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-75c76546-wvf2m\" (UID: \"29de54d5-5064-4955-9ac1-afbd28adbd65\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-75c76546-wvf2m"
Jul 21 04:36:34.647555 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:34.647531    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29de54d5-5064-4955-9ac1-afbd28adbd65-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-75c76546-wvf2m\" (UID: \"29de54d5-5064-4955-9ac1-afbd28adbd65\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-75c76546-wvf2m"
Jul 21 04:36:34.701382 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:34.701353    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-75c76546-wvf2m"
Jul 21 04:36:34.824896 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:34.824864    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-75c76546-wvf2m"]
Jul 21 04:36:34.827876 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:36:34.827848    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29de54d5_5064_4955_9ac1_afbd28adbd65.slice/crio-f354d9baf49a05a5de571ed6e16c363195aba59f7dbe8fc2a66d70091a618078 WatchSource:0}: Error finding container f354d9baf49a05a5de571ed6e16c363195aba59f7dbe8fc2a66d70091a618078: Status 404 returned error can't find the container with id f354d9baf49a05a5de571ed6e16c363195aba59f7dbe8fc2a66d70091a618078
Jul 21 04:36:35.333638 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:35.333553    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-75c76546-wvf2m" event={"ID":"29de54d5-5064-4955-9ac1-afbd28adbd65","Type":"ContainerStarted","Data":"a8942db485878625a99befc720de0c6dafbb99486bd8675fa32662c368475bff"}
Jul 21 04:36:35.333638 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:35.333610    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-75c76546-wvf2m" event={"ID":"29de54d5-5064-4955-9ac1-afbd28adbd65","Type":"ContainerStarted","Data":"f354d9baf49a05a5de571ed6e16c363195aba59f7dbe8fc2a66d70091a618078"}
Jul 21 04:36:35.348768 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:35.348724    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-75c76546-wvf2m" podStartSLOduration=1.348709216 podStartE2EDuration="1.348709216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:36:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:36:35.34698945 +0000 UTC m=+1925.236042614" watchObservedRunningTime="2026-07-21 04:36:35.348709216 +0000 UTC m=+1925.237762380"
Jul 21 04:36:36.339209 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:36.339174    2580 generic.go:356] "Generic (PLEG): container finished" podID="29de54d5-5064-4955-9ac1-afbd28adbd65" containerID="a8942db485878625a99befc720de0c6dafbb99486bd8675fa32662c368475bff" exitCode=0
Jul 21 04:36:36.339209 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:36.339217    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-75c76546-wvf2m" event={"ID":"29de54d5-5064-4955-9ac1-afbd28adbd65","Type":"ContainerDied","Data":"a8942db485878625a99befc720de0c6dafbb99486bd8675fa32662c368475bff"}
Jul 21 04:36:37.474777 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:37.474753    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-75c76546-wvf2m"
Jul 21 04:36:37.572730 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:37.572677    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29de54d5-5064-4955-9ac1-afbd28adbd65-maas-api-service-ca\") pod \"29de54d5-5064-4955-9ac1-afbd28adbd65\" (UID: \"29de54d5-5064-4955-9ac1-afbd28adbd65\") "
Jul 21 04:36:37.573046 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:37.573022    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29de54d5-5064-4955-9ac1-afbd28adbd65-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "29de54d5-5064-4955-9ac1-afbd28adbd65" (UID: "29de54d5-5064-4955-9ac1-afbd28adbd65"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:36:37.673878 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:37.673849    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29de54d5-5064-4955-9ac1-afbd28adbd65-maas-api-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:36:38.349066 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:38.349036    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-75c76546-wvf2m"
Jul 21 04:36:38.349228 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:38.349042    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-75c76546-wvf2m" event={"ID":"29de54d5-5064-4955-9ac1-afbd28adbd65","Type":"ContainerDied","Data":"f354d9baf49a05a5de571ed6e16c363195aba59f7dbe8fc2a66d70091a618078"}
Jul 21 04:36:38.349228 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:38.349168    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f354d9baf49a05a5de571ed6e16c363195aba59f7dbe8fc2a66d70091a618078"
Jul 21 04:36:44.790691 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:44.790652    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq"]
Jul 21 04:36:44.791216 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:44.790910    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq" podUID="06600d24-c2fb-47c0-96b5-fcdd804b2eb1" containerName="maas-api" containerID="cri-o://a142f87e5c6c205ad7f45c641022035b47c2eb3b08621fc80ee308b07bf7db5d" gracePeriod=30
Jul 21 04:36:45.035968 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:45.035944    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq"
Jul 21 04:36:45.133543 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:45.133511    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06600d24-c2fb-47c0-96b5-fcdd804b2eb1-openshift-service-ca\") pod \"06600d24-c2fb-47c0-96b5-fcdd804b2eb1\" (UID: \"06600d24-c2fb-47c0-96b5-fcdd804b2eb1\") "
Jul 21 04:36:45.133715 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:45.133586    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06600d24-c2fb-47c0-96b5-fcdd804b2eb1-maas-api-tls\") pod \"06600d24-c2fb-47c0-96b5-fcdd804b2eb1\" (UID: \"06600d24-c2fb-47c0-96b5-fcdd804b2eb1\") "
Jul 21 04:36:45.133715 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:45.133605    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trgg2\" (UniqueName: \"kubernetes.io/projected/06600d24-c2fb-47c0-96b5-fcdd804b2eb1-kube-api-access-trgg2\") pod \"06600d24-c2fb-47c0-96b5-fcdd804b2eb1\" (UID: \"06600d24-c2fb-47c0-96b5-fcdd804b2eb1\") "
Jul 21 04:36:45.133935 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:45.133909    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06600d24-c2fb-47c0-96b5-fcdd804b2eb1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "06600d24-c2fb-47c0-96b5-fcdd804b2eb1" (UID: "06600d24-c2fb-47c0-96b5-fcdd804b2eb1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:36:45.135636 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:45.135614    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06600d24-c2fb-47c0-96b5-fcdd804b2eb1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "06600d24-c2fb-47c0-96b5-fcdd804b2eb1" (UID: "06600d24-c2fb-47c0-96b5-fcdd804b2eb1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:36:45.135759 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:45.135724    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06600d24-c2fb-47c0-96b5-fcdd804b2eb1-kube-api-access-trgg2" (OuterVolumeSpecName: "kube-api-access-trgg2") pod "06600d24-c2fb-47c0-96b5-fcdd804b2eb1" (UID: "06600d24-c2fb-47c0-96b5-fcdd804b2eb1"). InnerVolumeSpecName "kube-api-access-trgg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:36:45.234173 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:45.234109    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06600d24-c2fb-47c0-96b5-fcdd804b2eb1-openshift-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:36:45.234173 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:45.234168    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06600d24-c2fb-47c0-96b5-fcdd804b2eb1-maas-api-tls\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:36:45.234173 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:45.234179    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trgg2\" (UniqueName: \"kubernetes.io/projected/06600d24-c2fb-47c0-96b5-fcdd804b2eb1-kube-api-access-trgg2\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:36:45.379783 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:45.379748    2580 generic.go:356] "Generic (PLEG): container finished" podID="06600d24-c2fb-47c0-96b5-fcdd804b2eb1" containerID="a142f87e5c6c205ad7f45c641022035b47c2eb3b08621fc80ee308b07bf7db5d" exitCode=0
Jul 21 04:36:45.379943 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:45.379807    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq"
Jul 21 04:36:45.379943 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:45.379834    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq" event={"ID":"06600d24-c2fb-47c0-96b5-fcdd804b2eb1","Type":"ContainerDied","Data":"a142f87e5c6c205ad7f45c641022035b47c2eb3b08621fc80ee308b07bf7db5d"}
Jul 21 04:36:45.379943 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:45.379888    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq" event={"ID":"06600d24-c2fb-47c0-96b5-fcdd804b2eb1","Type":"ContainerDied","Data":"501d982c1b6f49e0dd02763526d937f255f58b29d214e97d09ca2a48e4d7fc20"}
Jul 21 04:36:45.379943 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:45.379911    2580 scope.go:117] "RemoveContainer" containerID="a142f87e5c6c205ad7f45c641022035b47c2eb3b08621fc80ee308b07bf7db5d"
Jul 21 04:36:45.388686 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:45.388671    2580 scope.go:117] "RemoveContainer" containerID="a142f87e5c6c205ad7f45c641022035b47c2eb3b08621fc80ee308b07bf7db5d"
Jul 21 04:36:45.388921 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:36:45.388898    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a142f87e5c6c205ad7f45c641022035b47c2eb3b08621fc80ee308b07bf7db5d\": container with ID starting with a142f87e5c6c205ad7f45c641022035b47c2eb3b08621fc80ee308b07bf7db5d not found: ID does not exist" containerID="a142f87e5c6c205ad7f45c641022035b47c2eb3b08621fc80ee308b07bf7db5d"
Jul 21 04:36:45.388991 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:45.388934    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a142f87e5c6c205ad7f45c641022035b47c2eb3b08621fc80ee308b07bf7db5d"} err="failed to get container status \"a142f87e5c6c205ad7f45c641022035b47c2eb3b08621fc80ee308b07bf7db5d\": rpc error: code = NotFound desc = could not find container \"a142f87e5c6c205ad7f45c641022035b47c2eb3b08621fc80ee308b07bf7db5d\": container with ID starting with a142f87e5c6c205ad7f45c641022035b47c2eb3b08621fc80ee308b07bf7db5d not found: ID does not exist"
Jul 21 04:36:45.400281 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:45.400257    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq"]
Jul 21 04:36:45.405725 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:45.405705    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-75c76546-55fcd85cdc-zdbbq"]
Jul 21 04:36:46.693142 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:46.693101    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06600d24-c2fb-47c0-96b5-fcdd804b2eb1" path="/var/lib/kubelet/pods/06600d24-c2fb-47c0-96b5-fcdd804b2eb1/volumes"
Jul 21 04:36:49.455805 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:49.455766    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-75c76546-wvf2m"]
Jul 21 04:36:49.457959 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:49.457933    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-75c76546-wvf2m"]
Jul 21 04:36:50.411785 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.411749    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"]
Jul 21 04:36:50.412249 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.412228    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71ced2f4-9600-439e-9f0c-d71008261920" containerName="istio-proxy"
Jul 21 04:36:50.412249 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.412246    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="71ced2f4-9600-439e-9f0c-d71008261920" containerName="istio-proxy"
Jul 21 04:36:50.412415 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.412256    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06600d24-c2fb-47c0-96b5-fcdd804b2eb1" containerName="maas-api"
Jul 21 04:36:50.412415 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.412261    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="06600d24-c2fb-47c0-96b5-fcdd804b2eb1" containerName="maas-api"
Jul 21 04:36:50.412415 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.412269    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29de54d5-5064-4955-9ac1-afbd28adbd65" containerName="revoke-keys"
Jul 21 04:36:50.412415 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.412275    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="29de54d5-5064-4955-9ac1-afbd28adbd65" containerName="revoke-keys"
Jul 21 04:36:50.412415 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.412322    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="71ced2f4-9600-439e-9f0c-d71008261920" containerName="istio-proxy"
Jul 21 04:36:50.412415 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.412330    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="06600d24-c2fb-47c0-96b5-fcdd804b2eb1" containerName="maas-api"
Jul 21 04:36:50.412415 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.412337    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="29de54d5-5064-4955-9ac1-afbd28adbd65" containerName="revoke-keys"
Jul 21 04:36:50.416579 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.416561    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:50.418759 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.418726    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4e7463e5-openshift-default-dockercfg-w27lg\""
Jul 21 04:36:50.426142 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.426093    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"]
Jul 21 04:36:50.481829 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.481796    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1675fd8-c030-40a3-b56e-eba7416f1522-credential-socket\") pod \"e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") " pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:50.481829 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.481830    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1675fd8-c030-40a3-b56e-eba7416f1522-workload-certs\") pod \"e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") " pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:50.482266 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.481846    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1675fd8-c030-40a3-b56e-eba7416f1522-istiod-ca-cert\") pod \"e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") " pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:50.482266 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.481932    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1675fd8-c030-40a3-b56e-eba7416f1522-workload-socket\") pod \"e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") " pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:50.482266 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.481958    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1675fd8-c030-40a3-b56e-eba7416f1522-istio-token\") pod \"e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") " pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:50.482266 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.481975    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1675fd8-c030-40a3-b56e-eba7416f1522-istio-data\") pod \"e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") " pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:50.482266 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.482019    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1675fd8-c030-40a3-b56e-eba7416f1522-istio-envoy\") pod \"e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") " pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:50.482266 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.482057    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1675fd8-c030-40a3-b56e-eba7416f1522-istio-podinfo\") pod \"e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") " pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:50.482266 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.482075    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc8vz\" (UniqueName: \"kubernetes.io/projected/b1675fd8-c030-40a3-b56e-eba7416f1522-kube-api-access-wc8vz\") pod \"e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") " pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:50.583511 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.583466    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1675fd8-c030-40a3-b56e-eba7416f1522-istio-token\") pod \"e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") " pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:50.583511 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.583511    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1675fd8-c030-40a3-b56e-eba7416f1522-istio-data\") pod \"e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") " pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:50.583752 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.583539    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1675fd8-c030-40a3-b56e-eba7416f1522-istio-envoy\") pod \"e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") " pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:50.583752 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.583658    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1675fd8-c030-40a3-b56e-eba7416f1522-istio-podinfo\") pod \"e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") " pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:50.583752 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.583688    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc8vz\" (UniqueName: \"kubernetes.io/projected/b1675fd8-c030-40a3-b56e-eba7416f1522-kube-api-access-wc8vz\") pod \"e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") " pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:50.583902 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.583761    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1675fd8-c030-40a3-b56e-eba7416f1522-credential-socket\") pod \"e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") " pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:50.583902 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.583781    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1675fd8-c030-40a3-b56e-eba7416f1522-workload-certs\") pod \"e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") " pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:50.583902 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.583804    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1675fd8-c030-40a3-b56e-eba7416f1522-istiod-ca-cert\") pod \"e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") " pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:50.584068 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.583895    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1675fd8-c030-40a3-b56e-eba7416f1522-workload-socket\") pod \"e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") " pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:50.584068 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.584005    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1675fd8-c030-40a3-b56e-eba7416f1522-istio-data\") pod \"e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") " pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:50.584196 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.584081    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1675fd8-c030-40a3-b56e-eba7416f1522-workload-certs\") pod \"e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") " pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:50.584274 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.584255    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1675fd8-c030-40a3-b56e-eba7416f1522-workload-socket\") pod \"e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") " pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:50.584330 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.584277    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1675fd8-c030-40a3-b56e-eba7416f1522-credential-socket\") pod \"e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") " pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:50.584603 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.584579    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1675fd8-c030-40a3-b56e-eba7416f1522-istiod-ca-cert\") pod \"e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") " pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:50.585855 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.585830    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1675fd8-c030-40a3-b56e-eba7416f1522-istio-envoy\") pod \"e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") " pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:50.586088 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.586073    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1675fd8-c030-40a3-b56e-eba7416f1522-istio-podinfo\") pod \"e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") " pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:50.591320 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.591298    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1675fd8-c030-40a3-b56e-eba7416f1522-istio-token\") pod \"e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") " pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:50.591688 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.591663    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc8vz\" (UniqueName: \"kubernetes.io/projected/b1675fd8-c030-40a3-b56e-eba7416f1522-kube-api-access-wc8vz\") pod \"e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") " pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:50.693281 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.693203    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29de54d5-5064-4955-9ac1-afbd28adbd65" path="/var/lib/kubelet/pods/29de54d5-5064-4955-9ac1-afbd28adbd65/volumes"
Jul 21 04:36:50.728897 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.728859    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:50.863640 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.863614    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"]
Jul 21 04:36:50.865253 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:36:50.865227    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1675fd8_c030_40a3_b56e_eba7416f1522.slice/crio-ac5d17805bfd4b421d1364ddc2f2e308511cf10747e6a217c1a10fb3c4e53596 WatchSource:0}: Error finding container ac5d17805bfd4b421d1364ddc2f2e308511cf10747e6a217c1a10fb3c4e53596: Status 404 returned error can't find the container with id ac5d17805bfd4b421d1364ddc2f2e308511cf10747e6a217c1a10fb3c4e53596
Jul 21 04:36:50.867327 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.867300    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:36:50.867397 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.867365    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:36:50.867435 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:50.867393    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:36:51.408931 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:51.408895    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn" event={"ID":"b1675fd8-c030-40a3-b56e-eba7416f1522","Type":"ContainerStarted","Data":"6598554240d069100dcd49d4f32fb1861d0167494f90e053ecc42b386647f619"}
Jul 21 04:36:51.409155 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:51.408957    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn" event={"ID":"b1675fd8-c030-40a3-b56e-eba7416f1522","Type":"ContainerStarted","Data":"ac5d17805bfd4b421d1364ddc2f2e308511cf10747e6a217c1a10fb3c4e53596"}
Jul 21 04:36:51.428788 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:51.428734    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn" podStartSLOduration=1.428720053 podStartE2EDuration="1.428720053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:36:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:36:51.426776892 +0000 UTC m=+1941.315830052" watchObservedRunningTime="2026-07-21 04:36:51.428720053 +0000 UTC m=+1941.317773218"
Jul 21 04:36:51.730066 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:51.729982    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:51.734950 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:51.734923    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:52.419188 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:52.419157    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:52.420151 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:52.420115    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:36:52.864515 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:52.864440    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr"]
Jul 21 04:36:52.867910 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:52.867891    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr"
Jul 21 04:36:52.870301 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:52.870275    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-4e7463e5-serving-cert\""
Jul 21 04:36:52.879320 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:52.879298    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr"]
Jul 21 04:36:52.905934 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:52.905905    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftrxh\" (UniqueName: \"kubernetes.io/projected/93d0c1b7-6648-4573-97da-518937b5a041-kube-api-access-ftrxh\") pod \"maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr\" (UID: \"93d0c1b7-6648-4573-97da-518937b5a041\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr"
Jul 21 04:36:52.906071 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:52.905948    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93d0c1b7-6648-4573-97da-518937b5a041-openshift-service-ca\") pod \"maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr\" (UID: \"93d0c1b7-6648-4573-97da-518937b5a041\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr"
Jul 21 04:36:52.906071 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:52.906032    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93d0c1b7-6648-4573-97da-518937b5a041-maas-api-tls\") pod \"maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr\" (UID: \"93d0c1b7-6648-4573-97da-518937b5a041\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr"
Jul 21 04:36:53.006825 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:53.006794    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93d0c1b7-6648-4573-97da-518937b5a041-maas-api-tls\") pod \"maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr\" (UID: \"93d0c1b7-6648-4573-97da-518937b5a041\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr"
Jul 21 04:36:53.006951 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:53.006870    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftrxh\" (UniqueName: \"kubernetes.io/projected/93d0c1b7-6648-4573-97da-518937b5a041-kube-api-access-ftrxh\") pod \"maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr\" (UID: \"93d0c1b7-6648-4573-97da-518937b5a041\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr"
Jul 21 04:36:53.006951 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:53.006892    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93d0c1b7-6648-4573-97da-518937b5a041-openshift-service-ca\") pod \"maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr\" (UID: \"93d0c1b7-6648-4573-97da-518937b5a041\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr"
Jul 21 04:36:53.007496 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:53.007476    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93d0c1b7-6648-4573-97da-518937b5a041-openshift-service-ca\") pod \"maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr\" (UID: \"93d0c1b7-6648-4573-97da-518937b5a041\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr"
Jul 21 04:36:53.009188 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:53.009168    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93d0c1b7-6648-4573-97da-518937b5a041-maas-api-tls\") pod \"maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr\" (UID: \"93d0c1b7-6648-4573-97da-518937b5a041\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr"
Jul 21 04:36:53.017953 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:53.017932    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftrxh\" (UniqueName: \"kubernetes.io/projected/93d0c1b7-6648-4573-97da-518937b5a041-kube-api-access-ftrxh\") pod \"maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr\" (UID: \"93d0c1b7-6648-4573-97da-518937b5a041\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr"
Jul 21 04:36:53.179684 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:53.179651    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr"
Jul 21 04:36:53.317532 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:53.317508    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr"]
Jul 21 04:36:53.319402 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:36:53.319374    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93d0c1b7_6648_4573_97da_518937b5a041.slice/crio-de0263fcef3a6a52081a43810862739aa9e416970b71500b592fb22521dedea8 WatchSource:0}: Error finding container de0263fcef3a6a52081a43810862739aa9e416970b71500b592fb22521dedea8: Status 404 returned error can't find the container with id de0263fcef3a6a52081a43810862739aa9e416970b71500b592fb22521dedea8
Jul 21 04:36:53.424652 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:53.424614    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr" event={"ID":"93d0c1b7-6648-4573-97da-518937b5a041","Type":"ContainerStarted","Data":"de0263fcef3a6a52081a43810862739aa9e416970b71500b592fb22521dedea8"}
Jul 21 04:36:54.430860 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:54.430823    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr" event={"ID":"93d0c1b7-6648-4573-97da-518937b5a041","Type":"ContainerStarted","Data":"b098cc81a2fd4ce1a67509a44e26ccde5415c4f64ab97d5bc32d416dece76cec"}
Jul 21 04:36:54.431274 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:54.431148    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr"
Jul 21 04:36:54.449120 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:36:54.449057    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr" podStartSLOduration=2.062113327 podStartE2EDuration="2.449042663s" totalImagesPullingTime="386.929336ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:36:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:36:54.447067969 +0000 UTC m=+1944.336121145" watchObservedRunningTime="2026-07-21 04:36:54.449042663 +0000 UTC m=+1944.338095826"
Jul 21 04:37:00.441691 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:00.441655    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr"
Jul 21 04:37:07.420394 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:07.420357    2580 patch_prober.go:28] interesting pod/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Jul 21 04:37:07.420819 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:07.420411    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn" podUID="b1675fd8-c030-40a3-b56e-eba7416f1522" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Jul 21 04:37:07.491886 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:07.491853    2580 generic.go:356] "Generic (PLEG): container finished" podID="b1675fd8-c030-40a3-b56e-eba7416f1522" containerID="6598554240d069100dcd49d4f32fb1861d0167494f90e053ecc42b386647f619" exitCode=0
Jul 21 04:37:07.492042 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:07.491916    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn" event={"ID":"b1675fd8-c030-40a3-b56e-eba7416f1522","Type":"ContainerDied","Data":"6598554240d069100dcd49d4f32fb1861d0167494f90e053ecc42b386647f619"}
Jul 21 04:37:07.492332 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:07.492318    2580 scope.go:117] "RemoveContainer" containerID="6598554240d069100dcd49d4f32fb1861d0167494f90e053ecc42b386647f619"
Jul 21 04:37:07.493290 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:07.493263    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:37:07.493397 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:07.493349    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:37:07.493458 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:07.493399    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:37:08.497916 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:08.497885    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn" event={"ID":"b1675fd8-c030-40a3-b56e-eba7416f1522","Type":"ContainerStarted","Data":"be0cd30181e16abdf6252fc6364c3ed8d6ca30412ef17984027fbcf194e06bd1"}
Jul 21 04:37:08.729475 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:08.729430    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:37:08.729695 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:08.729571    2580 patch_prober.go:28] interesting pod/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Jul 21 04:37:08.729695 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:08.729629    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn" podUID="b1675fd8-c030-40a3-b56e-eba7416f1522" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Jul 21 04:37:09.729770 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:09.729727    2580 patch_prober.go:28] interesting pod/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Jul 21 04:37:09.730400 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:09.730364    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn" podUID="b1675fd8-c030-40a3-b56e-eba7416f1522" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Jul 21 04:37:10.729459 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:10.729407    2580 patch_prober.go:28] interesting pod/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Jul 21 04:37:10.729678 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:10.729488    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn" podUID="b1675fd8-c030-40a3-b56e-eba7416f1522" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Jul 21 04:37:11.730186 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:11.730138    2580 patch_prober.go:28] interesting pod/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Jul 21 04:37:11.730657 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:11.730211    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn" podUID="b1675fd8-c030-40a3-b56e-eba7416f1522" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Jul 21 04:37:12.733860 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:12.733826    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:37:12.734333 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:12.734105    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:37:12.734839 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:12.734822    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:37:29.330501 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:29.330415    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr"]
Jul 21 04:37:29.330989 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:29.330729    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr" podUID="93d0c1b7-6648-4573-97da-518937b5a041" containerName="maas-api" containerID="cri-o://b098cc81a2fd4ce1a67509a44e26ccde5415c4f64ab97d5bc32d416dece76cec" gracePeriod=30
Jul 21 04:37:29.579798 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:29.579767    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr"
Jul 21 04:37:29.591286 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:29.591221    2580 generic.go:356] "Generic (PLEG): container finished" podID="93d0c1b7-6648-4573-97da-518937b5a041" containerID="b098cc81a2fd4ce1a67509a44e26ccde5415c4f64ab97d5bc32d416dece76cec" exitCode=0
Jul 21 04:37:29.591413 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:29.591281    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr"
Jul 21 04:37:29.591413 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:29.591312    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr" event={"ID":"93d0c1b7-6648-4573-97da-518937b5a041","Type":"ContainerDied","Data":"b098cc81a2fd4ce1a67509a44e26ccde5415c4f64ab97d5bc32d416dece76cec"}
Jul 21 04:37:29.591413 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:29.591380    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr" event={"ID":"93d0c1b7-6648-4573-97da-518937b5a041","Type":"ContainerDied","Data":"de0263fcef3a6a52081a43810862739aa9e416970b71500b592fb22521dedea8"}
Jul 21 04:37:29.591413 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:29.591410    2580 scope.go:117] "RemoveContainer" containerID="b098cc81a2fd4ce1a67509a44e26ccde5415c4f64ab97d5bc32d416dece76cec"
Jul 21 04:37:29.601060 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:29.601028    2580 scope.go:117] "RemoveContainer" containerID="b098cc81a2fd4ce1a67509a44e26ccde5415c4f64ab97d5bc32d416dece76cec"
Jul 21 04:37:29.601430 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:37:29.601409    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b098cc81a2fd4ce1a67509a44e26ccde5415c4f64ab97d5bc32d416dece76cec\": container with ID starting with b098cc81a2fd4ce1a67509a44e26ccde5415c4f64ab97d5bc32d416dece76cec not found: ID does not exist" containerID="b098cc81a2fd4ce1a67509a44e26ccde5415c4f64ab97d5bc32d416dece76cec"
Jul 21 04:37:29.601506 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:29.601440    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b098cc81a2fd4ce1a67509a44e26ccde5415c4f64ab97d5bc32d416dece76cec"} err="failed to get container status \"b098cc81a2fd4ce1a67509a44e26ccde5415c4f64ab97d5bc32d416dece76cec\": rpc error: code = NotFound desc = could not find container \"b098cc81a2fd4ce1a67509a44e26ccde5415c4f64ab97d5bc32d416dece76cec\": container with ID starting with b098cc81a2fd4ce1a67509a44e26ccde5415c4f64ab97d5bc32d416dece76cec not found: ID does not exist"
Jul 21 04:37:29.632748 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:29.632720    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93d0c1b7-6648-4573-97da-518937b5a041-openshift-service-ca\") pod \"93d0c1b7-6648-4573-97da-518937b5a041\" (UID: \"93d0c1b7-6648-4573-97da-518937b5a041\") "
Jul 21 04:37:29.632858 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:29.632774    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93d0c1b7-6648-4573-97da-518937b5a041-maas-api-tls\") pod \"93d0c1b7-6648-4573-97da-518937b5a041\" (UID: \"93d0c1b7-6648-4573-97da-518937b5a041\") "
Jul 21 04:37:29.632858 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:29.632802    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftrxh\" (UniqueName: \"kubernetes.io/projected/93d0c1b7-6648-4573-97da-518937b5a041-kube-api-access-ftrxh\") pod \"93d0c1b7-6648-4573-97da-518937b5a041\" (UID: \"93d0c1b7-6648-4573-97da-518937b5a041\") "
Jul 21 04:37:29.633151 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:29.633100    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93d0c1b7-6648-4573-97da-518937b5a041-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "93d0c1b7-6648-4573-97da-518937b5a041" (UID: "93d0c1b7-6648-4573-97da-518937b5a041"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:37:29.634752 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:29.634728    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93d0c1b7-6648-4573-97da-518937b5a041-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "93d0c1b7-6648-4573-97da-518937b5a041" (UID: "93d0c1b7-6648-4573-97da-518937b5a041"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:37:29.634841 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:29.634800    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93d0c1b7-6648-4573-97da-518937b5a041-kube-api-access-ftrxh" (OuterVolumeSpecName: "kube-api-access-ftrxh") pod "93d0c1b7-6648-4573-97da-518937b5a041" (UID: "93d0c1b7-6648-4573-97da-518937b5a041"). InnerVolumeSpecName "kube-api-access-ftrxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:37:29.733601 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:29.733564    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93d0c1b7-6648-4573-97da-518937b5a041-openshift-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:37:29.733601 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:29.733596    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93d0c1b7-6648-4573-97da-518937b5a041-maas-api-tls\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:37:29.733785 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:29.733611    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftrxh\" (UniqueName: \"kubernetes.io/projected/93d0c1b7-6648-4573-97da-518937b5a041-kube-api-access-ftrxh\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:37:29.912544 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:29.912501    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr"]
Jul 21 04:37:29.916531 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:29.916504    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4e7463e5-c96df9cb6-gwcmr"]
Jul 21 04:37:30.693768 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:30.693730    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93d0c1b7-6648-4573-97da-518937b5a041" path="/var/lib/kubelet/pods/93d0c1b7-6648-4573-97da-518937b5a041/volumes"
Jul 21 04:37:35.054316 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:35.054282    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"]
Jul 21 04:37:35.054811 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:35.054513    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn" podUID="b1675fd8-c030-40a3-b56e-eba7416f1522" containerName="istio-proxy" containerID="cri-o://be0cd30181e16abdf6252fc6364c3ed8d6ca30412ef17984027fbcf194e06bd1" gracePeriod=30
Jul 21 04:37:38.966774 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:38.966735    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5016fdfc-84897d7499-24887"]
Jul 21 04:37:38.967216 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:38.967187    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93d0c1b7-6648-4573-97da-518937b5a041" containerName="maas-api"
Jul 21 04:37:38.967216 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:38.967203    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="93d0c1b7-6648-4573-97da-518937b5a041" containerName="maas-api"
Jul 21 04:37:38.967314 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:38.967302    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="93d0c1b7-6648-4573-97da-518937b5a041" containerName="maas-api"
Jul 21 04:37:38.970171 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:38.970156    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5016fdfc-84897d7499-24887"
Jul 21 04:37:38.973448 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:38.973426    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-5016fdfc-serving-cert\""
Jul 21 04:37:38.994393 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:38.994366    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5016fdfc-84897d7499-24887"]
Jul 21 04:37:39.020160 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:39.020134    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fabab01-8c51-48e5-a7a1-822003c678df-openshift-service-ca\") pod \"maas-api-e2e-derive-5016fdfc-84897d7499-24887\" (UID: \"1fabab01-8c51-48e5-a7a1-822003c678df\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5016fdfc-84897d7499-24887"
Jul 21 04:37:39.020317 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:39.020167    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpcrn\" (UniqueName: \"kubernetes.io/projected/1fabab01-8c51-48e5-a7a1-822003c678df-kube-api-access-xpcrn\") pod \"maas-api-e2e-derive-5016fdfc-84897d7499-24887\" (UID: \"1fabab01-8c51-48e5-a7a1-822003c678df\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5016fdfc-84897d7499-24887"
Jul 21 04:37:39.020317 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:39.020194    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1fabab01-8c51-48e5-a7a1-822003c678df-maas-api-tls\") pod \"maas-api-e2e-derive-5016fdfc-84897d7499-24887\" (UID: \"1fabab01-8c51-48e5-a7a1-822003c678df\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5016fdfc-84897d7499-24887"
Jul 21 04:37:39.120875 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:39.120835    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fabab01-8c51-48e5-a7a1-822003c678df-openshift-service-ca\") pod \"maas-api-e2e-derive-5016fdfc-84897d7499-24887\" (UID: \"1fabab01-8c51-48e5-a7a1-822003c678df\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5016fdfc-84897d7499-24887"
Jul 21 04:37:39.120875 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:39.120875    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpcrn\" (UniqueName: \"kubernetes.io/projected/1fabab01-8c51-48e5-a7a1-822003c678df-kube-api-access-xpcrn\") pod \"maas-api-e2e-derive-5016fdfc-84897d7499-24887\" (UID: \"1fabab01-8c51-48e5-a7a1-822003c678df\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5016fdfc-84897d7499-24887"
Jul 21 04:37:39.121084 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:39.120901    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1fabab01-8c51-48e5-a7a1-822003c678df-maas-api-tls\") pod \"maas-api-e2e-derive-5016fdfc-84897d7499-24887\" (UID: \"1fabab01-8c51-48e5-a7a1-822003c678df\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5016fdfc-84897d7499-24887"
Jul 21 04:37:39.121509 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:39.121488    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fabab01-8c51-48e5-a7a1-822003c678df-openshift-service-ca\") pod \"maas-api-e2e-derive-5016fdfc-84897d7499-24887\" (UID: \"1fabab01-8c51-48e5-a7a1-822003c678df\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5016fdfc-84897d7499-24887"
Jul 21 04:37:39.123344 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:39.123324    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1fabab01-8c51-48e5-a7a1-822003c678df-maas-api-tls\") pod \"maas-api-e2e-derive-5016fdfc-84897d7499-24887\" (UID: \"1fabab01-8c51-48e5-a7a1-822003c678df\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5016fdfc-84897d7499-24887"
Jul 21 04:37:39.138381 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:39.138357    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpcrn\" (UniqueName: \"kubernetes.io/projected/1fabab01-8c51-48e5-a7a1-822003c678df-kube-api-access-xpcrn\") pod \"maas-api-e2e-derive-5016fdfc-84897d7499-24887\" (UID: \"1fabab01-8c51-48e5-a7a1-822003c678df\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5016fdfc-84897d7499-24887"
Jul 21 04:37:39.282857 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:39.282774    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5016fdfc-84897d7499-24887"
Jul 21 04:37:39.425788 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:39.425763    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5016fdfc-84897d7499-24887"]
Jul 21 04:37:39.428320 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:37:39.428294    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fabab01_8c51_48e5_a7a1_822003c678df.slice/crio-993daff4991bec3e42ea31e8d3ace373b7180bb51a56ed6c7215260ce0920f5f WatchSource:0}: Error finding container 993daff4991bec3e42ea31e8d3ace373b7180bb51a56ed6c7215260ce0920f5f: Status 404 returned error can't find the container with id 993daff4991bec3e42ea31e8d3ace373b7180bb51a56ed6c7215260ce0920f5f
Jul 21 04:37:39.634949 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:39.634919    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5016fdfc-84897d7499-24887" event={"ID":"1fabab01-8c51-48e5-a7a1-822003c678df","Type":"ContainerStarted","Data":"993daff4991bec3e42ea31e8d3ace373b7180bb51a56ed6c7215260ce0920f5f"}
Jul 21 04:37:40.307743 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.307720    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:37:40.437235 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.437201    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1675fd8-c030-40a3-b56e-eba7416f1522-credential-socket\") pod \"b1675fd8-c030-40a3-b56e-eba7416f1522\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") "
Jul 21 04:37:40.437410 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.437243    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1675fd8-c030-40a3-b56e-eba7416f1522-workload-socket\") pod \"b1675fd8-c030-40a3-b56e-eba7416f1522\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") "
Jul 21 04:37:40.437410 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.437269    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1675fd8-c030-40a3-b56e-eba7416f1522-istio-data\") pod \"b1675fd8-c030-40a3-b56e-eba7416f1522\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") "
Jul 21 04:37:40.437410 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.437287    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1675fd8-c030-40a3-b56e-eba7416f1522-istiod-ca-cert\") pod \"b1675fd8-c030-40a3-b56e-eba7416f1522\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") "
Jul 21 04:37:40.437410 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.437314    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wc8vz\" (UniqueName: \"kubernetes.io/projected/b1675fd8-c030-40a3-b56e-eba7416f1522-kube-api-access-wc8vz\") pod \"b1675fd8-c030-40a3-b56e-eba7416f1522\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") "
Jul 21 04:37:40.437410 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.437350    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1675fd8-c030-40a3-b56e-eba7416f1522-istio-envoy\") pod \"b1675fd8-c030-40a3-b56e-eba7416f1522\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") "
Jul 21 04:37:40.437410 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.437370    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1675fd8-c030-40a3-b56e-eba7416f1522-istio-token\") pod \"b1675fd8-c030-40a3-b56e-eba7416f1522\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") "
Jul 21 04:37:40.437410 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.437410    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1675fd8-c030-40a3-b56e-eba7416f1522-istio-podinfo\") pod \"b1675fd8-c030-40a3-b56e-eba7416f1522\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") "
Jul 21 04:37:40.437761 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.437455    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1675fd8-c030-40a3-b56e-eba7416f1522-workload-certs\") pod \"b1675fd8-c030-40a3-b56e-eba7416f1522\" (UID: \"b1675fd8-c030-40a3-b56e-eba7416f1522\") "
Jul 21 04:37:40.437761 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.437531    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1675fd8-c030-40a3-b56e-eba7416f1522-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b1675fd8-c030-40a3-b56e-eba7416f1522" (UID: "b1675fd8-c030-40a3-b56e-eba7416f1522"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:37:40.437761 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.437546    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1675fd8-c030-40a3-b56e-eba7416f1522-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b1675fd8-c030-40a3-b56e-eba7416f1522" (UID: "b1675fd8-c030-40a3-b56e-eba7416f1522"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:37:40.437761 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.437740    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1675fd8-c030-40a3-b56e-eba7416f1522-credential-socket\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:37:40.437761 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.437759    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1675fd8-c030-40a3-b56e-eba7416f1522-workload-socket\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:37:40.438004 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.437766    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1675fd8-c030-40a3-b56e-eba7416f1522-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b1675fd8-c030-40a3-b56e-eba7416f1522" (UID: "b1675fd8-c030-40a3-b56e-eba7416f1522"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:37:40.438055 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.438036    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1675fd8-c030-40a3-b56e-eba7416f1522-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b1675fd8-c030-40a3-b56e-eba7416f1522" (UID: "b1675fd8-c030-40a3-b56e-eba7416f1522"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:37:40.438238 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.438214    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1675fd8-c030-40a3-b56e-eba7416f1522-istio-data" (OuterVolumeSpecName: "istio-data") pod "b1675fd8-c030-40a3-b56e-eba7416f1522" (UID: "b1675fd8-c030-40a3-b56e-eba7416f1522"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:37:40.440116 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.440088    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1675fd8-c030-40a3-b56e-eba7416f1522-istio-token" (OuterVolumeSpecName: "istio-token") pod "b1675fd8-c030-40a3-b56e-eba7416f1522" (UID: "b1675fd8-c030-40a3-b56e-eba7416f1522"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:37:40.440116 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.440087    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1675fd8-c030-40a3-b56e-eba7416f1522-kube-api-access-wc8vz" (OuterVolumeSpecName: "kube-api-access-wc8vz") pod "b1675fd8-c030-40a3-b56e-eba7416f1522" (UID: "b1675fd8-c030-40a3-b56e-eba7416f1522"). InnerVolumeSpecName "kube-api-access-wc8vz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:37:40.440116 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.440136    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1675fd8-c030-40a3-b56e-eba7416f1522-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b1675fd8-c030-40a3-b56e-eba7416f1522" (UID: "b1675fd8-c030-40a3-b56e-eba7416f1522"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:37:40.440305 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.440149    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b1675fd8-c030-40a3-b56e-eba7416f1522-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b1675fd8-c030-40a3-b56e-eba7416f1522" (UID: "b1675fd8-c030-40a3-b56e-eba7416f1522"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 04:37:40.538382 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.538346    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1675fd8-c030-40a3-b56e-eba7416f1522-istio-podinfo\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:37:40.538382 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.538376    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1675fd8-c030-40a3-b56e-eba7416f1522-workload-certs\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:37:40.538382 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.538385    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1675fd8-c030-40a3-b56e-eba7416f1522-istio-data\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:37:40.538382 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.538392    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1675fd8-c030-40a3-b56e-eba7416f1522-istiod-ca-cert\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:37:40.538638 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.538400    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wc8vz\" (UniqueName: \"kubernetes.io/projected/b1675fd8-c030-40a3-b56e-eba7416f1522-kube-api-access-wc8vz\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:37:40.538638 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.538409    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1675fd8-c030-40a3-b56e-eba7416f1522-istio-envoy\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:37:40.538638 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.538418    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1675fd8-c030-40a3-b56e-eba7416f1522-istio-token\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:37:40.640988 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.640953    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5016fdfc-84897d7499-24887" event={"ID":"1fabab01-8c51-48e5-a7a1-822003c678df","Type":"ContainerStarted","Data":"2a2f5cf3a1bed2e45aa585dc40db86be53f47aa609c2f0c6bd448af6705f4df4"}
Jul 21 04:37:40.641194 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.641044    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5016fdfc-84897d7499-24887"
Jul 21 04:37:40.642622 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.642597    2580 generic.go:356] "Generic (PLEG): container finished" podID="b1675fd8-c030-40a3-b56e-eba7416f1522" containerID="be0cd30181e16abdf6252fc6364c3ed8d6ca30412ef17984027fbcf194e06bd1" exitCode=0
Jul 21 04:37:40.642719 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.642633    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"
Jul 21 04:37:40.642719 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.642682    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn" event={"ID":"b1675fd8-c030-40a3-b56e-eba7416f1522","Type":"ContainerDied","Data":"be0cd30181e16abdf6252fc6364c3ed8d6ca30412ef17984027fbcf194e06bd1"}
Jul 21 04:37:40.642813 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.642725    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn" event={"ID":"b1675fd8-c030-40a3-b56e-eba7416f1522","Type":"ContainerDied","Data":"ac5d17805bfd4b421d1364ddc2f2e308511cf10747e6a217c1a10fb3c4e53596"}
Jul 21 04:37:40.642813 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.642745    2580 scope.go:117] "RemoveContainer" containerID="be0cd30181e16abdf6252fc6364c3ed8d6ca30412ef17984027fbcf194e06bd1"
Jul 21 04:37:40.651571 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.651550    2580 scope.go:117] "RemoveContainer" containerID="6598554240d069100dcd49d4f32fb1861d0167494f90e053ecc42b386647f619"
Jul 21 04:37:40.658795 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.658780    2580 scope.go:117] "RemoveContainer" containerID="be0cd30181e16abdf6252fc6364c3ed8d6ca30412ef17984027fbcf194e06bd1"
Jul 21 04:37:40.659037 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:37:40.659010    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be0cd30181e16abdf6252fc6364c3ed8d6ca30412ef17984027fbcf194e06bd1\": container with ID starting with be0cd30181e16abdf6252fc6364c3ed8d6ca30412ef17984027fbcf194e06bd1 not found: ID does not exist" containerID="be0cd30181e16abdf6252fc6364c3ed8d6ca30412ef17984027fbcf194e06bd1"
Jul 21 04:37:40.659081 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.659036    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be0cd30181e16abdf6252fc6364c3ed8d6ca30412ef17984027fbcf194e06bd1"} err="failed to get container status \"be0cd30181e16abdf6252fc6364c3ed8d6ca30412ef17984027fbcf194e06bd1\": rpc error: code = NotFound desc = could not find container \"be0cd30181e16abdf6252fc6364c3ed8d6ca30412ef17984027fbcf194e06bd1\": container with ID starting with be0cd30181e16abdf6252fc6364c3ed8d6ca30412ef17984027fbcf194e06bd1 not found: ID does not exist"
Jul 21 04:37:40.659081 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.659056    2580 scope.go:117] "RemoveContainer" containerID="6598554240d069100dcd49d4f32fb1861d0167494f90e053ecc42b386647f619"
Jul 21 04:37:40.659282 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:37:40.659268    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6598554240d069100dcd49d4f32fb1861d0167494f90e053ecc42b386647f619\": container with ID starting with 6598554240d069100dcd49d4f32fb1861d0167494f90e053ecc42b386647f619 not found: ID does not exist" containerID="6598554240d069100dcd49d4f32fb1861d0167494f90e053ecc42b386647f619"
Jul 21 04:37:40.659319 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.659286    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6598554240d069100dcd49d4f32fb1861d0167494f90e053ecc42b386647f619"} err="failed to get container status \"6598554240d069100dcd49d4f32fb1861d0167494f90e053ecc42b386647f619\": rpc error: code = NotFound desc = could not find container \"6598554240d069100dcd49d4f32fb1861d0167494f90e053ecc42b386647f619\": container with ID starting with 6598554240d069100dcd49d4f32fb1861d0167494f90e053ecc42b386647f619 not found: ID does not exist"
Jul 21 04:37:40.667707 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.667666    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5016fdfc-84897d7499-24887" podStartSLOduration=2.26108582 podStartE2EDuration="2.667651498s" totalImagesPullingTime="406.565678ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:37:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:37:40.665478088 +0000 UTC m=+1990.554531253" watchObservedRunningTime="2026-07-21 04:37:40.667651498 +0000 UTC m=+1990.556704661"
Jul 21 04:37:40.694471 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.694417    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"]
Jul 21 04:37:40.694471 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:40.694446    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4e7463e5-openshift-default-5f69cbf96f-tqcgn"]
Jul 21 04:37:42.693602 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:42.693571    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1675fd8-c030-40a3-b56e-eba7416f1522" path="/var/lib/kubelet/pods/b1675fd8-c030-40a3-b56e-eba7416f1522/volumes"
Jul 21 04:37:46.654460 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:37:46.654432    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5016fdfc-84897d7499-24887"
Jul 21 04:38:03.738927 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:03.738890    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5016fdfc-lxl9d"]
Jul 21 04:38:03.739353 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:03.739236    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1675fd8-c030-40a3-b56e-eba7416f1522" containerName="istio-proxy"
Jul 21 04:38:03.739353 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:03.739248    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1675fd8-c030-40a3-b56e-eba7416f1522" containerName="istio-proxy"
Jul 21 04:38:03.739353 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:03.739255    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1675fd8-c030-40a3-b56e-eba7416f1522" containerName="istio-proxy"
Jul 21 04:38:03.739353 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:03.739261    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1675fd8-c030-40a3-b56e-eba7416f1522" containerName="istio-proxy"
Jul 21 04:38:03.739353 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:03.739310    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1675fd8-c030-40a3-b56e-eba7416f1522" containerName="istio-proxy"
Jul 21 04:38:03.742035 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:03.742017    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5016fdfc-lxl9d"
Jul 21 04:38:03.751734 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:03.746544    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-k4z5s\""
Jul 21 04:38:03.756439 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:03.756326    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5016fdfc-lxl9d"]
Jul 21 04:38:03.846784 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:03.846747    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a1d9848-1926-4816-91e7-5197399688a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5016fdfc-lxl9d\" (UID: \"8a1d9848-1926-4816-91e7-5197399688a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5016fdfc-lxl9d"
Jul 21 04:38:03.948010 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:03.947974    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a1d9848-1926-4816-91e7-5197399688a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5016fdfc-lxl9d\" (UID: \"8a1d9848-1926-4816-91e7-5197399688a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5016fdfc-lxl9d"
Jul 21 04:38:03.948646 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:03.948627    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a1d9848-1926-4816-91e7-5197399688a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5016fdfc-lxl9d\" (UID: \"8a1d9848-1926-4816-91e7-5197399688a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5016fdfc-lxl9d"
Jul 21 04:38:04.059637 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:04.059537    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5016fdfc-lxl9d"
Jul 21 04:38:04.199570 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:04.199414    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5016fdfc-lxl9d"]
Jul 21 04:38:04.202187 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:38:04.202157    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a1d9848_1926_4816_91e7_5197399688a4.slice/crio-6ff39d85fe6ae13f3c9b89c19fb149c665d980295974f666179ab6b2c4490ced WatchSource:0}: Error finding container 6ff39d85fe6ae13f3c9b89c19fb149c665d980295974f666179ab6b2c4490ced: Status 404 returned error can't find the container with id 6ff39d85fe6ae13f3c9b89c19fb149c665d980295974f666179ab6b2c4490ced
Jul 21 04:38:04.760212 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:04.760101    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5016fdfc-lxl9d" event={"ID":"8a1d9848-1926-4816-91e7-5197399688a4","Type":"ContainerStarted","Data":"4493a770a6d7bace8c10cacc8592fd10b3a4a4d0b66c905800a7f784ff7aa7f5"}
Jul 21 04:38:04.760212 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:04.760175    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5016fdfc-lxl9d" event={"ID":"8a1d9848-1926-4816-91e7-5197399688a4","Type":"ContainerStarted","Data":"6ff39d85fe6ae13f3c9b89c19fb149c665d980295974f666179ab6b2c4490ced"}
Jul 21 04:38:04.792939 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:04.792881    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5016fdfc-lxl9d" podStartSLOduration=1.792862162 podStartE2EDuration="1.792862162s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:38:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:38:04.792726778 +0000 UTC m=+2014.681779970" watchObservedRunningTime="2026-07-21 04:38:04.792862162 +0000 UTC m=+2014.681915327"
Jul 21 04:38:05.766025 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:05.765988    2580 generic.go:356] "Generic (PLEG): container finished" podID="8a1d9848-1926-4816-91e7-5197399688a4" containerID="4493a770a6d7bace8c10cacc8592fd10b3a4a4d0b66c905800a7f784ff7aa7f5" exitCode=0
Jul 21 04:38:05.766446 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:05.766073    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5016fdfc-lxl9d" event={"ID":"8a1d9848-1926-4816-91e7-5197399688a4","Type":"ContainerDied","Data":"4493a770a6d7bace8c10cacc8592fd10b3a4a4d0b66c905800a7f784ff7aa7f5"}
Jul 21 04:38:06.895097 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:06.895073    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5016fdfc-lxl9d"
Jul 21 04:38:07.072489 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:07.072385    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a1d9848-1926-4816-91e7-5197399688a4-maas-api-service-ca\") pod \"8a1d9848-1926-4816-91e7-5197399688a4\" (UID: \"8a1d9848-1926-4816-91e7-5197399688a4\") "
Jul 21 04:38:07.072766 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:07.072742    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a1d9848-1926-4816-91e7-5197399688a4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8a1d9848-1926-4816-91e7-5197399688a4" (UID: "8a1d9848-1926-4816-91e7-5197399688a4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:38:07.173383 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:07.173348    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a1d9848-1926-4816-91e7-5197399688a4-maas-api-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:38:07.775688 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:07.775654    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5016fdfc-lxl9d"
Jul 21 04:38:07.775859 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:07.775653    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5016fdfc-lxl9d" event={"ID":"8a1d9848-1926-4816-91e7-5197399688a4","Type":"ContainerDied","Data":"6ff39d85fe6ae13f3c9b89c19fb149c665d980295974f666179ab6b2c4490ced"}
Jul 21 04:38:07.775859 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:07.775779    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ff39d85fe6ae13f3c9b89c19fb149c665d980295974f666179ab6b2c4490ced"
Jul 21 04:38:14.480803 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:14.480763    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5016fdfc-84897d7499-24887"]
Jul 21 04:38:14.481326 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:14.481021    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5016fdfc-84897d7499-24887" podUID="1fabab01-8c51-48e5-a7a1-822003c678df" containerName="maas-api" containerID="cri-o://2a2f5cf3a1bed2e45aa585dc40db86be53f47aa609c2f0c6bd448af6705f4df4" gracePeriod=30
Jul 21 04:38:14.724721 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:14.724698    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5016fdfc-84897d7499-24887"
Jul 21 04:38:14.726675 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:14.726656    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fabab01-8c51-48e5-a7a1-822003c678df-openshift-service-ca\") pod \"1fabab01-8c51-48e5-a7a1-822003c678df\" (UID: \"1fabab01-8c51-48e5-a7a1-822003c678df\") "
Jul 21 04:38:14.726733 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:14.726691    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpcrn\" (UniqueName: \"kubernetes.io/projected/1fabab01-8c51-48e5-a7a1-822003c678df-kube-api-access-xpcrn\") pod \"1fabab01-8c51-48e5-a7a1-822003c678df\" (UID: \"1fabab01-8c51-48e5-a7a1-822003c678df\") "
Jul 21 04:38:14.726770 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:14.726736    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1fabab01-8c51-48e5-a7a1-822003c678df-maas-api-tls\") pod \"1fabab01-8c51-48e5-a7a1-822003c678df\" (UID: \"1fabab01-8c51-48e5-a7a1-822003c678df\") "
Jul 21 04:38:14.726974 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:14.726949    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fabab01-8c51-48e5-a7a1-822003c678df-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1fabab01-8c51-48e5-a7a1-822003c678df" (UID: "1fabab01-8c51-48e5-a7a1-822003c678df"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:38:14.728589 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:14.728565    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fabab01-8c51-48e5-a7a1-822003c678df-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1fabab01-8c51-48e5-a7a1-822003c678df" (UID: "1fabab01-8c51-48e5-a7a1-822003c678df"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:38:14.728695 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:14.728673    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fabab01-8c51-48e5-a7a1-822003c678df-kube-api-access-xpcrn" (OuterVolumeSpecName: "kube-api-access-xpcrn") pod "1fabab01-8c51-48e5-a7a1-822003c678df" (UID: "1fabab01-8c51-48e5-a7a1-822003c678df"). InnerVolumeSpecName "kube-api-access-xpcrn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:38:14.808091 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:14.808056    2580 generic.go:356] "Generic (PLEG): container finished" podID="1fabab01-8c51-48e5-a7a1-822003c678df" containerID="2a2f5cf3a1bed2e45aa585dc40db86be53f47aa609c2f0c6bd448af6705f4df4" exitCode=0
Jul 21 04:38:14.808241 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:14.808107    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5016fdfc-84897d7499-24887"
Jul 21 04:38:14.808241 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:14.808153    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5016fdfc-84897d7499-24887" event={"ID":"1fabab01-8c51-48e5-a7a1-822003c678df","Type":"ContainerDied","Data":"2a2f5cf3a1bed2e45aa585dc40db86be53f47aa609c2f0c6bd448af6705f4df4"}
Jul 21 04:38:14.808241 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:14.808224    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5016fdfc-84897d7499-24887" event={"ID":"1fabab01-8c51-48e5-a7a1-822003c678df","Type":"ContainerDied","Data":"993daff4991bec3e42ea31e8d3ace373b7180bb51a56ed6c7215260ce0920f5f"}
Jul 21 04:38:14.808369 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:14.808245    2580 scope.go:117] "RemoveContainer" containerID="2a2f5cf3a1bed2e45aa585dc40db86be53f47aa609c2f0c6bd448af6705f4df4"
Jul 21 04:38:14.817158 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:14.817119    2580 scope.go:117] "RemoveContainer" containerID="2a2f5cf3a1bed2e45aa585dc40db86be53f47aa609c2f0c6bd448af6705f4df4"
Jul 21 04:38:14.817386 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:38:14.817370    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a2f5cf3a1bed2e45aa585dc40db86be53f47aa609c2f0c6bd448af6705f4df4\": container with ID starting with 2a2f5cf3a1bed2e45aa585dc40db86be53f47aa609c2f0c6bd448af6705f4df4 not found: ID does not exist" containerID="2a2f5cf3a1bed2e45aa585dc40db86be53f47aa609c2f0c6bd448af6705f4df4"
Jul 21 04:38:14.817443 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:14.817392    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a2f5cf3a1bed2e45aa585dc40db86be53f47aa609c2f0c6bd448af6705f4df4"} err="failed to get container status \"2a2f5cf3a1bed2e45aa585dc40db86be53f47aa609c2f0c6bd448af6705f4df4\": rpc error: code = NotFound desc = could not find container \"2a2f5cf3a1bed2e45aa585dc40db86be53f47aa609c2f0c6bd448af6705f4df4\": container with ID starting with 2a2f5cf3a1bed2e45aa585dc40db86be53f47aa609c2f0c6bd448af6705f4df4 not found: ID does not exist"
Jul 21 04:38:14.827862 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:14.827842    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fabab01-8c51-48e5-a7a1-822003c678df-openshift-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:38:14.827862 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:14.827863    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpcrn\" (UniqueName: \"kubernetes.io/projected/1fabab01-8c51-48e5-a7a1-822003c678df-kube-api-access-xpcrn\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:38:14.827970 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:14.827874    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1fabab01-8c51-48e5-a7a1-822003c678df-maas-api-tls\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:38:14.836961 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:14.836934    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5016fdfc-84897d7499-24887"]
Jul 21 04:38:14.840901 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:14.840881    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5016fdfc-84897d7499-24887"]
Jul 21 04:38:16.693378 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:16.693349    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fabab01-8c51-48e5-a7a1-822003c678df" path="/var/lib/kubelet/pods/1fabab01-8c51-48e5-a7a1-822003c678df/volumes"
Jul 21 04:38:18.929549 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:18.929512    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5016fdfc-lxl9d"]
Jul 21 04:38:18.951818 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:18.951790    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5016fdfc-lxl9d"]
Jul 21 04:38:20.699136 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:38:20.699087    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a1d9848-1926-4816-91e7-5197399688a4" path="/var/lib/kubelet/pods/8a1d9848-1926-4816-91e7-5197399688a4/volumes"
Jul 21 04:39:30.689530 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:39:30.689496    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-694fk_6f2c16b6-c4e7-480c-b4d7-1312ed5ad130/ovn-acl-logging/0.log"
Jul 21 04:39:30.693991 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:39:30.693963    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-694fk_6f2c16b6-c4e7-480c-b4d7-1312ed5ad130/ovn-acl-logging/0.log"
Jul 21 04:40:05.180236 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.180202    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"]
Jul 21 04:40:05.180710 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.180528    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a1d9848-1926-4816-91e7-5197399688a4" containerName="revoke-keys"
Jul 21 04:40:05.180710 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.180540    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a1d9848-1926-4816-91e7-5197399688a4" containerName="revoke-keys"
Jul 21 04:40:05.180710 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.180562    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fabab01-8c51-48e5-a7a1-822003c678df" containerName="maas-api"
Jul 21 04:40:05.180710 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.180568    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fabab01-8c51-48e5-a7a1-822003c678df" containerName="maas-api"
Jul 21 04:40:05.180710 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.180623    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fabab01-8c51-48e5-a7a1-822003c678df" containerName="maas-api"
Jul 21 04:40:05.180710 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.180634    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1675fd8-c030-40a3-b56e-eba7416f1522" containerName="istio-proxy"
Jul 21 04:40:05.180710 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.180641    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a1d9848-1926-4816-91e7-5197399688a4" containerName="revoke-keys"
Jul 21 04:40:05.183396 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.183379    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:05.185848 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.185829    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-70ff50f3-openshift-default-dockercfg-ztg8j\""
Jul 21 04:40:05.209498 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.209470    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"]
Jul 21 04:40:05.257530 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.257499    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89620210-c0a9-4abd-b3f8-8f5be130b7b7-workload-socket\") pod \"e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") " pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:05.257677 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.257541    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89620210-c0a9-4abd-b3f8-8f5be130b7b7-istio-data\") pod \"e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") " pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:05.257677 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.257609    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89620210-c0a9-4abd-b3f8-8f5be130b7b7-workload-certs\") pod \"e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") " pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:05.257677 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.257632    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89620210-c0a9-4abd-b3f8-8f5be130b7b7-istio-podinfo\") pod \"e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") " pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:05.257819 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.257681    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89620210-c0a9-4abd-b3f8-8f5be130b7b7-istio-envoy\") pod \"e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") " pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:05.257819 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.257709    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89620210-c0a9-4abd-b3f8-8f5be130b7b7-istio-token\") pod \"e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") " pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:05.257819 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.257795    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89620210-c0a9-4abd-b3f8-8f5be130b7b7-credential-socket\") pod \"e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") " pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:05.257966 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.257854    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnzd5\" (UniqueName: \"kubernetes.io/projected/89620210-c0a9-4abd-b3f8-8f5be130b7b7-kube-api-access-wnzd5\") pod \"e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") " pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:05.257966 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.257884    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89620210-c0a9-4abd-b3f8-8f5be130b7b7-istiod-ca-cert\") pod \"e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") " pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:05.359256 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.359219    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnzd5\" (UniqueName: \"kubernetes.io/projected/89620210-c0a9-4abd-b3f8-8f5be130b7b7-kube-api-access-wnzd5\") pod \"e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") " pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:05.359256 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.359258    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89620210-c0a9-4abd-b3f8-8f5be130b7b7-istiod-ca-cert\") pod \"e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") " pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:05.359502 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.359310    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89620210-c0a9-4abd-b3f8-8f5be130b7b7-workload-socket\") pod \"e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") " pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:05.359502 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.359326    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89620210-c0a9-4abd-b3f8-8f5be130b7b7-istio-data\") pod \"e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") " pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:05.359502 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.359363    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89620210-c0a9-4abd-b3f8-8f5be130b7b7-workload-certs\") pod \"e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") " pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:05.359502 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.359378    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89620210-c0a9-4abd-b3f8-8f5be130b7b7-istio-podinfo\") pod \"e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") " pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:05.359502 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.359400    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89620210-c0a9-4abd-b3f8-8f5be130b7b7-istio-envoy\") pod \"e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") " pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:05.359502 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.359421    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89620210-c0a9-4abd-b3f8-8f5be130b7b7-istio-token\") pod \"e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") " pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:05.359502 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.359478    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89620210-c0a9-4abd-b3f8-8f5be130b7b7-credential-socket\") pod \"e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") " pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:05.359876 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.359810    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89620210-c0a9-4abd-b3f8-8f5be130b7b7-istio-data\") pod \"e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") " pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:05.359999 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.359970    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89620210-c0a9-4abd-b3f8-8f5be130b7b7-credential-socket\") pod \"e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") " pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:05.360076 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.359978    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89620210-c0a9-4abd-b3f8-8f5be130b7b7-workload-socket\") pod \"e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") " pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:05.360150 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.360107    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89620210-c0a9-4abd-b3f8-8f5be130b7b7-istiod-ca-cert\") pod \"e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") " pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:05.360355 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.360307    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89620210-c0a9-4abd-b3f8-8f5be130b7b7-workload-certs\") pod \"e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") " pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:05.361774 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.361753    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89620210-c0a9-4abd-b3f8-8f5be130b7b7-istio-envoy\") pod \"e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") " pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:05.361902 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.361884    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89620210-c0a9-4abd-b3f8-8f5be130b7b7-istio-podinfo\") pod \"e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") " pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:05.367209 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.367184    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89620210-c0a9-4abd-b3f8-8f5be130b7b7-istio-token\") pod \"e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") " pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:05.367376 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.367359    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnzd5\" (UniqueName: \"kubernetes.io/projected/89620210-c0a9-4abd-b3f8-8f5be130b7b7-kube-api-access-wnzd5\") pod \"e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") " pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:05.493504 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.493421    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:05.625429 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.625267    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"]
Jul 21 04:40:05.628252 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:40:05.628215    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89620210_c0a9_4abd_b3f8_8f5be130b7b7.slice/crio-6b016b3386f47e76151897943c5dd7c178ff34ca87724be9bb2854c8738ff585 WatchSource:0}: Error finding container 6b016b3386f47e76151897943c5dd7c178ff34ca87724be9bb2854c8738ff585: Status 404 returned error can't find the container with id 6b016b3386f47e76151897943c5dd7c178ff34ca87724be9bb2854c8738ff585
Jul 21 04:40:05.630671 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.630632    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:40:05.630745 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.630718    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:40:05.630785 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:05.630761    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:40:06.299967 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:06.299936    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps" event={"ID":"89620210-c0a9-4abd-b3f8-8f5be130b7b7","Type":"ContainerStarted","Data":"543bad14c39836e2f201041d3b68787dd7e8c99b304afe7b53409f6bec4f42f4"}
Jul 21 04:40:06.300381 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:06.299995    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps" event={"ID":"89620210-c0a9-4abd-b3f8-8f5be130b7b7","Type":"ContainerStarted","Data":"6b016b3386f47e76151897943c5dd7c178ff34ca87724be9bb2854c8738ff585"}
Jul 21 04:40:06.321761 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:06.321713    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps" podStartSLOduration=1.321696942 podStartE2EDuration="1.321696942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:40:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:40:06.321012147 +0000 UTC m=+2136.210065324" watchObservedRunningTime="2026-07-21 04:40:06.321696942 +0000 UTC m=+2136.210750106"
Jul 21 04:40:06.494606 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:06.494571    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:06.499615 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:06.499588    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:07.304955 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:07.304921    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:07.305825 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:07.305809    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:08.394213 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:08.394163    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6"]
Jul 21 04:40:08.397671 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:08.397650    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6"
Jul 21 04:40:08.399861 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:08.399846    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-70ff50f3-serving-cert\""
Jul 21 04:40:08.409854 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:08.409830    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6"]
Jul 21 04:40:08.487211 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:08.487174    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7215c9d7-44f2-4cf1-a4d6-bba935519663-openshift-service-ca\") pod \"maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6\" (UID: \"7215c9d7-44f2-4cf1-a4d6-bba935519663\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6"
Jul 21 04:40:08.487211 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:08.487216    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz5zv\" (UniqueName: \"kubernetes.io/projected/7215c9d7-44f2-4cf1-a4d6-bba935519663-kube-api-access-mz5zv\") pod \"maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6\" (UID: \"7215c9d7-44f2-4cf1-a4d6-bba935519663\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6"
Jul 21 04:40:08.487420 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:08.487242    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7215c9d7-44f2-4cf1-a4d6-bba935519663-maas-api-tls\") pod \"maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6\" (UID: \"7215c9d7-44f2-4cf1-a4d6-bba935519663\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6"
Jul 21 04:40:08.588373 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:08.588342    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7215c9d7-44f2-4cf1-a4d6-bba935519663-openshift-service-ca\") pod \"maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6\" (UID: \"7215c9d7-44f2-4cf1-a4d6-bba935519663\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6"
Jul 21 04:40:08.588584 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:08.588381    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz5zv\" (UniqueName: \"kubernetes.io/projected/7215c9d7-44f2-4cf1-a4d6-bba935519663-kube-api-access-mz5zv\") pod \"maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6\" (UID: \"7215c9d7-44f2-4cf1-a4d6-bba935519663\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6"
Jul 21 04:40:08.588584 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:08.588406    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7215c9d7-44f2-4cf1-a4d6-bba935519663-maas-api-tls\") pod \"maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6\" (UID: \"7215c9d7-44f2-4cf1-a4d6-bba935519663\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6"
Jul 21 04:40:08.588584 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:40:08.588529    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-70ff50f3-serving-cert: secret "maas-api-e2e-mt-70ff50f3-serving-cert" not found
Jul 21 04:40:08.588584 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:40:08.588588    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7215c9d7-44f2-4cf1-a4d6-bba935519663-maas-api-tls podName:7215c9d7-44f2-4cf1-a4d6-bba935519663 nodeName:}" failed. No retries permitted until 2026-07-21 04:40:09.088570903 +0000 UTC m=+2138.977624044 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7215c9d7-44f2-4cf1-a4d6-bba935519663-maas-api-tls") pod "maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6" (UID: "7215c9d7-44f2-4cf1-a4d6-bba935519663") : secret "maas-api-e2e-mt-70ff50f3-serving-cert" not found
Jul 21 04:40:08.589262 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:08.589238    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7215c9d7-44f2-4cf1-a4d6-bba935519663-openshift-service-ca\") pod \"maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6\" (UID: \"7215c9d7-44f2-4cf1-a4d6-bba935519663\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6"
Jul 21 04:40:08.599020 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:08.598998    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz5zv\" (UniqueName: \"kubernetes.io/projected/7215c9d7-44f2-4cf1-a4d6-bba935519663-kube-api-access-mz5zv\") pod \"maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6\" (UID: \"7215c9d7-44f2-4cf1-a4d6-bba935519663\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6"
Jul 21 04:40:09.093055 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:09.093024    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7215c9d7-44f2-4cf1-a4d6-bba935519663-maas-api-tls\") pod \"maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6\" (UID: \"7215c9d7-44f2-4cf1-a4d6-bba935519663\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6"
Jul 21 04:40:09.095405 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:09.095372    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7215c9d7-44f2-4cf1-a4d6-bba935519663-maas-api-tls\") pod \"maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6\" (UID: \"7215c9d7-44f2-4cf1-a4d6-bba935519663\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6"
Jul 21 04:40:09.308452 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:09.308408    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6"
Jul 21 04:40:09.432827 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:09.432800    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6"]
Jul 21 04:40:09.435143 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:40:09.435094    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7215c9d7_44f2_4cf1_a4d6_bba935519663.slice/crio-893f2243c5636bbda796d823819860ccf80927c0eee41a1a3b4d9a9fc04b3892 WatchSource:0}: Error finding container 893f2243c5636bbda796d823819860ccf80927c0eee41a1a3b4d9a9fc04b3892: Status 404 returned error can't find the container with id 893f2243c5636bbda796d823819860ccf80927c0eee41a1a3b4d9a9fc04b3892
Jul 21 04:40:10.320823 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:10.320741    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6" event={"ID":"7215c9d7-44f2-4cf1-a4d6-bba935519663","Type":"ContainerStarted","Data":"a8f70754331c115a443bb6b676a67a91d9d58305deb41eea356120df59adb783"}
Jul 21 04:40:10.320823 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:10.320798    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6" event={"ID":"7215c9d7-44f2-4cf1-a4d6-bba935519663","Type":"ContainerStarted","Data":"893f2243c5636bbda796d823819860ccf80927c0eee41a1a3b4d9a9fc04b3892"}
Jul 21 04:40:10.320996 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:10.320934    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6"
Jul 21 04:40:10.337936 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:10.337863    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6" podStartSLOduration=1.8898877060000001 podStartE2EDuration="2.337845724s" totalImagesPullingTime="447.958018ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:40:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:40:10.336774076 +0000 UTC m=+2140.225827260" watchObservedRunningTime="2026-07-21 04:40:10.337845724 +0000 UTC m=+2140.226898888"
Jul 21 04:40:16.336732 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:16.336700    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6"
Jul 21 04:40:21.371718 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:21.371617    2580 generic.go:356] "Generic (PLEG): container finished" podID="89620210-c0a9-4abd-b3f8-8f5be130b7b7" containerID="543bad14c39836e2f201041d3b68787dd7e8c99b304afe7b53409f6bec4f42f4" exitCode=0
Jul 21 04:40:21.371718 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:21.371689    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps" event={"ID":"89620210-c0a9-4abd-b3f8-8f5be130b7b7","Type":"ContainerDied","Data":"543bad14c39836e2f201041d3b68787dd7e8c99b304afe7b53409f6bec4f42f4"}
Jul 21 04:40:21.372165 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:21.372073    2580 scope.go:117] "RemoveContainer" containerID="543bad14c39836e2f201041d3b68787dd7e8c99b304afe7b53409f6bec4f42f4"
Jul 21 04:40:21.373134 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:21.373100    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:40:21.373206 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:21.373193    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:40:21.373257 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:21.373243    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:40:22.305731 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:22.305646    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:22.378016 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:22.377982    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps" event={"ID":"89620210-c0a9-4abd-b3f8-8f5be130b7b7","Type":"ContainerStarted","Data":"07cb804ef94859b8f5d8403d698b52359347dba6def32d1364766a341b8a4116"}
Jul 21 04:40:22.494483 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:22.494448    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:22.495622 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:22.495598    2580 patch_prober.go:28] interesting pod/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 21 04:40:22.495736 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:22.495660    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps" podUID="89620210-c0a9-4abd-b3f8-8f5be130b7b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 21 04:40:23.494033 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:23.493996    2580 patch_prober.go:28] interesting pod/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 21 04:40:23.494453 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:23.494085    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps" podUID="89620210-c0a9-4abd-b3f8-8f5be130b7b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 21 04:40:24.494423 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:24.494381    2580 patch_prober.go:28] interesting pod/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 21 04:40:24.494888 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:24.494442    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps" podUID="89620210-c0a9-4abd-b3f8-8f5be130b7b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 21 04:40:25.494063 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:25.494020    2580 patch_prober.go:28] interesting pod/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 21 04:40:25.494298 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:25.494084    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps" podUID="89620210-c0a9-4abd-b3f8-8f5be130b7b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 21 04:40:26.497501 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:26.497472    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:26.497860 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:26.497828    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:26.498532 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:26.498515    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:30.843176 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:30.843141    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6"]
Jul 21 04:40:30.843598 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:30.843416    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6" podUID="7215c9d7-44f2-4cf1-a4d6-bba935519663" containerName="maas-api" containerID="cri-o://a8f70754331c115a443bb6b676a67a91d9d58305deb41eea356120df59adb783" gracePeriod=30
Jul 21 04:40:31.101400 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:31.101346    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6"
Jul 21 04:40:31.196019 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:31.195987    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mz5zv\" (UniqueName: \"kubernetes.io/projected/7215c9d7-44f2-4cf1-a4d6-bba935519663-kube-api-access-mz5zv\") pod \"7215c9d7-44f2-4cf1-a4d6-bba935519663\" (UID: \"7215c9d7-44f2-4cf1-a4d6-bba935519663\") "
Jul 21 04:40:31.196195 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:31.196056    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7215c9d7-44f2-4cf1-a4d6-bba935519663-openshift-service-ca\") pod \"7215c9d7-44f2-4cf1-a4d6-bba935519663\" (UID: \"7215c9d7-44f2-4cf1-a4d6-bba935519663\") "
Jul 21 04:40:31.196195 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:31.196083    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7215c9d7-44f2-4cf1-a4d6-bba935519663-maas-api-tls\") pod \"7215c9d7-44f2-4cf1-a4d6-bba935519663\" (UID: \"7215c9d7-44f2-4cf1-a4d6-bba935519663\") "
Jul 21 04:40:31.196426 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:31.196392    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7215c9d7-44f2-4cf1-a4d6-bba935519663-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7215c9d7-44f2-4cf1-a4d6-bba935519663" (UID: "7215c9d7-44f2-4cf1-a4d6-bba935519663"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:40:31.198073 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:31.198051    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7215c9d7-44f2-4cf1-a4d6-bba935519663-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7215c9d7-44f2-4cf1-a4d6-bba935519663" (UID: "7215c9d7-44f2-4cf1-a4d6-bba935519663"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:40:31.198187 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:31.198108    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7215c9d7-44f2-4cf1-a4d6-bba935519663-kube-api-access-mz5zv" (OuterVolumeSpecName: "kube-api-access-mz5zv") pod "7215c9d7-44f2-4cf1-a4d6-bba935519663" (UID: "7215c9d7-44f2-4cf1-a4d6-bba935519663"). InnerVolumeSpecName "kube-api-access-mz5zv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:40:31.297695 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:31.297662    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mz5zv\" (UniqueName: \"kubernetes.io/projected/7215c9d7-44f2-4cf1-a4d6-bba935519663-kube-api-access-mz5zv\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:40:31.297695 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:31.297691    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7215c9d7-44f2-4cf1-a4d6-bba935519663-openshift-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:40:31.297695 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:31.297700    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7215c9d7-44f2-4cf1-a4d6-bba935519663-maas-api-tls\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:40:31.422740 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:31.422706    2580 generic.go:356] "Generic (PLEG): container finished" podID="7215c9d7-44f2-4cf1-a4d6-bba935519663" containerID="a8f70754331c115a443bb6b676a67a91d9d58305deb41eea356120df59adb783" exitCode=0
Jul 21 04:40:31.422933 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:31.422765    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6"
Jul 21 04:40:31.422933 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:31.422793    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6" event={"ID":"7215c9d7-44f2-4cf1-a4d6-bba935519663","Type":"ContainerDied","Data":"a8f70754331c115a443bb6b676a67a91d9d58305deb41eea356120df59adb783"}
Jul 21 04:40:31.422933 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:31.422869    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6" event={"ID":"7215c9d7-44f2-4cf1-a4d6-bba935519663","Type":"ContainerDied","Data":"893f2243c5636bbda796d823819860ccf80927c0eee41a1a3b4d9a9fc04b3892"}
Jul 21 04:40:31.422933 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:31.422890    2580 scope.go:117] "RemoveContainer" containerID="a8f70754331c115a443bb6b676a67a91d9d58305deb41eea356120df59adb783"
Jul 21 04:40:31.432394 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:31.432376    2580 scope.go:117] "RemoveContainer" containerID="a8f70754331c115a443bb6b676a67a91d9d58305deb41eea356120df59adb783"
Jul 21 04:40:31.432635 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:40:31.432617    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8f70754331c115a443bb6b676a67a91d9d58305deb41eea356120df59adb783\": container with ID starting with a8f70754331c115a443bb6b676a67a91d9d58305deb41eea356120df59adb783 not found: ID does not exist" containerID="a8f70754331c115a443bb6b676a67a91d9d58305deb41eea356120df59adb783"
Jul 21 04:40:31.432690 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:31.432643    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8f70754331c115a443bb6b676a67a91d9d58305deb41eea356120df59adb783"} err="failed to get container status \"a8f70754331c115a443bb6b676a67a91d9d58305deb41eea356120df59adb783\": rpc error: code = NotFound desc = could not find container \"a8f70754331c115a443bb6b676a67a91d9d58305deb41eea356120df59adb783\": container with ID starting with a8f70754331c115a443bb6b676a67a91d9d58305deb41eea356120df59adb783 not found: ID does not exist"
Jul 21 04:40:31.443667 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:31.443645    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6"]
Jul 21 04:40:31.448731 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:31.448712    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-70ff50f3-6fd8c79b8c-xzdn6"]
Jul 21 04:40:32.693452 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:32.693419    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7215c9d7-44f2-4cf1-a4d6-bba935519663" path="/var/lib/kubelet/pods/7215c9d7-44f2-4cf1-a4d6-bba935519663/volumes"
Jul 21 04:40:41.980616 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:41.980584    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"]
Jul 21 04:40:41.981254 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:41.980807    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps" podUID="89620210-c0a9-4abd-b3f8-8f5be130b7b7" containerName="istio-proxy" containerID="cri-o://07cb804ef94859b8f5d8403d698b52359347dba6def32d1364766a341b8a4116" gracePeriod=30
Jul 21 04:40:47.231881 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.231857    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:47.339505 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.339416    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89620210-c0a9-4abd-b3f8-8f5be130b7b7-istio-envoy\") pod \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") "
Jul 21 04:40:47.339505 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.339454    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89620210-c0a9-4abd-b3f8-8f5be130b7b7-istio-data\") pod \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") "
Jul 21 04:40:47.339505 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.339482    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89620210-c0a9-4abd-b3f8-8f5be130b7b7-workload-certs\") pod \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") "
Jul 21 04:40:47.339505 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.339504    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89620210-c0a9-4abd-b3f8-8f5be130b7b7-credential-socket\") pod \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") "
Jul 21 04:40:47.339832 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.339529    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89620210-c0a9-4abd-b3f8-8f5be130b7b7-istio-token\") pod \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") "
Jul 21 04:40:47.339832 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.339562    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89620210-c0a9-4abd-b3f8-8f5be130b7b7-istiod-ca-cert\") pod \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") "
Jul 21 04:40:47.339832 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.339588    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89620210-c0a9-4abd-b3f8-8f5be130b7b7-workload-socket\") pod \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") "
Jul 21 04:40:47.339832 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.339615    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89620210-c0a9-4abd-b3f8-8f5be130b7b7-istio-podinfo\") pod \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") "
Jul 21 04:40:47.339832 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.339647    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnzd5\" (UniqueName: \"kubernetes.io/projected/89620210-c0a9-4abd-b3f8-8f5be130b7b7-kube-api-access-wnzd5\") pod \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\" (UID: \"89620210-c0a9-4abd-b3f8-8f5be130b7b7\") "
Jul 21 04:40:47.339832 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.339785    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89620210-c0a9-4abd-b3f8-8f5be130b7b7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "89620210-c0a9-4abd-b3f8-8f5be130b7b7" (UID: "89620210-c0a9-4abd-b3f8-8f5be130b7b7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:40:47.340103 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.339894    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89620210-c0a9-4abd-b3f8-8f5be130b7b7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "89620210-c0a9-4abd-b3f8-8f5be130b7b7" (UID: "89620210-c0a9-4abd-b3f8-8f5be130b7b7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:40:47.340103 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.339905    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89620210-c0a9-4abd-b3f8-8f5be130b7b7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "89620210-c0a9-4abd-b3f8-8f5be130b7b7" (UID: "89620210-c0a9-4abd-b3f8-8f5be130b7b7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:40:47.340103 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.339971    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89620210-c0a9-4abd-b3f8-8f5be130b7b7-workload-certs\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:40:47.340595 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.340302    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89620210-c0a9-4abd-b3f8-8f5be130b7b7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "89620210-c0a9-4abd-b3f8-8f5be130b7b7" (UID: "89620210-c0a9-4abd-b3f8-8f5be130b7b7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:40:47.340595 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.340496    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89620210-c0a9-4abd-b3f8-8f5be130b7b7-istio-data" (OuterVolumeSpecName: "istio-data") pod "89620210-c0a9-4abd-b3f8-8f5be130b7b7" (UID: "89620210-c0a9-4abd-b3f8-8f5be130b7b7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:40:47.341670 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.341642    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89620210-c0a9-4abd-b3f8-8f5be130b7b7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "89620210-c0a9-4abd-b3f8-8f5be130b7b7" (UID: "89620210-c0a9-4abd-b3f8-8f5be130b7b7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:40:47.341818 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.341799    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89620210-c0a9-4abd-b3f8-8f5be130b7b7-istio-token" (OuterVolumeSpecName: "istio-token") pod "89620210-c0a9-4abd-b3f8-8f5be130b7b7" (UID: "89620210-c0a9-4abd-b3f8-8f5be130b7b7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:40:47.341818 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.341806    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/89620210-c0a9-4abd-b3f8-8f5be130b7b7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "89620210-c0a9-4abd-b3f8-8f5be130b7b7" (UID: "89620210-c0a9-4abd-b3f8-8f5be130b7b7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 04:40:47.341921 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.341907    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89620210-c0a9-4abd-b3f8-8f5be130b7b7-kube-api-access-wnzd5" (OuterVolumeSpecName: "kube-api-access-wnzd5") pod "89620210-c0a9-4abd-b3f8-8f5be130b7b7" (UID: "89620210-c0a9-4abd-b3f8-8f5be130b7b7"). InnerVolumeSpecName "kube-api-access-wnzd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:40:47.440651 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.440620    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnzd5\" (UniqueName: \"kubernetes.io/projected/89620210-c0a9-4abd-b3f8-8f5be130b7b7-kube-api-access-wnzd5\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:40:47.440651 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.440648    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89620210-c0a9-4abd-b3f8-8f5be130b7b7-istio-envoy\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:40:47.440651 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.440660    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89620210-c0a9-4abd-b3f8-8f5be130b7b7-istio-data\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:40:47.440860 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.440669    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89620210-c0a9-4abd-b3f8-8f5be130b7b7-credential-socket\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:40:47.440860 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.440678    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89620210-c0a9-4abd-b3f8-8f5be130b7b7-istio-token\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:40:47.440860 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.440686    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89620210-c0a9-4abd-b3f8-8f5be130b7b7-istiod-ca-cert\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:40:47.440860 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.440693    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89620210-c0a9-4abd-b3f8-8f5be130b7b7-workload-socket\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:40:47.440860 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.440702    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89620210-c0a9-4abd-b3f8-8f5be130b7b7-istio-podinfo\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:40:47.495312 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.495278    2580 generic.go:356] "Generic (PLEG): container finished" podID="89620210-c0a9-4abd-b3f8-8f5be130b7b7" containerID="07cb804ef94859b8f5d8403d698b52359347dba6def32d1364766a341b8a4116" exitCode=0
Jul 21 04:40:47.495472 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.495323    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"
Jul 21 04:40:47.495472 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.495361    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps" event={"ID":"89620210-c0a9-4abd-b3f8-8f5be130b7b7","Type":"ContainerDied","Data":"07cb804ef94859b8f5d8403d698b52359347dba6def32d1364766a341b8a4116"}
Jul 21 04:40:47.495472 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.495413    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps" event={"ID":"89620210-c0a9-4abd-b3f8-8f5be130b7b7","Type":"ContainerDied","Data":"6b016b3386f47e76151897943c5dd7c178ff34ca87724be9bb2854c8738ff585"}
Jul 21 04:40:47.495472 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.495444    2580 scope.go:117] "RemoveContainer" containerID="07cb804ef94859b8f5d8403d698b52359347dba6def32d1364766a341b8a4116"
Jul 21 04:40:47.504472 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.504457    2580 scope.go:117] "RemoveContainer" containerID="543bad14c39836e2f201041d3b68787dd7e8c99b304afe7b53409f6bec4f42f4"
Jul 21 04:40:47.511785 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.511768    2580 scope.go:117] "RemoveContainer" containerID="07cb804ef94859b8f5d8403d698b52359347dba6def32d1364766a341b8a4116"
Jul 21 04:40:47.512026 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:40:47.512007    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07cb804ef94859b8f5d8403d698b52359347dba6def32d1364766a341b8a4116\": container with ID starting with 07cb804ef94859b8f5d8403d698b52359347dba6def32d1364766a341b8a4116 not found: ID does not exist" containerID="07cb804ef94859b8f5d8403d698b52359347dba6def32d1364766a341b8a4116"
Jul 21 04:40:47.512074 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.512035    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07cb804ef94859b8f5d8403d698b52359347dba6def32d1364766a341b8a4116"} err="failed to get container status \"07cb804ef94859b8f5d8403d698b52359347dba6def32d1364766a341b8a4116\": rpc error: code = NotFound desc = could not find container \"07cb804ef94859b8f5d8403d698b52359347dba6def32d1364766a341b8a4116\": container with ID starting with 07cb804ef94859b8f5d8403d698b52359347dba6def32d1364766a341b8a4116 not found: ID does not exist"
Jul 21 04:40:47.512074 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.512051    2580 scope.go:117] "RemoveContainer" containerID="543bad14c39836e2f201041d3b68787dd7e8c99b304afe7b53409f6bec4f42f4"
Jul 21 04:40:47.512294 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:40:47.512275    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"543bad14c39836e2f201041d3b68787dd7e8c99b304afe7b53409f6bec4f42f4\": container with ID starting with 543bad14c39836e2f201041d3b68787dd7e8c99b304afe7b53409f6bec4f42f4 not found: ID does not exist" containerID="543bad14c39836e2f201041d3b68787dd7e8c99b304afe7b53409f6bec4f42f4"
Jul 21 04:40:47.512340 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.512300    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"543bad14c39836e2f201041d3b68787dd7e8c99b304afe7b53409f6bec4f42f4"} err="failed to get container status \"543bad14c39836e2f201041d3b68787dd7e8c99b304afe7b53409f6bec4f42f4\": rpc error: code = NotFound desc = could not find container \"543bad14c39836e2f201041d3b68787dd7e8c99b304afe7b53409f6bec4f42f4\": container with ID starting with 543bad14c39836e2f201041d3b68787dd7e8c99b304afe7b53409f6bec4f42f4 not found: ID does not exist"
Jul 21 04:40:47.516118 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.516096    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"]
Jul 21 04:40:47.520631 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:47.520613    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-70ff50f3-openshift-default-ff4bb9bd7-542ps"]
Jul 21 04:40:48.693476 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:40:48.693442    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89620210-c0a9-4abd-b3f8-8f5be130b7b7" path="/var/lib/kubelet/pods/89620210-c0a9-4abd-b3f8-8f5be130b7b7/volumes"
Jul 21 04:41:01.739292 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.739249    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"]
Jul 21 04:41:01.739768 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.739715    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7215c9d7-44f2-4cf1-a4d6-bba935519663" containerName="maas-api"
Jul 21 04:41:01.739768 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.739735    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7215c9d7-44f2-4cf1-a4d6-bba935519663" containerName="maas-api"
Jul 21 04:41:01.739768 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.739749    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89620210-c0a9-4abd-b3f8-8f5be130b7b7" containerName="istio-proxy"
Jul 21 04:41:01.739768 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.739757    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="89620210-c0a9-4abd-b3f8-8f5be130b7b7" containerName="istio-proxy"
Jul 21 04:41:01.739979 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.739857    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="89620210-c0a9-4abd-b3f8-8f5be130b7b7" containerName="istio-proxy"
Jul 21 04:41:01.739979 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.739874    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7215c9d7-44f2-4cf1-a4d6-bba935519663" containerName="maas-api"
Jul 21 04:41:01.739979 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.739886    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="89620210-c0a9-4abd-b3f8-8f5be130b7b7" containerName="istio-proxy"
Jul 21 04:41:01.744501 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.744478    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:01.746825 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.746799    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-3a722384-openshift-default-dockercfg-8zdgc\""
Jul 21 04:41:01.758924 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.758896    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"]
Jul 21 04:41:01.856632 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.856593    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-istio-envoy\") pod \"e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") " pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:01.856802 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.856645    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-istiod-ca-cert\") pod \"e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") " pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:01.856802 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.856704    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-istio-data\") pod \"e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") " pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:01.856802 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.856790    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-istio-podinfo\") pod \"e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") " pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:01.856907 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.856849    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-istio-token\") pod \"e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") " pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:01.856907 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.856880    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-credential-socket\") pod \"e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") " pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:01.856979 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.856943    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-workload-socket\") pod \"e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") " pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:01.856979 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.856972    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntrjr\" (UniqueName: \"kubernetes.io/projected/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-kube-api-access-ntrjr\") pod \"e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") " pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:01.857043 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.856998    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-workload-certs\") pod \"e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") " pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:01.957650 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.957616    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-credential-socket\") pod \"e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") " pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:01.957831 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.957660    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-workload-socket\") pod \"e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") " pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:01.957831 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.957677    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntrjr\" (UniqueName: \"kubernetes.io/projected/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-kube-api-access-ntrjr\") pod \"e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") " pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:01.957831 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.957698    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-workload-certs\") pod \"e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") " pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:01.957831 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.957731    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-istio-envoy\") pod \"e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") " pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:01.957831 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.957760    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-istiod-ca-cert\") pod \"e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") " pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:01.957831 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.957781    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-istio-data\") pod \"e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") " pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:01.958176 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.957893    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-istio-podinfo\") pod \"e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") " pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:01.958176 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.957948    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-istio-token\") pod \"e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") " pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:01.958176 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.958067    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-credential-socket\") pod \"e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") " pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:01.958429 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.958405    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-workload-certs\") pod \"e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") " pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:01.958502 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.958450    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-istio-data\") pod \"e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") " pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:01.958604 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.958576    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-workload-socket\") pod \"e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") " pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:01.958729 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.958707    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-istiod-ca-cert\") pod \"e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") " pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:01.960266 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.960236    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-istio-envoy\") pod \"e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") " pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:01.960519 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.960499    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-istio-podinfo\") pod \"e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") " pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:01.965406 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.965383    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-istio-token\") pod \"e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") " pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:01.965565 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:01.965550    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntrjr\" (UniqueName: \"kubernetes.io/projected/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-kube-api-access-ntrjr\") pod \"e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") " pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:02.054981 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:02.054898    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:02.187329 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:02.187295    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"]
Jul 21 04:41:02.191628 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:41:02.191593    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68bb84b9_ca3b_4402_8c9e_5f25fd48adff.slice/crio-68d1d5c43d1f47abb05852866d05d770953e4e30b47229d30eed4553cc5a61ef WatchSource:0}: Error finding container 68d1d5c43d1f47abb05852866d05d770953e4e30b47229d30eed4553cc5a61ef: Status 404 returned error can't find the container with id 68d1d5c43d1f47abb05852866d05d770953e4e30b47229d30eed4553cc5a61ef
Jul 21 04:41:02.194635 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:02.194594    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:41:02.194725 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:02.194683    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:41:02.194761 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:02.194728    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:41:02.568875 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:02.568840    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r" event={"ID":"68bb84b9-ca3b-4402-8c9e-5f25fd48adff","Type":"ContainerStarted","Data":"303dca24d1bf7cc66eb36eb64968bf70e0809bc2c4a5342450c9cd886ad23f74"}
Jul 21 04:41:02.569068 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:02.568897    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r" event={"ID":"68bb84b9-ca3b-4402-8c9e-5f25fd48adff","Type":"ContainerStarted","Data":"68d1d5c43d1f47abb05852866d05d770953e4e30b47229d30eed4553cc5a61ef"}
Jul 21 04:41:02.588500 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:02.588453    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r" podStartSLOduration=1.588436364 podStartE2EDuration="1.588436364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:41:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:41:02.58796721 +0000 UTC m=+2192.477020409" watchObservedRunningTime="2026-07-21 04:41:02.588436364 +0000 UTC m=+2192.477489528"
Jul 21 04:41:03.055850 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:03.055816    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:03.060830 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:03.060803    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:03.573728 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:03.573696    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:03.574689 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:03.574669    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:04.612341 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:04.612309    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg"]
Jul 21 04:41:04.612837 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:04.612817    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89620210-c0a9-4abd-b3f8-8f5be130b7b7" containerName="istio-proxy"
Jul 21 04:41:04.612906 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:04.612841    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="89620210-c0a9-4abd-b3f8-8f5be130b7b7" containerName="istio-proxy"
Jul 21 04:41:04.615792 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:04.615771    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg"
Jul 21 04:41:04.618035 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:04.618009    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-3a722384-serving-cert\""
Jul 21 04:41:04.626726 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:04.626699    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg"]
Jul 21 04:41:04.683211 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:04.683174    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f-openshift-service-ca\") pod \"maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg\" (UID: \"00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg"
Jul 21 04:41:04.683345 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:04.683296    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f-maas-api-tls\") pod \"maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg\" (UID: \"00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg"
Jul 21 04:41:04.683521 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:04.683499    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55wcs\" (UniqueName: \"kubernetes.io/projected/00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f-kube-api-access-55wcs\") pod \"maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg\" (UID: \"00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg"
Jul 21 04:41:04.784592 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:04.784556    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f-maas-api-tls\") pod \"maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg\" (UID: \"00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg"
Jul 21 04:41:04.784808 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:04.784630    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55wcs\" (UniqueName: \"kubernetes.io/projected/00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f-kube-api-access-55wcs\") pod \"maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg\" (UID: \"00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg"
Jul 21 04:41:04.784808 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:04.784688    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f-openshift-service-ca\") pod \"maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg\" (UID: \"00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg"
Jul 21 04:41:04.785426 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:04.785403    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f-openshift-service-ca\") pod \"maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg\" (UID: \"00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg"
Jul 21 04:41:04.787212 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:04.787190    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f-maas-api-tls\") pod \"maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg\" (UID: \"00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg"
Jul 21 04:41:04.793510 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:04.793491    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55wcs\" (UniqueName: \"kubernetes.io/projected/00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f-kube-api-access-55wcs\") pod \"maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg\" (UID: \"00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg"
Jul 21 04:41:04.927348 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:04.927321    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg"
Jul 21 04:41:05.055189 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:05.055032    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg"]
Jul 21 04:41:05.058293 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:41:05.058261    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00d5f62b_7c2e_47f9_989c_5fa3b7e94c6f.slice/crio-5a09a4cf43c5630387005def18e7677d771fc18a9cfa59d716742ff7ab4c803b WatchSource:0}: Error finding container 5a09a4cf43c5630387005def18e7677d771fc18a9cfa59d716742ff7ab4c803b: Status 404 returned error can't find the container with id 5a09a4cf43c5630387005def18e7677d771fc18a9cfa59d716742ff7ab4c803b
Jul 21 04:41:05.059659 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:05.059639    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 04:41:05.582979 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:05.582950    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg" event={"ID":"00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f","Type":"ContainerStarted","Data":"920046af14f7126fbbe0ad731211377a6e43b69fbb7b2df38d3a32ebdfd2b198"}
Jul 21 04:41:05.583170 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:05.583000    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg" event={"ID":"00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f","Type":"ContainerStarted","Data":"5a09a4cf43c5630387005def18e7677d771fc18a9cfa59d716742ff7ab4c803b"}
Jul 21 04:41:05.583296 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:05.583266    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg"
Jul 21 04:41:05.599742 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:05.599692    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg" podStartSLOduration=1.1584749269999999 podStartE2EDuration="1.599669509s" totalImagesPullingTime="441.194582ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:41:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:41:05.599257989 +0000 UTC m=+2195.488311153" watchObservedRunningTime="2026-07-21 04:41:05.599669509 +0000 UTC m=+2195.488722727"
Jul 21 04:41:11.592229 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:11.592196    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg"
Jul 21 04:41:17.645254 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:17.645218    2580 generic.go:356] "Generic (PLEG): container finished" podID="68bb84b9-ca3b-4402-8c9e-5f25fd48adff" containerID="303dca24d1bf7cc66eb36eb64968bf70e0809bc2c4a5342450c9cd886ad23f74" exitCode=0
Jul 21 04:41:17.645662 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:17.645287    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r" event={"ID":"68bb84b9-ca3b-4402-8c9e-5f25fd48adff","Type":"ContainerDied","Data":"303dca24d1bf7cc66eb36eb64968bf70e0809bc2c4a5342450c9cd886ad23f74"}
Jul 21 04:41:17.645706 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:17.645684    2580 scope.go:117] "RemoveContainer" containerID="303dca24d1bf7cc66eb36eb64968bf70e0809bc2c4a5342450c9cd886ad23f74"
Jul 21 04:41:17.646665 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:17.646640    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:41:17.646718 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:17.646706    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:41:17.646763 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:17.646740    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:41:18.574067 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:18.574019    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:18.651533 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:18.651501    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r" event={"ID":"68bb84b9-ca3b-4402-8c9e-5f25fd48adff","Type":"ContainerStarted","Data":"f4a8b2a0cbe01be78cf4170054c56412da790da56e7bf373d547eb2949d616b7"}
Jul 21 04:41:19.055299 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:19.055261    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:19.056377 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:19.056350    2580 patch_prober.go:28] interesting pod/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 21 04:41:19.056491 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:19.056401    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r" podUID="68bb84b9-ca3b-4402-8c9e-5f25fd48adff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 21 04:41:20.055385 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:20.055346    2580 patch_prober.go:28] interesting pod/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 21 04:41:20.055777 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:20.055409    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r" podUID="68bb84b9-ca3b-4402-8c9e-5f25fd48adff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 21 04:41:21.056109 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:21.056065    2580 patch_prober.go:28] interesting pod/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 21 04:41:21.056615 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:21.056151    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r" podUID="68bb84b9-ca3b-4402-8c9e-5f25fd48adff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 21 04:41:22.055533 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:22.055493    2580 patch_prober.go:28] interesting pod/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 21 04:41:22.055724 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:22.055555    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r" podUID="68bb84b9-ca3b-4402-8c9e-5f25fd48adff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 21 04:41:23.058979 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:23.058950    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:23.059418 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:23.059240    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:23.059819 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:23.059801    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:41:47.696661 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:47.696620    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a722384-nqhjw"]
Jul 21 04:41:47.699916 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:47.699901    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a722384-nqhjw"
Jul 21 04:41:47.701988 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:47.701966    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-k4z5s\""
Jul 21 04:41:47.707649 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:47.707250    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a722384-nqhjw"]
Jul 21 04:41:47.765876 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:47.765838    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2a20e23-8028-4291-afa0-5753b38d37f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3a722384-nqhjw\" (UID: \"b2a20e23-8028-4291-afa0-5753b38d37f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a722384-nqhjw"
Jul 21 04:41:47.867139 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:47.867101    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2a20e23-8028-4291-afa0-5753b38d37f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3a722384-nqhjw\" (UID: \"b2a20e23-8028-4291-afa0-5753b38d37f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a722384-nqhjw"
Jul 21 04:41:47.867718 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:47.867696    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2a20e23-8028-4291-afa0-5753b38d37f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3a722384-nqhjw\" (UID: \"b2a20e23-8028-4291-afa0-5753b38d37f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a722384-nqhjw"
Jul 21 04:41:48.011569 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:48.011489    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a722384-nqhjw"
Jul 21 04:41:48.137338 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:48.137310    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a722384-nqhjw"]
Jul 21 04:41:48.138924 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:41:48.138896    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2a20e23_8028_4291_afa0_5753b38d37f4.slice/crio-a7d99e64495192843dc2635c2ddcf7d00cdb73c49c327ecdf00d43180372d649 WatchSource:0}: Error finding container a7d99e64495192843dc2635c2ddcf7d00cdb73c49c327ecdf00d43180372d649: Status 404 returned error can't find the container with id a7d99e64495192843dc2635c2ddcf7d00cdb73c49c327ecdf00d43180372d649
Jul 21 04:41:48.784525 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:48.784498    2580 generic.go:356] "Generic (PLEG): container finished" podID="b2a20e23-8028-4291-afa0-5753b38d37f4" containerID="b03c830003ccc97341e01fce588f88f62ac53250c5b1a2a64f306930f9157948" exitCode=0
Jul 21 04:41:48.784876 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:48.784549    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a722384-nqhjw" event={"ID":"b2a20e23-8028-4291-afa0-5753b38d37f4","Type":"ContainerDied","Data":"b03c830003ccc97341e01fce588f88f62ac53250c5b1a2a64f306930f9157948"}
Jul 21 04:41:48.784876 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:48.784612    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a722384-nqhjw" event={"ID":"b2a20e23-8028-4291-afa0-5753b38d37f4","Type":"ContainerStarted","Data":"a7d99e64495192843dc2635c2ddcf7d00cdb73c49c327ecdf00d43180372d649"}
Jul 21 04:41:49.916361 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:49.916336    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a722384-nqhjw"
Jul 21 04:41:49.985833 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:49.985801    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2a20e23-8028-4291-afa0-5753b38d37f4-maas-api-service-ca\") pod \"b2a20e23-8028-4291-afa0-5753b38d37f4\" (UID: \"b2a20e23-8028-4291-afa0-5753b38d37f4\") "
Jul 21 04:41:49.986159 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:49.986114    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2a20e23-8028-4291-afa0-5753b38d37f4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b2a20e23-8028-4291-afa0-5753b38d37f4" (UID: "b2a20e23-8028-4291-afa0-5753b38d37f4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:41:50.087376 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:50.087305    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2a20e23-8028-4291-afa0-5753b38d37f4-maas-api-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:41:50.795218 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:50.795183    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a722384-nqhjw"
Jul 21 04:41:50.795373 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:50.795186    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a722384-nqhjw" event={"ID":"b2a20e23-8028-4291-afa0-5753b38d37f4","Type":"ContainerDied","Data":"a7d99e64495192843dc2635c2ddcf7d00cdb73c49c327ecdf00d43180372d649"}
Jul 21 04:41:50.795373 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:41:50.795314    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7d99e64495192843dc2635c2ddcf7d00cdb73c49c327ecdf00d43180372d649"
Jul 21 04:42:03.166566 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:42:03.166475    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg"]
Jul 21 04:42:03.167060 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:42:03.166740    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg" podUID="00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f" containerName="maas-api" containerID="cri-o://920046af14f7126fbbe0ad731211377a6e43b69fbb7b2df38d3a32ebdfd2b198" gracePeriod=30
Jul 21 04:42:03.419485 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:42:03.419424    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg"
Jul 21 04:42:03.497016 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:42:03.496981    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f-maas-api-tls\") pod \"00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f\" (UID: \"00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f\") "
Jul 21 04:42:03.497261 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:42:03.497084    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f-openshift-service-ca\") pod \"00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f\" (UID: \"00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f\") "
Jul 21 04:42:03.497261 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:42:03.497111    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55wcs\" (UniqueName: \"kubernetes.io/projected/00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f-kube-api-access-55wcs\") pod \"00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f\" (UID: \"00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f\") "
Jul 21 04:42:03.497467 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:42:03.497437    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f" (UID: "00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:42:03.499292 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:42:03.499252    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f-kube-api-access-55wcs" (OuterVolumeSpecName: "kube-api-access-55wcs") pod "00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f" (UID: "00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f"). InnerVolumeSpecName "kube-api-access-55wcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:42:03.499405 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:42:03.499374    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f" (UID: "00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:42:03.598033 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:42:03.597978    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f-openshift-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:42:03.598033 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:42:03.598026    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55wcs\" (UniqueName: \"kubernetes.io/projected/00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f-kube-api-access-55wcs\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:42:03.598033 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:42:03.598036    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f-maas-api-tls\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:42:03.853525 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:42:03.853438    2580 generic.go:356] "Generic (PLEG): container finished" podID="00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f" containerID="920046af14f7126fbbe0ad731211377a6e43b69fbb7b2df38d3a32ebdfd2b198" exitCode=0
Jul 21 04:42:03.853525 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:42:03.853485    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg" event={"ID":"00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f","Type":"ContainerDied","Data":"920046af14f7126fbbe0ad731211377a6e43b69fbb7b2df38d3a32ebdfd2b198"}
Jul 21 04:42:03.853525 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:42:03.853523    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg" event={"ID":"00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f","Type":"ContainerDied","Data":"5a09a4cf43c5630387005def18e7677d771fc18a9cfa59d716742ff7ab4c803b"}
Jul 21 04:42:03.853760 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:42:03.853545    2580 scope.go:117] "RemoveContainer" containerID="920046af14f7126fbbe0ad731211377a6e43b69fbb7b2df38d3a32ebdfd2b198"
Jul 21 04:42:03.853760 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:42:03.853487    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg"
Jul 21 04:42:03.868996 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:42:03.868973    2580 scope.go:117] "RemoveContainer" containerID="920046af14f7126fbbe0ad731211377a6e43b69fbb7b2df38d3a32ebdfd2b198"
Jul 21 04:42:03.869338 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:42:03.869308    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"920046af14f7126fbbe0ad731211377a6e43b69fbb7b2df38d3a32ebdfd2b198\": container with ID starting with 920046af14f7126fbbe0ad731211377a6e43b69fbb7b2df38d3a32ebdfd2b198 not found: ID does not exist" containerID="920046af14f7126fbbe0ad731211377a6e43b69fbb7b2df38d3a32ebdfd2b198"
Jul 21 04:42:03.869430 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:42:03.869349    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"920046af14f7126fbbe0ad731211377a6e43b69fbb7b2df38d3a32ebdfd2b198"} err="failed to get container status \"920046af14f7126fbbe0ad731211377a6e43b69fbb7b2df38d3a32ebdfd2b198\": rpc error: code = NotFound desc = could not find container \"920046af14f7126fbbe0ad731211377a6e43b69fbb7b2df38d3a32ebdfd2b198\": container with ID starting with 920046af14f7126fbbe0ad731211377a6e43b69fbb7b2df38d3a32ebdfd2b198 not found: ID does not exist"
Jul 21 04:42:03.878601 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:42:03.878574    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg"]
Jul 21 04:42:03.884493 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:42:03.884469    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3a722384-b588bcbfb-zbmpg"]
Jul 21 04:42:04.694033 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:42:04.694002    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f" path="/var/lib/kubelet/pods/00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f/volumes"
Jul 21 04:42:07.772378 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:42:07.772336    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a722384-nqhjw"]
Jul 21 04:42:07.776670 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:42:07.776638    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a722384-nqhjw"]
Jul 21 04:42:08.693070 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:42:08.693036    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2a20e23-8028-4291-afa0-5753b38d37f4" path="/var/lib/kubelet/pods/b2a20e23-8028-4291-afa0-5753b38d37f4/volumes"
Jul 21 04:43:12.937878 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:12.937848    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"]
Jul 21 04:43:12.938405 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:12.938057    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r" podUID="68bb84b9-ca3b-4402-8c9e-5f25fd48adff" containerName="istio-proxy" containerID="cri-o://f4a8b2a0cbe01be78cf4170054c56412da790da56e7bf373d547eb2949d616b7" gracePeriod=30
Jul 21 04:43:18.181772 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.181746    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:43:18.187799 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.187772    2580 generic.go:356] "Generic (PLEG): container finished" podID="68bb84b9-ca3b-4402-8c9e-5f25fd48adff" containerID="f4a8b2a0cbe01be78cf4170054c56412da790da56e7bf373d547eb2949d616b7" exitCode=0
Jul 21 04:43:18.187911 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.187815    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"
Jul 21 04:43:18.187911 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.187838    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r" event={"ID":"68bb84b9-ca3b-4402-8c9e-5f25fd48adff","Type":"ContainerDied","Data":"f4a8b2a0cbe01be78cf4170054c56412da790da56e7bf373d547eb2949d616b7"}
Jul 21 04:43:18.187911 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.187882    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r" event={"ID":"68bb84b9-ca3b-4402-8c9e-5f25fd48adff","Type":"ContainerDied","Data":"68d1d5c43d1f47abb05852866d05d770953e4e30b47229d30eed4553cc5a61ef"}
Jul 21 04:43:18.187911 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.187905    2580 scope.go:117] "RemoveContainer" containerID="f4a8b2a0cbe01be78cf4170054c56412da790da56e7bf373d547eb2949d616b7"
Jul 21 04:43:18.198182 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.198149    2580 scope.go:117] "RemoveContainer" containerID="303dca24d1bf7cc66eb36eb64968bf70e0809bc2c4a5342450c9cd886ad23f74"
Jul 21 04:43:18.205879 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.205864    2580 scope.go:117] "RemoveContainer" containerID="f4a8b2a0cbe01be78cf4170054c56412da790da56e7bf373d547eb2949d616b7"
Jul 21 04:43:18.206159 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:43:18.206140    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4a8b2a0cbe01be78cf4170054c56412da790da56e7bf373d547eb2949d616b7\": container with ID starting with f4a8b2a0cbe01be78cf4170054c56412da790da56e7bf373d547eb2949d616b7 not found: ID does not exist" containerID="f4a8b2a0cbe01be78cf4170054c56412da790da56e7bf373d547eb2949d616b7"
Jul 21 04:43:18.206247 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.206171    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4a8b2a0cbe01be78cf4170054c56412da790da56e7bf373d547eb2949d616b7"} err="failed to get container status \"f4a8b2a0cbe01be78cf4170054c56412da790da56e7bf373d547eb2949d616b7\": rpc error: code = NotFound desc = could not find container \"f4a8b2a0cbe01be78cf4170054c56412da790da56e7bf373d547eb2949d616b7\": container with ID starting with f4a8b2a0cbe01be78cf4170054c56412da790da56e7bf373d547eb2949d616b7 not found: ID does not exist"
Jul 21 04:43:18.206247 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.206195    2580 scope.go:117] "RemoveContainer" containerID="303dca24d1bf7cc66eb36eb64968bf70e0809bc2c4a5342450c9cd886ad23f74"
Jul 21 04:43:18.206512 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:43:18.206472    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"303dca24d1bf7cc66eb36eb64968bf70e0809bc2c4a5342450c9cd886ad23f74\": container with ID starting with 303dca24d1bf7cc66eb36eb64968bf70e0809bc2c4a5342450c9cd886ad23f74 not found: ID does not exist" containerID="303dca24d1bf7cc66eb36eb64968bf70e0809bc2c4a5342450c9cd886ad23f74"
Jul 21 04:43:18.206726 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.206510    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"303dca24d1bf7cc66eb36eb64968bf70e0809bc2c4a5342450c9cd886ad23f74"} err="failed to get container status \"303dca24d1bf7cc66eb36eb64968bf70e0809bc2c4a5342450c9cd886ad23f74\": rpc error: code = NotFound desc = could not find container \"303dca24d1bf7cc66eb36eb64968bf70e0809bc2c4a5342450c9cd886ad23f74\": container with ID starting with 303dca24d1bf7cc66eb36eb64968bf70e0809bc2c4a5342450c9cd886ad23f74 not found: ID does not exist"
Jul 21 04:43:18.337339 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.337304    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-istio-podinfo\") pod \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") "
Jul 21 04:43:18.337339 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.337339    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-workload-certs\") pod \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") "
Jul 21 04:43:18.337579 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.337403    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-istio-token\") pod \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") "
Jul 21 04:43:18.337579 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.337430    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-workload-socket\") pod \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") "
Jul 21 04:43:18.337579 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.337491    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-istio-envoy\") pod \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") "
Jul 21 04:43:18.337579 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.337513    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-credential-socket\") pod \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") "
Jul 21 04:43:18.337579 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.337556    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-istiod-ca-cert\") pod \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") "
Jul 21 04:43:18.337826 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.337601    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntrjr\" (UniqueName: \"kubernetes.io/projected/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-kube-api-access-ntrjr\") pod \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") "
Jul 21 04:43:18.337826 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.337666    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-istio-data\") pod \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\" (UID: \"68bb84b9-ca3b-4402-8c9e-5f25fd48adff\") "
Jul 21 04:43:18.337826 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.337673    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "68bb84b9-ca3b-4402-8c9e-5f25fd48adff" (UID: "68bb84b9-ca3b-4402-8c9e-5f25fd48adff"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:43:18.337826 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.337724    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "68bb84b9-ca3b-4402-8c9e-5f25fd48adff" (UID: "68bb84b9-ca3b-4402-8c9e-5f25fd48adff"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:43:18.338036 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.337809    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "68bb84b9-ca3b-4402-8c9e-5f25fd48adff" (UID: "68bb84b9-ca3b-4402-8c9e-5f25fd48adff"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:43:18.338036 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.337971    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-credential-socket\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:43:18.338036 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.337992    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-workload-certs\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:43:18.338036 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.338006    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-workload-socket\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:43:18.338324 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.338149    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "68bb84b9-ca3b-4402-8c9e-5f25fd48adff" (UID: "68bb84b9-ca3b-4402-8c9e-5f25fd48adff"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:43:18.338570 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.338542    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-istio-data" (OuterVolumeSpecName: "istio-data") pod "68bb84b9-ca3b-4402-8c9e-5f25fd48adff" (UID: "68bb84b9-ca3b-4402-8c9e-5f25fd48adff"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:43:18.339480 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.339455    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "68bb84b9-ca3b-4402-8c9e-5f25fd48adff" (UID: "68bb84b9-ca3b-4402-8c9e-5f25fd48adff"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 04:43:18.339679 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.339652    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-kube-api-access-ntrjr" (OuterVolumeSpecName: "kube-api-access-ntrjr") pod "68bb84b9-ca3b-4402-8c9e-5f25fd48adff" (UID: "68bb84b9-ca3b-4402-8c9e-5f25fd48adff"). InnerVolumeSpecName "kube-api-access-ntrjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:43:18.339769 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.339707    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "68bb84b9-ca3b-4402-8c9e-5f25fd48adff" (UID: "68bb84b9-ca3b-4402-8c9e-5f25fd48adff"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:43:18.339769 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.339711    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-istio-token" (OuterVolumeSpecName: "istio-token") pod "68bb84b9-ca3b-4402-8c9e-5f25fd48adff" (UID: "68bb84b9-ca3b-4402-8c9e-5f25fd48adff"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:43:18.439209 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.439177    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-istio-envoy\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:43:18.439209 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.439203    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-istiod-ca-cert\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:43:18.439209 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.439212    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntrjr\" (UniqueName: \"kubernetes.io/projected/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-kube-api-access-ntrjr\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:43:18.439410 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.439221    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-istio-data\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:43:18.439410 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.439229    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-istio-podinfo\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:43:18.439410 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.439236    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68bb84b9-ca3b-4402-8c9e-5f25fd48adff-istio-token\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:43:18.510271 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.510240    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"]
Jul 21 04:43:18.514039 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.514016    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-3a722384-openshift-default-748ccfb4d7-pcn9r"]
Jul 21 04:43:18.693815 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:18.693774    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68bb84b9-ca3b-4402-8c9e-5f25fd48adff" path="/var/lib/kubelet/pods/68bb84b9-ca3b-4402-8c9e-5f25fd48adff/volumes"
Jul 21 04:43:30.777923 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:43:30.777847    2580 scope.go:117] "RemoveContainer" containerID="a8942db485878625a99befc720de0c6dafbb99486bd8675fa32662c368475bff"
Jul 21 04:44:08.864856 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:08.864824    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"]
Jul 21 04:44:08.865347 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:08.865173    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f" containerName="maas-api"
Jul 21 04:44:08.865347 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:08.865185    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f" containerName="maas-api"
Jul 21 04:44:08.865347 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:08.865202    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68bb84b9-ca3b-4402-8c9e-5f25fd48adff" containerName="istio-proxy"
Jul 21 04:44:08.865347 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:08.865207    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="68bb84b9-ca3b-4402-8c9e-5f25fd48adff" containerName="istio-proxy"
Jul 21 04:44:08.865347 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:08.865215    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2a20e23-8028-4291-afa0-5753b38d37f4" containerName="revoke-keys"
Jul 21 04:44:08.865347 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:08.865220    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2a20e23-8028-4291-afa0-5753b38d37f4" containerName="revoke-keys"
Jul 21 04:44:08.865347 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:08.865227    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68bb84b9-ca3b-4402-8c9e-5f25fd48adff" containerName="istio-proxy"
Jul 21 04:44:08.865347 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:08.865232    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="68bb84b9-ca3b-4402-8c9e-5f25fd48adff" containerName="istio-proxy"
Jul 21 04:44:08.865347 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:08.865284    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="68bb84b9-ca3b-4402-8c9e-5f25fd48adff" containerName="istio-proxy"
Jul 21 04:44:08.865347 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:08.865293    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="00d5f62b-7c2e-47f9-989c-5fa3b7e94c6f" containerName="maas-api"
Jul 21 04:44:08.865347 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:08.865300    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2a20e23-8028-4291-afa0-5753b38d37f4" containerName="revoke-keys"
Jul 21 04:44:08.868088 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:08.868071    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:08.870482 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:08.870459    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-628b16-openshift-default-dockercfg-fcrwk\""
Jul 21 04:44:08.881949 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:08.881924    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"]
Jul 21 04:44:08.976389 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:08.975945    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-istiod-ca-cert\") pod \"e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") " pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:08.976389 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:08.976044    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-workload-certs\") pod \"e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") " pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:08.976389 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:08.976071    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nszdd\" (UniqueName: \"kubernetes.io/projected/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-kube-api-access-nszdd\") pod \"e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") " pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:08.976389 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:08.976101    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-istio-data\") pod \"e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") " pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:08.976389 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:08.976171    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-istio-podinfo\") pod \"e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") " pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:08.976389 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:08.976192    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-istio-token\") pod \"e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") " pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:08.976389 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:08.976217    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-istio-envoy\") pod \"e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") " pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:08.976389 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:08.976259    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-credential-socket\") pod \"e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") " pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:08.976389 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:08.976282    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-workload-socket\") pod \"e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") " pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:09.077458 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:09.077426    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-workload-certs\") pod \"e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") " pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:09.077458 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:09.077460    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nszdd\" (UniqueName: \"kubernetes.io/projected/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-kube-api-access-nszdd\") pod \"e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") " pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:09.077712 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:09.077479    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-istio-data\") pod \"e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") " pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:09.077712 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:09.077548    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-istio-podinfo\") pod \"e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") " pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:09.077712 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:09.077590    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-istio-token\") pod \"e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") " pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:09.077712 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:09.077624    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-istio-envoy\") pod \"e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") " pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:09.077712 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:09.077670    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-credential-socket\") pod \"e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") " pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:09.077712 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:09.077698    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-workload-socket\") pod \"e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") " pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:09.078023 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:09.077754    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-istiod-ca-cert\") pod \"e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") " pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:09.078023 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:09.077871    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-istio-data\") pod \"e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") " pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:09.078155 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:09.078054    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-credential-socket\") pod \"e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") " pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:09.078220 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:09.078163    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-workload-socket\") pod \"e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") " pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:09.078265 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:09.078228    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-workload-certs\") pod \"e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") " pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:09.078512 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:09.078492    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-istiod-ca-cert\") pod \"e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") " pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:09.080338 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:09.080319    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-istio-envoy\") pod \"e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") " pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:09.080576 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:09.080549    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-istio-podinfo\") pod \"e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") " pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:09.087997 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:09.087977    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-istio-token\") pod \"e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") " pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:09.088325 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:09.088306    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nszdd\" (UniqueName: \"kubernetes.io/projected/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-kube-api-access-nszdd\") pod \"e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") " pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:09.177994 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:09.177965    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:09.309625 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:09.309592    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"]
Jul 21 04:44:09.313101 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:44:09.313071    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3150e2cd_d869_42e1_895e_37bc6fcf0ea2.slice/crio-4daec5070768e85cacf6722b5223c96064e683a437a0cba55fc05706b117ba71 WatchSource:0}: Error finding container 4daec5070768e85cacf6722b5223c96064e683a437a0cba55fc05706b117ba71: Status 404 returned error can't find the container with id 4daec5070768e85cacf6722b5223c96064e683a437a0cba55fc05706b117ba71
Jul 21 04:44:09.315248 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:09.315219    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:44:09.315345 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:09.315294    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:44:09.315407 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:09.315341    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:44:09.415177 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:09.415111    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45" event={"ID":"3150e2cd-d869-42e1-895e-37bc6fcf0ea2","Type":"ContainerStarted","Data":"e99c98a9850daee1daf017b8d753f068546b59c665868d2aeef3c5b699aea21a"}
Jul 21 04:44:09.415344 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:09.415197    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45" event={"ID":"3150e2cd-d869-42e1-895e-37bc6fcf0ea2","Type":"ContainerStarted","Data":"4daec5070768e85cacf6722b5223c96064e683a437a0cba55fc05706b117ba71"}
Jul 21 04:44:09.437090 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:09.436991    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45" podStartSLOduration=1.43697099 podStartE2EDuration="1.43697099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:44:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:44:09.435418109 +0000 UTC m=+2379.324471271" watchObservedRunningTime="2026-07-21 04:44:09.43697099 +0000 UTC m=+2379.326024152"
Jul 21 04:44:10.178648 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:10.178613    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:10.183299 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:10.183273    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:10.419984 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:10.419951    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:10.421077 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:10.421060    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:11.539144 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:11.539092    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh"]
Jul 21 04:44:11.539690 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:11.539674    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="68bb84b9-ca3b-4402-8c9e-5f25fd48adff" containerName="istio-proxy"
Jul 21 04:44:11.542828 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:11.542807    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh"
Jul 21 04:44:11.544982 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:11.544960    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-628b16-serving-cert\""
Jul 21 04:44:11.552802 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:11.552778    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh"]
Jul 21 04:44:11.597164 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:11.597112    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh\" (UID: \"a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh"
Jul 21 04:44:11.597280 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:11.597187    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n4h8\" (UniqueName: \"kubernetes.io/projected/a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f-kube-api-access-5n4h8\") pod \"maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh\" (UID: \"a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh"
Jul 21 04:44:11.597321 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:11.597307    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f-maas-api-tls\") pod \"maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh\" (UID: \"a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh"
Jul 21 04:44:11.697991 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:11.697963    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f-maas-api-tls\") pod \"maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh\" (UID: \"a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh"
Jul 21 04:44:11.698167 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:11.698005    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh\" (UID: \"a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh"
Jul 21 04:44:11.698167 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:11.698023    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n4h8\" (UniqueName: \"kubernetes.io/projected/a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f-kube-api-access-5n4h8\") pod \"maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh\" (UID: \"a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh"
Jul 21 04:44:11.698693 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:11.698664    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh\" (UID: \"a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh"
Jul 21 04:44:11.700345 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:11.700318    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f-maas-api-tls\") pod \"maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh\" (UID: \"a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh"
Jul 21 04:44:11.711953 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:11.711926    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n4h8\" (UniqueName: \"kubernetes.io/projected/a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f-kube-api-access-5n4h8\") pod \"maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh\" (UID: \"a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh"
Jul 21 04:44:11.855047 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:11.854960    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh"
Jul 21 04:44:11.994641 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:44:11.994602    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0c9e92e_0544_4bc6_bd68_3b4e4fdca89f.slice/crio-de8f5a3428e84a00cfd3c77447a21bc8c6cdb7ae67030161d3896fd33805ba31 WatchSource:0}: Error finding container de8f5a3428e84a00cfd3c77447a21bc8c6cdb7ae67030161d3896fd33805ba31: Status 404 returned error can't find the container with id de8f5a3428e84a00cfd3c77447a21bc8c6cdb7ae67030161d3896fd33805ba31
Jul 21 04:44:11.998022 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:11.997996    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh"]
Jul 21 04:44:12.429196 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:12.429158    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh" event={"ID":"a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f","Type":"ContainerStarted","Data":"de8f5a3428e84a00cfd3c77447a21bc8c6cdb7ae67030161d3896fd33805ba31"}
Jul 21 04:44:13.435195 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:13.435152    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh" event={"ID":"a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f","Type":"ContainerStarted","Data":"0893b1a90a351fae2bba2e620cae0871a6cf9aded16c3f86818de64f5eb27076"}
Jul 21 04:44:13.435615 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:13.435276    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh"
Jul 21 04:44:13.455996 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:13.455944    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh" podStartSLOduration=1.8676520779999999 podStartE2EDuration="2.455928635s" totalImagesPullingTime="588.276557ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:44:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:44:13.454529391 +0000 UTC m=+2383.343582555" watchObservedRunningTime="2026-07-21 04:44:13.455928635 +0000 UTC m=+2383.344981799"
Jul 21 04:44:19.445229 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:19.445195    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh"
Jul 21 04:44:19.736241 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:19.736166    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w"]
Jul 21 04:44:19.739826 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:19.739805    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w"
Jul 21 04:44:19.742721 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:19.742696    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-c8ed6c-serving-cert\""
Jul 21 04:44:19.750539 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:19.750471    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w"]
Jul 21 04:44:19.774869 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:19.774839    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vcng\" (UniqueName: \"kubernetes.io/projected/bfaca095-ee70-4b15-872f-d003f3bff8cf-kube-api-access-8vcng\") pod \"maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w\" (UID: \"bfaca095-ee70-4b15-872f-d003f3bff8cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w"
Jul 21 04:44:19.774992 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:19.774886    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfaca095-ee70-4b15-872f-d003f3bff8cf-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w\" (UID: \"bfaca095-ee70-4b15-872f-d003f3bff8cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w"
Jul 21 04:44:19.774992 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:19.774924    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfaca095-ee70-4b15-872f-d003f3bff8cf-maas-api-tls\") pod \"maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w\" (UID: \"bfaca095-ee70-4b15-872f-d003f3bff8cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w"
Jul 21 04:44:19.876218 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:19.876181    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vcng\" (UniqueName: \"kubernetes.io/projected/bfaca095-ee70-4b15-872f-d003f3bff8cf-kube-api-access-8vcng\") pod \"maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w\" (UID: \"bfaca095-ee70-4b15-872f-d003f3bff8cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w"
Jul 21 04:44:19.876403 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:19.876239    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfaca095-ee70-4b15-872f-d003f3bff8cf-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w\" (UID: \"bfaca095-ee70-4b15-872f-d003f3bff8cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w"
Jul 21 04:44:19.876403 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:19.876265    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfaca095-ee70-4b15-872f-d003f3bff8cf-maas-api-tls\") pod \"maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w\" (UID: \"bfaca095-ee70-4b15-872f-d003f3bff8cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w"
Jul 21 04:44:19.876403 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:44:19.876387    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-c8ed6c-serving-cert: secret "maas-api-e2e-inf-b-c8ed6c-serving-cert" not found
Jul 21 04:44:19.876578 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:44:19.876441    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfaca095-ee70-4b15-872f-d003f3bff8cf-maas-api-tls podName:bfaca095-ee70-4b15-872f-d003f3bff8cf nodeName:}" failed. No retries permitted until 2026-07-21 04:44:20.376423729 +0000 UTC m=+2390.265476870 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bfaca095-ee70-4b15-872f-d003f3bff8cf-maas-api-tls") pod "maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w" (UID: "bfaca095-ee70-4b15-872f-d003f3bff8cf") : secret "maas-api-e2e-inf-b-c8ed6c-serving-cert" not found
Jul 21 04:44:19.877048 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:19.877024    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfaca095-ee70-4b15-872f-d003f3bff8cf-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w\" (UID: \"bfaca095-ee70-4b15-872f-d003f3bff8cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w"
Jul 21 04:44:19.884789 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:19.884760    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vcng\" (UniqueName: \"kubernetes.io/projected/bfaca095-ee70-4b15-872f-d003f3bff8cf-kube-api-access-8vcng\") pod \"maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w\" (UID: \"bfaca095-ee70-4b15-872f-d003f3bff8cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w"
Jul 21 04:44:20.380360 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:20.380327    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfaca095-ee70-4b15-872f-d003f3bff8cf-maas-api-tls\") pod \"maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w\" (UID: \"bfaca095-ee70-4b15-872f-d003f3bff8cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w"
Jul 21 04:44:20.382704 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:20.382676    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfaca095-ee70-4b15-872f-d003f3bff8cf-maas-api-tls\") pod \"maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w\" (UID: \"bfaca095-ee70-4b15-872f-d003f3bff8cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w"
Jul 21 04:44:20.653279 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:20.653239    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w"
Jul 21 04:44:20.802634 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:20.802594    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w"]
Jul 21 04:44:20.804731 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:44:20.804703    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfaca095_ee70_4b15_872f_d003f3bff8cf.slice/crio-f9c14b2a3c9b30bc0729a0c4543ec34b298af8cd37dab57b5a7dc59b332c3ffa WatchSource:0}: Error finding container f9c14b2a3c9b30bc0729a0c4543ec34b298af8cd37dab57b5a7dc59b332c3ffa: Status 404 returned error can't find the container with id f9c14b2a3c9b30bc0729a0c4543ec34b298af8cd37dab57b5a7dc59b332c3ffa
Jul 21 04:44:21.472706 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:21.472670    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w" event={"ID":"bfaca095-ee70-4b15-872f-d003f3bff8cf","Type":"ContainerStarted","Data":"188f2359b21feeae9636d62c2bb55ee65593ad6dcc6757920748dd5eb3b60239"}
Jul 21 04:44:21.472897 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:21.472733    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w" event={"ID":"bfaca095-ee70-4b15-872f-d003f3bff8cf","Type":"ContainerStarted","Data":"f9c14b2a3c9b30bc0729a0c4543ec34b298af8cd37dab57b5a7dc59b332c3ffa"}
Jul 21 04:44:21.472897 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:21.472765    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w"
Jul 21 04:44:21.489999 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:21.489916    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w" podStartSLOduration=2.058669171 podStartE2EDuration="2.489901271s" totalImagesPullingTime="431.2321ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:44:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:44:21.489042897 +0000 UTC m=+2391.378096073" watchObservedRunningTime="2026-07-21 04:44:21.489901271 +0000 UTC m=+2391.378954435"
Jul 21 04:44:26.462296 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:26.462249    2580 patch_prober.go:28] interesting pod/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 21 04:44:26.462693 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:26.462314    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45" podUID="3150e2cd-d869-42e1-895e-37bc6fcf0ea2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 21 04:44:27.484032 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:27.484005    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w"
Jul 21 04:44:27.503869 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:27.503835    2580 generic.go:356] "Generic (PLEG): container finished" podID="3150e2cd-d869-42e1-895e-37bc6fcf0ea2" containerID="e99c98a9850daee1daf017b8d753f068546b59c665868d2aeef3c5b699aea21a" exitCode=0
Jul 21 04:44:27.504007 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:27.503911    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45" event={"ID":"3150e2cd-d869-42e1-895e-37bc6fcf0ea2","Type":"ContainerDied","Data":"e99c98a9850daee1daf017b8d753f068546b59c665868d2aeef3c5b699aea21a"}
Jul 21 04:44:27.504281 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:27.504264    2580 scope.go:117] "RemoveContainer" containerID="e99c98a9850daee1daf017b8d753f068546b59c665868d2aeef3c5b699aea21a"
Jul 21 04:44:27.505248 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:27.505223    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:44:27.505306 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:27.505287    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:44:27.505342 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:27.505319    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:44:28.511581 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:28.510514    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45" event={"ID":"3150e2cd-d869-42e1-895e-37bc6fcf0ea2","Type":"ContainerStarted","Data":"e4d3c3c5c7a1b544c675b40b13619d046646fa8353dfc7499a5a36bb18d7185d"}
Jul 21 04:44:29.178894 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:29.178857    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:29.179223 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:29.179199    2580 patch_prober.go:28] interesting pod/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 21 04:44:29.179283 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:29.179250    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45" podUID="3150e2cd-d869-42e1-895e-37bc6fcf0ea2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 21 04:44:30.178332 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:30.178295    2580 patch_prober.go:28] interesting pod/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 21 04:44:30.178728 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:30.178352    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45" podUID="3150e2cd-d869-42e1-895e-37bc6fcf0ea2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 21 04:44:30.739962 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:30.739929    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-694fk_6f2c16b6-c4e7-480c-b4d7-1312ed5ad130/ovn-acl-logging/0.log"
Jul 21 04:44:30.745428 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:30.745401    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-694fk_6f2c16b6-c4e7-480c-b4d7-1312ed5ad130/ovn-acl-logging/0.log"
Jul 21 04:44:30.797928 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:30.797901    2580 scope.go:117] "RemoveContainer" containerID="4493a770a6d7bace8c10cacc8592fd10b3a4a4d0b66c905800a7f784ff7aa7f5"
Jul 21 04:44:31.178676 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:31.178636    2580 patch_prober.go:28] interesting pod/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 21 04:44:31.179172 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:31.178691    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45" podUID="3150e2cd-d869-42e1-895e-37bc6fcf0ea2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 21 04:44:32.178836 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:32.178799    2580 patch_prober.go:28] interesting pod/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 21 04:44:32.179251 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:32.178853    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45" podUID="3150e2cd-d869-42e1-895e-37bc6fcf0ea2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 21 04:44:33.181994 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:33.181965    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:33.182390 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:33.182327    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:44:33.182907 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:44:33.182886    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:45:00.139252 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:00.139169    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743485-mf7bf"]
Jul 21 04:45:00.142780 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:00.142762    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743485-mf7bf"
Jul 21 04:45:00.145317 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:00.145294    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-k4z5s\""
Jul 21 04:45:00.150322 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:00.150302    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743485-mf7bf"]
Jul 21 04:45:00.153808 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:00.153789    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743485-mf7bf"
Jul 21 04:45:00.289792 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:00.289764    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743485-mf7bf"]
Jul 21 04:45:00.291592 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:45:00.291563    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode48b7d49_c639_4136_a749_bac42ce1a204.slice/crio-01be41a77f6aedeabb98e138f0eefda9085d392194727a4a2af7f3bb2cd6302e WatchSource:0}: Error finding container 01be41a77f6aedeabb98e138f0eefda9085d392194727a4a2af7f3bb2cd6302e: Status 404 returned error can't find the container with id 01be41a77f6aedeabb98e138f0eefda9085d392194727a4a2af7f3bb2cd6302e
Jul 21 04:45:00.663732 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:00.663693    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743485-mf7bf" event={"ID":"e48b7d49-c639-4136-a749-bac42ce1a204","Type":"ContainerStarted","Data":"a762f461b29144e8a796f7f301e266548eef72ff29348bfe41d5dc8ebb14f165"}
Jul 21 04:45:00.663925 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:00.663778    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743485-mf7bf" event={"ID":"e48b7d49-c639-4136-a749-bac42ce1a204","Type":"ContainerStarted","Data":"01be41a77f6aedeabb98e138f0eefda9085d392194727a4a2af7f3bb2cd6302e"}
Jul 21 04:45:00.680560 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:00.680496    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743485-mf7bf" podStartSLOduration=0.6804805 podStartE2EDuration="680.4805ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:45:00.67843233 +0000 UTC m=+2430.567485493" watchObservedRunningTime="2026-07-21 04:45:00.6804805 +0000 UTC m=+2430.569533664"
Jul 21 04:45:01.669632 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:01.669589    2580 generic.go:356] "Generic (PLEG): container finished" podID="e48b7d49-c639-4136-a749-bac42ce1a204" containerID="a762f461b29144e8a796f7f301e266548eef72ff29348bfe41d5dc8ebb14f165" exitCode=0
Jul 21 04:45:01.670042 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:01.669669    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743485-mf7bf" event={"ID":"e48b7d49-c639-4136-a749-bac42ce1a204","Type":"ContainerDied","Data":"a762f461b29144e8a796f7f301e266548eef72ff29348bfe41d5dc8ebb14f165"}
Jul 21 04:45:02.807617 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:02.807589    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743485-mf7bf"
Jul 21 04:45:03.679767 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:03.679733    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743485-mf7bf"
Jul 21 04:45:03.679971 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:03.679731    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743485-mf7bf" event={"ID":"e48b7d49-c639-4136-a749-bac42ce1a204","Type":"ContainerDied","Data":"01be41a77f6aedeabb98e138f0eefda9085d392194727a4a2af7f3bb2cd6302e"}
Jul 21 04:45:03.679971 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:03.679854    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="01be41a77f6aedeabb98e138f0eefda9085d392194727a4a2af7f3bb2cd6302e"
Jul 21 04:45:55.302545 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:55.302508    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh"]
Jul 21 04:45:55.303111 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:55.302788    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh" podUID="a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f" containerName="maas-api" containerID="cri-o://0893b1a90a351fae2bba2e620cae0871a6cf9aded16c3f86818de64f5eb27076" gracePeriod=30
Jul 21 04:45:55.560673 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:55.560615    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh"
Jul 21 04:45:55.609043 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:55.609014    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f-openshift-service-ca\") pod \"a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f\" (UID: \"a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f\") "
Jul 21 04:45:55.609207 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:55.609060    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f-maas-api-tls\") pod \"a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f\" (UID: \"a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f\") "
Jul 21 04:45:55.609207 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:55.609079    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5n4h8\" (UniqueName: \"kubernetes.io/projected/a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f-kube-api-access-5n4h8\") pod \"a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f\" (UID: \"a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f\") "
Jul 21 04:45:55.609456 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:55.609429    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f" (UID: "a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:45:55.611075 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:55.611055    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f" (UID: "a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:45:55.611188 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:55.611171    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f-kube-api-access-5n4h8" (OuterVolumeSpecName: "kube-api-access-5n4h8") pod "a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f" (UID: "a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f"). InnerVolumeSpecName "kube-api-access-5n4h8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:45:55.710356 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:55.710310    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f-openshift-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:45:55.710356 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:55.710351    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f-maas-api-tls\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:45:55.710356 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:55.710361    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5n4h8\" (UniqueName: \"kubernetes.io/projected/a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f-kube-api-access-5n4h8\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:45:55.907377 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:55.907341    2580 generic.go:356] "Generic (PLEG): container finished" podID="a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f" containerID="0893b1a90a351fae2bba2e620cae0871a6cf9aded16c3f86818de64f5eb27076" exitCode=0
Jul 21 04:45:55.907592 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:55.907391    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh"
Jul 21 04:45:55.907592 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:55.907421    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh" event={"ID":"a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f","Type":"ContainerDied","Data":"0893b1a90a351fae2bba2e620cae0871a6cf9aded16c3f86818de64f5eb27076"}
Jul 21 04:45:55.907592 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:55.907474    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh" event={"ID":"a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f","Type":"ContainerDied","Data":"de8f5a3428e84a00cfd3c77447a21bc8c6cdb7ae67030161d3896fd33805ba31"}
Jul 21 04:45:55.907592 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:55.907496    2580 scope.go:117] "RemoveContainer" containerID="0893b1a90a351fae2bba2e620cae0871a6cf9aded16c3f86818de64f5eb27076"
Jul 21 04:45:55.916381 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:55.916366    2580 scope.go:117] "RemoveContainer" containerID="0893b1a90a351fae2bba2e620cae0871a6cf9aded16c3f86818de64f5eb27076"
Jul 21 04:45:55.916620 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:45:55.916601    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0893b1a90a351fae2bba2e620cae0871a6cf9aded16c3f86818de64f5eb27076\": container with ID starting with 0893b1a90a351fae2bba2e620cae0871a6cf9aded16c3f86818de64f5eb27076 not found: ID does not exist" containerID="0893b1a90a351fae2bba2e620cae0871a6cf9aded16c3f86818de64f5eb27076"
Jul 21 04:45:55.916670 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:55.916627    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0893b1a90a351fae2bba2e620cae0871a6cf9aded16c3f86818de64f5eb27076"} err="failed to get container status \"0893b1a90a351fae2bba2e620cae0871a6cf9aded16c3f86818de64f5eb27076\": rpc error: code = NotFound desc = could not find container \"0893b1a90a351fae2bba2e620cae0871a6cf9aded16c3f86818de64f5eb27076\": container with ID starting with 0893b1a90a351fae2bba2e620cae0871a6cf9aded16c3f86818de64f5eb27076 not found: ID does not exist"
Jul 21 04:45:55.928596 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:55.928567    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh"]
Jul 21 04:45:55.932941 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:55.932920    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-628b16-7fbc8f7987-gntlh"]
Jul 21 04:45:56.693781 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:45:56.693749    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f" path="/var/lib/kubelet/pods/a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f/volumes"
Jul 21 04:46:06.589512 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:06.589469    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"]
Jul 21 04:46:06.589982 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:06.589760    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45" podUID="3150e2cd-d869-42e1-895e-37bc6fcf0ea2" containerName="istio-proxy" containerID="cri-o://e4d3c3c5c7a1b544c675b40b13619d046646fa8353dfc7499a5a36bb18d7185d" gracePeriod=30
Jul 21 04:46:06.941181 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:06.941147    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8ed6c-2cwp4"]
Jul 21 04:46:06.941468 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:06.941456    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f" containerName="maas-api"
Jul 21 04:46:06.941512 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:06.941469    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f" containerName="maas-api"
Jul 21 04:46:06.941512 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:06.941494    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e48b7d49-c639-4136-a749-bac42ce1a204" containerName="cleanup"
Jul 21 04:46:06.941512 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:06.941500    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e48b7d49-c639-4136-a749-bac42ce1a204" containerName="cleanup"
Jul 21 04:46:06.941605 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:06.941553    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0c9e92e-0544-4bc6-bd68-3b4e4fdca89f" containerName="maas-api"
Jul 21 04:46:06.941605 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:06.941559    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e48b7d49-c639-4136-a749-bac42ce1a204" containerName="cleanup"
Jul 21 04:46:06.944332 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:06.944314    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8ed6c-2cwp4"
Jul 21 04:46:06.946596 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:06.946577    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-k4z5s\""
Jul 21 04:46:06.952078 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:06.952059    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8ed6c-2cwp4"]
Jul 21 04:46:07.009789 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:07.009756    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eba1e63a-831d-46ab-b387-896295888512-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c8ed6c-2cwp4\" (UID: \"eba1e63a-831d-46ab-b387-896295888512\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8ed6c-2cwp4"
Jul 21 04:46:07.110227 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:07.110193    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eba1e63a-831d-46ab-b387-896295888512-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c8ed6c-2cwp4\" (UID: \"eba1e63a-831d-46ab-b387-896295888512\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8ed6c-2cwp4"
Jul 21 04:46:07.110820 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:07.110799    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eba1e63a-831d-46ab-b387-896295888512-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c8ed6c-2cwp4\" (UID: \"eba1e63a-831d-46ab-b387-896295888512\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8ed6c-2cwp4"
Jul 21 04:46:07.255653 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:07.255562    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8ed6c-2cwp4"
Jul 21 04:46:07.384095 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:07.384069    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8ed6c-2cwp4"]
Jul 21 04:46:07.386377 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:46:07.386350    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeba1e63a_831d_46ab_b387_896295888512.slice/crio-5399ed6abb9bca2f5a9f014be0bb7fcf5ea89155b59b868285dbf225f5f4c62b WatchSource:0}: Error finding container 5399ed6abb9bca2f5a9f014be0bb7fcf5ea89155b59b868285dbf225f5f4c62b: Status 404 returned error can't find the container with id 5399ed6abb9bca2f5a9f014be0bb7fcf5ea89155b59b868285dbf225f5f4c62b
Jul 21 04:46:07.963406 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:07.963370    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8ed6c-2cwp4" event={"ID":"eba1e63a-831d-46ab-b387-896295888512","Type":"ContainerStarted","Data":"f8bfe9e5528482a5a2788a881b542538f49a85eccfbf2262e7b848141ec9156e"}
Jul 21 04:46:07.963875 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:07.963421    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8ed6c-2cwp4" event={"ID":"eba1e63a-831d-46ab-b387-896295888512","Type":"ContainerStarted","Data":"5399ed6abb9bca2f5a9f014be0bb7fcf5ea89155b59b868285dbf225f5f4c62b"}
Jul 21 04:46:07.979461 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:07.979408    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8ed6c-2cwp4" podStartSLOduration=1.979392214 podStartE2EDuration="1.979392214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:46:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:46:07.977102716 +0000 UTC m=+2497.866155892" watchObservedRunningTime="2026-07-21 04:46:07.979392214 +0000 UTC m=+2497.868445377"
Jul 21 04:46:08.969532 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:08.969497    2580 generic.go:356] "Generic (PLEG): container finished" podID="eba1e63a-831d-46ab-b387-896295888512" containerID="f8bfe9e5528482a5a2788a881b542538f49a85eccfbf2262e7b848141ec9156e" exitCode=0
Jul 21 04:46:08.969927 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:08.969569    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8ed6c-2cwp4" event={"ID":"eba1e63a-831d-46ab-b387-896295888512","Type":"ContainerDied","Data":"f8bfe9e5528482a5a2788a881b542538f49a85eccfbf2262e7b848141ec9156e"}
Jul 21 04:46:10.101043 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:10.101019    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8ed6c-2cwp4"
Jul 21 04:46:10.238872 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:10.238785    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eba1e63a-831d-46ab-b387-896295888512-maas-api-service-ca\") pod \"eba1e63a-831d-46ab-b387-896295888512\" (UID: \"eba1e63a-831d-46ab-b387-896295888512\") "
Jul 21 04:46:10.239119 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:10.239097    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eba1e63a-831d-46ab-b387-896295888512-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "eba1e63a-831d-46ab-b387-896295888512" (UID: "eba1e63a-831d-46ab-b387-896295888512"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:46:10.339768 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:10.339737    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eba1e63a-831d-46ab-b387-896295888512-maas-api-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:46:10.979777 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:10.979694    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8ed6c-2cwp4"
Jul 21 04:46:10.979955 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:10.979685    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8ed6c-2cwp4" event={"ID":"eba1e63a-831d-46ab-b387-896295888512","Type":"ContainerDied","Data":"5399ed6abb9bca2f5a9f014be0bb7fcf5ea89155b59b868285dbf225f5f4c62b"}
Jul 21 04:46:10.979955 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:10.979817    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5399ed6abb9bca2f5a9f014be0bb7fcf5ea89155b59b868285dbf225f5f4c62b"
Jul 21 04:46:11.844078 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:11.844057    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:46:11.955080 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:11.955040    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-credential-socket\") pod \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") "
Jul 21 04:46:11.955080 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:11.955083    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-istio-envoy\") pod \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") "
Jul 21 04:46:11.955335 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:11.955114    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-istiod-ca-cert\") pod \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") "
Jul 21 04:46:11.955335 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:11.955157    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-workload-socket\") pod \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") "
Jul 21 04:46:11.955335 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:11.955216    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-istio-data\") pod \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") "
Jul 21 04:46:11.955485 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:11.955362    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-istio-podinfo\") pod \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") "
Jul 21 04:46:11.955485 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:11.955407    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3150e2cd-d869-42e1-895e-37bc6fcf0ea2" (UID: "3150e2cd-d869-42e1-895e-37bc6fcf0ea2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:46:11.955485 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:11.955465    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-workload-certs\") pod \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") "
Jul 21 04:46:11.955612 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:11.955532    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-istio-token\") pod \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") "
Jul 21 04:46:11.955612 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:11.955566    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nszdd\" (UniqueName: \"kubernetes.io/projected/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-kube-api-access-nszdd\") pod \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\" (UID: \"3150e2cd-d869-42e1-895e-37bc6fcf0ea2\") "
Jul 21 04:46:11.955612 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:11.955566    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3150e2cd-d869-42e1-895e-37bc6fcf0ea2" (UID: "3150e2cd-d869-42e1-895e-37bc6fcf0ea2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:46:11.955772 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:11.955665    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3150e2cd-d869-42e1-895e-37bc6fcf0ea2" (UID: "3150e2cd-d869-42e1-895e-37bc6fcf0ea2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:46:11.955827 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:11.955809    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3150e2cd-d869-42e1-895e-37bc6fcf0ea2" (UID: "3150e2cd-d869-42e1-895e-37bc6fcf0ea2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:46:11.956034 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:11.956007    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-workload-certs\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:46:11.956202 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:11.956038    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-credential-socket\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:46:11.956202 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:11.956052    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-istiod-ca-cert\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:46:11.956202 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:11.956065    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-workload-socket\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:46:11.956385 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:11.956202    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-istio-data" (OuterVolumeSpecName: "istio-data") pod "3150e2cd-d869-42e1-895e-37bc6fcf0ea2" (UID: "3150e2cd-d869-42e1-895e-37bc6fcf0ea2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:46:11.957529 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:11.957500    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3150e2cd-d869-42e1-895e-37bc6fcf0ea2" (UID: "3150e2cd-d869-42e1-895e-37bc6fcf0ea2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:46:11.957648 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:11.957594    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3150e2cd-d869-42e1-895e-37bc6fcf0ea2" (UID: "3150e2cd-d869-42e1-895e-37bc6fcf0ea2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 04:46:11.957712 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:11.957643    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-kube-api-access-nszdd" (OuterVolumeSpecName: "kube-api-access-nszdd") pod "3150e2cd-d869-42e1-895e-37bc6fcf0ea2" (UID: "3150e2cd-d869-42e1-895e-37bc6fcf0ea2"). InnerVolumeSpecName "kube-api-access-nszdd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:46:11.957712 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:11.957643    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-istio-token" (OuterVolumeSpecName: "istio-token") pod "3150e2cd-d869-42e1-895e-37bc6fcf0ea2" (UID: "3150e2cd-d869-42e1-895e-37bc6fcf0ea2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:46:11.985856 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:11.985832    2580 generic.go:356] "Generic (PLEG): container finished" podID="3150e2cd-d869-42e1-895e-37bc6fcf0ea2" containerID="e4d3c3c5c7a1b544c675b40b13619d046646fa8353dfc7499a5a36bb18d7185d" exitCode=0
Jul 21 04:46:11.985986 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:11.985895    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"
Jul 21 04:46:11.985986 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:11.985922    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45" event={"ID":"3150e2cd-d869-42e1-895e-37bc6fcf0ea2","Type":"ContainerDied","Data":"e4d3c3c5c7a1b544c675b40b13619d046646fa8353dfc7499a5a36bb18d7185d"}
Jul 21 04:46:11.985986 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:11.985980    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45" event={"ID":"3150e2cd-d869-42e1-895e-37bc6fcf0ea2","Type":"ContainerDied","Data":"4daec5070768e85cacf6722b5223c96064e683a437a0cba55fc05706b117ba71"}
Jul 21 04:46:11.986152 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:11.986006    2580 scope.go:117] "RemoveContainer" containerID="e4d3c3c5c7a1b544c675b40b13619d046646fa8353dfc7499a5a36bb18d7185d"
Jul 21 04:46:11.995331 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:11.995309    2580 scope.go:117] "RemoveContainer" containerID="e99c98a9850daee1daf017b8d753f068546b59c665868d2aeef3c5b699aea21a"
Jul 21 04:46:12.002889 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:12.002873    2580 scope.go:117] "RemoveContainer" containerID="e4d3c3c5c7a1b544c675b40b13619d046646fa8353dfc7499a5a36bb18d7185d"
Jul 21 04:46:12.003175 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:46:12.003149    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4d3c3c5c7a1b544c675b40b13619d046646fa8353dfc7499a5a36bb18d7185d\": container with ID starting with e4d3c3c5c7a1b544c675b40b13619d046646fa8353dfc7499a5a36bb18d7185d not found: ID does not exist" containerID="e4d3c3c5c7a1b544c675b40b13619d046646fa8353dfc7499a5a36bb18d7185d"
Jul 21 04:46:12.003267 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:12.003181    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4d3c3c5c7a1b544c675b40b13619d046646fa8353dfc7499a5a36bb18d7185d"} err="failed to get container status \"e4d3c3c5c7a1b544c675b40b13619d046646fa8353dfc7499a5a36bb18d7185d\": rpc error: code = NotFound desc = could not find container \"e4d3c3c5c7a1b544c675b40b13619d046646fa8353dfc7499a5a36bb18d7185d\": container with ID starting with e4d3c3c5c7a1b544c675b40b13619d046646fa8353dfc7499a5a36bb18d7185d not found: ID does not exist"
Jul 21 04:46:12.003267 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:12.003196    2580 scope.go:117] "RemoveContainer" containerID="e99c98a9850daee1daf017b8d753f068546b59c665868d2aeef3c5b699aea21a"
Jul 21 04:46:12.003458 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:46:12.003438    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e99c98a9850daee1daf017b8d753f068546b59c665868d2aeef3c5b699aea21a\": container with ID starting with e99c98a9850daee1daf017b8d753f068546b59c665868d2aeef3c5b699aea21a not found: ID does not exist" containerID="e99c98a9850daee1daf017b8d753f068546b59c665868d2aeef3c5b699aea21a"
Jul 21 04:46:12.003509 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:12.003466    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e99c98a9850daee1daf017b8d753f068546b59c665868d2aeef3c5b699aea21a"} err="failed to get container status \"e99c98a9850daee1daf017b8d753f068546b59c665868d2aeef3c5b699aea21a\": rpc error: code = NotFound desc = could not find container \"e99c98a9850daee1daf017b8d753f068546b59c665868d2aeef3c5b699aea21a\": container with ID starting with e99c98a9850daee1daf017b8d753f068546b59c665868d2aeef3c5b699aea21a not found: ID does not exist"
Jul 21 04:46:12.018243 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:12.018223    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"]
Jul 21 04:46:12.025945 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:12.025925    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-628b16-openshift-default-55d88c45c5-24k45"]
Jul 21 04:46:12.057326 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:12.057302    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-istio-envoy\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:46:12.057326 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:12.057324    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-istio-data\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:46:12.057450 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:12.057332    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-istio-podinfo\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:46:12.057450 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:12.057340    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-istio-token\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:46:12.057450 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:12.057351    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nszdd\" (UniqueName: \"kubernetes.io/projected/3150e2cd-d869-42e1-895e-37bc6fcf0ea2-kube-api-access-nszdd\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:46:12.693939 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:12.693905    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3150e2cd-d869-42e1-895e-37bc6fcf0ea2" path="/var/lib/kubelet/pods/3150e2cd-d869-42e1-895e-37bc6fcf0ea2/volumes"
Jul 21 04:46:17.427802 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:17.427773    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w"]
Jul 21 04:46:17.428246 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:17.427997    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w" podUID="bfaca095-ee70-4b15-872f-d003f3bff8cf" containerName="maas-api" containerID="cri-o://188f2359b21feeae9636d62c2bb55ee65593ad6dcc6757920748dd5eb3b60239" gracePeriod=30
Jul 21 04:46:17.478546 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:17.478513    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w" podUID="bfaca095-ee70-4b15-872f-d003f3bff8cf" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.41:8443/health\": dial tcp 10.134.0.41:8443: connect: connection refused"
Jul 21 04:46:17.672872 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:17.672846    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w"
Jul 21 04:46:17.806440 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:17.806358    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfaca095-ee70-4b15-872f-d003f3bff8cf-maas-api-tls\") pod \"bfaca095-ee70-4b15-872f-d003f3bff8cf\" (UID: \"bfaca095-ee70-4b15-872f-d003f3bff8cf\") "
Jul 21 04:46:17.806440 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:17.806409    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vcng\" (UniqueName: \"kubernetes.io/projected/bfaca095-ee70-4b15-872f-d003f3bff8cf-kube-api-access-8vcng\") pod \"bfaca095-ee70-4b15-872f-d003f3bff8cf\" (UID: \"bfaca095-ee70-4b15-872f-d003f3bff8cf\") "
Jul 21 04:46:17.806630 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:17.806490    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfaca095-ee70-4b15-872f-d003f3bff8cf-openshift-service-ca\") pod \"bfaca095-ee70-4b15-872f-d003f3bff8cf\" (UID: \"bfaca095-ee70-4b15-872f-d003f3bff8cf\") "
Jul 21 04:46:17.806856 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:17.806832    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfaca095-ee70-4b15-872f-d003f3bff8cf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bfaca095-ee70-4b15-872f-d003f3bff8cf" (UID: "bfaca095-ee70-4b15-872f-d003f3bff8cf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:46:17.808544 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:17.808517    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfaca095-ee70-4b15-872f-d003f3bff8cf-kube-api-access-8vcng" (OuterVolumeSpecName: "kube-api-access-8vcng") pod "bfaca095-ee70-4b15-872f-d003f3bff8cf" (UID: "bfaca095-ee70-4b15-872f-d003f3bff8cf"). InnerVolumeSpecName "kube-api-access-8vcng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:46:17.808652 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:17.808637    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfaca095-ee70-4b15-872f-d003f3bff8cf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bfaca095-ee70-4b15-872f-d003f3bff8cf" (UID: "bfaca095-ee70-4b15-872f-d003f3bff8cf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:46:17.907391 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:17.907350    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfaca095-ee70-4b15-872f-d003f3bff8cf-openshift-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:46:17.907391 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:17.907383    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfaca095-ee70-4b15-872f-d003f3bff8cf-maas-api-tls\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:46:17.907391 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:17.907392    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vcng\" (UniqueName: \"kubernetes.io/projected/bfaca095-ee70-4b15-872f-d003f3bff8cf-kube-api-access-8vcng\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:46:18.014892 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:18.014856    2580 generic.go:356] "Generic (PLEG): container finished" podID="bfaca095-ee70-4b15-872f-d003f3bff8cf" containerID="188f2359b21feeae9636d62c2bb55ee65593ad6dcc6757920748dd5eb3b60239" exitCode=0
Jul 21 04:46:18.015049 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:18.014897    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w"
Jul 21 04:46:18.015049 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:18.014898    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w" event={"ID":"bfaca095-ee70-4b15-872f-d003f3bff8cf","Type":"ContainerDied","Data":"188f2359b21feeae9636d62c2bb55ee65593ad6dcc6757920748dd5eb3b60239"}
Jul 21 04:46:18.015049 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:18.015026    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w" event={"ID":"bfaca095-ee70-4b15-872f-d003f3bff8cf","Type":"ContainerDied","Data":"f9c14b2a3c9b30bc0729a0c4543ec34b298af8cd37dab57b5a7dc59b332c3ffa"}
Jul 21 04:46:18.015226 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:18.015053    2580 scope.go:117] "RemoveContainer" containerID="188f2359b21feeae9636d62c2bb55ee65593ad6dcc6757920748dd5eb3b60239"
Jul 21 04:46:18.024201 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:18.024185    2580 scope.go:117] "RemoveContainer" containerID="188f2359b21feeae9636d62c2bb55ee65593ad6dcc6757920748dd5eb3b60239"
Jul 21 04:46:18.024426 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:46:18.024407    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"188f2359b21feeae9636d62c2bb55ee65593ad6dcc6757920748dd5eb3b60239\": container with ID starting with 188f2359b21feeae9636d62c2bb55ee65593ad6dcc6757920748dd5eb3b60239 not found: ID does not exist" containerID="188f2359b21feeae9636d62c2bb55ee65593ad6dcc6757920748dd5eb3b60239"
Jul 21 04:46:18.024470 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:18.024438    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"188f2359b21feeae9636d62c2bb55ee65593ad6dcc6757920748dd5eb3b60239"} err="failed to get container status \"188f2359b21feeae9636d62c2bb55ee65593ad6dcc6757920748dd5eb3b60239\": rpc error: code = NotFound desc = could not find container \"188f2359b21feeae9636d62c2bb55ee65593ad6dcc6757920748dd5eb3b60239\": container with ID starting with 188f2359b21feeae9636d62c2bb55ee65593ad6dcc6757920748dd5eb3b60239 not found: ID does not exist"
Jul 21 04:46:18.035850 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:18.035829    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w"]
Jul 21 04:46:18.040793 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:18.040772    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c8ed6c-66846bb8bd-9v97w"]
Jul 21 04:46:18.693361 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:18.693318    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfaca095-ee70-4b15-872f-d003f3bff8cf" path="/var/lib/kubelet/pods/bfaca095-ee70-4b15-872f-d003f3bff8cf/volumes"
Jul 21 04:46:22.047047 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:22.046972    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8ed6c-2cwp4"]
Jul 21 04:46:22.050380 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:22.050355    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8ed6c-2cwp4"]
Jul 21 04:46:22.693188 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:22.693153    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eba1e63a-831d-46ab-b387-896295888512" path="/var/lib/kubelet/pods/eba1e63a-831d-46ab-b387-896295888512/volumes"
Jul 21 04:46:29.696726 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.696694    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"]
Jul 21 04:46:29.697190 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.696997    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3150e2cd-d869-42e1-895e-37bc6fcf0ea2" containerName="istio-proxy"
Jul 21 04:46:29.697190 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.697010    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3150e2cd-d869-42e1-895e-37bc6fcf0ea2" containerName="istio-proxy"
Jul 21 04:46:29.697190 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.697024    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3150e2cd-d869-42e1-895e-37bc6fcf0ea2" containerName="istio-proxy"
Jul 21 04:46:29.697190 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.697029    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3150e2cd-d869-42e1-895e-37bc6fcf0ea2" containerName="istio-proxy"
Jul 21 04:46:29.697190 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.697045    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eba1e63a-831d-46ab-b387-896295888512" containerName="revoke-keys"
Jul 21 04:46:29.697190 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.697050    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="eba1e63a-831d-46ab-b387-896295888512" containerName="revoke-keys"
Jul 21 04:46:29.697190 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.697058    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfaca095-ee70-4b15-872f-d003f3bff8cf" containerName="maas-api"
Jul 21 04:46:29.697190 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.697063    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfaca095-ee70-4b15-872f-d003f3bff8cf" containerName="maas-api"
Jul 21 04:46:29.697190 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.697113    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfaca095-ee70-4b15-872f-d003f3bff8cf" containerName="maas-api"
Jul 21 04:46:29.697190 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.697136    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3150e2cd-d869-42e1-895e-37bc6fcf0ea2" containerName="istio-proxy"
Jul 21 04:46:29.697190 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.697143    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="eba1e63a-831d-46ab-b387-896295888512" containerName="revoke-keys"
Jul 21 04:46:29.697190 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.697148    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3150e2cd-d869-42e1-895e-37bc6fcf0ea2" containerName="istio-proxy"
Jul 21 04:46:29.701522 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.701504    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:29.703970 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.703952    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-8ae251-openshift-default-dockercfg-r2mv2\""
Jul 21 04:46:29.711796 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.711773    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"]
Jul 21 04:46:29.814631 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.814592    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d58cfd9-f95d-4bab-bc58-966197948bc1-workload-certs\") pod \"e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") " pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:29.814631 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.814629    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d58cfd9-f95d-4bab-bc58-966197948bc1-istio-data\") pod \"e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") " pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:29.814885 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.814656    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d58cfd9-f95d-4bab-bc58-966197948bc1-istiod-ca-cert\") pod \"e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") " pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:29.814885 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.814809    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d58cfd9-f95d-4bab-bc58-966197948bc1-istio-envoy\") pod \"e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") " pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:29.814885 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.814866    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d58cfd9-f95d-4bab-bc58-966197948bc1-credential-socket\") pod \"e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") " pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:29.815087 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.814927    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d58cfd9-f95d-4bab-bc58-966197948bc1-istio-podinfo\") pod \"e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") " pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:29.815087 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.814996    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d58cfd9-f95d-4bab-bc58-966197948bc1-istio-token\") pod \"e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") " pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:29.815087 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.815025    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d58cfd9-f95d-4bab-bc58-966197948bc1-workload-socket\") pod \"e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") " pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:29.815087 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.815056    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhbjn\" (UniqueName: \"kubernetes.io/projected/3d58cfd9-f95d-4bab-bc58-966197948bc1-kube-api-access-dhbjn\") pod \"e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") " pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:29.916170 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.916113    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d58cfd9-f95d-4bab-bc58-966197948bc1-workload-certs\") pod \"e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") " pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:29.916170 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.916165    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d58cfd9-f95d-4bab-bc58-966197948bc1-istio-data\") pod \"e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") " pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:29.916405 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.916272    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d58cfd9-f95d-4bab-bc58-966197948bc1-istiod-ca-cert\") pod \"e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") " pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:29.916405 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.916315    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d58cfd9-f95d-4bab-bc58-966197948bc1-istio-envoy\") pod \"e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") " pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:29.916405 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.916370    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d58cfd9-f95d-4bab-bc58-966197948bc1-credential-socket\") pod \"e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") " pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:29.916573 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.916426    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d58cfd9-f95d-4bab-bc58-966197948bc1-istio-podinfo\") pod \"e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") " pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:29.916573 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.916485    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d58cfd9-f95d-4bab-bc58-966197948bc1-istio-token\") pod \"e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") " pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:29.916573 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.916513    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d58cfd9-f95d-4bab-bc58-966197948bc1-workload-socket\") pod \"e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") " pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:29.916573 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.916542    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d58cfd9-f95d-4bab-bc58-966197948bc1-workload-certs\") pod \"e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") " pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:29.916573 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.916546    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhbjn\" (UniqueName: \"kubernetes.io/projected/3d58cfd9-f95d-4bab-bc58-966197948bc1-kube-api-access-dhbjn\") pod \"e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") " pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:29.916812 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.916579    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d58cfd9-f95d-4bab-bc58-966197948bc1-istio-data\") pod \"e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") " pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:29.917095 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.917073    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d58cfd9-f95d-4bab-bc58-966197948bc1-credential-socket\") pod \"e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") " pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:29.917207 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.917099    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d58cfd9-f95d-4bab-bc58-966197948bc1-workload-socket\") pod \"e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") " pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:29.917278 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.917260    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d58cfd9-f95d-4bab-bc58-966197948bc1-istiod-ca-cert\") pod \"e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") " pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:29.918663 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.918640    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d58cfd9-f95d-4bab-bc58-966197948bc1-istio-envoy\") pod \"e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") " pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:29.918970 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.918941    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d58cfd9-f95d-4bab-bc58-966197948bc1-istio-podinfo\") pod \"e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") " pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:29.924961 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.924942    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d58cfd9-f95d-4bab-bc58-966197948bc1-istio-token\") pod \"e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") " pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:29.925240 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:29.925201    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhbjn\" (UniqueName: \"kubernetes.io/projected/3d58cfd9-f95d-4bab-bc58-966197948bc1-kube-api-access-dhbjn\") pod \"e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") " pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:30.012085 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:30.011994    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:30.148386 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:30.148357    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"]
Jul 21 04:46:30.150249 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:46:30.150220    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d58cfd9_f95d_4bab_bc58_966197948bc1.slice/crio-c8fb6dde54ac848a60010f4544143eb1e5849a7df5db79e8e5bebf24179bbba6 WatchSource:0}: Error finding container c8fb6dde54ac848a60010f4544143eb1e5849a7df5db79e8e5bebf24179bbba6: Status 404 returned error can't find the container with id c8fb6dde54ac848a60010f4544143eb1e5849a7df5db79e8e5bebf24179bbba6
Jul 21 04:46:30.152438 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:30.152402    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:46:30.152534 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:30.152479    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:46:30.152534 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:30.152524    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:46:31.085343 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:31.084589    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78" event={"ID":"3d58cfd9-f95d-4bab-bc58-966197948bc1","Type":"ContainerStarted","Data":"6405cfa94265b8d5c428a4b1269beebc97e1148bfb0ecf6a2a65080b6826c135"}
Jul 21 04:46:31.085343 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:31.084655    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78" event={"ID":"3d58cfd9-f95d-4bab-bc58-966197948bc1","Type":"ContainerStarted","Data":"c8fb6dde54ac848a60010f4544143eb1e5849a7df5db79e8e5bebf24179bbba6"}
Jul 21 04:46:31.115640 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:31.115545    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78" podStartSLOduration=2.115529583 podStartE2EDuration="2.115529583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:46:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:46:31.113401504 +0000 UTC m=+2521.002454668" watchObservedRunningTime="2026-07-21 04:46:31.115529583 +0000 UTC m=+2521.004582747"
Jul 21 04:46:32.012893 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:32.012856    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:32.017691 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:32.017665    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:32.089135 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:32.089109    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:32.090028 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:32.090008    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:33.448304 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:33.448267    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-8ae251-6447746577-pqrc2"]
Jul 21 04:46:33.452917 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:33.452898    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8ae251-6447746577-pqrc2"
Jul 21 04:46:33.459932 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:33.459908    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-8ae251-serving-cert\""
Jul 21 04:46:33.478108 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:33.478078    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-8ae251-6447746577-pqrc2"]
Jul 21 04:46:33.547675 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:33.547637    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8372063d-8c89-480a-b073-b6be8d771f48-openshift-service-ca\") pod \"maas-api-e2e-api-a-8ae251-6447746577-pqrc2\" (UID: \"8372063d-8c89-480a-b073-b6be8d771f48\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8ae251-6447746577-pqrc2"
Jul 21 04:46:33.547850 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:33.547758    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8372063d-8c89-480a-b073-b6be8d771f48-maas-api-tls\") pod \"maas-api-e2e-api-a-8ae251-6447746577-pqrc2\" (UID: \"8372063d-8c89-480a-b073-b6be8d771f48\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8ae251-6447746577-pqrc2"
Jul 21 04:46:33.547850 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:33.547803    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98gps\" (UniqueName: \"kubernetes.io/projected/8372063d-8c89-480a-b073-b6be8d771f48-kube-api-access-98gps\") pod \"maas-api-e2e-api-a-8ae251-6447746577-pqrc2\" (UID: \"8372063d-8c89-480a-b073-b6be8d771f48\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8ae251-6447746577-pqrc2"
Jul 21 04:46:33.648880 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:33.648844    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8372063d-8c89-480a-b073-b6be8d771f48-maas-api-tls\") pod \"maas-api-e2e-api-a-8ae251-6447746577-pqrc2\" (UID: \"8372063d-8c89-480a-b073-b6be8d771f48\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8ae251-6447746577-pqrc2"
Jul 21 04:46:33.649046 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:33.648891    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98gps\" (UniqueName: \"kubernetes.io/projected/8372063d-8c89-480a-b073-b6be8d771f48-kube-api-access-98gps\") pod \"maas-api-e2e-api-a-8ae251-6447746577-pqrc2\" (UID: \"8372063d-8c89-480a-b073-b6be8d771f48\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8ae251-6447746577-pqrc2"
Jul 21 04:46:33.649046 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:33.648938    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8372063d-8c89-480a-b073-b6be8d771f48-openshift-service-ca\") pod \"maas-api-e2e-api-a-8ae251-6447746577-pqrc2\" (UID: \"8372063d-8c89-480a-b073-b6be8d771f48\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8ae251-6447746577-pqrc2"
Jul 21 04:46:33.649706 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:33.649679    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8372063d-8c89-480a-b073-b6be8d771f48-openshift-service-ca\") pod \"maas-api-e2e-api-a-8ae251-6447746577-pqrc2\" (UID: \"8372063d-8c89-480a-b073-b6be8d771f48\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8ae251-6447746577-pqrc2"
Jul 21 04:46:33.651292 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:33.651270    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8372063d-8c89-480a-b073-b6be8d771f48-maas-api-tls\") pod \"maas-api-e2e-api-a-8ae251-6447746577-pqrc2\" (UID: \"8372063d-8c89-480a-b073-b6be8d771f48\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8ae251-6447746577-pqrc2"
Jul 21 04:46:33.669595 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:33.669564    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98gps\" (UniqueName: \"kubernetes.io/projected/8372063d-8c89-480a-b073-b6be8d771f48-kube-api-access-98gps\") pod \"maas-api-e2e-api-a-8ae251-6447746577-pqrc2\" (UID: \"8372063d-8c89-480a-b073-b6be8d771f48\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8ae251-6447746577-pqrc2"
Jul 21 04:46:33.763598 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:33.763499    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8ae251-6447746577-pqrc2"
Jul 21 04:46:33.918843 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:33.918797    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-8ae251-6447746577-pqrc2"]
Jul 21 04:46:33.921501 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:46:33.921472    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8372063d_8c89_480a_b073_b6be8d771f48.slice/crio-cbed2f1a618119d0c50e88c399709892f04e56b855650950fcda1854b0970427 WatchSource:0}: Error finding container cbed2f1a618119d0c50e88c399709892f04e56b855650950fcda1854b0970427: Status 404 returned error can't find the container with id cbed2f1a618119d0c50e88c399709892f04e56b855650950fcda1854b0970427
Jul 21 04:46:33.923048 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:33.923031    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 04:46:34.097589 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:34.097511    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8ae251-6447746577-pqrc2" event={"ID":"8372063d-8c89-480a-b073-b6be8d771f48","Type":"ContainerStarted","Data":"cbed2f1a618119d0c50e88c399709892f04e56b855650950fcda1854b0970427"}
Jul 21 04:46:35.103885 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:35.103846    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8ae251-6447746577-pqrc2" event={"ID":"8372063d-8c89-480a-b073-b6be8d771f48","Type":"ContainerStarted","Data":"d1f6ae64cdff35a0398289292b0d83fc258c7fb2d088fe04adc1f03f3c81bbdc"}
Jul 21 04:46:35.104290 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:35.103978    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8ae251-6447746577-pqrc2"
Jul 21 04:46:35.124597 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:35.124540    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8ae251-6447746577-pqrc2" podStartSLOduration=1.614806959 podStartE2EDuration="2.124523858s" totalImagesPullingTime="509.716899ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:46:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:46:35.123596494 +0000 UTC m=+2525.012649659" watchObservedRunningTime="2026-07-21 04:46:35.124523858 +0000 UTC m=+2525.013577022"
Jul 21 04:46:41.135534 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:41.135496    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8ae251-6447746577-pqrc2"
Jul 21 04:46:41.357035 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:41.357003    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5"]
Jul 21 04:46:41.360337 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:41.360317    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5"
Jul 21 04:46:41.362462 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:41.362433    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-bccec9-serving-cert\""
Jul 21 04:46:41.375092 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:41.375069    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5"]
Jul 21 04:46:41.429645 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:41.429548    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6jsx\" (UniqueName: \"kubernetes.io/projected/fe53f50a-b141-4a24-8299-77befdd21def-kube-api-access-z6jsx\") pod \"maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5\" (UID: \"fe53f50a-b141-4a24-8299-77befdd21def\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5"
Jul 21 04:46:41.430010 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:41.429983    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe53f50a-b141-4a24-8299-77befdd21def-openshift-service-ca\") pod \"maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5\" (UID: \"fe53f50a-b141-4a24-8299-77befdd21def\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5"
Jul 21 04:46:41.430212 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:41.430195    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe53f50a-b141-4a24-8299-77befdd21def-maas-api-tls\") pod \"maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5\" (UID: \"fe53f50a-b141-4a24-8299-77befdd21def\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5"
Jul 21 04:46:41.530887 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:41.530847    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6jsx\" (UniqueName: \"kubernetes.io/projected/fe53f50a-b141-4a24-8299-77befdd21def-kube-api-access-z6jsx\") pod \"maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5\" (UID: \"fe53f50a-b141-4a24-8299-77befdd21def\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5"
Jul 21 04:46:41.531241 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:41.531216    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe53f50a-b141-4a24-8299-77befdd21def-openshift-service-ca\") pod \"maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5\" (UID: \"fe53f50a-b141-4a24-8299-77befdd21def\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5"
Jul 21 04:46:41.531390 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:41.531371    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe53f50a-b141-4a24-8299-77befdd21def-maas-api-tls\") pod \"maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5\" (UID: \"fe53f50a-b141-4a24-8299-77befdd21def\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5"
Jul 21 04:46:41.531663 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:46:41.531643    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-bccec9-serving-cert: secret "maas-api-e2e-api-b-bccec9-serving-cert" not found
Jul 21 04:46:41.531809 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:46:41.531797    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe53f50a-b141-4a24-8299-77befdd21def-maas-api-tls podName:fe53f50a-b141-4a24-8299-77befdd21def nodeName:}" failed. No retries permitted until 2026-07-21 04:46:42.031774749 +0000 UTC m=+2531.920827905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fe53f50a-b141-4a24-8299-77befdd21def-maas-api-tls") pod "maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5" (UID: "fe53f50a-b141-4a24-8299-77befdd21def") : secret "maas-api-e2e-api-b-bccec9-serving-cert" not found
Jul 21 04:46:41.533097 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:41.533075    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe53f50a-b141-4a24-8299-77befdd21def-openshift-service-ca\") pod \"maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5\" (UID: \"fe53f50a-b141-4a24-8299-77befdd21def\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5"
Jul 21 04:46:41.542591 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:41.542569    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6jsx\" (UniqueName: \"kubernetes.io/projected/fe53f50a-b141-4a24-8299-77befdd21def-kube-api-access-z6jsx\") pod \"maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5\" (UID: \"fe53f50a-b141-4a24-8299-77befdd21def\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5"
Jul 21 04:46:42.036443 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:42.036407    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe53f50a-b141-4a24-8299-77befdd21def-maas-api-tls\") pod \"maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5\" (UID: \"fe53f50a-b141-4a24-8299-77befdd21def\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5"
Jul 21 04:46:42.039248 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:42.039216    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe53f50a-b141-4a24-8299-77befdd21def-maas-api-tls\") pod \"maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5\" (UID: \"fe53f50a-b141-4a24-8299-77befdd21def\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5"
Jul 21 04:46:42.271054 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:42.271020    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5"
Jul 21 04:46:42.468637 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:42.468570    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5"]
Jul 21 04:46:42.471191 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:46:42.471119    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe53f50a_b141_4a24_8299_77befdd21def.slice/crio-ea94c7d38f8508fda56b4716819894bba35cd4818462251d7106c60b961655f2 WatchSource:0}: Error finding container ea94c7d38f8508fda56b4716819894bba35cd4818462251d7106c60b961655f2: Status 404 returned error can't find the container with id ea94c7d38f8508fda56b4716819894bba35cd4818462251d7106c60b961655f2
Jul 21 04:46:43.147765 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:43.147732    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5" event={"ID":"fe53f50a-b141-4a24-8299-77befdd21def","Type":"ContainerStarted","Data":"4d34f8c6dadb1fa61ef17d02bc57a5a8291f70b41e94fd04604736a0d67dfbf4"}
Jul 21 04:46:43.147977 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:43.147781    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5" event={"ID":"fe53f50a-b141-4a24-8299-77befdd21def","Type":"ContainerStarted","Data":"ea94c7d38f8508fda56b4716819894bba35cd4818462251d7106c60b961655f2"}
Jul 21 04:46:43.147977 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:43.147871    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5"
Jul 21 04:46:43.167354 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:43.167307    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5" podStartSLOduration=1.863063819 podStartE2EDuration="2.167290891s" totalImagesPullingTime="304.227072ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:46:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:46:43.165743186 +0000 UTC m=+2533.054796349" watchObservedRunningTime="2026-07-21 04:46:43.167290891 +0000 UTC m=+2533.056344055"
Jul 21 04:46:47.091005 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:47.090924    2580 patch_prober.go:28] interesting pod/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 21 04:46:47.091005 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:47.090980    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78" podUID="3d58cfd9-f95d-4bab-bc58-966197948bc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 21 04:46:47.168602 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:47.168569    2580 generic.go:356] "Generic (PLEG): container finished" podID="3d58cfd9-f95d-4bab-bc58-966197948bc1" containerID="6405cfa94265b8d5c428a4b1269beebc97e1148bfb0ecf6a2a65080b6826c135" exitCode=0
Jul 21 04:46:47.168758 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:47.168640    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78" event={"ID":"3d58cfd9-f95d-4bab-bc58-966197948bc1","Type":"ContainerDied","Data":"6405cfa94265b8d5c428a4b1269beebc97e1148bfb0ecf6a2a65080b6826c135"}
Jul 21 04:46:47.169047 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:47.169029    2580 scope.go:117] "RemoveContainer" containerID="6405cfa94265b8d5c428a4b1269beebc97e1148bfb0ecf6a2a65080b6826c135"
Jul 21 04:46:47.170060 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:47.170026    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:46:47.170156 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:47.170117    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:46:47.170207 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:47.170184    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:46:48.174646 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:48.174614    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78" event={"ID":"3d58cfd9-f95d-4bab-bc58-966197948bc1","Type":"ContainerStarted","Data":"4dc1292aa0f18ddddc11071055aaa117195341204df6d07eb77ff5d5ed1aecf2"}
Jul 21 04:46:49.013119 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:49.013080    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:49.013346 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:49.013218    2580 patch_prober.go:28] interesting pod/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 21 04:46:49.013346 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:49.013262    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78" podUID="3d58cfd9-f95d-4bab-bc58-966197948bc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 21 04:46:49.158082 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:49.158055    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5"
Jul 21 04:46:50.013394 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:50.013351    2580 patch_prober.go:28] interesting pod/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 21 04:46:50.013909 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:50.013435    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78" podUID="3d58cfd9-f95d-4bab-bc58-966197948bc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 21 04:46:51.012592 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:51.012551    2580 patch_prober.go:28] interesting pod/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 21 04:46:51.012799 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:51.012627    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78" podUID="3d58cfd9-f95d-4bab-bc58-966197948bc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 21 04:46:52.016509 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:52.016480    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:52.016887 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:52.016856    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:46:52.017594 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:46:52.017578    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:47:09.837481 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:09.837446    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-8ae251-6447746577-pqrc2"]
Jul 21 04:47:09.838040 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:09.837648    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8ae251-6447746577-pqrc2" podUID="8372063d-8c89-480a-b073-b6be8d771f48" containerName="maas-api" containerID="cri-o://d1f6ae64cdff35a0398289292b0d83fc258c7fb2d088fe04adc1f03f3c81bbdc" gracePeriod=30
Jul 21 04:47:10.089379 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:10.089318    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8ae251-6447746577-pqrc2"
Jul 21 04:47:10.206356 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:10.206324    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8372063d-8c89-480a-b073-b6be8d771f48-openshift-service-ca\") pod \"8372063d-8c89-480a-b073-b6be8d771f48\" (UID: \"8372063d-8c89-480a-b073-b6be8d771f48\") "
Jul 21 04:47:10.206539 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:10.206378    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8372063d-8c89-480a-b073-b6be8d771f48-maas-api-tls\") pod \"8372063d-8c89-480a-b073-b6be8d771f48\" (UID: \"8372063d-8c89-480a-b073-b6be8d771f48\") "
Jul 21 04:47:10.206539 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:10.206440    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98gps\" (UniqueName: \"kubernetes.io/projected/8372063d-8c89-480a-b073-b6be8d771f48-kube-api-access-98gps\") pod \"8372063d-8c89-480a-b073-b6be8d771f48\" (UID: \"8372063d-8c89-480a-b073-b6be8d771f48\") "
Jul 21 04:47:10.206790 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:10.206759    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8372063d-8c89-480a-b073-b6be8d771f48-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8372063d-8c89-480a-b073-b6be8d771f48" (UID: "8372063d-8c89-480a-b073-b6be8d771f48"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:47:10.208570 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:10.208532    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8372063d-8c89-480a-b073-b6be8d771f48-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8372063d-8c89-480a-b073-b6be8d771f48" (UID: "8372063d-8c89-480a-b073-b6be8d771f48"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:47:10.208682 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:10.208650    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8372063d-8c89-480a-b073-b6be8d771f48-kube-api-access-98gps" (OuterVolumeSpecName: "kube-api-access-98gps") pod "8372063d-8c89-480a-b073-b6be8d771f48" (UID: "8372063d-8c89-480a-b073-b6be8d771f48"). InnerVolumeSpecName "kube-api-access-98gps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:47:10.272269 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:10.272231    2580 generic.go:356] "Generic (PLEG): container finished" podID="8372063d-8c89-480a-b073-b6be8d771f48" containerID="d1f6ae64cdff35a0398289292b0d83fc258c7fb2d088fe04adc1f03f3c81bbdc" exitCode=0
Jul 21 04:47:10.272441 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:10.272275    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8ae251-6447746577-pqrc2"
Jul 21 04:47:10.272441 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:10.272310    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8ae251-6447746577-pqrc2" event={"ID":"8372063d-8c89-480a-b073-b6be8d771f48","Type":"ContainerDied","Data":"d1f6ae64cdff35a0398289292b0d83fc258c7fb2d088fe04adc1f03f3c81bbdc"}
Jul 21 04:47:10.272441 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:10.272354    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8ae251-6447746577-pqrc2" event={"ID":"8372063d-8c89-480a-b073-b6be8d771f48","Type":"ContainerDied","Data":"cbed2f1a618119d0c50e88c399709892f04e56b855650950fcda1854b0970427"}
Jul 21 04:47:10.272441 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:10.272376    2580 scope.go:117] "RemoveContainer" containerID="d1f6ae64cdff35a0398289292b0d83fc258c7fb2d088fe04adc1f03f3c81bbdc"
Jul 21 04:47:10.281654 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:10.281637    2580 scope.go:117] "RemoveContainer" containerID="d1f6ae64cdff35a0398289292b0d83fc258c7fb2d088fe04adc1f03f3c81bbdc"
Jul 21 04:47:10.281914 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:47:10.281896    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1f6ae64cdff35a0398289292b0d83fc258c7fb2d088fe04adc1f03f3c81bbdc\": container with ID starting with d1f6ae64cdff35a0398289292b0d83fc258c7fb2d088fe04adc1f03f3c81bbdc not found: ID does not exist" containerID="d1f6ae64cdff35a0398289292b0d83fc258c7fb2d088fe04adc1f03f3c81bbdc"
Jul 21 04:47:10.281982 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:10.281919    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1f6ae64cdff35a0398289292b0d83fc258c7fb2d088fe04adc1f03f3c81bbdc"} err="failed to get container status \"d1f6ae64cdff35a0398289292b0d83fc258c7fb2d088fe04adc1f03f3c81bbdc\": rpc error: code = NotFound desc = could not find container \"d1f6ae64cdff35a0398289292b0d83fc258c7fb2d088fe04adc1f03f3c81bbdc\": container with ID starting with d1f6ae64cdff35a0398289292b0d83fc258c7fb2d088fe04adc1f03f3c81bbdc not found: ID does not exist"
Jul 21 04:47:10.295745 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:10.295715    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-8ae251-6447746577-pqrc2"]
Jul 21 04:47:10.299439 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:10.299414    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-8ae251-6447746577-pqrc2"]
Jul 21 04:47:10.307458 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:10.307432    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8372063d-8c89-480a-b073-b6be8d771f48-openshift-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:47:10.307535 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:10.307465    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8372063d-8c89-480a-b073-b6be8d771f48-maas-api-tls\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:47:10.307535 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:10.307480    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98gps\" (UniqueName: \"kubernetes.io/projected/8372063d-8c89-480a-b073-b6be8d771f48-kube-api-access-98gps\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:47:10.695624 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:10.695585    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8372063d-8c89-480a-b073-b6be8d771f48" path="/var/lib/kubelet/pods/8372063d-8c89-480a-b073-b6be8d771f48/volumes"
Jul 21 04:47:20.608296 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:20.608255    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"]
Jul 21 04:47:20.608827 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:20.608470    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78" podUID="3d58cfd9-f95d-4bab-bc58-966197948bc1" containerName="istio-proxy" containerID="cri-o://4dc1292aa0f18ddddc11071055aaa117195341204df6d07eb77ff5d5ed1aecf2" gracePeriod=30
Jul 21 04:47:22.019308 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:22.019270    2580 patch_prober.go:28] interesting pod/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 04:47:22.019695 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:22.019344    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78" podUID="3d58cfd9-f95d-4bab-bc58-966197948bc1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 04:47:25.861071 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:25.861045    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:47:25.955176 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:25.955121    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d58cfd9-f95d-4bab-bc58-966197948bc1-workload-socket\") pod \"3d58cfd9-f95d-4bab-bc58-966197948bc1\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") "
Jul 21 04:47:25.955176 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:25.955180    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d58cfd9-f95d-4bab-bc58-966197948bc1-istio-data\") pod \"3d58cfd9-f95d-4bab-bc58-966197948bc1\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") "
Jul 21 04:47:25.955414 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:25.955201    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhbjn\" (UniqueName: \"kubernetes.io/projected/3d58cfd9-f95d-4bab-bc58-966197948bc1-kube-api-access-dhbjn\") pod \"3d58cfd9-f95d-4bab-bc58-966197948bc1\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") "
Jul 21 04:47:25.955414 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:25.955221    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d58cfd9-f95d-4bab-bc58-966197948bc1-workload-certs\") pod \"3d58cfd9-f95d-4bab-bc58-966197948bc1\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") "
Jul 21 04:47:25.955414 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:25.955247    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d58cfd9-f95d-4bab-bc58-966197948bc1-istiod-ca-cert\") pod \"3d58cfd9-f95d-4bab-bc58-966197948bc1\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") "
Jul 21 04:47:25.955414 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:25.955283    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d58cfd9-f95d-4bab-bc58-966197948bc1-istio-podinfo\") pod \"3d58cfd9-f95d-4bab-bc58-966197948bc1\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") "
Jul 21 04:47:25.955414 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:25.955339    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d58cfd9-f95d-4bab-bc58-966197948bc1-credential-socket\") pod \"3d58cfd9-f95d-4bab-bc58-966197948bc1\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") "
Jul 21 04:47:25.955414 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:25.955373    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d58cfd9-f95d-4bab-bc58-966197948bc1-istio-envoy\") pod \"3d58cfd9-f95d-4bab-bc58-966197948bc1\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") "
Jul 21 04:47:25.955414 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:25.955397    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d58cfd9-f95d-4bab-bc58-966197948bc1-istio-token\") pod \"3d58cfd9-f95d-4bab-bc58-966197948bc1\" (UID: \"3d58cfd9-f95d-4bab-bc58-966197948bc1\") "
Jul 21 04:47:25.955414 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:25.955407    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d58cfd9-f95d-4bab-bc58-966197948bc1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3d58cfd9-f95d-4bab-bc58-966197948bc1" (UID: "3d58cfd9-f95d-4bab-bc58-966197948bc1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:47:25.955739 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:25.955680    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d58cfd9-f95d-4bab-bc58-966197948bc1-workload-socket\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:47:25.955739 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:25.955720    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d58cfd9-f95d-4bab-bc58-966197948bc1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3d58cfd9-f95d-4bab-bc58-966197948bc1" (UID: "3d58cfd9-f95d-4bab-bc58-966197948bc1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:47:25.955854 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:25.955803    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d58cfd9-f95d-4bab-bc58-966197948bc1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3d58cfd9-f95d-4bab-bc58-966197948bc1" (UID: "3d58cfd9-f95d-4bab-bc58-966197948bc1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:47:25.955944 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:25.955915    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d58cfd9-f95d-4bab-bc58-966197948bc1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3d58cfd9-f95d-4bab-bc58-966197948bc1" (UID: "3d58cfd9-f95d-4bab-bc58-966197948bc1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:47:25.956252 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:25.956228    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d58cfd9-f95d-4bab-bc58-966197948bc1-istio-data" (OuterVolumeSpecName: "istio-data") pod "3d58cfd9-f95d-4bab-bc58-966197948bc1" (UID: "3d58cfd9-f95d-4bab-bc58-966197948bc1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:47:25.957606 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:25.957579    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d58cfd9-f95d-4bab-bc58-966197948bc1-istio-token" (OuterVolumeSpecName: "istio-token") pod "3d58cfd9-f95d-4bab-bc58-966197948bc1" (UID: "3d58cfd9-f95d-4bab-bc58-966197948bc1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:47:25.957606 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:25.957592    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d58cfd9-f95d-4bab-bc58-966197948bc1-kube-api-access-dhbjn" (OuterVolumeSpecName: "kube-api-access-dhbjn") pod "3d58cfd9-f95d-4bab-bc58-966197948bc1" (UID: "3d58cfd9-f95d-4bab-bc58-966197948bc1"). InnerVolumeSpecName "kube-api-access-dhbjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:47:25.957849 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:25.957830    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3d58cfd9-f95d-4bab-bc58-966197948bc1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3d58cfd9-f95d-4bab-bc58-966197948bc1" (UID: "3d58cfd9-f95d-4bab-bc58-966197948bc1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 04:47:25.957849 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:25.957835    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d58cfd9-f95d-4bab-bc58-966197948bc1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3d58cfd9-f95d-4bab-bc58-966197948bc1" (UID: "3d58cfd9-f95d-4bab-bc58-966197948bc1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:47:26.056366 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:26.056334    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d58cfd9-f95d-4bab-bc58-966197948bc1-istio-podinfo\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:47:26.056366 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:26.056362    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d58cfd9-f95d-4bab-bc58-966197948bc1-credential-socket\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:47:26.056366 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:26.056372    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d58cfd9-f95d-4bab-bc58-966197948bc1-istio-envoy\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:47:26.056582 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:26.056381    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d58cfd9-f95d-4bab-bc58-966197948bc1-istio-token\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:47:26.056582 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:26.056388    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d58cfd9-f95d-4bab-bc58-966197948bc1-istio-data\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:47:26.056582 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:26.056395    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhbjn\" (UniqueName: \"kubernetes.io/projected/3d58cfd9-f95d-4bab-bc58-966197948bc1-kube-api-access-dhbjn\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:47:26.056582 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:26.056404    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d58cfd9-f95d-4bab-bc58-966197948bc1-workload-certs\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:47:26.056582 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:26.056412    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d58cfd9-f95d-4bab-bc58-966197948bc1-istiod-ca-cert\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:47:26.345948 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:26.345853    2580 generic.go:356] "Generic (PLEG): container finished" podID="3d58cfd9-f95d-4bab-bc58-966197948bc1" containerID="4dc1292aa0f18ddddc11071055aaa117195341204df6d07eb77ff5d5ed1aecf2" exitCode=0
Jul 21 04:47:26.345948 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:26.345903    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"
Jul 21 04:47:26.346201 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:26.345937    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78" event={"ID":"3d58cfd9-f95d-4bab-bc58-966197948bc1","Type":"ContainerDied","Data":"4dc1292aa0f18ddddc11071055aaa117195341204df6d07eb77ff5d5ed1aecf2"}
Jul 21 04:47:26.346201 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:26.346002    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78" event={"ID":"3d58cfd9-f95d-4bab-bc58-966197948bc1","Type":"ContainerDied","Data":"c8fb6dde54ac848a60010f4544143eb1e5849a7df5db79e8e5bebf24179bbba6"}
Jul 21 04:47:26.346201 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:26.346034    2580 scope.go:117] "RemoveContainer" containerID="4dc1292aa0f18ddddc11071055aaa117195341204df6d07eb77ff5d5ed1aecf2"
Jul 21 04:47:26.354891 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:26.354874    2580 scope.go:117] "RemoveContainer" containerID="6405cfa94265b8d5c428a4b1269beebc97e1148bfb0ecf6a2a65080b6826c135"
Jul 21 04:47:26.362270 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:26.362257    2580 scope.go:117] "RemoveContainer" containerID="4dc1292aa0f18ddddc11071055aaa117195341204df6d07eb77ff5d5ed1aecf2"
Jul 21 04:47:26.362517 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:47:26.362497    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4dc1292aa0f18ddddc11071055aaa117195341204df6d07eb77ff5d5ed1aecf2\": container with ID starting with 4dc1292aa0f18ddddc11071055aaa117195341204df6d07eb77ff5d5ed1aecf2 not found: ID does not exist" containerID="4dc1292aa0f18ddddc11071055aaa117195341204df6d07eb77ff5d5ed1aecf2"
Jul 21 04:47:26.362594 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:26.362530    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dc1292aa0f18ddddc11071055aaa117195341204df6d07eb77ff5d5ed1aecf2"} err="failed to get container status \"4dc1292aa0f18ddddc11071055aaa117195341204df6d07eb77ff5d5ed1aecf2\": rpc error: code = NotFound desc = could not find container \"4dc1292aa0f18ddddc11071055aaa117195341204df6d07eb77ff5d5ed1aecf2\": container with ID starting with 4dc1292aa0f18ddddc11071055aaa117195341204df6d07eb77ff5d5ed1aecf2 not found: ID does not exist"
Jul 21 04:47:26.362594 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:26.362552    2580 scope.go:117] "RemoveContainer" containerID="6405cfa94265b8d5c428a4b1269beebc97e1148bfb0ecf6a2a65080b6826c135"
Jul 21 04:47:26.362772 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:47:26.362754    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6405cfa94265b8d5c428a4b1269beebc97e1148bfb0ecf6a2a65080b6826c135\": container with ID starting with 6405cfa94265b8d5c428a4b1269beebc97e1148bfb0ecf6a2a65080b6826c135 not found: ID does not exist" containerID="6405cfa94265b8d5c428a4b1269beebc97e1148bfb0ecf6a2a65080b6826c135"
Jul 21 04:47:26.362811 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:26.362778    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6405cfa94265b8d5c428a4b1269beebc97e1148bfb0ecf6a2a65080b6826c135"} err="failed to get container status \"6405cfa94265b8d5c428a4b1269beebc97e1148bfb0ecf6a2a65080b6826c135\": rpc error: code = NotFound desc = could not find container \"6405cfa94265b8d5c428a4b1269beebc97e1148bfb0ecf6a2a65080b6826c135\": container with ID starting with 6405cfa94265b8d5c428a4b1269beebc97e1148bfb0ecf6a2a65080b6826c135 not found: ID does not exist"
Jul 21 04:47:26.366936 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:26.366917    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"]
Jul 21 04:47:26.371236 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:26.371213    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-8ae251-openshift-default-5789cfdc87-nbv78"]
Jul 21 04:47:26.693719 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:26.693688    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d58cfd9-f95d-4bab-bc58-966197948bc1" path="/var/lib/kubelet/pods/3d58cfd9-f95d-4bab-bc58-966197948bc1/volumes"
Jul 21 04:47:36.542546 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:36.542512    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5"]
Jul 21 04:47:36.542986 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:36.542752    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5" podUID="fe53f50a-b141-4a24-8299-77befdd21def" containerName="maas-api" containerID="cri-o://4d34f8c6dadb1fa61ef17d02bc57a5a8291f70b41e94fd04604736a0d67dfbf4" gracePeriod=30
Jul 21 04:47:36.805739 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:36.805681    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5"
Jul 21 04:47:36.945202 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:36.945168    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6jsx\" (UniqueName: \"kubernetes.io/projected/fe53f50a-b141-4a24-8299-77befdd21def-kube-api-access-z6jsx\") pod \"fe53f50a-b141-4a24-8299-77befdd21def\" (UID: \"fe53f50a-b141-4a24-8299-77befdd21def\") "
Jul 21 04:47:36.945370 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:36.945245    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe53f50a-b141-4a24-8299-77befdd21def-openshift-service-ca\") pod \"fe53f50a-b141-4a24-8299-77befdd21def\" (UID: \"fe53f50a-b141-4a24-8299-77befdd21def\") "
Jul 21 04:47:36.945425 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:36.945406    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe53f50a-b141-4a24-8299-77befdd21def-maas-api-tls\") pod \"fe53f50a-b141-4a24-8299-77befdd21def\" (UID: \"fe53f50a-b141-4a24-8299-77befdd21def\") "
Jul 21 04:47:36.945577 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:36.945556    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe53f50a-b141-4a24-8299-77befdd21def-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fe53f50a-b141-4a24-8299-77befdd21def" (UID: "fe53f50a-b141-4a24-8299-77befdd21def"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:47:36.945694 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:36.945677    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe53f50a-b141-4a24-8299-77befdd21def-openshift-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:47:36.947255 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:36.947225    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe53f50a-b141-4a24-8299-77befdd21def-kube-api-access-z6jsx" (OuterVolumeSpecName: "kube-api-access-z6jsx") pod "fe53f50a-b141-4a24-8299-77befdd21def" (UID: "fe53f50a-b141-4a24-8299-77befdd21def"). InnerVolumeSpecName "kube-api-access-z6jsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:47:36.947363 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:36.947287    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe53f50a-b141-4a24-8299-77befdd21def-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fe53f50a-b141-4a24-8299-77befdd21def" (UID: "fe53f50a-b141-4a24-8299-77befdd21def"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:47:37.046938 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:37.046906    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe53f50a-b141-4a24-8299-77befdd21def-maas-api-tls\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:47:37.046938 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:37.046934    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6jsx\" (UniqueName: \"kubernetes.io/projected/fe53f50a-b141-4a24-8299-77befdd21def-kube-api-access-z6jsx\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:47:37.395972 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:37.395939    2580 generic.go:356] "Generic (PLEG): container finished" podID="fe53f50a-b141-4a24-8299-77befdd21def" containerID="4d34f8c6dadb1fa61ef17d02bc57a5a8291f70b41e94fd04604736a0d67dfbf4" exitCode=0
Jul 21 04:47:37.396180 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:37.395989    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5"
Jul 21 04:47:37.396180 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:37.396026    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5" event={"ID":"fe53f50a-b141-4a24-8299-77befdd21def","Type":"ContainerDied","Data":"4d34f8c6dadb1fa61ef17d02bc57a5a8291f70b41e94fd04604736a0d67dfbf4"}
Jul 21 04:47:37.396180 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:37.396108    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5" event={"ID":"fe53f50a-b141-4a24-8299-77befdd21def","Type":"ContainerDied","Data":"ea94c7d38f8508fda56b4716819894bba35cd4818462251d7106c60b961655f2"}
Jul 21 04:47:37.396180 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:37.396147    2580 scope.go:117] "RemoveContainer" containerID="4d34f8c6dadb1fa61ef17d02bc57a5a8291f70b41e94fd04604736a0d67dfbf4"
Jul 21 04:47:37.405026 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:37.405010    2580 scope.go:117] "RemoveContainer" containerID="4d34f8c6dadb1fa61ef17d02bc57a5a8291f70b41e94fd04604736a0d67dfbf4"
Jul 21 04:47:37.405301 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:47:37.405282    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d34f8c6dadb1fa61ef17d02bc57a5a8291f70b41e94fd04604736a0d67dfbf4\": container with ID starting with 4d34f8c6dadb1fa61ef17d02bc57a5a8291f70b41e94fd04604736a0d67dfbf4 not found: ID does not exist" containerID="4d34f8c6dadb1fa61ef17d02bc57a5a8291f70b41e94fd04604736a0d67dfbf4"
Jul 21 04:47:37.405360 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:37.405309    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d34f8c6dadb1fa61ef17d02bc57a5a8291f70b41e94fd04604736a0d67dfbf4"} err="failed to get container status \"4d34f8c6dadb1fa61ef17d02bc57a5a8291f70b41e94fd04604736a0d67dfbf4\": rpc error: code = NotFound desc = could not find container \"4d34f8c6dadb1fa61ef17d02bc57a5a8291f70b41e94fd04604736a0d67dfbf4\": container with ID starting with 4d34f8c6dadb1fa61ef17d02bc57a5a8291f70b41e94fd04604736a0d67dfbf4 not found: ID does not exist"
Jul 21 04:47:37.415790 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:37.415759    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5"]
Jul 21 04:47:37.419419 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:37.419401    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-bccec9-dbc6f78bc-dhpt5"]
Jul 21 04:47:38.694021 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:38.693984    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe53f50a-b141-4a24-8299-77befdd21def" path="/var/lib/kubelet/pods/fe53f50a-b141-4a24-8299-77befdd21def/volumes"
Jul 21 04:47:48.496770 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.496735    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"]
Jul 21 04:47:48.497215 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.497196    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d58cfd9-f95d-4bab-bc58-966197948bc1" containerName="istio-proxy"
Jul 21 04:47:48.497369 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.497220    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d58cfd9-f95d-4bab-bc58-966197948bc1" containerName="istio-proxy"
Jul 21 04:47:48.497369 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.497240    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe53f50a-b141-4a24-8299-77befdd21def" containerName="maas-api"
Jul 21 04:47:48.497369 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.497249    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe53f50a-b141-4a24-8299-77befdd21def" containerName="maas-api"
Jul 21 04:47:48.497369 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.497265    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8372063d-8c89-480a-b073-b6be8d771f48" containerName="maas-api"
Jul 21 04:47:48.497369 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.497273    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8372063d-8c89-480a-b073-b6be8d771f48" containerName="maas-api"
Jul 21 04:47:48.497369 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.497355    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d58cfd9-f95d-4bab-bc58-966197948bc1" containerName="istio-proxy"
Jul 21 04:47:48.497369 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.497371    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d58cfd9-f95d-4bab-bc58-966197948bc1" containerName="istio-proxy"
Jul 21 04:47:48.497672 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.497383    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8372063d-8c89-480a-b073-b6be8d771f48" containerName="maas-api"
Jul 21 04:47:48.497672 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.497393    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe53f50a-b141-4a24-8299-77befdd21def" containerName="maas-api"
Jul 21 04:47:48.501614 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.501594    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:48.504054 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.504033    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-e19fee-openshift-default-dockercfg-4lt2s\""
Jul 21 04:47:48.512017 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.511997    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"]
Jul 21 04:47:48.646295 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.646255    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-credential-socket\") pod \"e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") " pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:48.646456 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.646305    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-istiod-ca-cert\") pod \"e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") " pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:48.646456 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.646334    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-istio-podinfo\") pod \"e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") " pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:48.646456 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.646365    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-istio-data\") pod \"e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") " pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:48.646563 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.646460    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-istio-envoy\") pod \"e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") " pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:48.646563 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.646490    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk9np\" (UniqueName: \"kubernetes.io/projected/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-kube-api-access-jk9np\") pod \"e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") " pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:48.646563 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.646523    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-workload-certs\") pod \"e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") " pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:48.646563 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.646547    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-istio-token\") pod \"e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") " pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:48.646693 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.646566    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-workload-socket\") pod \"e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") " pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:48.747784 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.747688    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-credential-socket\") pod \"e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") " pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:48.747784 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.747726    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-istiod-ca-cert\") pod \"e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") " pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:48.747784 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.747745    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-istio-podinfo\") pod \"e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") " pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:48.747784 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.747763    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-istio-data\") pod \"e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") " pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:48.748096 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.747824    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-istio-envoy\") pod \"e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") " pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:48.748096 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.747864    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk9np\" (UniqueName: \"kubernetes.io/projected/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-kube-api-access-jk9np\") pod \"e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") " pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:48.748096 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.747902    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-workload-certs\") pod \"e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") " pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:48.748096 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.747917    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-istio-token\") pod \"e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") " pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:48.748096 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.747935    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-workload-socket\") pod \"e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") " pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:48.748377 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.748158    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-istio-data\") pod \"e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") " pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:48.748516 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.748489    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-credential-socket\") pod \"e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") " pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:48.748653 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.748519    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-workload-certs\") pod \"e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") " pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:48.748653 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.748591    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-workload-socket\") pod \"e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") " pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:48.748983 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.748963    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-istiod-ca-cert\") pod \"e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") " pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:48.750522 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.750498    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-istio-envoy\") pod \"e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") " pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:48.750633 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.750615    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-istio-podinfo\") pod \"e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") " pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:48.755363 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.755338    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-istio-token\") pod \"e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") " pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:48.755696 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.755676    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk9np\" (UniqueName: \"kubernetes.io/projected/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-kube-api-access-jk9np\") pod \"e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") " pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:48.811612 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.811579    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:48.942345 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.942316    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"]
Jul 21 04:47:48.943956 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:47:48.943928    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod427aa7e3_44ab_41a8_bbf5_07a9786f96e9.slice/crio-d5586661046a8ee6df3716f02171603ed01973601d6ee5e6f88684e210243d85 WatchSource:0}: Error finding container d5586661046a8ee6df3716f02171603ed01973601d6ee5e6f88684e210243d85: Status 404 returned error can't find the container with id d5586661046a8ee6df3716f02171603ed01973601d6ee5e6f88684e210243d85
Jul 21 04:47:48.946111 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.946078    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:47:48.946200 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.946158    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:47:48.946200 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:48.946190    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:47:49.454772 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:49.454738    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv" event={"ID":"427aa7e3-44ab-41a8-bbf5-07a9786f96e9","Type":"ContainerStarted","Data":"e885335c8e3dc3faa4f78a9ca844055f172d73a1301975cc99b57f51f0212c32"}
Jul 21 04:47:49.454923 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:49.454789    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv" event={"ID":"427aa7e3-44ab-41a8-bbf5-07a9786f96e9","Type":"ContainerStarted","Data":"d5586661046a8ee6df3716f02171603ed01973601d6ee5e6f88684e210243d85"}
Jul 21 04:47:49.479418 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:49.479356    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv" podStartSLOduration=1.479340441 podStartE2EDuration="1.479340441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:47:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:47:49.47797624 +0000 UTC m=+2599.367029438" watchObservedRunningTime="2026-07-21 04:47:49.479340441 +0000 UTC m=+2599.368393605"
Jul 21 04:47:49.812584 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:49.812493    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:49.817022 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:49.816997    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:50.459944 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:50.459904    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:50.461056 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:50.461035    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:47:51.540115 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:51.540086    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp"]
Jul 21 04:47:51.540504 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:51.540429    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d58cfd9-f95d-4bab-bc58-966197948bc1" containerName="istio-proxy"
Jul 21 04:47:51.540504 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:51.540441    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d58cfd9-f95d-4bab-bc58-966197948bc1" containerName="istio-proxy"
Jul 21 04:47:51.543371 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:51.543354    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp"
Jul 21 04:47:51.545561 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:51.545531    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-e19fee-serving-cert\""
Jul 21 04:47:51.555137 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:51.555101    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp"]
Jul 21 04:47:51.674203 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:51.674170    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p492\" (UniqueName: \"kubernetes.io/projected/2bd12a09-9a17-4569-9883-15c550206942-kube-api-access-9p492\") pod \"maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp\" (UID: \"2bd12a09-9a17-4569-9883-15c550206942\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp"
Jul 21 04:47:51.674385 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:51.674303    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bd12a09-9a17-4569-9883-15c550206942-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp\" (UID: \"2bd12a09-9a17-4569-9883-15c550206942\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp"
Jul 21 04:47:51.674385 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:51.674366    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bd12a09-9a17-4569-9883-15c550206942-maas-api-tls\") pod \"maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp\" (UID: \"2bd12a09-9a17-4569-9883-15c550206942\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp"
Jul 21 04:47:51.775022 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:51.774932    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bd12a09-9a17-4569-9883-15c550206942-maas-api-tls\") pod \"maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp\" (UID: \"2bd12a09-9a17-4569-9883-15c550206942\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp"
Jul 21 04:47:51.775022 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:51.774992    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p492\" (UniqueName: \"kubernetes.io/projected/2bd12a09-9a17-4569-9883-15c550206942-kube-api-access-9p492\") pod \"maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp\" (UID: \"2bd12a09-9a17-4569-9883-15c550206942\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp"
Jul 21 04:47:51.775245 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:51.775076    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bd12a09-9a17-4569-9883-15c550206942-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp\" (UID: \"2bd12a09-9a17-4569-9883-15c550206942\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp"
Jul 21 04:47:51.775735 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:51.775717    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bd12a09-9a17-4569-9883-15c550206942-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp\" (UID: \"2bd12a09-9a17-4569-9883-15c550206942\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp"
Jul 21 04:47:51.777398 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:51.777379    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bd12a09-9a17-4569-9883-15c550206942-maas-api-tls\") pod \"maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp\" (UID: \"2bd12a09-9a17-4569-9883-15c550206942\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp"
Jul 21 04:47:51.783406 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:51.783377    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p492\" (UniqueName: \"kubernetes.io/projected/2bd12a09-9a17-4569-9883-15c550206942-kube-api-access-9p492\") pod \"maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp\" (UID: \"2bd12a09-9a17-4569-9883-15c550206942\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp"
Jul 21 04:47:51.855422 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:51.855345    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp"
Jul 21 04:47:51.987913 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:51.987759    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp"]
Jul 21 04:47:51.989969 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:47:51.989943    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bd12a09_9a17_4569_9883_15c550206942.slice/crio-1cfeb06d3dc3fdd511cdf88ae763af6994346faaae69a3faae258574cbd5f481 WatchSource:0}: Error finding container 1cfeb06d3dc3fdd511cdf88ae763af6994346faaae69a3faae258574cbd5f481: Status 404 returned error can't find the container with id 1cfeb06d3dc3fdd511cdf88ae763af6994346faaae69a3faae258574cbd5f481
Jul 21 04:47:52.469150 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:52.469100    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp" event={"ID":"2bd12a09-9a17-4569-9883-15c550206942","Type":"ContainerStarted","Data":"d7b9065c235acf6bd9e8b61048ad3f39b438bb5aed0f31fe68a0beef97f0763a"}
Jul 21 04:47:52.469316 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:52.469169    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp" event={"ID":"2bd12a09-9a17-4569-9883-15c550206942","Type":"ContainerStarted","Data":"1cfeb06d3dc3fdd511cdf88ae763af6994346faaae69a3faae258574cbd5f481"}
Jul 21 04:47:52.469316 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:52.469273    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp"
Jul 21 04:47:52.487934 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:52.487886    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp" podStartSLOduration=1.109174324 podStartE2EDuration="1.487870406s" totalImagesPullingTime="378.696082ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:47:52.486592279 +0000 UTC m=+2602.375645456" watchObservedRunningTime="2026-07-21 04:47:52.487870406 +0000 UTC m=+2602.376923574"
Jul 21 04:47:58.479447 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:58.479412    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp"
Jul 21 04:47:59.724148 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:59.721087    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x"]
Jul 21 04:47:59.734275 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:59.734245    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x"
Jul 21 04:47:59.739350 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:59.739320    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x"]
Jul 21 04:47:59.740014 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:59.739994    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-cfd2ba-serving-cert\""
Jul 21 04:47:59.855687 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:59.855651    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c954906f-ea16-4a46-b4fd-cdd020e091cc-maas-api-tls\") pod \"maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x\" (UID: \"c954906f-ea16-4a46-b4fd-cdd020e091cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x"
Jul 21 04:47:59.855897 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:59.855796    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmbvj\" (UniqueName: \"kubernetes.io/projected/c954906f-ea16-4a46-b4fd-cdd020e091cc-kube-api-access-tmbvj\") pod \"maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x\" (UID: \"c954906f-ea16-4a46-b4fd-cdd020e091cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x"
Jul 21 04:47:59.855979 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:59.855894    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c954906f-ea16-4a46-b4fd-cdd020e091cc-openshift-service-ca\") pod \"maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x\" (UID: \"c954906f-ea16-4a46-b4fd-cdd020e091cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x"
Jul 21 04:47:59.957507 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:59.957470    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c954906f-ea16-4a46-b4fd-cdd020e091cc-maas-api-tls\") pod \"maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x\" (UID: \"c954906f-ea16-4a46-b4fd-cdd020e091cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x"
Jul 21 04:47:59.957507 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:59.957523    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmbvj\" (UniqueName: \"kubernetes.io/projected/c954906f-ea16-4a46-b4fd-cdd020e091cc-kube-api-access-tmbvj\") pod \"maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x\" (UID: \"c954906f-ea16-4a46-b4fd-cdd020e091cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x"
Jul 21 04:47:59.957799 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:59.957557    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c954906f-ea16-4a46-b4fd-cdd020e091cc-openshift-service-ca\") pod \"maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x\" (UID: \"c954906f-ea16-4a46-b4fd-cdd020e091cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x"
Jul 21 04:47:59.957799 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:47:59.957636    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-cfd2ba-serving-cert: secret "maas-api-e2e-shared-b-cfd2ba-serving-cert" not found
Jul 21 04:47:59.957799 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:47:59.957712    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c954906f-ea16-4a46-b4fd-cdd020e091cc-maas-api-tls podName:c954906f-ea16-4a46-b4fd-cdd020e091cc nodeName:}" failed. No retries permitted until 2026-07-21 04:48:00.457694253 +0000 UTC m=+2610.346747402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c954906f-ea16-4a46-b4fd-cdd020e091cc-maas-api-tls") pod "maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x" (UID: "c954906f-ea16-4a46-b4fd-cdd020e091cc") : secret "maas-api-e2e-shared-b-cfd2ba-serving-cert" not found
Jul 21 04:47:59.958193 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:59.958176    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c954906f-ea16-4a46-b4fd-cdd020e091cc-openshift-service-ca\") pod \"maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x\" (UID: \"c954906f-ea16-4a46-b4fd-cdd020e091cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x"
Jul 21 04:47:59.968482 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:47:59.968458    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmbvj\" (UniqueName: \"kubernetes.io/projected/c954906f-ea16-4a46-b4fd-cdd020e091cc-kube-api-access-tmbvj\") pod \"maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x\" (UID: \"c954906f-ea16-4a46-b4fd-cdd020e091cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x"
Jul 21 04:48:00.464149 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:48:00.464086    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c954906f-ea16-4a46-b4fd-cdd020e091cc-maas-api-tls\") pod \"maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x\" (UID: \"c954906f-ea16-4a46-b4fd-cdd020e091cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x"
Jul 21 04:48:00.466906 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:48:00.466875    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c954906f-ea16-4a46-b4fd-cdd020e091cc-maas-api-tls\") pod \"maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x\" (UID: \"c954906f-ea16-4a46-b4fd-cdd020e091cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x"
Jul 21 04:48:00.657107 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:48:00.657063    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x"
Jul 21 04:48:00.809739 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:48:00.809712    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x"]
Jul 21 04:48:00.837279 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:48:00.837231    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc954906f_ea16_4a46_b4fd_cdd020e091cc.slice/crio-4d76dcc9a87b1aa1f06d24cb19ff2dd461d60035abe62ad896a221c5989967ba WatchSource:0}: Error finding container 4d76dcc9a87b1aa1f06d24cb19ff2dd461d60035abe62ad896a221c5989967ba: Status 404 returned error can't find the container with id 4d76dcc9a87b1aa1f06d24cb19ff2dd461d60035abe62ad896a221c5989967ba
Jul 21 04:48:01.514418 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:48:01.514368    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x" event={"ID":"c954906f-ea16-4a46-b4fd-cdd020e091cc","Type":"ContainerStarted","Data":"09f06cd6097e52141d64edf32de20bdef3226171193928aa130b4a5df9114e63"}
Jul 21 04:48:01.514587 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:48:01.514441    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x" event={"ID":"c954906f-ea16-4a46-b4fd-cdd020e091cc","Type":"ContainerStarted","Data":"4d76dcc9a87b1aa1f06d24cb19ff2dd461d60035abe62ad896a221c5989967ba"}
Jul 21 04:48:01.514587 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:48:01.514525    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x"
Jul 21 04:48:01.530200 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:48:01.530152    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x" podStartSLOduration=1.9427790950000001 podStartE2EDuration="2.530114152s" totalImagesPullingTime="587.335057ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:48:01.529169761 +0000 UTC m=+2611.418222926" watchObservedRunningTime="2026-07-21 04:48:01.530114152 +0000 UTC m=+2611.419167368"
Jul 21 04:48:04.530505 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:48:04.530474    2580 generic.go:356] "Generic (PLEG): container finished" podID="427aa7e3-44ab-41a8-bbf5-07a9786f96e9" containerID="e885335c8e3dc3faa4f78a9ca844055f172d73a1301975cc99b57f51f0212c32" exitCode=0
Jul 21 04:48:04.530997 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:48:04.530552    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv" event={"ID":"427aa7e3-44ab-41a8-bbf5-07a9786f96e9","Type":"ContainerDied","Data":"e885335c8e3dc3faa4f78a9ca844055f172d73a1301975cc99b57f51f0212c32"}
Jul 21 04:48:04.530997 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:48:04.530937    2580 scope.go:117] "RemoveContainer" containerID="e885335c8e3dc3faa4f78a9ca844055f172d73a1301975cc99b57f51f0212c32"
Jul 21 04:48:04.532045 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:48:04.532023    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:48:04.532107 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:48:04.532088    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:48:04.532157 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:48:04.532120    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 04:48:05.460574 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:48:05.460527    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:48:05.540849 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:48:05.540817    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv" event={"ID":"427aa7e3-44ab-41a8-bbf5-07a9786f96e9","Type":"ContainerStarted","Data":"8dcf900eb802e206e7ae5589c095f965e6b08a17f371d8e8aa7636abb6e1b1c7"}
Jul 21 04:48:05.813505 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:48:05.813398    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:48:05.813685 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:48:05.813612    2580 patch_prober.go:28] interesting pod/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 21 04:48:05.813685 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:48:05.813664    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv" podUID="427aa7e3-44ab-41a8-bbf5-07a9786f96e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 21 04:48:06.812723 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:48:06.812678    2580 patch_prober.go:28] interesting pod/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 21 04:48:06.813235 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:48:06.812746    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv" podUID="427aa7e3-44ab-41a8-bbf5-07a9786f96e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 21 04:48:07.529429 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:48:07.529377    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x"
Jul 21 04:48:07.812442 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:48:07.812332    2580 patch_prober.go:28] interesting pod/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 21 04:48:07.812442 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:48:07.812425    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv" podUID="427aa7e3-44ab-41a8-bbf5-07a9786f96e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 21 04:48:08.812720 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:48:08.812680    2580 patch_prober.go:28] interesting pod/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 21 04:48:08.813354 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:48:08.813318    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv" podUID="427aa7e3-44ab-41a8-bbf5-07a9786f96e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 21 04:48:09.815987 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:48:09.815960    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:48:09.816462 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:48:09.816249    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:48:09.816887 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:48:09.816871    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:48:30.871935 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:48:30.871904    2580 scope.go:117] "RemoveContainer" containerID="b03c830003ccc97341e01fce588f88f62ac53250c5b1a2a64f306930f9157948"
Jul 21 04:49:30.766766 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:49:30.766692    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-694fk_6f2c16b6-c4e7-480c-b4d7-1312ed5ad130/ovn-acl-logging/0.log"
Jul 21 04:49:30.773493 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:49:30.773471    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-694fk_6f2c16b6-c4e7-480c-b4d7-1312ed5ad130/ovn-acl-logging/0.log"
Jul 21 04:52:30.913076 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:52:30.912994    2580 scope.go:117] "RemoveContainer" containerID="f8bfe9e5528482a5a2788a881b542538f49a85eccfbf2262e7b848141ec9156e"
Jul 21 04:53:58.541391 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:53:58.541304    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp"]
Jul 21 04:53:58.541951 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:53:58.541548    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp" podUID="2bd12a09-9a17-4569-9883-15c550206942" containerName="maas-api" containerID="cri-o://d7b9065c235acf6bd9e8b61048ad3f39b438bb5aed0f31fe68a0beef97f0763a" gracePeriod=30
Jul 21 04:53:58.983493 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:53:58.983469    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp"
Jul 21 04:53:59.112250 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:53:59.112162    2580 generic.go:356] "Generic (PLEG): container finished" podID="2bd12a09-9a17-4569-9883-15c550206942" containerID="d7b9065c235acf6bd9e8b61048ad3f39b438bb5aed0f31fe68a0beef97f0763a" exitCode=0
Jul 21 04:53:59.112250 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:53:59.112202    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp" event={"ID":"2bd12a09-9a17-4569-9883-15c550206942","Type":"ContainerDied","Data":"d7b9065c235acf6bd9e8b61048ad3f39b438bb5aed0f31fe68a0beef97f0763a"}
Jul 21 04:53:59.112250 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:53:59.112241    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp"
Jul 21 04:53:59.112250 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:53:59.112249    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp" event={"ID":"2bd12a09-9a17-4569-9883-15c550206942","Type":"ContainerDied","Data":"1cfeb06d3dc3fdd511cdf88ae763af6994346faaae69a3faae258574cbd5f481"}
Jul 21 04:53:59.112564 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:53:59.112276    2580 scope.go:117] "RemoveContainer" containerID="d7b9065c235acf6bd9e8b61048ad3f39b438bb5aed0f31fe68a0beef97f0763a"
Jul 21 04:53:59.125624 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:53:59.125603    2580 scope.go:117] "RemoveContainer" containerID="d7b9065c235acf6bd9e8b61048ad3f39b438bb5aed0f31fe68a0beef97f0763a"
Jul 21 04:53:59.125892 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:53:59.125874    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7b9065c235acf6bd9e8b61048ad3f39b438bb5aed0f31fe68a0beef97f0763a\": container with ID starting with d7b9065c235acf6bd9e8b61048ad3f39b438bb5aed0f31fe68a0beef97f0763a not found: ID does not exist" containerID="d7b9065c235acf6bd9e8b61048ad3f39b438bb5aed0f31fe68a0beef97f0763a"
Jul 21 04:53:59.125955 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:53:59.125904    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7b9065c235acf6bd9e8b61048ad3f39b438bb5aed0f31fe68a0beef97f0763a"} err="failed to get container status \"d7b9065c235acf6bd9e8b61048ad3f39b438bb5aed0f31fe68a0beef97f0763a\": rpc error: code = NotFound desc = could not find container \"d7b9065c235acf6bd9e8b61048ad3f39b438bb5aed0f31fe68a0beef97f0763a\": container with ID starting with d7b9065c235acf6bd9e8b61048ad3f39b438bb5aed0f31fe68a0beef97f0763a not found: ID does not exist"
Jul 21 04:53:59.133182 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:53:59.133162    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9p492\" (UniqueName: \"kubernetes.io/projected/2bd12a09-9a17-4569-9883-15c550206942-kube-api-access-9p492\") pod \"2bd12a09-9a17-4569-9883-15c550206942\" (UID: \"2bd12a09-9a17-4569-9883-15c550206942\") "
Jul 21 04:53:59.133242 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:53:59.133212    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bd12a09-9a17-4569-9883-15c550206942-maas-api-tls\") pod \"2bd12a09-9a17-4569-9883-15c550206942\" (UID: \"2bd12a09-9a17-4569-9883-15c550206942\") "
Jul 21 04:53:59.133334 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:53:59.133324    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bd12a09-9a17-4569-9883-15c550206942-openshift-service-ca\") pod \"2bd12a09-9a17-4569-9883-15c550206942\" (UID: \"2bd12a09-9a17-4569-9883-15c550206942\") "
Jul 21 04:53:59.133606 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:53:59.133585    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bd12a09-9a17-4569-9883-15c550206942-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2bd12a09-9a17-4569-9883-15c550206942" (UID: "2bd12a09-9a17-4569-9883-15c550206942"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:53:59.135209 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:53:59.135190    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bd12a09-9a17-4569-9883-15c550206942-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2bd12a09-9a17-4569-9883-15c550206942" (UID: "2bd12a09-9a17-4569-9883-15c550206942"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:53:59.135315 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:53:59.135294    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bd12a09-9a17-4569-9883-15c550206942-kube-api-access-9p492" (OuterVolumeSpecName: "kube-api-access-9p492") pod "2bd12a09-9a17-4569-9883-15c550206942" (UID: "2bd12a09-9a17-4569-9883-15c550206942"). InnerVolumeSpecName "kube-api-access-9p492". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:53:59.234307 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:53:59.234258    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bd12a09-9a17-4569-9883-15c550206942-openshift-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:53:59.234307 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:53:59.234301    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9p492\" (UniqueName: \"kubernetes.io/projected/2bd12a09-9a17-4569-9883-15c550206942-kube-api-access-9p492\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:53:59.234307 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:53:59.234313    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bd12a09-9a17-4569-9883-15c550206942-maas-api-tls\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:53:59.432039 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:53:59.432008    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp"]
Jul 21 04:53:59.437390 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:53:59.437362    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e19fee-5d79bbd799-bs7zp"]
Jul 21 04:54:00.693211 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:00.693172    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bd12a09-9a17-4569-9883-15c550206942" path="/var/lib/kubelet/pods/2bd12a09-9a17-4569-9883-15c550206942/volumes"
Jul 21 04:54:09.770842 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:09.770811    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"]
Jul 21 04:54:09.771358 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:09.771024    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv" podUID="427aa7e3-44ab-41a8-bbf5-07a9786f96e9" containerName="istio-proxy" containerID="cri-o://8dcf900eb802e206e7ae5589c095f965e6b08a17f371d8e8aa7636abb6e1b1c7" gracePeriod=30
Jul 21 04:54:09.818622 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:09.818583    2580 patch_prober.go:28] interesting pod/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 04:54:09.818771 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:09.818636    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv" podUID="427aa7e3-44ab-41a8-bbf5-07a9786f96e9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 04:54:15.021418 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.021395    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:54:15.177385 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.177350    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-istio-token\") pod \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") "
Jul 21 04:54:15.177385 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.177388    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-istio-envoy\") pod \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") "
Jul 21 04:54:15.177620 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.177416    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-istiod-ca-cert\") pod \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") "
Jul 21 04:54:15.177620 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.177445    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-workload-socket\") pod \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") "
Jul 21 04:54:15.177710 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.177621    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-istio-podinfo\") pod \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") "
Jul 21 04:54:15.177710 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.177675    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-workload-certs\") pod \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") "
Jul 21 04:54:15.177818 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.177709    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jk9np\" (UniqueName: \"kubernetes.io/projected/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-kube-api-access-jk9np\") pod \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") "
Jul 21 04:54:15.177818 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.177742    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-istio-data\") pod \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") "
Jul 21 04:54:15.177818 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.177775    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-credential-socket\") pod \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\" (UID: \"427aa7e3-44ab-41a8-bbf5-07a9786f96e9\") "
Jul 21 04:54:15.177818 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.177784    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "427aa7e3-44ab-41a8-bbf5-07a9786f96e9" (UID: "427aa7e3-44ab-41a8-bbf5-07a9786f96e9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:54:15.178019 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.177874    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "427aa7e3-44ab-41a8-bbf5-07a9786f96e9" (UID: "427aa7e3-44ab-41a8-bbf5-07a9786f96e9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:54:15.178097 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.178070    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "427aa7e3-44ab-41a8-bbf5-07a9786f96e9" (UID: "427aa7e3-44ab-41a8-bbf5-07a9786f96e9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:54:15.178318 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.178249    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-istiod-ca-cert\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:54:15.178318 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.178276    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-workload-socket\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:54:15.178318 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.178292    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-credential-socket\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:54:15.178536 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.178405    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "427aa7e3-44ab-41a8-bbf5-07a9786f96e9" (UID: "427aa7e3-44ab-41a8-bbf5-07a9786f96e9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:54:15.179071 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.179033    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-istio-data" (OuterVolumeSpecName: "istio-data") pod "427aa7e3-44ab-41a8-bbf5-07a9786f96e9" (UID: "427aa7e3-44ab-41a8-bbf5-07a9786f96e9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:54:15.179980 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.179948    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-istio-token" (OuterVolumeSpecName: "istio-token") pod "427aa7e3-44ab-41a8-bbf5-07a9786f96e9" (UID: "427aa7e3-44ab-41a8-bbf5-07a9786f96e9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:54:15.180075 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.180026    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "427aa7e3-44ab-41a8-bbf5-07a9786f96e9" (UID: "427aa7e3-44ab-41a8-bbf5-07a9786f96e9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:54:15.180075 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.180060    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-kube-api-access-jk9np" (OuterVolumeSpecName: "kube-api-access-jk9np") pod "427aa7e3-44ab-41a8-bbf5-07a9786f96e9" (UID: "427aa7e3-44ab-41a8-bbf5-07a9786f96e9"). InnerVolumeSpecName "kube-api-access-jk9np". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:54:15.180199 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.180179    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "427aa7e3-44ab-41a8-bbf5-07a9786f96e9" (UID: "427aa7e3-44ab-41a8-bbf5-07a9786f96e9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 04:54:15.184074 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.184046    2580 generic.go:356] "Generic (PLEG): container finished" podID="427aa7e3-44ab-41a8-bbf5-07a9786f96e9" containerID="8dcf900eb802e206e7ae5589c095f965e6b08a17f371d8e8aa7636abb6e1b1c7" exitCode=0
Jul 21 04:54:15.184183 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.184110    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"
Jul 21 04:54:15.184183 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.184162    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv" event={"ID":"427aa7e3-44ab-41a8-bbf5-07a9786f96e9","Type":"ContainerDied","Data":"8dcf900eb802e206e7ae5589c095f965e6b08a17f371d8e8aa7636abb6e1b1c7"}
Jul 21 04:54:15.184310 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.184223    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv" event={"ID":"427aa7e3-44ab-41a8-bbf5-07a9786f96e9","Type":"ContainerDied","Data":"d5586661046a8ee6df3716f02171603ed01973601d6ee5e6f88684e210243d85"}
Jul 21 04:54:15.184310 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.184259    2580 scope.go:117] "RemoveContainer" containerID="8dcf900eb802e206e7ae5589c095f965e6b08a17f371d8e8aa7636abb6e1b1c7"
Jul 21 04:54:15.199949 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.199931    2580 scope.go:117] "RemoveContainer" containerID="e885335c8e3dc3faa4f78a9ca844055f172d73a1301975cc99b57f51f0212c32"
Jul 21 04:54:15.207473 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.207457    2580 scope.go:117] "RemoveContainer" containerID="8dcf900eb802e206e7ae5589c095f965e6b08a17f371d8e8aa7636abb6e1b1c7"
Jul 21 04:54:15.207713 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:54:15.207692    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dcf900eb802e206e7ae5589c095f965e6b08a17f371d8e8aa7636abb6e1b1c7\": container with ID starting with 8dcf900eb802e206e7ae5589c095f965e6b08a17f371d8e8aa7636abb6e1b1c7 not found: ID does not exist" containerID="8dcf900eb802e206e7ae5589c095f965e6b08a17f371d8e8aa7636abb6e1b1c7"
Jul 21 04:54:15.207786 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.207725    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dcf900eb802e206e7ae5589c095f965e6b08a17f371d8e8aa7636abb6e1b1c7"} err="failed to get container status \"8dcf900eb802e206e7ae5589c095f965e6b08a17f371d8e8aa7636abb6e1b1c7\": rpc error: code = NotFound desc = could not find container \"8dcf900eb802e206e7ae5589c095f965e6b08a17f371d8e8aa7636abb6e1b1c7\": container with ID starting with 8dcf900eb802e206e7ae5589c095f965e6b08a17f371d8e8aa7636abb6e1b1c7 not found: ID does not exist"
Jul 21 04:54:15.207786 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.207747    2580 scope.go:117] "RemoveContainer" containerID="e885335c8e3dc3faa4f78a9ca844055f172d73a1301975cc99b57f51f0212c32"
Jul 21 04:54:15.208041 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:54:15.208021    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e885335c8e3dc3faa4f78a9ca844055f172d73a1301975cc99b57f51f0212c32\": container with ID starting with e885335c8e3dc3faa4f78a9ca844055f172d73a1301975cc99b57f51f0212c32 not found: ID does not exist" containerID="e885335c8e3dc3faa4f78a9ca844055f172d73a1301975cc99b57f51f0212c32"
Jul 21 04:54:15.208113 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.208049    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e885335c8e3dc3faa4f78a9ca844055f172d73a1301975cc99b57f51f0212c32"} err="failed to get container status \"e885335c8e3dc3faa4f78a9ca844055f172d73a1301975cc99b57f51f0212c32\": rpc error: code = NotFound desc = could not find container \"e885335c8e3dc3faa4f78a9ca844055f172d73a1301975cc99b57f51f0212c32\": container with ID starting with e885335c8e3dc3faa4f78a9ca844055f172d73a1301975cc99b57f51f0212c32 not found: ID does not exist"
Jul 21 04:54:15.210606 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.210582    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"]
Jul 21 04:54:15.214448 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.214427    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-e19fee-openshift-default-7d4469989f-g56hv"]
Jul 21 04:54:15.279631 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.279597    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-istio-token\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:54:15.279631 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.279625    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-istio-envoy\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:54:15.279631 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.279637    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-istio-podinfo\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:54:15.279855 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.279648    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-workload-certs\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:54:15.279855 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.279662    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jk9np\" (UniqueName: \"kubernetes.io/projected/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-kube-api-access-jk9np\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:54:15.279855 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:15.279673    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/427aa7e3-44ab-41a8-bbf5-07a9786f96e9-istio-data\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:54:16.693505 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:16.693471    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="427aa7e3-44ab-41a8-bbf5-07a9786f96e9" path="/var/lib/kubelet/pods/427aa7e3-44ab-41a8-bbf5-07a9786f96e9/volumes"
Jul 21 04:54:20.636060 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:20.636026    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x"]
Jul 21 04:54:20.636589 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:20.636278    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x" podUID="c954906f-ea16-4a46-b4fd-cdd020e091cc" containerName="maas-api" containerID="cri-o://09f06cd6097e52141d64edf32de20bdef3226171193928aa130b4a5df9114e63" gracePeriod=30
Jul 21 04:54:21.080005 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:21.079983    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x"
Jul 21 04:54:21.122708 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:21.122675    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c954906f-ea16-4a46-b4fd-cdd020e091cc-maas-api-tls\") pod \"c954906f-ea16-4a46-b4fd-cdd020e091cc\" (UID: \"c954906f-ea16-4a46-b4fd-cdd020e091cc\") "
Jul 21 04:54:21.122869 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:21.122731    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmbvj\" (UniqueName: \"kubernetes.io/projected/c954906f-ea16-4a46-b4fd-cdd020e091cc-kube-api-access-tmbvj\") pod \"c954906f-ea16-4a46-b4fd-cdd020e091cc\" (UID: \"c954906f-ea16-4a46-b4fd-cdd020e091cc\") "
Jul 21 04:54:21.122869 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:21.122796    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c954906f-ea16-4a46-b4fd-cdd020e091cc-openshift-service-ca\") pod \"c954906f-ea16-4a46-b4fd-cdd020e091cc\" (UID: \"c954906f-ea16-4a46-b4fd-cdd020e091cc\") "
Jul 21 04:54:21.123203 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:21.123172    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c954906f-ea16-4a46-b4fd-cdd020e091cc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c954906f-ea16-4a46-b4fd-cdd020e091cc" (UID: "c954906f-ea16-4a46-b4fd-cdd020e091cc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:54:21.124866 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:21.124847    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c954906f-ea16-4a46-b4fd-cdd020e091cc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c954906f-ea16-4a46-b4fd-cdd020e091cc" (UID: "c954906f-ea16-4a46-b4fd-cdd020e091cc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:54:21.124965 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:21.124862    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c954906f-ea16-4a46-b4fd-cdd020e091cc-kube-api-access-tmbvj" (OuterVolumeSpecName: "kube-api-access-tmbvj") pod "c954906f-ea16-4a46-b4fd-cdd020e091cc" (UID: "c954906f-ea16-4a46-b4fd-cdd020e091cc"). InnerVolumeSpecName "kube-api-access-tmbvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:54:21.212372 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:21.212295    2580 generic.go:356] "Generic (PLEG): container finished" podID="c954906f-ea16-4a46-b4fd-cdd020e091cc" containerID="09f06cd6097e52141d64edf32de20bdef3226171193928aa130b4a5df9114e63" exitCode=0
Jul 21 04:54:21.212372 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:21.212337    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x"
Jul 21 04:54:21.212533 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:21.212388    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x" event={"ID":"c954906f-ea16-4a46-b4fd-cdd020e091cc","Type":"ContainerDied","Data":"09f06cd6097e52141d64edf32de20bdef3226171193928aa130b4a5df9114e63"}
Jul 21 04:54:21.212533 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:21.212437    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x" event={"ID":"c954906f-ea16-4a46-b4fd-cdd020e091cc","Type":"ContainerDied","Data":"4d76dcc9a87b1aa1f06d24cb19ff2dd461d60035abe62ad896a221c5989967ba"}
Jul 21 04:54:21.212533 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:21.212464    2580 scope.go:117] "RemoveContainer" containerID="09f06cd6097e52141d64edf32de20bdef3226171193928aa130b4a5df9114e63"
Jul 21 04:54:21.220704 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:21.220688    2580 scope.go:117] "RemoveContainer" containerID="09f06cd6097e52141d64edf32de20bdef3226171193928aa130b4a5df9114e63"
Jul 21 04:54:21.220942 ip-10-0-143-205 kubenswrapper[2580]: E0721 04:54:21.220925    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09f06cd6097e52141d64edf32de20bdef3226171193928aa130b4a5df9114e63\": container with ID starting with 09f06cd6097e52141d64edf32de20bdef3226171193928aa130b4a5df9114e63 not found: ID does not exist" containerID="09f06cd6097e52141d64edf32de20bdef3226171193928aa130b4a5df9114e63"
Jul 21 04:54:21.220989 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:21.220948    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09f06cd6097e52141d64edf32de20bdef3226171193928aa130b4a5df9114e63"} err="failed to get container status \"09f06cd6097e52141d64edf32de20bdef3226171193928aa130b4a5df9114e63\": rpc error: code = NotFound desc = could not find container \"09f06cd6097e52141d64edf32de20bdef3226171193928aa130b4a5df9114e63\": container with ID starting with 09f06cd6097e52141d64edf32de20bdef3226171193928aa130b4a5df9114e63 not found: ID does not exist"
Jul 21 04:54:21.223402 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:21.223378    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c954906f-ea16-4a46-b4fd-cdd020e091cc-openshift-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:54:21.223402 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:21.223401    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c954906f-ea16-4a46-b4fd-cdd020e091cc-maas-api-tls\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:54:21.223566 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:21.223412    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmbvj\" (UniqueName: \"kubernetes.io/projected/c954906f-ea16-4a46-b4fd-cdd020e091cc-kube-api-access-tmbvj\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 21 04:54:21.233269 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:21.233248    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x"]
Jul 21 04:54:21.235096 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:21.235075    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-cfd2ba-55bb58665c-rb79x"]
Jul 21 04:54:22.692985 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:22.692942    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c954906f-ea16-4a46-b4fd-cdd020e091cc" path="/var/lib/kubelet/pods/c954906f-ea16-4a46-b4fd-cdd020e091cc/volumes"
Jul 21 04:54:30.792661 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:30.792632    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-694fk_6f2c16b6-c4e7-480c-b4d7-1312ed5ad130/ovn-acl-logging/0.log"
Jul 21 04:54:30.799917 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:30.799898    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-694fk_6f2c16b6-c4e7-480c-b4d7-1312ed5ad130/ovn-acl-logging/0.log"
Jul 21 04:54:39.057638 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:39.057608    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6b969ff8-8lg85_d1fd5901-e47c-450d-ba2d-37e37a7dee30/copy-manifests/0.log"
Jul 21 04:54:39.071501 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:39.071472    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6b969ff8-8lg85_d1fd5901-e47c-450d-ba2d-37e37a7dee30/manager/0.log"
Jul 21 04:54:39.697546 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:39.697518    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5d6dcd6f44-s4jfs_769f3842-8113-425d-8e2a-2f55ebe3536c/maas-api/0.log"
Jul 21 04:54:39.820688 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:39.820662    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29743470-c56wd_75f5619a-c27f-4a0b-8de8-5e83b881cc84/cleanup/0.log"
Jul 21 04:54:39.942007 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:39.941978    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29743485-mf7bf_e48b7d49-c639-4136-a749-bac42ce1a204/cleanup/0.log"
Jul 21 04:54:42.689669 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:42.689627    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4qgcws_985caf99-95d1-4450-a030-b81ed05cf0eb/istio-proxy/0.log"
Jul 21 04:54:42.818408 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:42.818374    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-82d8h_66402a62-9562-46fb-a06c-5906f5df9ef3/discovery/0.log"
Jul 21 04:54:44.045391 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:44.045360    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-2vfwm_f34f399f-687a-4bfb-863b-ad702cfa3806/main/0.log"
Jul 21 04:54:44.173625 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:44.173598    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-dhc5b_8984c50b-c906-4ad0-b751-ad2d1b18559a/main/0.log"
Jul 21 04:54:52.950305 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:52.950270    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dvcr2_f523d1f8-3698-4dd8-8d5d-f5f36251273b/global-pull-secret-syncer/0.log"
Jul 21 04:54:53.090900 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:53.090868    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bgqdw_685e7e2c-f971-4362-bb75-290223ff7d43/konnectivity-agent/0.log"
Jul 21 04:54:53.201229 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:54:53.201114    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-205.ec2.internal_aa1018754edc1c71ee351c98f23c1ba5/haproxy/0.log"
Jul 21 04:55:00.767770 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:00.767737    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_557dd272-45a2-4cc3-8863-5acc230a8f36/alertmanager/0.log"
Jul 21 04:55:00.789905 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:00.789881    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_557dd272-45a2-4cc3-8863-5acc230a8f36/config-reloader/0.log"
Jul 21 04:55:00.810377 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:00.810351    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_557dd272-45a2-4cc3-8863-5acc230a8f36/kube-rbac-proxy-web/0.log"
Jul 21 04:55:00.832959 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:00.832925    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_557dd272-45a2-4cc3-8863-5acc230a8f36/kube-rbac-proxy/0.log"
Jul 21 04:55:00.854429 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:00.854393    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_557dd272-45a2-4cc3-8863-5acc230a8f36/kube-rbac-proxy-metric/0.log"
Jul 21 04:55:00.879276 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:00.879251    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_557dd272-45a2-4cc3-8863-5acc230a8f36/prom-label-proxy/0.log"
Jul 21 04:55:00.902789 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:00.902763    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_557dd272-45a2-4cc3-8863-5acc230a8f36/init-config-reloader/0.log"
Jul 21 04:55:01.184427 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:01.184401    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lz5nl_aea6b452-a33c-4773-939a-34ff95ffd8f1/node-exporter/0.log"
Jul 21 04:55:01.207857 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:01.207824    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lz5nl_aea6b452-a33c-4773-939a-34ff95ffd8f1/kube-rbac-proxy/0.log"
Jul 21 04:55:01.229537 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:01.229511    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lz5nl_aea6b452-a33c-4773-939a-34ff95ffd8f1/init-textfile/0.log"
Jul 21 04:55:01.648824 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:01.648798    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b475d7d59-g7nqc_caf6bdf0-915a-4fd3-bc7f-2864df11bd57/telemeter-client/0.log"
Jul 21 04:55:01.669554 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:01.669532    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b475d7d59-g7nqc_caf6bdf0-915a-4fd3-bc7f-2864df11bd57/reload/0.log"
Jul 21 04:55:01.692040 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:01.692013    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b475d7d59-g7nqc_caf6bdf0-915a-4fd3-bc7f-2864df11bd57/kube-rbac-proxy/0.log"
Jul 21 04:55:03.293912 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.293878    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mhpnj/perf-node-gather-daemonset-z5v9z"]
Jul 21 04:55:03.294315 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.294222    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c954906f-ea16-4a46-b4fd-cdd020e091cc" containerName="maas-api"
Jul 21 04:55:03.294315 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.294235    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c954906f-ea16-4a46-b4fd-cdd020e091cc" containerName="maas-api"
Jul 21 04:55:03.294315 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.294252    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="427aa7e3-44ab-41a8-bbf5-07a9786f96e9" containerName="istio-proxy"
Jul 21 04:55:03.294315 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.294261    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="427aa7e3-44ab-41a8-bbf5-07a9786f96e9" containerName="istio-proxy"
Jul 21 04:55:03.294315 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.294273    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bd12a09-9a17-4569-9883-15c550206942" containerName="maas-api"
Jul 21 04:55:03.294315 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.294279    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bd12a09-9a17-4569-9883-15c550206942" containerName="maas-api"
Jul 21 04:55:03.294315 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.294292    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="427aa7e3-44ab-41a8-bbf5-07a9786f96e9" containerName="istio-proxy"
Jul 21 04:55:03.294315 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.294297    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="427aa7e3-44ab-41a8-bbf5-07a9786f96e9" containerName="istio-proxy"
Jul 21 04:55:03.294563 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.294352    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c954906f-ea16-4a46-b4fd-cdd020e091cc" containerName="maas-api"
Jul 21 04:55:03.294563 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.294361    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bd12a09-9a17-4569-9883-15c550206942" containerName="maas-api"
Jul 21 04:55:03.294563 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.294367    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="427aa7e3-44ab-41a8-bbf5-07a9786f96e9" containerName="istio-proxy"
Jul 21 04:55:03.294563 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.294375    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="427aa7e3-44ab-41a8-bbf5-07a9786f96e9" containerName="istio-proxy"
Jul 21 04:55:03.297516 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.297497    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-z5v9z"
Jul 21 04:55:03.300202 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.300181    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mhpnj\"/\"openshift-service-ca.crt\""
Jul 21 04:55:03.300877 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.300862    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mhpnj\"/\"default-dockercfg-xbcnv\""
Jul 21 04:55:03.300935 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.300868    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mhpnj\"/\"kube-root-ca.crt\""
Jul 21 04:55:03.315886 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.315859    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mhpnj/perf-node-gather-daemonset-z5v9z"]
Jul 21 04:55:03.479811 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.479767    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6dvf\" (UniqueName: \"kubernetes.io/projected/c6017bf1-5403-4833-88ba-c26033c34ca8-kube-api-access-j6dvf\") pod \"perf-node-gather-daemonset-z5v9z\" (UID: \"c6017bf1-5403-4833-88ba-c26033c34ca8\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-z5v9z"
Jul 21 04:55:03.480000 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.479828    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c6017bf1-5403-4833-88ba-c26033c34ca8-lib-modules\") pod \"perf-node-gather-daemonset-z5v9z\" (UID: \"c6017bf1-5403-4833-88ba-c26033c34ca8\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-z5v9z"
Jul 21 04:55:03.480000 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.479905    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6017bf1-5403-4833-88ba-c26033c34ca8-sys\") pod \"perf-node-gather-daemonset-z5v9z\" (UID: \"c6017bf1-5403-4833-88ba-c26033c34ca8\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-z5v9z"
Jul 21 04:55:03.480000 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.479943    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c6017bf1-5403-4833-88ba-c26033c34ca8-podres\") pod \"perf-node-gather-daemonset-z5v9z\" (UID: \"c6017bf1-5403-4833-88ba-c26033c34ca8\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-z5v9z"
Jul 21 04:55:03.480104 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.480024    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c6017bf1-5403-4833-88ba-c26033c34ca8-proc\") pod \"perf-node-gather-daemonset-z5v9z\" (UID: \"c6017bf1-5403-4833-88ba-c26033c34ca8\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-z5v9z"
Jul 21 04:55:03.581315 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.581227    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c6017bf1-5403-4833-88ba-c26033c34ca8-proc\") pod \"perf-node-gather-daemonset-z5v9z\" (UID: \"c6017bf1-5403-4833-88ba-c26033c34ca8\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-z5v9z"
Jul 21 04:55:03.581315 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.581287    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6dvf\" (UniqueName: \"kubernetes.io/projected/c6017bf1-5403-4833-88ba-c26033c34ca8-kube-api-access-j6dvf\") pod \"perf-node-gather-daemonset-z5v9z\" (UID: \"c6017bf1-5403-4833-88ba-c26033c34ca8\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-z5v9z"
Jul 21 04:55:03.581459 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.581332    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c6017bf1-5403-4833-88ba-c26033c34ca8-lib-modules\") pod \"perf-node-gather-daemonset-z5v9z\" (UID: \"c6017bf1-5403-4833-88ba-c26033c34ca8\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-z5v9z"
Jul 21 04:55:03.581459 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.581355    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c6017bf1-5403-4833-88ba-c26033c34ca8-proc\") pod \"perf-node-gather-daemonset-z5v9z\" (UID: \"c6017bf1-5403-4833-88ba-c26033c34ca8\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-z5v9z"
Jul 21 04:55:03.581459 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.581363    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6017bf1-5403-4833-88ba-c26033c34ca8-sys\") pod \"perf-node-gather-daemonset-z5v9z\" (UID: \"c6017bf1-5403-4833-88ba-c26033c34ca8\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-z5v9z"
Jul 21 04:55:03.581459 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.581415    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6017bf1-5403-4833-88ba-c26033c34ca8-sys\") pod \"perf-node-gather-daemonset-z5v9z\" (UID: \"c6017bf1-5403-4833-88ba-c26033c34ca8\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-z5v9z"
Jul 21 04:55:03.581459 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.581422    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c6017bf1-5403-4833-88ba-c26033c34ca8-podres\") pod \"perf-node-gather-daemonset-z5v9z\" (UID: \"c6017bf1-5403-4833-88ba-c26033c34ca8\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-z5v9z"
Jul 21 04:55:03.581617 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.581488    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c6017bf1-5403-4833-88ba-c26033c34ca8-podres\") pod \"perf-node-gather-daemonset-z5v9z\" (UID: \"c6017bf1-5403-4833-88ba-c26033c34ca8\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-z5v9z"
Jul 21 04:55:03.581617 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.581503    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c6017bf1-5403-4833-88ba-c26033c34ca8-lib-modules\") pod \"perf-node-gather-daemonset-z5v9z\" (UID: \"c6017bf1-5403-4833-88ba-c26033c34ca8\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-z5v9z"
Jul 21 04:55:03.590361 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.590341    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6dvf\" (UniqueName: \"kubernetes.io/projected/c6017bf1-5403-4833-88ba-c26033c34ca8-kube-api-access-j6dvf\") pod \"perf-node-gather-daemonset-z5v9z\" (UID: \"c6017bf1-5403-4833-88ba-c26033c34ca8\") " pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-z5v9z"
Jul 21 04:55:03.607414 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.607392    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-z5v9z"
Jul 21 04:55:03.737430 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:03.737314    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mhpnj/perf-node-gather-daemonset-z5v9z"]
Jul 21 04:55:03.740291 ip-10-0-143-205 kubenswrapper[2580]: W0721 04:55:03.740261    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc6017bf1_5403_4833_88ba_c26033c34ca8.slice/crio-5c23a2fd20e68c107f9031971a8613c7d4874c8c15166540719532fddee5a4e8 WatchSource:0}: Error finding container 5c23a2fd20e68c107f9031971a8613c7d4874c8c15166540719532fddee5a4e8: Status 404 returned error can't find the container with id 5c23a2fd20e68c107f9031971a8613c7d4874c8c15166540719532fddee5a4e8
Jul 21 04:55:04.357564 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:04.357532    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-nxdhw_c7cd692b-6a9d-4e16-82c8-103b3bd155ee/download-server/0.log"
Jul 21 04:55:04.406580 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:04.406550    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-z5v9z" event={"ID":"c6017bf1-5403-4833-88ba-c26033c34ca8","Type":"ContainerStarted","Data":"b1580e1d7b4a8671140d57a2e026e6b6fcee8f3dd3785ba768f1631715f0a6fa"}
Jul 21 04:55:04.406754 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:04.406597    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-z5v9z" event={"ID":"c6017bf1-5403-4833-88ba-c26033c34ca8","Type":"ContainerStarted","Data":"5c23a2fd20e68c107f9031971a8613c7d4874c8c15166540719532fddee5a4e8"}
Jul 21 04:55:04.406754 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:04.406636    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-z5v9z"
Jul 21 04:55:04.422493 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:04.422449    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-z5v9z" podStartSLOduration=1.4224342810000001 podStartE2EDuration="1.422434281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:55:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:55:04.421044934 +0000 UTC m=+3034.310098109" watchObservedRunningTime="2026-07-21 04:55:04.422434281 +0000 UTC m=+3034.311487506"
Jul 21 04:55:05.939625 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:05.939592    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8lpj2_5f1f7378-bc63-4332-907c-f3c74a346e1e/dns/0.log"
Jul 21 04:55:05.964846 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:05.964811    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8lpj2_5f1f7378-bc63-4332-907c-f3c74a346e1e/kube-rbac-proxy/0.log"
Jul 21 04:55:06.127329 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:06.127303    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5tmw9_3105d271-61a5-4d68-9b89-9b3ddebbaad6/dns-node-resolver/0.log"
Jul 21 04:55:06.743881 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:06.743856    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7xqgm_eeca8e4e-83b8-4f94-9b81-50631582bf15/node-ca/0.log"
Jul 21 04:55:07.723644 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:07.723612    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4qgcws_985caf99-95d1-4450-a030-b81ed05cf0eb/istio-proxy/0.log"
Jul 21 04:55:07.952058 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:07.952023    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-82d8h_66402a62-9562-46fb-a06c-5906f5df9ef3/discovery/0.log"
Jul 21 04:55:08.872148 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:08.872104    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-84nxz_5d302476-aea9-4a64-9923-fc9fe74a315e/serve-healthcheck-canary/0.log"
Jul 21 04:55:09.435405 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:09.435373    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jcnzc_7991c063-6fd8-44d1-93e1-2424d9a6f6f6/kube-rbac-proxy/0.log"
Jul 21 04:55:09.455951 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:09.455922    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jcnzc_7991c063-6fd8-44d1-93e1-2424d9a6f6f6/exporter/0.log"
Jul 21 04:55:09.477333 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:09.477301    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jcnzc_7991c063-6fd8-44d1-93e1-2424d9a6f6f6/extractor/0.log"
Jul 21 04:55:10.420694 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:10.420658    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mhpnj/perf-node-gather-daemonset-z5v9z"
Jul 21 04:55:12.472504 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:12.472469    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6b969ff8-8lg85_d1fd5901-e47c-450d-ba2d-37e37a7dee30/manager/0.log"
Jul 21 04:55:12.493323 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:12.493294    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6b969ff8-8lg85_d1fd5901-e47c-450d-ba2d-37e37a7dee30/copy-manifests/0.log"
Jul 21 04:55:13.511730 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:13.511624    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4qgcws_985caf99-95d1-4450-a030-b81ed05cf0eb/istio-proxy/0.log"
Jul 21 04:55:13.728300 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:13.728265    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-82d8h_66402a62-9562-46fb-a06c-5906f5df9ef3/discovery/0.log"
Jul 21 04:55:13.996339 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:13.996308    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-595b8bf6d6-xbtvl_6923f6e4-56a0-4dc5-b05d-7d56196da7fe/manager/0.log"
Jul 21 04:55:15.107710 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:15.107627    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4qgcws_985caf99-95d1-4450-a030-b81ed05cf0eb/istio-proxy/0.log"
Jul 21 04:55:15.328960 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:15.328903    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-82d8h_66402a62-9562-46fb-a06c-5906f5df9ef3/discovery/0.log"
Jul 21 04:55:20.194818 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:20.194779    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2jwvc_36152972-1f88-4b87-866d-873cef1a36f7/kube-multus/0.log"
Jul 21 04:55:20.363455 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:20.363424    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sqmm7_d358754d-0321-4914-8b07-65a70f8c58f8/kube-multus-additional-cni-plugins/0.log"
Jul 21 04:55:20.384545 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:20.384503    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sqmm7_d358754d-0321-4914-8b07-65a70f8c58f8/egress-router-binary-copy/0.log"
Jul 21 04:55:20.406794 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:20.406768    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sqmm7_d358754d-0321-4914-8b07-65a70f8c58f8/cni-plugins/0.log"
Jul 21 04:55:20.426732 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:20.426706    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sqmm7_d358754d-0321-4914-8b07-65a70f8c58f8/bond-cni-plugin/0.log"
Jul 21 04:55:20.445931 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:20.445854    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sqmm7_d358754d-0321-4914-8b07-65a70f8c58f8/routeoverride-cni/0.log"
Jul 21 04:55:20.465323 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:20.465292    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sqmm7_d358754d-0321-4914-8b07-65a70f8c58f8/whereabouts-cni-bincopy/0.log"
Jul 21 04:55:20.487250 ip-10-0-143-205 kubenswrapper[2580]: I0721 04:55:20.487225    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sqmm7_d358754d-0321-4914-8b07-65a70f8c58f8/whereabouts-cni/0.log"