Jul 08 21:13:25.725823 ip-10-0-143-138 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 08 21:13:25.725834 ip-10-0-143-138 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 08 21:13:25.725843 ip-10-0-143-138 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 08 21:13:25.726150 ip-10-0-143-138 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 08 21:13:37.114393 ip-10-0-143-138 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 08 21:13:37.114408 ip-10-0-143-138 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 962562892e35419dafab5bbeb2ad7106 --
Jul 08 21:15:39.225028 ip-10-0-143-138 systemd[1]: Starting Kubernetes Kubelet...
Jul 08 21:15:39.639072 ip-10-0-143-138 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 21:15:39.639072 ip-10-0-143-138 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 08 21:15:39.639072 ip-10-0-143-138 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 21:15:39.639072 ip-10-0-143-138 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 08 21:15:39.639072 ip-10-0-143-138 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 21:15:39.641093 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.641010    2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 08 21:15:39.647143 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647125    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 21:15:39.647143 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647142    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 21:15:39.647213 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647147    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 21:15:39.647213 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647150    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 21:15:39.647213 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647154    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 21:15:39.647213 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647156    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 21:15:39.647213 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647159    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 21:15:39.647213 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647162    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 21:15:39.647213 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647164    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 21:15:39.647213 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647167    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 21:15:39.647213 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647175    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 21:15:39.647213 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647178    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 21:15:39.647213 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647181    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 21:15:39.647213 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647184    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 21:15:39.647213 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647186    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 21:15:39.647213 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647189    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 21:15:39.647213 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647192    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 21:15:39.647213 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647194    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 21:15:39.647213 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647197    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 21:15:39.647213 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647199    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 21:15:39.647213 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647202    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 21:15:39.647213 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647204    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 21:15:39.647712 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647207    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 21:15:39.647712 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647209    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 21:15:39.647712 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647212    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 21:15:39.647712 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647214    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 21:15:39.647712 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647217    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 21:15:39.647712 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647220    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 21:15:39.647712 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647223    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 21:15:39.647712 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647226    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 21:15:39.647712 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647228    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 21:15:39.647712 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647231    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 21:15:39.647712 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647234    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 21:15:39.647712 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647236    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 21:15:39.647712 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647240    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 21:15:39.647712 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647244    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 21:15:39.647712 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647247    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 21:15:39.647712 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647250    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 21:15:39.647712 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647252    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 21:15:39.647712 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647255    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 21:15:39.647712 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647257    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 21:15:39.648195 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647259    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 21:15:39.648195 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647262    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 21:15:39.648195 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647264    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 21:15:39.648195 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647267    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 21:15:39.648195 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647269    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 21:15:39.648195 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647271    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 21:15:39.648195 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647274    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 21:15:39.648195 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647276    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 21:15:39.648195 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647279    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 21:15:39.648195 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647281    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 21:15:39.648195 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647284    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 21:15:39.648195 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647286    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 21:15:39.648195 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647288    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 21:15:39.648195 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647291    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 21:15:39.648195 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647294    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 21:15:39.648195 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647297    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 21:15:39.648195 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647300    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 21:15:39.648195 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647303    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 21:15:39.648195 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647305    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 21:15:39.648676 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647308    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 21:15:39.648676 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647310    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 21:15:39.648676 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647314    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 21:15:39.648676 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647316    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 21:15:39.648676 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647319    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 21:15:39.648676 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647321    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 21:15:39.648676 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647324    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 21:15:39.648676 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647326    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 21:15:39.648676 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647329    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 21:15:39.648676 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647331    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 21:15:39.648676 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647334    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 21:15:39.648676 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647336    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 21:15:39.648676 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647339    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 21:15:39.648676 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647342    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 21:15:39.648676 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647345    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 21:15:39.648676 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647349    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 21:15:39.648676 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647351    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 21:15:39.648676 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647354    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 21:15:39.648676 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647356    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 21:15:39.648676 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647359    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 21:15:39.649182 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647362    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 21:15:39.649182 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647365    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 21:15:39.649182 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647367    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 21:15:39.649182 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647369    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 21:15:39.649182 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647372    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 21:15:39.649182 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647375    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 21:15:39.649182 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647377    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 21:15:39.649182 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647381    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 21:15:39.649182 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647384    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 21:15:39.649182 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647387    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 21:15:39.649182 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647389    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 21:15:39.649182 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647392    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 21:15:39.649182 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647394    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 21:15:39.649182 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647397    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 21:15:39.649182 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647399    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 21:15:39.649182 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647403    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 21:15:39.649182 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647405    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 21:15:39.649182 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647409    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 21:15:39.649182 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.647413    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 21:15:39.649663 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648133    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 21:15:39.649663 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648141    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 21:15:39.649663 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648144    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 21:15:39.649663 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648147    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 21:15:39.649663 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648150    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 21:15:39.649663 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648152    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 21:15:39.649663 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648155    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 21:15:39.649663 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648157    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 21:15:39.649663 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648160    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 21:15:39.649663 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648162    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 21:15:39.649663 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648165    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 21:15:39.649663 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648168    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 21:15:39.649663 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648171    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 21:15:39.649663 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648174    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 21:15:39.649663 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648176    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 21:15:39.649663 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648179    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 21:15:39.649663 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648181    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 21:15:39.649663 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648184    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 21:15:39.649663 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648186    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 21:15:39.650147 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648189    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 21:15:39.650147 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648192    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 21:15:39.650147 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648195    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 21:15:39.650147 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648198    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 21:15:39.650147 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648200    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 21:15:39.650147 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648203    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 21:15:39.650147 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648205    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 21:15:39.650147 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648208    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 21:15:39.650147 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648211    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 21:15:39.650147 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648214    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 21:15:39.650147 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648225    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 21:15:39.650147 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648228    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 21:15:39.650147 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648231    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 21:15:39.650147 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648233    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 21:15:39.650147 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648235    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 21:15:39.650147 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648238    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 21:15:39.650147 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648240    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 21:15:39.650147 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648243    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 21:15:39.650147 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648245    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 21:15:39.650147 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648248    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 21:15:39.650660 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648250    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 21:15:39.650660 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648252    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 21:15:39.650660 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648255    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 21:15:39.650660 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648257    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 21:15:39.650660 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648260    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 21:15:39.650660 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648262    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 21:15:39.650660 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648265    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 21:15:39.650660 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648267    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 21:15:39.650660 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648270    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 21:15:39.650660 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648272    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 21:15:39.650660 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648275    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 21:15:39.650660 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648277    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 21:15:39.650660 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648280    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 21:15:39.650660 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648283    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 21:15:39.650660 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648286    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 21:15:39.650660 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648289    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 21:15:39.650660 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648291    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 21:15:39.650660 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648294    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 21:15:39.650660 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648297    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 21:15:39.650660 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648299    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 21:15:39.651176 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648302    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 21:15:39.651176 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648304    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 21:15:39.651176 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648307    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 21:15:39.651176 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648312    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 21:15:39.651176 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648314    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 21:15:39.651176 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648317    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 21:15:39.651176 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648319    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 21:15:39.651176 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648322    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 21:15:39.651176 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648324    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 21:15:39.651176 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648326    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 21:15:39.651176 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648329    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 21:15:39.651176 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648331    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 21:15:39.651176 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648333    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 21:15:39.651176 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648336    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 21:15:39.651176 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648338    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 21:15:39.651176 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648342    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 21:15:39.651176 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648345    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 21:15:39.651176 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648348    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 21:15:39.651176 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648350    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 21:15:39.651631 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648354    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 21:15:39.651631 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648358    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 21:15:39.651631 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648362    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 21:15:39.651631 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648365    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 21:15:39.651631 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648368    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 21:15:39.651631 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648372    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 21:15:39.651631 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648375    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 21:15:39.651631 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648377    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 21:15:39.651631 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648380    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 21:15:39.651631 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648382    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 21:15:39.651631 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648384    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 21:15:39.651631 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648387    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 21:15:39.651631 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648389    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 21:15:39.651631 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648392    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 21:15:39.651631 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648394    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 21:15:39.651631 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648398    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 21:15:39.651631 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648401    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 21:15:39.651631 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648405    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 21:15:39.651631 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648408    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 21:15:39.652131 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648410    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 21:15:39.652131 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648413    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 21:15:39.652131 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648850    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 21:15:39.652131 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648855    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 21:15:39.652131 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648859    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 21:15:39.652131 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648862    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 21:15:39.652131 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648865    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 21:15:39.652131 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648867    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 21:15:39.652131 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648871    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 21:15:39.652131 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648875    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 21:15:39.652131 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648878    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 21:15:39.652131 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648880    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 21:15:39.652131 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648883    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 21:15:39.652131 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648885    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 21:15:39.652131 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648888    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 21:15:39.652131 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648892    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 21:15:39.652131 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648895    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 21:15:39.652131 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648897    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 21:15:39.652131 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648900    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 21:15:39.652592 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648903    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 21:15:39.652592 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648905    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 21:15:39.652592 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648908    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 21:15:39.652592 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648910    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 21:15:39.652592 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648913    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 21:15:39.652592 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648916    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 21:15:39.652592 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648918    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 21:15:39.652592 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648921    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 21:15:39.652592 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648923    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 21:15:39.652592 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648926    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 21:15:39.652592 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648928    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 21:15:39.652592 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648931    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 21:15:39.652592 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648934    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 21:15:39.652592 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648936    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 21:15:39.652592 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648939    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 21:15:39.652592 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648941    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 21:15:39.652592 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648943    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 21:15:39.652592 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648946    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 21:15:39.652592 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648948    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 21:15:39.652592 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648951    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 21:15:39.653099 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648953    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 21:15:39.653099 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648955    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 21:15:39.653099 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648958    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 21:15:39.653099 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648960    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 21:15:39.653099 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648963    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 21:15:39.653099 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648967    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 21:15:39.653099 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648971    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 21:15:39.653099 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648973    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 21:15:39.653099 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648977    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 21:15:39.653099 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648980    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 21:15:39.653099 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648983    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 21:15:39.653099 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648987    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 21:15:39.653099 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648989    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 21:15:39.653099 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648992    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 21:15:39.653099 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648994    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 21:15:39.653099 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648997    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 21:15:39.653099 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.648999    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 21:15:39.653099 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649002    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 21:15:39.653099 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649005    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 21:15:39.653099 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649008    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 21:15:39.653617 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649010    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 21:15:39.653617 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649013    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 21:15:39.653617 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649015    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 21:15:39.653617 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649018    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 21:15:39.653617 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649020    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 21:15:39.653617 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649023    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 21:15:39.653617 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649025    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 21:15:39.653617 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649027    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 21:15:39.653617 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649030    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 21:15:39.653617 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649032    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 21:15:39.653617 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649034    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 21:15:39.653617 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649037    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 21:15:39.653617 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649039    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 21:15:39.653617 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649042    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 21:15:39.653617 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649044    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 21:15:39.653617 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649046    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 21:15:39.653617 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649049    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 21:15:39.653617 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649051    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 21:15:39.653617 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649054    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 21:15:39.653617 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649056    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 21:15:39.654105 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649060    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 21:15:39.654105 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649062    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 21:15:39.654105 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649065    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 21:15:39.654105 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649069    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 21:15:39.654105 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649072    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 21:15:39.654105 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649075    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 21:15:39.654105 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649078    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 21:15:39.654105 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649080    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 21:15:39.654105 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649083    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 21:15:39.654105 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649086    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 21:15:39.654105 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649089    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 21:15:39.654105 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649091    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 21:15:39.654105 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649094    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 21:15:39.654105 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649096    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 21:15:39.654105 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649099    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 21:15:39.654105 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649101    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 21:15:39.654105 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649104    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 21:15:39.654105 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649107    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 21:15:39.654563 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649109    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 21:15:39.654563 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649111    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 21:15:39.654563 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649114    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 21:15:39.654563 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649117    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 21:15:39.654563 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649180    2571 flags.go:64] FLAG: --address="0.0.0.0"
Jul 08 21:15:39.654563 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649187    2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 08 21:15:39.654563 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649193    2571 flags.go:64] FLAG: --anonymous-auth="true"
Jul 08 21:15:39.654563 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649198    2571 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 08 21:15:39.654563 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649204    2571 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 08 21:15:39.654563 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649208    2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 08 21:15:39.654563 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649215    2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 08 21:15:39.654563 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649221    2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 08 21:15:39.654563 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649226    2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 08 21:15:39.654563 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649231    2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 08 21:15:39.654563 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649237    2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 08 21:15:39.654563 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649240    2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 08 21:15:39.654563 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649243    2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 08 21:15:39.654563 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649247    2571 flags.go:64] FLAG: --cgroup-root=""
Jul 08 21:15:39.654563 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649250    2571 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 08 21:15:39.654563 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649253    2571 flags.go:64] FLAG: --client-ca-file=""
Jul 08 21:15:39.654563 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649256    2571 flags.go:64] FLAG: --cloud-provider="external"
Jul 08 21:15:39.654563 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649258    2571 flags.go:64] FLAG: --cluster-dns="[]"
Jul 08 21:15:39.654563 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649262    2571 flags.go:64] FLAG: --cluster-domain=""
Jul 08 21:15:39.655144 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649264    2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 08 21:15:39.655144 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649267    2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 08 21:15:39.655144 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649270    2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 08 21:15:39.655144 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649273    2571 flags.go:64] FLAG: --container-log-max-files="5"
Jul 08 21:15:39.655144 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649277    2571 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 08 21:15:39.655144 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649280    2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 08 21:15:39.655144 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649283    2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 08 21:15:39.655144 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649286    2571 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 08 21:15:39.655144 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649289    2571 flags.go:64] FLAG: --contention-profiling="false"
Jul 08 21:15:39.655144 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649293    2571 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 08 21:15:39.655144 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649296    2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 08 21:15:39.655144 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649299    2571 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 08 21:15:39.655144 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649301    2571 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 08 21:15:39.655144 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649305    2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 08 21:15:39.655144 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649308    2571 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 08 21:15:39.655144 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649311    2571 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 08 21:15:39.655144 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649314    2571 flags.go:64] FLAG: --enable-load-reader="false"
Jul 08 21:15:39.655144 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649317    2571 flags.go:64] FLAG: --enable-server="true"
Jul 08 21:15:39.655144 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649320    2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 08 21:15:39.655144 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649323    2571 flags.go:64] FLAG: --event-burst="100"
Jul 08 21:15:39.655144 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649327    2571 flags.go:64] FLAG: --event-qps="50"
Jul 08 21:15:39.655144 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649329    2571 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 08 21:15:39.655144 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649332    2571 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 08 21:15:39.655144 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649336    2571 flags.go:64] FLAG: --eviction-hard=""
Jul 08 21:15:39.655719 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649340    2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 08 21:15:39.655719 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649343    2571 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 08 21:15:39.655719 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649346    2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 08 21:15:39.655719 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649349    2571 flags.go:64] FLAG: --eviction-soft=""
Jul 08 21:15:39.655719 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649352    2571 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 08 21:15:39.655719 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649355    2571 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 08 21:15:39.655719 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649358    2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 08 21:15:39.655719 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649361    2571 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 08 21:15:39.655719 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649364    2571 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 08 21:15:39.655719 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649366    2571 flags.go:64] FLAG: --fail-swap-on="true"
Jul 08 21:15:39.655719 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649369    2571 flags.go:64] FLAG: --feature-gates=""
Jul 08 21:15:39.655719 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649376    2571 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 08 21:15:39.655719 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649379    2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 08 21:15:39.655719 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649382    2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 08 21:15:39.655719 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649384    2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 08 21:15:39.655719 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649387    2571 flags.go:64] FLAG: --healthz-port="10248"
Jul 08 21:15:39.655719 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649390    2571 flags.go:64] FLAG: --help="false"
Jul 08 21:15:39.655719 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649393    2571 flags.go:64] FLAG: --hostname-override="ip-10-0-143-138.ec2.internal"
Jul 08 21:15:39.655719 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649397    2571 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 08 21:15:39.655719 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649400    2571 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 08 21:15:39.655719 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649403    2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 08 21:15:39.655719 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649406    2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 08 21:15:39.655719 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649410    2571 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 08 21:15:39.656453 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649413    2571 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 08 21:15:39.656453 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649415    2571 flags.go:64] FLAG: --image-service-endpoint=""
Jul 08 21:15:39.656453 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649418    2571 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 08 21:15:39.656453 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649421    2571 flags.go:64] FLAG: --kube-api-burst="100"
Jul 08 21:15:39.656453 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649424    2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 08 21:15:39.656453 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649427    2571 flags.go:64] FLAG: --kube-api-qps="50"
Jul 08 21:15:39.656453 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649429    2571 flags.go:64] FLAG: --kube-reserved=""
Jul 08 21:15:39.656453 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649432    2571 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 08 21:15:39.656453 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649436    2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 08 21:15:39.656453 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649439    2571 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 08 21:15:39.656453 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649442    2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 08 21:15:39.656453 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649445    2571 flags.go:64] FLAG: --lock-file=""
Jul 08 21:15:39.656453 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649448    2571 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 08 21:15:39.656453 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649451    2571 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 08 21:15:39.656453 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649454    2571 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 08 21:15:39.656453 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649460    2571 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 08 21:15:39.656453 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649463    2571 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 08 21:15:39.656453 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649466    2571 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 08 21:15:39.656453 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649468    2571 flags.go:64] FLAG: --logging-format="text"
Jul 08 21:15:39.656453 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649471    2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 08 21:15:39.656453 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649475    2571 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 08 21:15:39.656453 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649477    2571 flags.go:64] FLAG: --manifest-url=""
Jul 08 21:15:39.656453 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649480    2571 flags.go:64] FLAG: --manifest-url-header=""
Jul 08 21:15:39.656453 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649485    2571 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 08 21:15:39.656453 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649497    2571 flags.go:64] FLAG: --max-open-files="1000000"
Jul 08 21:15:39.657513 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649501    2571 flags.go:64] FLAG: --max-pods="110"
Jul 08 21:15:39.657513 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649504    2571 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 08 21:15:39.657513 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649507    2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 08 21:15:39.657513 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649510    2571 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 08 21:15:39.657513 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649513    2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 08 21:15:39.657513 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649516    2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 08 21:15:39.657513 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649519    2571 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 08 21:15:39.657513 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649522    2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 08 21:15:39.657513 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649529    2571 flags.go:64] FLAG: --node-status-max-images="50"
Jul 08 21:15:39.657513 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649532    2571 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 08 21:15:39.657513 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649535    2571 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 08 21:15:39.657513 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649538    2571 flags.go:64] FLAG: --pod-cidr=""
Jul 08 21:15:39.657513 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649541    2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 08 21:15:39.657513 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649546    2571 flags.go:64] FLAG: --pod-manifest-path=""
Jul 08 21:15:39.657513 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649549    2571 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 08 21:15:39.657513 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649552    2571 flags.go:64] FLAG: --pods-per-core="0"
Jul 08 21:15:39.657513 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649557    2571 flags.go:64] FLAG: --port="10250"
Jul 08 21:15:39.657513 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649560    2571 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 08 21:15:39.657513 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649562    2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02b12ebe0973644d0"
Jul 08 21:15:39.657513 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649566    2571 flags.go:64] FLAG: --qos-reserved=""
Jul 08 21:15:39.657513 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649569    2571 flags.go:64] FLAG: --read-only-port="10255"
Jul 08 21:15:39.657513 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649572    2571 flags.go:64] FLAG: --register-node="true"
Jul 08 21:15:39.657513 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649574    2571 flags.go:64] FLAG: --register-with-taints=""
Jul 08 21:15:39.657513 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649578    2571 flags.go:64] FLAG: --registry-burst="10"
Jul 08 21:15:39.658458 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649580    2571 flags.go:64] FLAG: --registry-qps="5"
Jul 08 21:15:39.658458 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649583    2571 flags.go:64] FLAG: --reserved-cpus=""
Jul 08 21:15:39.658458 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649586    2571 flags.go:64] FLAG: --reserved-memory=""
Jul 08 21:15:39.658458 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649589    2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 08 21:15:39.658458 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649592    2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 08 21:15:39.658458 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649595    2571 flags.go:64] FLAG: --rotate-certificates="false"
Jul 08 21:15:39.658458 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649598    2571 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 08 21:15:39.658458 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649601    2571 flags.go:64] FLAG: --runonce="false"
Jul 08 21:15:39.658458 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649603    2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 08 21:15:39.658458 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649606    2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 08 21:15:39.658458 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649609    2571 flags.go:64] FLAG: --seccomp-default="false"
Jul 08 21:15:39.658458 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649612    2571 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 08 21:15:39.658458 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649616    2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 08 21:15:39.658458 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649618    2571 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 08 21:15:39.658458 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649621    2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 08 21:15:39.658458 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649624    2571 flags.go:64] FLAG: --storage-driver-password="root"
Jul 08 21:15:39.658458 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649627    2571 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 08 21:15:39.658458 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649630    2571 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 08 21:15:39.658458 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649634    2571 flags.go:64] FLAG: --storage-driver-user="root"
Jul 08 21:15:39.658458 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649637    2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 08 21:15:39.658458 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649640    2571 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 08 21:15:39.658458 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649643    2571 flags.go:64] FLAG: --system-cgroups=""
Jul 08 21:15:39.658458 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649646    2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 08 21:15:39.658458 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649651    2571 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 08 21:15:39.658458 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649655    2571 flags.go:64] FLAG: --tls-cert-file=""
Jul 08 21:15:39.659114 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649659    2571 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 08 21:15:39.659114 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649662    2571 flags.go:64] FLAG: --tls-min-version=""
Jul 08 21:15:39.659114 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649665    2571 flags.go:64] FLAG: --tls-private-key-file=""
Jul 08 21:15:39.659114 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649668    2571 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 08 21:15:39.659114 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649671    2571 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 08 21:15:39.659114 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649674    2571 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 08 21:15:39.659114 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649678    2571 flags.go:64] FLAG: --v="2"
Jul 08 21:15:39.659114 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649681    2571 flags.go:64] FLAG: --version="false"
Jul 08 21:15:39.659114 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649685    2571 flags.go:64] FLAG: --vmodule=""
Jul 08 21:15:39.659114 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649689    2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 08 21:15:39.659114 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.649692    2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 08 21:15:39.659114 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649820    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 21:15:39.659114 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649824    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 21:15:39.659114 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649827    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 21:15:39.659114 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649830    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 21:15:39.659114 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649833    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 21:15:39.659114 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649835    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 21:15:39.659114 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649838    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 21:15:39.659114 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649840    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 21:15:39.659114 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649843    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 21:15:39.659114 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649848    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 21:15:39.659114 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649851    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 21:15:39.659642 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649854    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 21:15:39.659642 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649857    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 21:15:39.659642 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649860    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 21:15:39.659642 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649864    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 21:15:39.659642 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649866    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 21:15:39.659642 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649869    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 21:15:39.659642 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649871    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 21:15:39.659642 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649874    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 21:15:39.659642 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649876    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 21:15:39.659642 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649879    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 21:15:39.659642 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649882    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 21:15:39.659642 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649884    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 21:15:39.659642 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649887    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 21:15:39.659642 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649889    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 21:15:39.659642 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649892    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 21:15:39.659642 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649894    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 21:15:39.659642 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649896    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 21:15:39.659642 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649899    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 21:15:39.659642 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649901    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 21:15:39.660132 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649904    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 21:15:39.660132 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649906    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 21:15:39.660132 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649909    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 21:15:39.660132 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649911    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 21:15:39.660132 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649913    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 21:15:39.660132 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649916    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 21:15:39.660132 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649918    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 21:15:39.660132 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649921    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 21:15:39.660132 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649923    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 21:15:39.660132 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649925    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 21:15:39.660132 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649928    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 21:15:39.660132 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649930    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 21:15:39.660132 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649933    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 21:15:39.660132 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649936    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 21:15:39.660132 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649938    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 21:15:39.660132 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649941    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 21:15:39.660132 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649946    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 21:15:39.660132 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649949    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 21:15:39.660132 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649952    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 21:15:39.660132 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649954    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 21:15:39.660647 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649957    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 21:15:39.660647 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649959    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 21:15:39.660647 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649963    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 21:15:39.660647 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649965    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 21:15:39.660647 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649968    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 21:15:39.660647 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649970    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 21:15:39.660647 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649973    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 21:15:39.660647 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649976    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 21:15:39.660647 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649978    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 21:15:39.660647 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649981    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 21:15:39.660647 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649983    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 21:15:39.660647 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649986    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 21:15:39.660647 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649988    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 21:15:39.660647 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649990    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 21:15:39.660647 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649993    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 21:15:39.660647 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649995    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 21:15:39.660647 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.649998    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 21:15:39.660647 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650001    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 21:15:39.660647 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650003    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 21:15:39.660647 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650006    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 21:15:39.661212 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650008    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 21:15:39.661212 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650011    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 21:15:39.661212 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650013    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 21:15:39.661212 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650015    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 21:15:39.661212 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650018    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 21:15:39.661212 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650021    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 21:15:39.661212 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650024    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 21:15:39.661212 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650026    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 21:15:39.661212 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650030    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 21:15:39.661212 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650032    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 21:15:39.661212 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650035    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 21:15:39.661212 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650037    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 21:15:39.661212 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650039    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 21:15:39.661212 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650042    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 21:15:39.661212 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650046    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 21:15:39.661212 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650048    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 21:15:39.661212 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650051    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 21:15:39.661212 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650053    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 21:15:39.661212 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650056    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 21:15:39.661212 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650058    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 21:15:39.661708 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650061    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 21:15:39.661708 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650063    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 21:15:39.661708 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650066    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 21:15:39.661708 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650068    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 21:15:39.661708 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650070    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 21:15:39.661708 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650073    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 21:15:39.661708 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650075    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 21:15:39.661708 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650078    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 21:15:39.661708 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.650081    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 21:15:39.661708 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.650701    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 21:15:39.661708 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.659335    2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 08 21:15:39.661708 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.659350    2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 08 21:15:39.661708 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.659371    2571 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 08 21:15:39.661708 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.659376    2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 08 21:15:39.662089 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659446    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 21:15:39.662089 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659452    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 21:15:39.662089 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659455    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 21:15:39.662089 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659458    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 21:15:39.662089 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659461    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 21:15:39.662089 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659464    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 21:15:39.662089 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659467    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 21:15:39.662089 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659469    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 21:15:39.662089 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659472    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 21:15:39.662089 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659475    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 21:15:39.662089 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659479    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 21:15:39.662089 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659483    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 21:15:39.662089 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659487    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 21:15:39.662089 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659489    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 21:15:39.662089 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659492    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 21:15:39.662089 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659495    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 21:15:39.662089 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659497    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 21:15:39.662089 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659500    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 21:15:39.662089 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659502    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 21:15:39.662572 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659505    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 21:15:39.662572 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659507    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 21:15:39.662572 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659510    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 21:15:39.662572 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659513    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 21:15:39.662572 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659516    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 21:15:39.662572 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659518    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 21:15:39.662572 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659521    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 21:15:39.662572 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659523    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 21:15:39.662572 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659526    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 21:15:39.662572 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659529    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 21:15:39.662572 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659532    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 21:15:39.662572 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659534    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 21:15:39.662572 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659537    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 21:15:39.662572 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659540    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 21:15:39.662572 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659542    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 21:15:39.662572 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659545    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 21:15:39.662572 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659547    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 21:15:39.662572 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659550    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 21:15:39.662572 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659554    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 21:15:39.663094 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659557    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 21:15:39.663094 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659560    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 21:15:39.663094 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659563    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 21:15:39.663094 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659565    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 21:15:39.663094 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659568    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 21:15:39.663094 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659570    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 21:15:39.663094 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659574    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 21:15:39.663094 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659576    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 21:15:39.663094 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659579    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 21:15:39.663094 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659581    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 21:15:39.663094 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659584    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 21:15:39.663094 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659587    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 21:15:39.663094 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659589    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 21:15:39.663094 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659592    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 21:15:39.663094 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659594    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 21:15:39.663094 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659597    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 21:15:39.663094 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659599    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 21:15:39.663094 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659602    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 21:15:39.663094 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659605    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 21:15:39.663094 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659607    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 21:15:39.663583 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659610    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 21:15:39.663583 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659612    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 21:15:39.663583 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659615    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 21:15:39.663583 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659618    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 21:15:39.663583 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659620    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 21:15:39.663583 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659623    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 21:15:39.663583 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659626    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 21:15:39.663583 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659629    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 21:15:39.663583 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659631    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 21:15:39.663583 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659633    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 21:15:39.663583 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659636    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 21:15:39.663583 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659639    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 21:15:39.663583 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659641    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 21:15:39.663583 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659643    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 21:15:39.663583 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659646    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 21:15:39.663583 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659649    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 21:15:39.663583 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659652    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 21:15:39.663583 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659655    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 21:15:39.663583 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659657    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 21:15:39.663583 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659660    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 21:15:39.664097 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659662    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 21:15:39.664097 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659665    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 21:15:39.664097 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659669    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 21:15:39.664097 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659673    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 21:15:39.664097 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659675    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 21:15:39.664097 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659678    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 21:15:39.664097 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659680    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 21:15:39.664097 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659683    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 21:15:39.664097 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659685    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 21:15:39.664097 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659688    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 21:15:39.664097 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659690    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 21:15:39.664097 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659693    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 21:15:39.664097 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659696    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 21:15:39.664097 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659698    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 21:15:39.664097 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659701    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 21:15:39.664097 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659703    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 21:15:39.664097 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659706    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 21:15:39.664097 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659709    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 21:15:39.664097 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659711    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 21:15:39.664097 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659714    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 21:15:39.664589 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659716    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 21:15:39.664589 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.659721    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 21:15:39.664589 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659855    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 21:15:39.664589 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659861    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 21:15:39.664589 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659864    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 21:15:39.664589 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659867    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 21:15:39.664589 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659870    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 21:15:39.664589 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659872    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 21:15:39.664589 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659875    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 21:15:39.664589 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659877    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 21:15:39.664589 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659880    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 21:15:39.664589 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659883    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 21:15:39.664589 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659885    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 21:15:39.664589 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659888    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 21:15:39.664589 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659891    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 21:15:39.664984 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659894    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 21:15:39.664984 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659897    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 21:15:39.664984 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659899    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 21:15:39.664984 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659902    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 21:15:39.664984 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659905    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 21:15:39.664984 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659907    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 21:15:39.664984 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659910    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 21:15:39.664984 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659912    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 21:15:39.664984 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659915    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 21:15:39.664984 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659917    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 21:15:39.664984 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659920    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 21:15:39.664984 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659922    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 21:15:39.664984 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659925    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 21:15:39.664984 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659927    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 21:15:39.664984 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659930    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 21:15:39.664984 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659932    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 21:15:39.664984 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659935    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 21:15:39.664984 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659938    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 21:15:39.664984 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659940    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 21:15:39.665430 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659943    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 21:15:39.665430 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659945    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 21:15:39.665430 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659948    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 21:15:39.665430 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659950    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 21:15:39.665430 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659952    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 21:15:39.665430 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659955    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 21:15:39.665430 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659957    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 21:15:39.665430 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659960    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 21:15:39.665430 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659963    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 21:15:39.665430 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659965    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 21:15:39.665430 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659967    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 21:15:39.665430 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659970    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 21:15:39.665430 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659972    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 21:15:39.665430 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659975    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 21:15:39.665430 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659979    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 21:15:39.665430 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659983    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 21:15:39.665430 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659986    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 21:15:39.665430 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659988    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 21:15:39.665430 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659991    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 21:15:39.665986 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659995    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 21:15:39.665986 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.659998    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 21:15:39.665986 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660001    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 21:15:39.665986 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660003    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 21:15:39.665986 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660006    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 21:15:39.665986 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660009    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 21:15:39.665986 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660011    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 21:15:39.665986 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660014    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 21:15:39.665986 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660017    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 21:15:39.665986 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660019    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 21:15:39.665986 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660022    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 21:15:39.665986 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660024    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 21:15:39.665986 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660027    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 21:15:39.665986 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660029    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 21:15:39.665986 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660032    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 21:15:39.665986 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660034    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 21:15:39.665986 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660037    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 21:15:39.665986 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660040    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 21:15:39.665986 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660042    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 21:15:39.665986 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660044    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 21:15:39.666462 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660047    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 21:15:39.666462 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660050    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 21:15:39.666462 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660054    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 21:15:39.666462 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660056    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 21:15:39.666462 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660059    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 21:15:39.666462 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660061    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 21:15:39.666462 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660064    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 21:15:39.666462 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660067    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 21:15:39.666462 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660070    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 21:15:39.666462 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660072    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 21:15:39.666462 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660074    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 21:15:39.666462 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660077    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 21:15:39.666462 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660079    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 21:15:39.666462 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660081    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 21:15:39.666462 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660084    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 21:15:39.666462 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660086    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 21:15:39.666462 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660089    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 21:15:39.666462 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660092    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 21:15:39.666462 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660094    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 21:15:39.666949 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660097    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 21:15:39.666949 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660100    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 21:15:39.666949 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660102    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 21:15:39.666949 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660104    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 21:15:39.666949 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660107    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 21:15:39.666949 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660109    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 21:15:39.666949 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660111    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 21:15:39.666949 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660114    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 21:15:39.666949 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:39.660116    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 21:15:39.666949 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.660121    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 21:15:39.666949 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.660233    2571 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 08 21:15:39.666949 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.662305    2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 08 21:15:39.666949 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.663983    2571 server.go:1019] "Starting client certificate rotation"
Jul 08 21:15:39.666949 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.664082    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 21:15:39.667286 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.664109    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 21:15:39.667286 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.666789    2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 21:15:39.669774 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.669740    2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 21:15:39.681679 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.681660    2571 log.go:25] "Validated CRI v1 runtime API"
Jul 08 21:15:39.684444 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.684424    2571 log.go:25] "Validated CRI v1 image API"
Jul 08 21:15:39.685166 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.685151    2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 08 21:15:39.688644 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.688625    2571 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 82d2d6ba-eddd-487e-836e-4037e99d881c:/dev/nvme0n1p3 96f1d0b7-bb8b-4a69-aec9-80dab86e1691:/dev/nvme0n1p4]
Jul 08 21:15:39.688715 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.688644    2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 08 21:15:39.695603 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.695583    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 21:15:39.696444 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.696166    2571 manager.go:216] Machine: {Timestamp:2026-07-08 21:15:39.694381427 +0000 UTC m=+0.349284138 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3114990 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2432d45686d562a32f8f90e35acc1d SystemUUID:ec2432d4-5686-d562-a32f-8f90e35acc1d BootID:96256289-2e35-419d-afab-5bbeb2ad7106 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f1:ce:5a:d8:8f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f1:ce:5a:d8:8f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:02:df:fe:df:10 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 08 21:15:39.696444 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.696443    2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 08 21:15:39.696580 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.696568    2571 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 08 21:15:39.700203 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.700177    2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 08 21:15:39.700332 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.700207    2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-138.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 08 21:15:39.700908 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.700898    2571 topology_manager.go:138] "Creating topology manager with none policy"
Jul 08 21:15:39.700939 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.700910    2571 container_manager_linux.go:309] "Creating device plugin manager"
Jul 08 21:15:39.700939 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.700917    2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 21:15:39.701599 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.701589    2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 21:15:39.702976 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.702966    2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 08 21:15:39.706508 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.706496    2571 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 21:15:39.706623 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.706613    2571 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 08 21:15:39.706658 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.706643    2571 kubelet.go:486] "Attempting to sync node with API server"
Jul 08 21:15:39.706658 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.706653    2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 08 21:15:39.706710 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.706666    2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 08 21:15:39.706710 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.706676    2571 kubelet.go:398] "Adding apiserver pod source"
Jul 08 21:15:39.706710 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.706685    2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 08 21:15:39.707053 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.707040    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 21:15:39.707100 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.707059    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 21:15:39.712456 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.712437    2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 08 21:15:39.714430 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.714416    2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 08 21:15:39.714483 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.714447    2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 08 21:15:39.715602 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.715590    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 08 21:15:39.715636 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.715607    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 08 21:15:39.715636 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.715614    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 08 21:15:39.715636 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.715620    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 08 21:15:39.715636 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.715632    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 08 21:15:39.715827 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.715639    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 08 21:15:39.715827 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.715651    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 08 21:15:39.715827 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.715668    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 08 21:15:39.715827 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.715678    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 08 21:15:39.715827 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.715684    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 08 21:15:39.715827 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.715692    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 08 21:15:39.715827 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.715698    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 08 21:15:39.716682 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:39.716661    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 21:15:39.716733 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:39.716685    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-138.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 21:15:39.717692 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.717680    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 08 21:15:39.717725 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.717696    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 08 21:15:39.720834 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.720821    2571 server.go:1268] "Started kubelet"
Jul 08 21:15:39.721025 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.720909    2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 08 21:15:39.721086 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.721025    2571 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 08 21:15:39.721148 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.720956    2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 08 21:15:39.721675 ip-10-0-143-138 systemd[1]: Started Kubernetes Kubelet.
Jul 08 21:15:39.723186 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.723157    2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 08 21:15:39.723346 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.723331    2571 server.go:310] "Adding debug handlers to kubelet server"
Jul 08 21:15:39.728120 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.728092    2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-138.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 21:15:39.729447 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:39.728146    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-138.ec2.internal.18c06d096edc7eba  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-138.ec2.internal,UID:ip-10-0-143-138.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-138.ec2.internal,},FirstTimestamp:2026-07-08 21:15:39.720793786 +0000 UTC m=+0.375696496,LastTimestamp:2026-07-08 21:15:39.720793786 +0000 UTC m=+0.375696496,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-138.ec2.internal,}"
Jul 08 21:15:39.730393 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:39.730367    2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 08 21:15:39.731536 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.731517    2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 08 21:15:39.731632 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.731536    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 08 21:15:39.731632 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:39.731603    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-138.ec2.internal\" not found"
Jul 08 21:15:39.732154 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.732131    2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 08 21:15:39.732346 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.732330    2571 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 08 21:15:39.732346 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.732348    2571 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 08 21:15:39.732474 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.732428    2571 factory.go:55] Registering systemd factory
Jul 08 21:15:39.732474 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.732442    2571 factory.go:223] Registration of the systemd container factory successfully
Jul 08 21:15:39.732474 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.732469    2571 reconstruct.go:97] "Volume reconstruction finished"
Jul 08 21:15:39.732474 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.732476    2571 reconciler.go:29] "Reconciler: start to sync state"
Jul 08 21:15:39.732696 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.732681    2571 factory.go:153] Registering CRI-O factory
Jul 08 21:15:39.732783 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.732699    2571 factory.go:223] Registration of the crio container factory successfully
Jul 08 21:15:39.732783 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.732769    2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 08 21:15:39.732868 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.732797    2571 factory.go:103] Registering Raw factory
Jul 08 21:15:39.732868 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.732813    2571 manager.go:1196] Started watching for new ooms in manager
Jul 08 21:15:39.733398 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.733385    2571 manager.go:349] Starting recovery of all containers
Jul 08 21:15:39.734764 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:39.734723    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 08 21:15:39.734860 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:39.734739    2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-138.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 08 21:15:39.739310 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.739267    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7zln9"
Jul 08 21:15:39.745575 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.745454    2571 manager.go:354] Recovery completed
Jul 08 21:15:39.746408 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.746389    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7zln9"
Jul 08 21:15:39.750410 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.750393    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:15:39.752370 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.752353    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-138.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:15:39.752439 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.752386    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-138.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:15:39.752439 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.752398    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-138.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:15:39.752926 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.752913    2571 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 08 21:15:39.752926 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.752924    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:15:39.753069 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.752925    2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 08 21:15:39.753069 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.752962    2571 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 21:15:39.753566 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.753552    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-138.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:15:39.753629 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.753581    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-138.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:15:39.753629 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.753596    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-138.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:15:39.754243 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.754229    2571 policy_none.go:49] "None policy: Start"
Jul 08 21:15:39.754243 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.754245    2571 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 08 21:15:39.754373 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.754255    2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 08 21:15:39.754474 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:39.754400    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-138.ec2.internal.18c06d0970be5345  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-138.ec2.internal,UID:ip-10-0-143-138.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-138.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-138.ec2.internal,},FirstTimestamp:2026-07-08 21:15:39.752371013 +0000 UTC m=+0.407273726,LastTimestamp:2026-07-08 21:15:39.752371013 +0000 UTC m=+0.407273726,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-138.ec2.internal,}"
Jul 08 21:15:39.755419 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.755408    2571 policy_none.go:47] "Start"
Jul 08 21:15:39.787277 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.787261    2571 manager.go:337] "Starting Device Plugin manager"
Jul 08 21:15:39.787350 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:39.787298    2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 08 21:15:39.787350 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.787308    2571 server.go:87] "Starting device plugin registration server"
Jul 08 21:15:39.787568 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.787557    2571 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 08 21:15:39.787604 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.787571    2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 08 21:15:39.787684 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.787667    2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 08 21:15:39.787794 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.787777    2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 08 21:15:39.787794 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.787789    2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 08 21:15:39.788265 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:39.788245    2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 08 21:15:39.788345 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:39.788290    2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-138.ec2.internal\" not found"
Jul 08 21:15:39.859821 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.859781    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 08 21:15:39.861125 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.861106    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 08 21:15:39.861174 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.861157    2571 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 08 21:15:39.861206 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.861184    2571 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 08 21:15:39.861237 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:39.861224    2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 08 21:15:39.863372 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.863350    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 21:15:39.888356 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.888340    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:15:39.889148 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.889107    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-138.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:15:39.889148 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.889137    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-138.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:15:39.889148 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.889147    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-138.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:15:39.889265 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.889170    2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-138.ec2.internal"
Jul 08 21:15:39.897993 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.897971    2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-138.ec2.internal"
Jul 08 21:15:39.898042 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:39.897992    2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-138.ec2.internal\": node \"ip-10-0-143-138.ec2.internal\" not found"
Jul 08 21:15:39.917785 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:39.917769    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-138.ec2.internal\" not found"
Jul 08 21:15:39.961561 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.961544    2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-138.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-138.ec2.internal"]
Jul 08 21:15:39.961664 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.961598    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:15:39.963256 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.963239    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-138.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:15:39.963324 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.963272    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-138.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:15:39.963324 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.963284    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-138.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:15:39.964571 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.964560    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:15:39.964694 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.964682    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-138.ec2.internal"
Jul 08 21:15:39.964727 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.964720    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:15:39.965296 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.965268    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-138.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:15:39.965296 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.965289    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-138.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:15:39.965445 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.965299    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-138.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:15:39.965445 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.965309    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-138.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:15:39.965445 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.965314    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-138.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:15:39.965445 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.965320    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-138.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:15:39.966625 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.966609    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-138.ec2.internal"
Jul 08 21:15:39.966700 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.966638    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:15:39.967352 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.967326    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-138.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:15:39.967445 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.967357    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-138.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:15:39.967445 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:39.967372    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-138.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:15:39.990357 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:39.990337    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-138.ec2.internal\" not found" node="ip-10-0-143-138.ec2.internal"
Jul 08 21:15:39.994639 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:39.994624    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-138.ec2.internal\" not found" node="ip-10-0-143-138.ec2.internal"
Jul 08 21:15:40.018802 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:40.018785    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-138.ec2.internal\" not found"
Jul 08 21:15:40.034828 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:40.034808    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e15bd876fdc5c28fde6928dbc5f32a53-config\") pod \"kube-apiserver-proxy-ip-10-0-143-138.ec2.internal\" (UID: \"e15bd876fdc5c28fde6928dbc5f32a53\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-138.ec2.internal"
Jul 08 21:15:40.034907 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:40.034831    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0b3dfc5d808bbc14c9960d594b65bdf6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-138.ec2.internal\" (UID: \"0b3dfc5d808bbc14c9960d594b65bdf6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-138.ec2.internal"
Jul 08 21:15:40.034907 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:40.034849    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b3dfc5d808bbc14c9960d594b65bdf6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-138.ec2.internal\" (UID: \"0b3dfc5d808bbc14c9960d594b65bdf6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-138.ec2.internal"
Jul 08 21:15:40.119625 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:40.119599    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-138.ec2.internal\" not found"
Jul 08 21:15:40.135951 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:40.135926    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0b3dfc5d808bbc14c9960d594b65bdf6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-138.ec2.internal\" (UID: \"0b3dfc5d808bbc14c9960d594b65bdf6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-138.ec2.internal"
Jul 08 21:15:40.136039 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:40.135959    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b3dfc5d808bbc14c9960d594b65bdf6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-138.ec2.internal\" (UID: \"0b3dfc5d808bbc14c9960d594b65bdf6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-138.ec2.internal"
Jul 08 21:15:40.136039 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:40.135976    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e15bd876fdc5c28fde6928dbc5f32a53-config\") pod \"kube-apiserver-proxy-ip-10-0-143-138.ec2.internal\" (UID: \"e15bd876fdc5c28fde6928dbc5f32a53\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-138.ec2.internal"
Jul 08 21:15:40.136039 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:40.136000    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e15bd876fdc5c28fde6928dbc5f32a53-config\") pod \"kube-apiserver-proxy-ip-10-0-143-138.ec2.internal\" (UID: \"e15bd876fdc5c28fde6928dbc5f32a53\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-138.ec2.internal"
Jul 08 21:15:40.136039 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:40.136024    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0b3dfc5d808bbc14c9960d594b65bdf6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-138.ec2.internal\" (UID: \"0b3dfc5d808bbc14c9960d594b65bdf6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-138.ec2.internal"
Jul 08 21:15:40.136164 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:40.136038    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b3dfc5d808bbc14c9960d594b65bdf6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-138.ec2.internal\" (UID: \"0b3dfc5d808bbc14c9960d594b65bdf6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-138.ec2.internal"
Jul 08 21:15:40.220365 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:40.220338    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-138.ec2.internal\" not found"
Jul 08 21:15:40.294682 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:40.294655    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-138.ec2.internal"
Jul 08 21:15:40.298473 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:40.298458    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-138.ec2.internal"
Jul 08 21:15:40.320961 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:40.320941    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-138.ec2.internal\" not found"
Jul 08 21:15:40.421306 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:40.421283    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-138.ec2.internal\" not found"
Jul 08 21:15:40.521696 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:40.521640    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-138.ec2.internal\" not found"
Jul 08 21:15:40.622046 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:40.622021    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-138.ec2.internal\" not found"
Jul 08 21:15:40.663497 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:40.663480    2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 08 21:15:40.663942 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:40.663589    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 21:15:40.722938 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:40.722905    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-138.ec2.internal\" not found"
Jul 08 21:15:40.748956 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:40.748928    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 21:10:39 +0000 UTC" deadline="2028-04-16 13:31:16.522906728 +0000 UTC"
Jul 08 21:15:40.748956 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:40.748950    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15544h15m35.773958908s"
Jul 08 21:15:40.823225 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:40.823159    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-138.ec2.internal\" not found"
Jul 08 21:15:40.857579 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:40.857546    2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 21:15:40.932278 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:40.932255    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-138.ec2.internal"
Jul 08 21:15:40.959802 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:40.959777    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 21:15:40.961596 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:40.961580    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-138.ec2.internal"
Jul 08 21:15:40.969609 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:40.969594    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 21:15:40.980098 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:40.980078    2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 21:15:40.991080 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:40.991048    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b3dfc5d808bbc14c9960d594b65bdf6.slice/crio-2ffa0faac1c5653951123f4e4685f34891a9ae51334ce2dc811381b4f2d0418b WatchSource:0}: Error finding container 2ffa0faac1c5653951123f4e4685f34891a9ae51334ce2dc811381b4f2d0418b: Status 404 returned error can't find the container with id 2ffa0faac1c5653951123f4e4685f34891a9ae51334ce2dc811381b4f2d0418b
Jul 08 21:15:40.991345 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:40.991325    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode15bd876fdc5c28fde6928dbc5f32a53.slice/crio-e1a0d0d7a5f2e8075dba76314b812d17df495508b326e14d9119caaa0938c748 WatchSource:0}: Error finding container e1a0d0d7a5f2e8075dba76314b812d17df495508b326e14d9119caaa0938c748: Status 404 returned error can't find the container with id e1a0d0d7a5f2e8075dba76314b812d17df495508b326e14d9119caaa0938c748
Jul 08 21:15:40.996632 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:40.996620    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 21:15:41.669457 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.669429    2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 21:15:41.708235 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.708212    2571 apiserver.go:52] "Watching apiserver"
Jul 08 21:15:41.714690 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.714672    2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 08 21:15:41.715056 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.715038    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-138.ec2.internal","openshift-network-diagnostics/network-check-target-tlc6m","openshift-network-operator/iptables-alerter-mb55f","openshift-ovn-kubernetes/ovnkube-node-8fjtm","kube-system/konnectivity-agent-lwvml","kube-system/kube-apiserver-proxy-ip-10-0-143-138.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28fp6","openshift-image-registry/node-ca-q6v7s","openshift-multus/multus-2dxpp","openshift-multus/multus-additional-cni-plugins-nq92z","openshift-multus/network-metrics-daemon-w5tkg","kube-system/global-pull-secret-syncer-hk4nc","openshift-cluster-node-tuning-operator/tuned-7hcjs","openshift-dns/node-resolver-kwg77"]
Jul 08 21:15:41.716577 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.716560    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28fp6"
Jul 08 21:15:41.717883 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.717865    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.719032 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.719014    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 08 21:15:41.719096 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.719060    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mb55f"
Jul 08 21:15:41.719144 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.719092    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xjjss\""
Jul 08 21:15:41.719144 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.719095    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 08 21:15:41.719144 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.719112    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 08 21:15:41.720166 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.720149    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.720236 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.720206    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kvv8z\""
Jul 08 21:15:41.720272 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.720236    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 08 21:15:41.720439 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.720426    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 08 21:15:41.721187 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.721168    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lwvml"
Jul 08 21:15:41.721455 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.721437    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 08 21:15:41.721538 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.721522    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5ghws\""
Jul 08 21:15:41.721665 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.721593    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 08 21:15:41.721665 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.721625    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 08 21:15:41.722292 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.722271    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 08 21:15:41.722376 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.722320    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q6v7s"
Jul 08 21:15:41.722467 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.722326    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 08 21:15:41.724958 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.724029    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 08 21:15:41.724958 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.724276    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 08 21:15:41.724958 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.724309    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 08 21:15:41.724958 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.724390    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2zxh6\""
Jul 08 21:15:41.724958 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.724540    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2w2lw\""
Jul 08 21:15:41.724958 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.724540    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 08 21:15:41.724958 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.724610    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 08 21:15:41.724958 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.724724    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 08 21:15:41.724958 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.724808    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.725448 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.724983    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 08 21:15:41.725995 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.725977    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:15:41.726101 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:41.726074    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5tkg" podUID="bcf041d9-9dcf-4edd-b480-dc0051905946"
Jul 08 21:15:41.726676 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.726659    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 08 21:15:41.726908 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.726895    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-k6xv2\""
Jul 08 21:15:41.727057 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.727047    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 08 21:15:41.727595 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.727326    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 08 21:15:41.727595 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.727414    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 08 21:15:41.727595 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.727445    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-24dcc\""
Jul 08 21:15:41.727595 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.727491    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:15:41.727595 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.727504    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 08 21:15:41.727595 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.727493    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 08 21:15:41.727595 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:41.727538    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlc6m" podUID="f75b6b6b-23e7-4360-8c27-1c8d9add975e"
Jul 08 21:15:41.728641 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.728628    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nq92z"
Jul 08 21:15:41.729938 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.729916    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:15:41.730016 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:41.729993    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hk4nc" podUID="fed9c17c-f689-4d9f-b52e-7ba52d04948f"
Jul 08 21:15:41.730563 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.730547    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4g5s2\""
Jul 08 21:15:41.730643 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.730572    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 08 21:15:41.730702 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.730680    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 08 21:15:41.732357 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.732343    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kwg77"
Jul 08 21:15:41.732591 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.732576    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 08 21:15:41.733399 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.733382    2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 08 21:15:41.734789 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.734770    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 08 21:15:41.734789 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.734785    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tchf5\""
Jul 08 21:15:41.734917 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.734770    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 08 21:15:41.743473 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.743444    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 21:15:41.744908 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.744887    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ddde1ed8-5f18-46d8-a25b-e18091943f8d-host-slash\") pod \"iptables-alerter-mb55f\" (UID: \"ddde1ed8-5f18-46d8-a25b-e18091943f8d\") " pod="openshift-network-operator/iptables-alerter-mb55f"
Jul 08 21:15:41.744978 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.744953    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-run-systemd\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.745032 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.744977    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-node-log\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.745082 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745032    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-host-run-ovn-kubernetes\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.745165 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745057    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fed9c17c-f689-4d9f-b52e-7ba52d04948f-original-pull-secret\") pod \"global-pull-secret-syncer-hk4nc\" (UID: \"fed9c17c-f689-4d9f-b52e-7ba52d04948f\") " pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:15:41.745165 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745112    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-multus-cni-dir\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.745165 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745131    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-hostroot\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.745265 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745183    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/41ce5641-ba26-475c-82e4-1d606f11a5dd-device-dir\") pod \"aws-ebs-csi-driver-node-28fp6\" (UID: \"41ce5641-ba26-475c-82e4-1d606f11a5dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28fp6"
Jul 08 21:15:41.745265 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745204    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-host-slash\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.745265 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745219    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsrlr\" (UniqueName: \"kubernetes.io/projected/13f8f143-b56b-41cc-b6d4-58330207e6d9-kube-api-access-qsrlr\") pod \"node-ca-q6v7s\" (UID: \"13f8f143-b56b-41cc-b6d4-58330207e6d9\") " pod="openshift-image-registry/node-ca-q6v7s"
Jul 08 21:15:41.745265 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745243    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-etc-sysconfig\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.745265 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745256    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-etc-sysctl-conf\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.745412 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745269    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-etc-tuned\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.745412 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745281    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-tmp\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.745412 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745295    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twgkm\" (UniqueName: \"kubernetes.io/projected/bcf041d9-9dcf-4edd-b480-dc0051905946-kube-api-access-twgkm\") pod \"network-metrics-daemon-w5tkg\" (UID: \"bcf041d9-9dcf-4edd-b480-dc0051905946\") " pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:15:41.745412 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745327    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/41ce5641-ba26-475c-82e4-1d606f11a5dd-sys-fs\") pod \"aws-ebs-csi-driver-node-28fp6\" (UID: \"41ce5641-ba26-475c-82e4-1d606f11a5dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28fp6"
Jul 08 21:15:41.745412 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745352    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/13f8f143-b56b-41cc-b6d4-58330207e6d9-serviceca\") pod \"node-ca-q6v7s\" (UID: \"13f8f143-b56b-41cc-b6d4-58330207e6d9\") " pod="openshift-image-registry/node-ca-q6v7s"
Jul 08 21:15:41.745412 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745370    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-os-release\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.745412 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745383    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e4b6b532-b51d-4685-b7d2-ddc06df5c56c-system-cni-dir\") pod \"multus-additional-cni-plugins-nq92z\" (UID: \"e4b6b532-b51d-4685-b7d2-ddc06df5c56c\") " pod="openshift-multus/multus-additional-cni-plugins-nq92z"
Jul 08 21:15:41.745412 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745398    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e4b6b532-b51d-4685-b7d2-ddc06df5c56c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nq92z\" (UID: \"e4b6b532-b51d-4685-b7d2-ddc06df5c56c\") " pod="openshift-multus/multus-additional-cni-plugins-nq92z"
Jul 08 21:15:41.745412 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745411    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db7d97d7-b4b1-4c44-a4e8-be1d3590a217-tmp-dir\") pod \"node-resolver-kwg77\" (UID: \"db7d97d7-b4b1-4c44-a4e8-be1d3590a217\") " pod="openshift-dns/node-resolver-kwg77"
Jul 08 21:15:41.745820 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745425    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-systemd-units\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.745820 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745455    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-host-cni-netd\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.745820 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745482    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.745820 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745505    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-ovn-node-metrics-cert\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.745820 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745527    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt5hg\" (UniqueName: \"kubernetes.io/projected/1180d3c1-505c-468f-81bf-81224aac85b1-kube-api-access-pt5hg\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.745820 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745549    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5wj7\" (UniqueName: \"kubernetes.io/projected/e4b6b532-b51d-4685-b7d2-ddc06df5c56c-kube-api-access-x5wj7\") pod \"multus-additional-cni-plugins-nq92z\" (UID: \"e4b6b532-b51d-4685-b7d2-ddc06df5c56c\") " pod="openshift-multus/multus-additional-cni-plugins-nq92z"
Jul 08 21:15:41.745820 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745573    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z49zq\" (UniqueName: \"kubernetes.io/projected/db7d97d7-b4b1-4c44-a4e8-be1d3590a217-kube-api-access-z49zq\") pod \"node-resolver-kwg77\" (UID: \"db7d97d7-b4b1-4c44-a4e8-be1d3590a217\") " pod="openshift-dns/node-resolver-kwg77"
Jul 08 21:15:41.745820 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745594    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/41ce5641-ba26-475c-82e4-1d606f11a5dd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-28fp6\" (UID: \"41ce5641-ba26-475c-82e4-1d606f11a5dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28fp6"
Jul 08 21:15:41.745820 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745615    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-etc-openvswitch\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.745820 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745645    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-host\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.745820 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745666    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-host-run-k8s-cni-cncf-io\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.745820 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745697    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/db7d97d7-b4b1-4c44-a4e8-be1d3590a217-hosts-file\") pod \"node-resolver-kwg77\" (UID: \"db7d97d7-b4b1-4c44-a4e8-be1d3590a217\") " pod="openshift-dns/node-resolver-kwg77"
Jul 08 21:15:41.745820 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745730    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/41ce5641-ba26-475c-82e4-1d606f11a5dd-registration-dir\") pod \"aws-ebs-csi-driver-node-28fp6\" (UID: \"41ce5641-ba26-475c-82e4-1d606f11a5dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28fp6"
Jul 08 21:15:41.745820 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745773    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-host-kubelet\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.745820 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745793    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-host-var-lib-kubelet\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.745820 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745816    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/41ce5641-ba26-475c-82e4-1d606f11a5dd-socket-dir\") pod \"aws-ebs-csi-driver-node-28fp6\" (UID: \"41ce5641-ba26-475c-82e4-1d606f11a5dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28fp6"
Jul 08 21:15:41.746379 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745834    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-run-ovn\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.746379 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745862    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-host-var-lib-cni-bin\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.746379 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745885    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1180d3c1-505c-468f-81bf-81224aac85b1-multus-daemon-config\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.746379 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745902    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e4b6b532-b51d-4685-b7d2-ddc06df5c56c-cnibin\") pod \"multus-additional-cni-plugins-nq92z\" (UID: \"e4b6b532-b51d-4685-b7d2-ddc06df5c56c\") " pod="openshift-multus/multus-additional-cni-plugins-nq92z"
Jul 08 21:15:41.746379 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745915    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e4b6b532-b51d-4685-b7d2-ddc06df5c56c-cni-binary-copy\") pod \"multus-additional-cni-plugins-nq92z\" (UID: \"e4b6b532-b51d-4685-b7d2-ddc06df5c56c\") " pod="openshift-multus/multus-additional-cni-plugins-nq92z"
Jul 08 21:15:41.746379 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745943    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-var-lib-openvswitch\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.746379 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.745971    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-ovnkube-script-lib\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.746379 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746015    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-etc-systemd\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.746379 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746044    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-log-socket\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.746379 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746074    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4crgc\" (UniqueName: \"kubernetes.io/projected/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-kube-api-access-4crgc\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.746379 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746093    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-etc-modprobe-d\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.746379 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746112    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e4b6b532-b51d-4685-b7d2-ddc06df5c56c-os-release\") pod \"multus-additional-cni-plugins-nq92z\" (UID: \"e4b6b532-b51d-4685-b7d2-ddc06df5c56c\") " pod="openshift-multus/multus-additional-cni-plugins-nq92z"
Jul 08 21:15:41.746379 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746133    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e4b6b532-b51d-4685-b7d2-ddc06df5c56c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nq92z\" (UID: \"e4b6b532-b51d-4685-b7d2-ddc06df5c56c\") " pod="openshift-multus/multus-additional-cni-plugins-nq92z"
Jul 08 21:15:41.746379 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746162    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e4b6b532-b51d-4685-b7d2-ddc06df5c56c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nq92z\" (UID: \"e4b6b532-b51d-4685-b7d2-ddc06df5c56c\") " pod="openshift-multus/multus-additional-cni-plugins-nq92z"
Jul 08 21:15:41.746379 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746184    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/41ce5641-ba26-475c-82e4-1d606f11a5dd-etc-selinux\") pod \"aws-ebs-csi-driver-node-28fp6\" (UID: \"41ce5641-ba26-475c-82e4-1d606f11a5dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28fp6"
Jul 08 21:15:41.746379 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746207    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zx9r\" (UniqueName: \"kubernetes.io/projected/41ce5641-ba26-475c-82e4-1d606f11a5dd-kube-api-access-4zx9r\") pod \"aws-ebs-csi-driver-node-28fp6\" (UID: \"41ce5641-ba26-475c-82e4-1d606f11a5dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28fp6"
Jul 08 21:15:41.746966 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746227    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27sjn\" (UniqueName: \"kubernetes.io/projected/ddde1ed8-5f18-46d8-a25b-e18091943f8d-kube-api-access-27sjn\") pod \"iptables-alerter-mb55f\" (UID: \"ddde1ed8-5f18-46d8-a25b-e18091943f8d\") " pod="openshift-network-operator/iptables-alerter-mb55f"
Jul 08 21:15:41.746966 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746248    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-etc-sysctl-d\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.746966 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746275    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1180d3c1-505c-468f-81bf-81224aac85b1-cni-binary-copy\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.746966 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746295    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-host-run-netns\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.746966 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746314    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-etc-kubernetes\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.746966 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746336    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-ovnkube-config\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.746966 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746355    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-sys\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.746966 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746378    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-var-lib-kubelet\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.746966 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746399    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-system-cni-dir\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.746966 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746419    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-host-run-netns\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.746966 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746439    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-multus-socket-dir-parent\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.746966 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746464    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-host-cni-bin\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.746966 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746482    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b260a6a3-7539-4175-b668-a648e3b3a123-agent-certs\") pod \"konnectivity-agent-lwvml\" (UID: \"b260a6a3-7539-4175-b668-a648e3b3a123\") " pod="kube-system/konnectivity-agent-lwvml"
Jul 08 21:15:41.746966 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746496    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b260a6a3-7539-4175-b668-a648e3b3a123-konnectivity-ca\") pod \"konnectivity-agent-lwvml\" (UID: \"b260a6a3-7539-4175-b668-a648e3b3a123\") " pod="kube-system/konnectivity-agent-lwvml"
Jul 08 21:15:41.746966 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746518    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13f8f143-b56b-41cc-b6d4-58330207e6d9-host\") pod \"node-ca-q6v7s\" (UID: \"13f8f143-b56b-41cc-b6d4-58330207e6d9\") " pod="openshift-image-registry/node-ca-q6v7s"
Jul 08 21:15:41.746966 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746532    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-lib-modules\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.746966 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746546    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ddde1ed8-5f18-46d8-a25b-e18091943f8d-iptables-alerter-script\") pod \"iptables-alerter-mb55f\" (UID: \"ddde1ed8-5f18-46d8-a25b-e18091943f8d\") " pod="openshift-network-operator/iptables-alerter-mb55f"
Jul 08 21:15:41.747472 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746559    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-run-openvswitch\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.747472 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746572    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-env-overrides\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.747472 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746585    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhqgg\" (UniqueName: \"kubernetes.io/projected/f75b6b6b-23e7-4360-8c27-1c8d9add975e-kube-api-access-jhqgg\") pod \"network-check-target-tlc6m\" (UID: \"f75b6b6b-23e7-4360-8c27-1c8d9add975e\") " pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:15:41.747472 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746598    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fed9c17c-f689-4d9f-b52e-7ba52d04948f-dbus\") pod \"global-pull-secret-syncer-hk4nc\" (UID: \"fed9c17c-f689-4d9f-b52e-7ba52d04948f\") " pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:15:41.747472 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746621    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-host-run-multus-certs\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.747472 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746634    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf041d9-9dcf-4edd-b480-dc0051905946-metrics-certs\") pod \"network-metrics-daemon-w5tkg\" (UID: \"bcf041d9-9dcf-4edd-b480-dc0051905946\") " pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:15:41.747472 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746657    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fed9c17c-f689-4d9f-b52e-7ba52d04948f-kubelet-config\") pod \"global-pull-secret-syncer-hk4nc\" (UID: \"fed9c17c-f689-4d9f-b52e-7ba52d04948f\") " pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:15:41.747472 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746689    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-etc-kubernetes\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.747472 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746729    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vrz7\" (UniqueName: \"kubernetes.io/projected/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-kube-api-access-6vrz7\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.747472 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746776    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-cnibin\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.747472 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746805    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-host-var-lib-cni-multus\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.747472 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746828    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-multus-conf-dir\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.747472 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.746849    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-run\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.761054 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.761037    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mzg4b"
Jul 08 21:15:41.767317 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.767295    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mzg4b"
Jul 08 21:15:41.847294 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847245    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-host-run-netns\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.847294 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847298    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-etc-kubernetes\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.847652 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847322    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-ovnkube-config\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.847652 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847343    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-sys\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.847652 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847364    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-var-lib-kubelet\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.847652 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847386    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-system-cni-dir\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.847652 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847408    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-host-run-netns\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.847652 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847430    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-multus-socket-dir-parent\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.847652 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847453    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-host-cni-bin\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.847652 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847475    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b260a6a3-7539-4175-b668-a648e3b3a123-agent-certs\") pod \"konnectivity-agent-lwvml\" (UID: \"b260a6a3-7539-4175-b668-a648e3b3a123\") " pod="kube-system/konnectivity-agent-lwvml"
Jul 08 21:15:41.847652 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847495    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b260a6a3-7539-4175-b668-a648e3b3a123-konnectivity-ca\") pod \"konnectivity-agent-lwvml\" (UID: \"b260a6a3-7539-4175-b668-a648e3b3a123\") " pod="kube-system/konnectivity-agent-lwvml"
Jul 08 21:15:41.847652 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847512    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13f8f143-b56b-41cc-b6d4-58330207e6d9-host\") pod \"node-ca-q6v7s\" (UID: \"13f8f143-b56b-41cc-b6d4-58330207e6d9\") " pod="openshift-image-registry/node-ca-q6v7s"
Jul 08 21:15:41.847652 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847532    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-lib-modules\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.847652 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847552    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ddde1ed8-5f18-46d8-a25b-e18091943f8d-iptables-alerter-script\") pod \"iptables-alerter-mb55f\" (UID: \"ddde1ed8-5f18-46d8-a25b-e18091943f8d\") " pod="openshift-network-operator/iptables-alerter-mb55f"
Jul 08 21:15:41.847652 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847574    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-run-openvswitch\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.847652 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847596    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-env-overrides\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.847652 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847625    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhqgg\" (UniqueName: \"kubernetes.io/projected/f75b6b6b-23e7-4360-8c27-1c8d9add975e-kube-api-access-jhqgg\") pod \"network-check-target-tlc6m\" (UID: \"f75b6b6b-23e7-4360-8c27-1c8d9add975e\") " pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:15:41.847652 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847648    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fed9c17c-f689-4d9f-b52e-7ba52d04948f-dbus\") pod \"global-pull-secret-syncer-hk4nc\" (UID: \"fed9c17c-f689-4d9f-b52e-7ba52d04948f\") " pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:15:41.847652 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847669    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-host-run-multus-certs\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.848883 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847691    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf041d9-9dcf-4edd-b480-dc0051905946-metrics-certs\") pod \"network-metrics-daemon-w5tkg\" (UID: \"bcf041d9-9dcf-4edd-b480-dc0051905946\") " pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:15:41.848883 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847723    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fed9c17c-f689-4d9f-b52e-7ba52d04948f-kubelet-config\") pod \"global-pull-secret-syncer-hk4nc\" (UID: \"fed9c17c-f689-4d9f-b52e-7ba52d04948f\") " pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:15:41.848883 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847764    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-etc-kubernetes\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.848883 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847793    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vrz7\" (UniqueName: \"kubernetes.io/projected/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-kube-api-access-6vrz7\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.848883 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847818    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-cnibin\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.848883 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847841    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-host-var-lib-cni-multus\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.848883 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847871    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-multus-conf-dir\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.848883 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847891    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-run\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.848883 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847911    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ddde1ed8-5f18-46d8-a25b-e18091943f8d-host-slash\") pod \"iptables-alerter-mb55f\" (UID: \"ddde1ed8-5f18-46d8-a25b-e18091943f8d\") " pod="openshift-network-operator/iptables-alerter-mb55f"
Jul 08 21:15:41.848883 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847931    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-run-systemd\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.848883 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847954    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-node-log\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.848883 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847973    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-host-run-ovn-kubernetes\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.848883 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.847990    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fed9c17c-f689-4d9f-b52e-7ba52d04948f-original-pull-secret\") pod \"global-pull-secret-syncer-hk4nc\" (UID: \"fed9c17c-f689-4d9f-b52e-7ba52d04948f\") " pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:15:41.848883 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848017    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-multus-cni-dir\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.848883 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848035    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-hostroot\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.848883 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848051    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/41ce5641-ba26-475c-82e4-1d606f11a5dd-device-dir\") pod \"aws-ebs-csi-driver-node-28fp6\" (UID: \"41ce5641-ba26-475c-82e4-1d606f11a5dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28fp6"
Jul 08 21:15:41.848883 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848068    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-host-slash\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.849854 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848090    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsrlr\" (UniqueName: \"kubernetes.io/projected/13f8f143-b56b-41cc-b6d4-58330207e6d9-kube-api-access-qsrlr\") pod \"node-ca-q6v7s\" (UID: \"13f8f143-b56b-41cc-b6d4-58330207e6d9\") " pod="openshift-image-registry/node-ca-q6v7s"
Jul 08 21:15:41.849854 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848111    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-etc-sysconfig\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.849854 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848133    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-etc-sysctl-conf\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.849854 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848161    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-etc-tuned\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.849854 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848194    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-tmp\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.849854 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848216    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twgkm\" (UniqueName: \"kubernetes.io/projected/bcf041d9-9dcf-4edd-b480-dc0051905946-kube-api-access-twgkm\") pod \"network-metrics-daemon-w5tkg\" (UID: \"bcf041d9-9dcf-4edd-b480-dc0051905946\") " pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:15:41.849854 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848239    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/41ce5641-ba26-475c-82e4-1d606f11a5dd-sys-fs\") pod \"aws-ebs-csi-driver-node-28fp6\" (UID: \"41ce5641-ba26-475c-82e4-1d606f11a5dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28fp6"
Jul 08 21:15:41.849854 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848260    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/13f8f143-b56b-41cc-b6d4-58330207e6d9-serviceca\") pod \"node-ca-q6v7s\" (UID: \"13f8f143-b56b-41cc-b6d4-58330207e6d9\") " pod="openshift-image-registry/node-ca-q6v7s"
Jul 08 21:15:41.849854 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848281    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-os-release\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.849854 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848303    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e4b6b532-b51d-4685-b7d2-ddc06df5c56c-system-cni-dir\") pod \"multus-additional-cni-plugins-nq92z\" (UID: \"e4b6b532-b51d-4685-b7d2-ddc06df5c56c\") " pod="openshift-multus/multus-additional-cni-plugins-nq92z"
Jul 08 21:15:41.849854 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848326    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e4b6b532-b51d-4685-b7d2-ddc06df5c56c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nq92z\" (UID: \"e4b6b532-b51d-4685-b7d2-ddc06df5c56c\") " pod="openshift-multus/multus-additional-cni-plugins-nq92z"
Jul 08 21:15:41.849854 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848358    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db7d97d7-b4b1-4c44-a4e8-be1d3590a217-tmp-dir\") pod \"node-resolver-kwg77\" (UID: \"db7d97d7-b4b1-4c44-a4e8-be1d3590a217\") " pod="openshift-dns/node-resolver-kwg77"
Jul 08 21:15:41.849854 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848382    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-systemd-units\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.849854 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848396    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-host-cni-netd\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.849854 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848419    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.849854 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848444    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-ovn-node-metrics-cert\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.849854 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848471    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt5hg\" (UniqueName: \"kubernetes.io/projected/1180d3c1-505c-468f-81bf-81224aac85b1-kube-api-access-pt5hg\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.851081 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848495    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5wj7\" (UniqueName: \"kubernetes.io/projected/e4b6b532-b51d-4685-b7d2-ddc06df5c56c-kube-api-access-x5wj7\") pod \"multus-additional-cni-plugins-nq92z\" (UID: \"e4b6b532-b51d-4685-b7d2-ddc06df5c56c\") " pod="openshift-multus/multus-additional-cni-plugins-nq92z"
Jul 08 21:15:41.851081 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848519    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z49zq\" (UniqueName: \"kubernetes.io/projected/db7d97d7-b4b1-4c44-a4e8-be1d3590a217-kube-api-access-z49zq\") pod \"node-resolver-kwg77\" (UID: \"db7d97d7-b4b1-4c44-a4e8-be1d3590a217\") " pod="openshift-dns/node-resolver-kwg77"
Jul 08 21:15:41.851081 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848542    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/41ce5641-ba26-475c-82e4-1d606f11a5dd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-28fp6\" (UID: \"41ce5641-ba26-475c-82e4-1d606f11a5dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28fp6"
Jul 08 21:15:41.851081 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848567    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-etc-openvswitch\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.851081 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848590    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-host\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.851081 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848614    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-host-run-k8s-cni-cncf-io\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.851081 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848652    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/db7d97d7-b4b1-4c44-a4e8-be1d3590a217-hosts-file\") pod \"node-resolver-kwg77\" (UID: \"db7d97d7-b4b1-4c44-a4e8-be1d3590a217\") " pod="openshift-dns/node-resolver-kwg77"
Jul 08 21:15:41.851081 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848688    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/41ce5641-ba26-475c-82e4-1d606f11a5dd-registration-dir\") pod \"aws-ebs-csi-driver-node-28fp6\" (UID: \"41ce5641-ba26-475c-82e4-1d606f11a5dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28fp6"
Jul 08 21:15:41.851081 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848712    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-host-kubelet\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.851081 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848730    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-host-var-lib-kubelet\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.851081 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848766    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/41ce5641-ba26-475c-82e4-1d606f11a5dd-socket-dir\") pod \"aws-ebs-csi-driver-node-28fp6\" (UID: \"41ce5641-ba26-475c-82e4-1d606f11a5dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28fp6"
Jul 08 21:15:41.851081 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848801    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-run-ovn\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.851081 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848854    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-run-ovn\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.851081 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:41.848892    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:15:41.851081 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:41.848962    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fed9c17c-f689-4d9f-b52e-7ba52d04948f-original-pull-secret podName:fed9c17c-f689-4d9f-b52e-7ba52d04948f nodeName:}" failed. No retries permitted until 2026-07-08 21:15:42.348940215 +0000 UTC m=+3.003842911 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fed9c17c-f689-4d9f-b52e-7ba52d04948f-original-pull-secret") pod "global-pull-secret-syncer-hk4nc" (UID: "fed9c17c-f689-4d9f-b52e-7ba52d04948f") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:15:41.851081 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.848993    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-multus-cni-dir\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.851081 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.849035    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-hostroot\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.851987 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.849078    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/41ce5641-ba26-475c-82e4-1d606f11a5dd-device-dir\") pod \"aws-ebs-csi-driver-node-28fp6\" (UID: \"41ce5641-ba26-475c-82e4-1d606f11a5dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28fp6"
Jul 08 21:15:41.851987 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.849114    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-host-slash\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.851987 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.849253    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-env-overrides\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.851987 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.849274    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-etc-sysconfig\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.851987 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.849326    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-host-run-netns\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.851987 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.849353    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-etc-kubernetes\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.851987 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.849357    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fed9c17c-f689-4d9f-b52e-7ba52d04948f-dbus\") pod \"global-pull-secret-syncer-hk4nc\" (UID: \"fed9c17c-f689-4d9f-b52e-7ba52d04948f\") " pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:15:41.851987 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.849384    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-etc-sysctl-conf\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.851987 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.849409    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-host-run-multus-certs\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.851987 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:41.849484    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:15:41.851987 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:41.849522    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf041d9-9dcf-4edd-b480-dc0051905946-metrics-certs podName:bcf041d9-9dcf-4edd-b480-dc0051905946 nodeName:}" failed. No retries permitted until 2026-07-08 21:15:42.349509182 +0000 UTC m=+3.004411880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcf041d9-9dcf-4edd-b480-dc0051905946-metrics-certs") pod "network-metrics-daemon-w5tkg" (UID: "bcf041d9-9dcf-4edd-b480-dc0051905946") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:15:41.851987 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.849567    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fed9c17c-f689-4d9f-b52e-7ba52d04948f-kubelet-config\") pod \"global-pull-secret-syncer-hk4nc\" (UID: \"fed9c17c-f689-4d9f-b52e-7ba52d04948f\") " pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:15:41.851987 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.849614    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-etc-kubernetes\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.851987 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.849638    2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 08 21:15:41.851987 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.849709    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-ovnkube-config\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.851987 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.849794    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-sys\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.851987 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.849848    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-host-run-netns\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.851987 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.849880    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-system-cni-dir\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.852899 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.849896    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-run\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.852899 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.849901    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-multus-conf-dir\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.852899 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.849937    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-multus-socket-dir-parent\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.852899 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.849944    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ddde1ed8-5f18-46d8-a25b-e18091943f8d-host-slash\") pod \"iptables-alerter-mb55f\" (UID: \"ddde1ed8-5f18-46d8-a25b-e18091943f8d\") " pod="openshift-network-operator/iptables-alerter-mb55f"
Jul 08 21:15:41.852899 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.849985    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-host-cni-bin\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.852899 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.849989    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-node-log\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.852899 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.850018    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-run-systemd\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.852899 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.850023    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-host-run-ovn-kubernetes\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.852899 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.850043    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-host-var-lib-cni-bin\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.852899 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.850067    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1180d3c1-505c-468f-81bf-81224aac85b1-multus-daemon-config\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.852899 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.850091    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e4b6b532-b51d-4685-b7d2-ddc06df5c56c-cnibin\") pod \"multus-additional-cni-plugins-nq92z\" (UID: \"e4b6b532-b51d-4685-b7d2-ddc06df5c56c\") " pod="openshift-multus/multus-additional-cni-plugins-nq92z"
Jul 08 21:15:41.852899 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.850114    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e4b6b532-b51d-4685-b7d2-ddc06df5c56c-cni-binary-copy\") pod \"multus-additional-cni-plugins-nq92z\" (UID: \"e4b6b532-b51d-4685-b7d2-ddc06df5c56c\") " pod="openshift-multus/multus-additional-cni-plugins-nq92z"
Jul 08 21:15:41.852899 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.850138    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-var-lib-openvswitch\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.852899 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.850159    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-ovnkube-script-lib\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.852899 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.850180    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-etc-systemd\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.852899 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.850203    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-log-socket\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.852899 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.850227    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4crgc\" (UniqueName: \"kubernetes.io/projected/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-kube-api-access-4crgc\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.852899 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.850250    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-etc-modprobe-d\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.853905 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.850273    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e4b6b532-b51d-4685-b7d2-ddc06df5c56c-os-release\") pod \"multus-additional-cni-plugins-nq92z\" (UID: \"e4b6b532-b51d-4685-b7d2-ddc06df5c56c\") " pod="openshift-multus/multus-additional-cni-plugins-nq92z"
Jul 08 21:15:41.853905 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.850287    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-cnibin\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.853905 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.850295    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e4b6b532-b51d-4685-b7d2-ddc06df5c56c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nq92z\" (UID: \"e4b6b532-b51d-4685-b7d2-ddc06df5c56c\") " pod="openshift-multus/multus-additional-cni-plugins-nq92z"
Jul 08 21:15:41.853905 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.850320    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e4b6b532-b51d-4685-b7d2-ddc06df5c56c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nq92z\" (UID: \"e4b6b532-b51d-4685-b7d2-ddc06df5c56c\") " pod="openshift-multus/multus-additional-cni-plugins-nq92z"
Jul 08 21:15:41.853905 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.850362    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/41ce5641-ba26-475c-82e4-1d606f11a5dd-etc-selinux\") pod \"aws-ebs-csi-driver-node-28fp6\" (UID: \"41ce5641-ba26-475c-82e4-1d606f11a5dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28fp6"
Jul 08 21:15:41.853905 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.850363    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/41ce5641-ba26-475c-82e4-1d606f11a5dd-sys-fs\") pod \"aws-ebs-csi-driver-node-28fp6\" (UID: \"41ce5641-ba26-475c-82e4-1d606f11a5dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28fp6"
Jul 08 21:15:41.853905 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.850415    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-lib-modules\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.853905 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.850434    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/41ce5641-ba26-475c-82e4-1d606f11a5dd-etc-selinux\") pod \"aws-ebs-csi-driver-node-28fp6\" (UID: \"41ce5641-ba26-475c-82e4-1d606f11a5dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28fp6"
Jul 08 21:15:41.853905 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.850464    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-host-var-lib-cni-bin\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.853905 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.850506    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-log-socket\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.853905 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.850558    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e4b6b532-b51d-4685-b7d2-ddc06df5c56c-cnibin\") pod \"multus-additional-cni-plugins-nq92z\" (UID: \"e4b6b532-b51d-4685-b7d2-ddc06df5c56c\") " pod="openshift-multus/multus-additional-cni-plugins-nq92z"
Jul 08 21:15:41.853905 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.850607    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-var-lib-openvswitch\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.853905 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.850766    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1180d3c1-505c-468f-81bf-81224aac85b1-multus-daemon-config\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.853905 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.850811    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e4b6b532-b51d-4685-b7d2-ddc06df5c56c-system-cni-dir\") pod \"multus-additional-cni-plugins-nq92z\" (UID: \"e4b6b532-b51d-4685-b7d2-ddc06df5c56c\") " pod="openshift-multus/multus-additional-cni-plugins-nq92z"
Jul 08 21:15:41.853905 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.850817    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-os-release\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.853905 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.850994    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-etc-modprobe-d\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.853905 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.851031    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e4b6b532-b51d-4685-b7d2-ddc06df5c56c-os-release\") pod \"multus-additional-cni-plugins-nq92z\" (UID: \"e4b6b532-b51d-4685-b7d2-ddc06df5c56c\") " pod="openshift-multus/multus-additional-cni-plugins-nq92z"
Jul 08 21:15:41.854790 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.851038    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/13f8f143-b56b-41cc-b6d4-58330207e6d9-serviceca\") pod \"node-ca-q6v7s\" (UID: \"13f8f143-b56b-41cc-b6d4-58330207e6d9\") " pod="openshift-image-registry/node-ca-q6v7s"
Jul 08 21:15:41.854790 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.851103    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/41ce5641-ba26-475c-82e4-1d606f11a5dd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-28fp6\" (UID: \"41ce5641-ba26-475c-82e4-1d606f11a5dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28fp6"
Jul 08 21:15:41.854790 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.851129    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e4b6b532-b51d-4685-b7d2-ddc06df5c56c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nq92z\" (UID: \"e4b6b532-b51d-4685-b7d2-ddc06df5c56c\") " pod="openshift-multus/multus-additional-cni-plugins-nq92z"
Jul 08 21:15:41.854790 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.851145    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-etc-openvswitch\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.854790 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.851144    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b260a6a3-7539-4175-b668-a648e3b3a123-konnectivity-ca\") pod \"konnectivity-agent-lwvml\" (UID: \"b260a6a3-7539-4175-b668-a648e3b3a123\") " pod="kube-system/konnectivity-agent-lwvml"
Jul 08 21:15:41.854790 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.851181    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-ovnkube-script-lib\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.854790 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.851205    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-host\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.854790 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.851245    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-host-run-k8s-cni-cncf-io\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.854790 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.851248    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-etc-systemd\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.854790 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.851301    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/db7d97d7-b4b1-4c44-a4e8-be1d3590a217-hosts-file\") pod \"node-resolver-kwg77\" (UID: \"db7d97d7-b4b1-4c44-a4e8-be1d3590a217\") " pod="openshift-dns/node-resolver-kwg77"
Jul 08 21:15:41.854790 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.851336    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-host-var-lib-kubelet\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.854790 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.851346    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e4b6b532-b51d-4685-b7d2-ddc06df5c56c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nq92z\" (UID: \"e4b6b532-b51d-4685-b7d2-ddc06df5c56c\") " pod="openshift-multus/multus-additional-cni-plugins-nq92z"
Jul 08 21:15:41.854790 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.851356    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/41ce5641-ba26-475c-82e4-1d606f11a5dd-socket-dir\") pod \"aws-ebs-csi-driver-node-28fp6\" (UID: \"41ce5641-ba26-475c-82e4-1d606f11a5dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28fp6"
Jul 08 21:15:41.854790 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.851380    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/41ce5641-ba26-475c-82e4-1d606f11a5dd-registration-dir\") pod \"aws-ebs-csi-driver-node-28fp6\" (UID: \"41ce5641-ba26-475c-82e4-1d606f11a5dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28fp6"
Jul 08 21:15:41.854790 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.851400    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-var-lib-kubelet\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.854790 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.851420    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-host-kubelet\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.854790 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.851429    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zx9r\" (UniqueName: \"kubernetes.io/projected/41ce5641-ba26-475c-82e4-1d606f11a5dd-kube-api-access-4zx9r\") pod \"aws-ebs-csi-driver-node-28fp6\" (UID: \"41ce5641-ba26-475c-82e4-1d606f11a5dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28fp6"
Jul 08 21:15:41.855392 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.851433    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e4b6b532-b51d-4685-b7d2-ddc06df5c56c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nq92z\" (UID: \"e4b6b532-b51d-4685-b7d2-ddc06df5c56c\") " pod="openshift-multus/multus-additional-cni-plugins-nq92z"
Jul 08 21:15:41.855392 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.851453    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27sjn\" (UniqueName: \"kubernetes.io/projected/ddde1ed8-5f18-46d8-a25b-e18091943f8d-kube-api-access-27sjn\") pod \"iptables-alerter-mb55f\" (UID: \"ddde1ed8-5f18-46d8-a25b-e18091943f8d\") " pod="openshift-network-operator/iptables-alerter-mb55f"
Jul 08 21:15:41.855392 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.851461    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.855392 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.851476    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-etc-sysctl-d\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.855392 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.851498    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1180d3c1-505c-468f-81bf-81224aac85b1-cni-binary-copy\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.855392 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.851503    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-systemd-units\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.855392 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.851551    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e4b6b532-b51d-4685-b7d2-ddc06df5c56c-cni-binary-copy\") pod \"multus-additional-cni-plugins-nq92z\" (UID: \"e4b6b532-b51d-4685-b7d2-ddc06df5c56c\") " pod="openshift-multus/multus-additional-cni-plugins-nq92z"
Jul 08 21:15:41.855392 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.851562    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-run-openvswitch\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.855392 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.851577    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db7d97d7-b4b1-4c44-a4e8-be1d3590a217-tmp-dir\") pod \"node-resolver-kwg77\" (UID: \"db7d97d7-b4b1-4c44-a4e8-be1d3590a217\") " pod="openshift-dns/node-resolver-kwg77"
Jul 08 21:15:41.855392 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.851585    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13f8f143-b56b-41cc-b6d4-58330207e6d9-host\") pod \"node-ca-q6v7s\" (UID: \"13f8f143-b56b-41cc-b6d4-58330207e6d9\") " pod="openshift-image-registry/node-ca-q6v7s"
Jul 08 21:15:41.855392 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.849847    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1180d3c1-505c-468f-81bf-81224aac85b1-host-var-lib-cni-multus\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.855392 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.851678    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-etc-sysctl-d\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.855392 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.851800    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-host-cni-netd\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.855392 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.852008    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ddde1ed8-5f18-46d8-a25b-e18091943f8d-iptables-alerter-script\") pod \"iptables-alerter-mb55f\" (UID: \"ddde1ed8-5f18-46d8-a25b-e18091943f8d\") " pod="openshift-network-operator/iptables-alerter-mb55f"
Jul 08 21:15:41.855392 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.852084    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1180d3c1-505c-468f-81bf-81224aac85b1-cni-binary-copy\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.856073 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.856050    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-etc-tuned\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.856306 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.856274    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 21:15:41.856544 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.856481    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b260a6a3-7539-4175-b668-a648e3b3a123-agent-certs\") pod \"konnectivity-agent-lwvml\" (UID: \"b260a6a3-7539-4175-b668-a648e3b3a123\") " pod="kube-system/konnectivity-agent-lwvml"
Jul 08 21:15:41.857087 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.857031    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-ovn-node-metrics-cert\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.859492 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.859471    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-tmp\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.860331 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:41.859987    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:15:41.860331 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:41.860006    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:15:41.860331 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:41.860018    2571 projected.go:196] Error preparing data for projected volume kube-api-access-jhqgg for pod openshift-network-diagnostics/network-check-target-tlc6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:15:41.860331 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:41.860067    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f75b6b6b-23e7-4360-8c27-1c8d9add975e-kube-api-access-jhqgg podName:f75b6b6b-23e7-4360-8c27-1c8d9add975e nodeName:}" failed. No retries permitted until 2026-07-08 21:15:42.360051009 +0000 UTC m=+3.014953705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jhqgg" (UniqueName: "kubernetes.io/projected/f75b6b6b-23e7-4360-8c27-1c8d9add975e-kube-api-access-jhqgg") pod "network-check-target-tlc6m" (UID: "f75b6b6b-23e7-4360-8c27-1c8d9add975e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:15:41.863891 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.861317    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsrlr\" (UniqueName: \"kubernetes.io/projected/13f8f143-b56b-41cc-b6d4-58330207e6d9-kube-api-access-qsrlr\") pod \"node-ca-q6v7s\" (UID: \"13f8f143-b56b-41cc-b6d4-58330207e6d9\") " pod="openshift-image-registry/node-ca-q6v7s"
Jul 08 21:15:41.865975 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.865946    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twgkm\" (UniqueName: \"kubernetes.io/projected/bcf041d9-9dcf-4edd-b480-dc0051905946-kube-api-access-twgkm\") pod \"network-metrics-daemon-w5tkg\" (UID: \"bcf041d9-9dcf-4edd-b480-dc0051905946\") " pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:15:41.866443 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.866360    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4crgc\" (UniqueName: \"kubernetes.io/projected/6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf-kube-api-access-4crgc\") pod \"ovnkube-node-8fjtm\" (UID: \"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:41.866443 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.866406    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-138.ec2.internal" event={"ID":"0b3dfc5d808bbc14c9960d594b65bdf6","Type":"ContainerStarted","Data":"2ffa0faac1c5653951123f4e4685f34891a9ae51334ce2dc811381b4f2d0418b"}
Jul 08 21:15:41.867154 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.866981    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z49zq\" (UniqueName: \"kubernetes.io/projected/db7d97d7-b4b1-4c44-a4e8-be1d3590a217-kube-api-access-z49zq\") pod \"node-resolver-kwg77\" (UID: \"db7d97d7-b4b1-4c44-a4e8-be1d3590a217\") " pod="openshift-dns/node-resolver-kwg77"
Jul 08 21:15:41.868201 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.867563    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5wj7\" (UniqueName: \"kubernetes.io/projected/e4b6b532-b51d-4685-b7d2-ddc06df5c56c-kube-api-access-x5wj7\") pod \"multus-additional-cni-plugins-nq92z\" (UID: \"e4b6b532-b51d-4685-b7d2-ddc06df5c56c\") " pod="openshift-multus/multus-additional-cni-plugins-nq92z"
Jul 08 21:15:41.868635 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.868616    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27sjn\" (UniqueName: \"kubernetes.io/projected/ddde1ed8-5f18-46d8-a25b-e18091943f8d-kube-api-access-27sjn\") pod \"iptables-alerter-mb55f\" (UID: \"ddde1ed8-5f18-46d8-a25b-e18091943f8d\") " pod="openshift-network-operator/iptables-alerter-mb55f"
Jul 08 21:15:41.869068 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.868734    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-138.ec2.internal" event={"ID":"e15bd876fdc5c28fde6928dbc5f32a53","Type":"ContainerStarted","Data":"e1a0d0d7a5f2e8075dba76314b812d17df495508b326e14d9119caaa0938c748"}
Jul 08 21:15:41.869068 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.868732    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vrz7\" (UniqueName: \"kubernetes.io/projected/4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8-kube-api-access-6vrz7\") pod \"tuned-7hcjs\" (UID: \"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:41.870154 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.869940    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt5hg\" (UniqueName: \"kubernetes.io/projected/1180d3c1-505c-468f-81bf-81224aac85b1-kube-api-access-pt5hg\") pod \"multus-2dxpp\" (UID: \"1180d3c1-505c-468f-81bf-81224aac85b1\") " pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:41.871299 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:41.870695    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zx9r\" (UniqueName: \"kubernetes.io/projected/41ce5641-ba26-475c-82e4-1d606f11a5dd-kube-api-access-4zx9r\") pod \"aws-ebs-csi-driver-node-28fp6\" (UID: \"41ce5641-ba26-475c-82e4-1d606f11a5dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28fp6"
Jul 08 21:15:42.028211 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:42.028123    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28fp6"
Jul 08 21:15:42.035284 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:42.035263    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7hcjs"
Jul 08 21:15:42.037599 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:42.037574    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41ce5641_ba26_475c_82e4_1d606f11a5dd.slice/crio-89871aea842d72b69c7f928cc352a06d2f9d3ab089cc3e797f8076456e0c0b20 WatchSource:0}: Error finding container 89871aea842d72b69c7f928cc352a06d2f9d3ab089cc3e797f8076456e0c0b20: Status 404 returned error can't find the container with id 89871aea842d72b69c7f928cc352a06d2f9d3ab089cc3e797f8076456e0c0b20
Jul 08 21:15:42.042692 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:42.042677    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mb55f"
Jul 08 21:15:42.043036 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:42.043015    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d0b8ac3_797f_4dfe_bf04_7aafe444c7f8.slice/crio-0fed4ab616892815dad41a70ee10208f55d378074e4e5d4a1373e0f6f074658b WatchSource:0}: Error finding container 0fed4ab616892815dad41a70ee10208f55d378074e4e5d4a1373e0f6f074658b: Status 404 returned error can't find the container with id 0fed4ab616892815dad41a70ee10208f55d378074e4e5d4a1373e0f6f074658b
Jul 08 21:15:42.048935 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:42.048911    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:15:42.049149 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:42.049131    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddde1ed8_5f18_46d8_a25b_e18091943f8d.slice/crio-3c0dec668dddc101afdee2e14baae01297b7da9f04472223a5ad63ac4d02be27 WatchSource:0}: Error finding container 3c0dec668dddc101afdee2e14baae01297b7da9f04472223a5ad63ac4d02be27: Status 404 returned error can't find the container with id 3c0dec668dddc101afdee2e14baae01297b7da9f04472223a5ad63ac4d02be27
Jul 08 21:15:42.056124 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:42.055816    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lwvml"
Jul 08 21:15:42.062885 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:42.062867    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q6v7s"
Jul 08 21:15:42.063066 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:42.063040    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f7a7b62_cbc8_4907_9a55_9bc0b8a89fbf.slice/crio-9bfe37bafe87753d4e7ce2a5619d64ace7a8e5d3894a2e9d3b78f14b0c6eaf4c WatchSource:0}: Error finding container 9bfe37bafe87753d4e7ce2a5619d64ace7a8e5d3894a2e9d3b78f14b0c6eaf4c: Status 404 returned error can't find the container with id 9bfe37bafe87753d4e7ce2a5619d64ace7a8e5d3894a2e9d3b78f14b0c6eaf4c
Jul 08 21:15:42.067059 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:42.066557    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb260a6a3_7539_4175_b668_a648e3b3a123.slice/crio-a3b491ae1fec82e34046df4fecb7a433874ae9c358d7bcd7c8273d2396613b39 WatchSource:0}: Error finding container a3b491ae1fec82e34046df4fecb7a433874ae9c358d7bcd7c8273d2396613b39: Status 404 returned error can't find the container with id a3b491ae1fec82e34046df4fecb7a433874ae9c358d7bcd7c8273d2396613b39
Jul 08 21:15:42.068957 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:42.068881    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2dxpp"
Jul 08 21:15:42.075318 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:42.075286    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nq92z"
Jul 08 21:15:42.080838 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:42.080821    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kwg77"
Jul 08 21:15:42.081608 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:42.081570    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1180d3c1_505c_468f_81bf_81224aac85b1.slice/crio-ab3660925e72a119bd1337fc810ebb034c65f159dc8843273e920b32adced2b6 WatchSource:0}: Error finding container ab3660925e72a119bd1337fc810ebb034c65f159dc8843273e920b32adced2b6: Status 404 returned error can't find the container with id ab3660925e72a119bd1337fc810ebb034c65f159dc8843273e920b32adced2b6
Jul 08 21:15:42.087685 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:42.087655    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4b6b532_b51d_4685_b7d2_ddc06df5c56c.slice/crio-0f3772c0d98b78ce32010b74e11e02393ad82e619facbc35384a0b223b1a0d7e WatchSource:0}: Error finding container 0f3772c0d98b78ce32010b74e11e02393ad82e619facbc35384a0b223b1a0d7e: Status 404 returned error can't find the container with id 0f3772c0d98b78ce32010b74e11e02393ad82e619facbc35384a0b223b1a0d7e
Jul 08 21:15:42.091243 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:15:42.091223    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb7d97d7_b4b1_4c44_a4e8_be1d3590a217.slice/crio-dfec80004a6b182a0c6340710f0ba1b1639977ab8df18f5cdc02535773e96d7a WatchSource:0}: Error finding container dfec80004a6b182a0c6340710f0ba1b1639977ab8df18f5cdc02535773e96d7a: Status 404 returned error can't find the container with id dfec80004a6b182a0c6340710f0ba1b1639977ab8df18f5cdc02535773e96d7a
Jul 08 21:15:42.355130 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:42.355106    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf041d9-9dcf-4edd-b480-dc0051905946-metrics-certs\") pod \"network-metrics-daemon-w5tkg\" (UID: \"bcf041d9-9dcf-4edd-b480-dc0051905946\") " pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:15:42.355289 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:42.355144    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fed9c17c-f689-4d9f-b52e-7ba52d04948f-original-pull-secret\") pod \"global-pull-secret-syncer-hk4nc\" (UID: \"fed9c17c-f689-4d9f-b52e-7ba52d04948f\") " pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:15:42.355289 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:42.355258    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:15:42.355289 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:42.355268    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:15:42.355476 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:42.355317    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fed9c17c-f689-4d9f-b52e-7ba52d04948f-original-pull-secret podName:fed9c17c-f689-4d9f-b52e-7ba52d04948f nodeName:}" failed. No retries permitted until 2026-07-08 21:15:43.35530051 +0000 UTC m=+4.010203213 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fed9c17c-f689-4d9f-b52e-7ba52d04948f-original-pull-secret") pod "global-pull-secret-syncer-hk4nc" (UID: "fed9c17c-f689-4d9f-b52e-7ba52d04948f") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:15:42.355476 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:42.355335    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf041d9-9dcf-4edd-b480-dc0051905946-metrics-certs podName:bcf041d9-9dcf-4edd-b480-dc0051905946 nodeName:}" failed. No retries permitted until 2026-07-08 21:15:43.355326027 +0000 UTC m=+4.010228723 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcf041d9-9dcf-4edd-b480-dc0051905946-metrics-certs") pod "network-metrics-daemon-w5tkg" (UID: "bcf041d9-9dcf-4edd-b480-dc0051905946") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:15:42.455575 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:42.455546    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhqgg\" (UniqueName: \"kubernetes.io/projected/f75b6b6b-23e7-4360-8c27-1c8d9add975e-kube-api-access-jhqgg\") pod \"network-check-target-tlc6m\" (UID: \"f75b6b6b-23e7-4360-8c27-1c8d9add975e\") " pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:15:42.455743 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:42.455723    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:15:42.455799 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:42.455768    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:15:42.455799 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:42.455781    2571 projected.go:196] Error preparing data for projected volume kube-api-access-jhqgg for pod openshift-network-diagnostics/network-check-target-tlc6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:15:42.455872 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:42.455845    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f75b6b6b-23e7-4360-8c27-1c8d9add975e-kube-api-access-jhqgg podName:f75b6b6b-23e7-4360-8c27-1c8d9add975e nodeName:}" failed. No retries permitted until 2026-07-08 21:15:43.455823821 +0000 UTC m=+4.110726520 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jhqgg" (UniqueName: "kubernetes.io/projected/f75b6b6b-23e7-4360-8c27-1c8d9add975e-kube-api-access-jhqgg") pod "network-check-target-tlc6m" (UID: "f75b6b6b-23e7-4360-8c27-1c8d9add975e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:15:42.769476 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:42.769413    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 21:10:41 +0000 UTC" deadline="2028-03-26 08:15:37.47613952 +0000 UTC"
Jul 08 21:15:42.769476 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:42.769469    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15034h59m54.706673719s"
Jul 08 21:15:42.871462 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:42.871425    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kwg77" event={"ID":"db7d97d7-b4b1-4c44-a4e8-be1d3590a217","Type":"ContainerStarted","Data":"dfec80004a6b182a0c6340710f0ba1b1639977ab8df18f5cdc02535773e96d7a"}
Jul 08 21:15:42.872671 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:42.872647    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nq92z" event={"ID":"e4b6b532-b51d-4685-b7d2-ddc06df5c56c","Type":"ContainerStarted","Data":"0f3772c0d98b78ce32010b74e11e02393ad82e619facbc35384a0b223b1a0d7e"}
Jul 08 21:15:42.873805 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:42.873779    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2dxpp" event={"ID":"1180d3c1-505c-468f-81bf-81224aac85b1","Type":"ContainerStarted","Data":"ab3660925e72a119bd1337fc810ebb034c65f159dc8843273e920b32adced2b6"}
Jul 08 21:15:42.874940 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:42.874918    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lwvml" event={"ID":"b260a6a3-7539-4175-b668-a648e3b3a123","Type":"ContainerStarted","Data":"a3b491ae1fec82e34046df4fecb7a433874ae9c358d7bcd7c8273d2396613b39"}
Jul 08 21:15:42.876008 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:42.875966    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mb55f" event={"ID":"ddde1ed8-5f18-46d8-a25b-e18091943f8d","Type":"ContainerStarted","Data":"3c0dec668dddc101afdee2e14baae01297b7da9f04472223a5ad63ac4d02be27"}
Jul 08 21:15:42.877137 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:42.877108    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28fp6" event={"ID":"41ce5641-ba26-475c-82e4-1d606f11a5dd","Type":"ContainerStarted","Data":"89871aea842d72b69c7f928cc352a06d2f9d3ab089cc3e797f8076456e0c0b20"}
Jul 08 21:15:42.878213 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:42.878188    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q6v7s" event={"ID":"13f8f143-b56b-41cc-b6d4-58330207e6d9","Type":"ContainerStarted","Data":"4100460f37f9f4f92cd55979132a2077221ebc274178196662b13e8f0b033a96"}
Jul 08 21:15:42.879328 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:42.879308    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm" event={"ID":"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf","Type":"ContainerStarted","Data":"9bfe37bafe87753d4e7ce2a5619d64ace7a8e5d3894a2e9d3b78f14b0c6eaf4c"}
Jul 08 21:15:42.880357 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:42.880333    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7hcjs" event={"ID":"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8","Type":"ContainerStarted","Data":"0fed4ab616892815dad41a70ee10208f55d378074e4e5d4a1373e0f6f074658b"}
Jul 08 21:15:43.362384 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:43.362351    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf041d9-9dcf-4edd-b480-dc0051905946-metrics-certs\") pod \"network-metrics-daemon-w5tkg\" (UID: \"bcf041d9-9dcf-4edd-b480-dc0051905946\") " pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:15:43.362549 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:43.362405    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fed9c17c-f689-4d9f-b52e-7ba52d04948f-original-pull-secret\") pod \"global-pull-secret-syncer-hk4nc\" (UID: \"fed9c17c-f689-4d9f-b52e-7ba52d04948f\") " pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:15:43.362549 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:43.362507    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:15:43.362549 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:43.362517    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:15:43.362716 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:43.362571    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf041d9-9dcf-4edd-b480-dc0051905946-metrics-certs podName:bcf041d9-9dcf-4edd-b480-dc0051905946 nodeName:}" failed. No retries permitted until 2026-07-08 21:15:45.362551428 +0000 UTC m=+6.017454140 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcf041d9-9dcf-4edd-b480-dc0051905946-metrics-certs") pod "network-metrics-daemon-w5tkg" (UID: "bcf041d9-9dcf-4edd-b480-dc0051905946") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:15:43.362716 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:43.362590    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fed9c17c-f689-4d9f-b52e-7ba52d04948f-original-pull-secret podName:fed9c17c-f689-4d9f-b52e-7ba52d04948f nodeName:}" failed. No retries permitted until 2026-07-08 21:15:45.362581083 +0000 UTC m=+6.017483790 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fed9c17c-f689-4d9f-b52e-7ba52d04948f-original-pull-secret") pod "global-pull-secret-syncer-hk4nc" (UID: "fed9c17c-f689-4d9f-b52e-7ba52d04948f") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:15:43.463004 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:43.462964    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhqgg\" (UniqueName: \"kubernetes.io/projected/f75b6b6b-23e7-4360-8c27-1c8d9add975e-kube-api-access-jhqgg\") pod \"network-check-target-tlc6m\" (UID: \"f75b6b6b-23e7-4360-8c27-1c8d9add975e\") " pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:15:43.463147 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:43.463128    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:15:43.463205 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:43.463156    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:15:43.463205 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:43.463169    2571 projected.go:196] Error preparing data for projected volume kube-api-access-jhqgg for pod openshift-network-diagnostics/network-check-target-tlc6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:15:43.463272 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:43.463237    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f75b6b6b-23e7-4360-8c27-1c8d9add975e-kube-api-access-jhqgg podName:f75b6b6b-23e7-4360-8c27-1c8d9add975e nodeName:}" failed. No retries permitted until 2026-07-08 21:15:45.463217274 +0000 UTC m=+6.118119981 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jhqgg" (UniqueName: "kubernetes.io/projected/f75b6b6b-23e7-4360-8c27-1c8d9add975e-kube-api-access-jhqgg") pod "network-check-target-tlc6m" (UID: "f75b6b6b-23e7-4360-8c27-1c8d9add975e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:15:43.769917 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:43.769624    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 21:10:41 +0000 UTC" deadline="2028-01-07 23:15:33.234980758 +0000 UTC"
Jul 08 21:15:43.769917 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:43.769890    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13153h59m49.465096749s"
Jul 08 21:15:43.862924 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:43.862888    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:15:43.863093 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:43.863037    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlc6m" podUID="f75b6b6b-23e7-4360-8c27-1c8d9add975e"
Jul 08 21:15:43.863456 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:43.863435    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:15:43.863553 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:43.863533    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hk4nc" podUID="fed9c17c-f689-4d9f-b52e-7ba52d04948f"
Jul 08 21:15:43.863617 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:43.863603    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:15:43.863698 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:43.863679    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5tkg" podUID="bcf041d9-9dcf-4edd-b480-dc0051905946"
Jul 08 21:15:43.890275 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:43.890237    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-138.ec2.internal" event={"ID":"e15bd876fdc5c28fde6928dbc5f32a53","Type":"ContainerStarted","Data":"d64fa94acc202459f8e4914e227590d15230608c8fbf580d54f05074b440a229"}
Jul 08 21:15:44.909072 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:44.909022    2571 generic.go:356] "Generic (PLEG): container finished" podID="0b3dfc5d808bbc14c9960d594b65bdf6" containerID="188ac1482b4e644435a45f672783ea3b3c26fd1ff82b8b5f96ddd86d044ecb5e" exitCode=0
Jul 08 21:15:44.910246 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:44.909813    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-138.ec2.internal" event={"ID":"0b3dfc5d808bbc14c9960d594b65bdf6","Type":"ContainerDied","Data":"188ac1482b4e644435a45f672783ea3b3c26fd1ff82b8b5f96ddd86d044ecb5e"}
Jul 08 21:15:44.926308 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:44.925221    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-138.ec2.internal" podStartSLOduration=4.925203853 podStartE2EDuration="4.925203853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:15:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:15:43.904686359 +0000 UTC m=+4.559589079" watchObservedRunningTime="2026-07-08 21:15:44.925203853 +0000 UTC m=+5.580106573"
Jul 08 21:15:45.386145 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:45.386110    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf041d9-9dcf-4edd-b480-dc0051905946-metrics-certs\") pod \"network-metrics-daemon-w5tkg\" (UID: \"bcf041d9-9dcf-4edd-b480-dc0051905946\") " pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:15:45.386334 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:45.386161    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fed9c17c-f689-4d9f-b52e-7ba52d04948f-original-pull-secret\") pod \"global-pull-secret-syncer-hk4nc\" (UID: \"fed9c17c-f689-4d9f-b52e-7ba52d04948f\") " pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:15:45.386334 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:45.386285    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:15:45.386467 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:45.386340    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fed9c17c-f689-4d9f-b52e-7ba52d04948f-original-pull-secret podName:fed9c17c-f689-4d9f-b52e-7ba52d04948f nodeName:}" failed. No retries permitted until 2026-07-08 21:15:49.386323303 +0000 UTC m=+10.041226003 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fed9c17c-f689-4d9f-b52e-7ba52d04948f-original-pull-secret") pod "global-pull-secret-syncer-hk4nc" (UID: "fed9c17c-f689-4d9f-b52e-7ba52d04948f") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:15:45.386467 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:45.386417    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:15:45.386467 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:45.386452    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf041d9-9dcf-4edd-b480-dc0051905946-metrics-certs podName:bcf041d9-9dcf-4edd-b480-dc0051905946 nodeName:}" failed. No retries permitted until 2026-07-08 21:15:49.386441329 +0000 UTC m=+10.041344026 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcf041d9-9dcf-4edd-b480-dc0051905946-metrics-certs") pod "network-metrics-daemon-w5tkg" (UID: "bcf041d9-9dcf-4edd-b480-dc0051905946") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:15:45.487070 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:45.486887    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhqgg\" (UniqueName: \"kubernetes.io/projected/f75b6b6b-23e7-4360-8c27-1c8d9add975e-kube-api-access-jhqgg\") pod \"network-check-target-tlc6m\" (UID: \"f75b6b6b-23e7-4360-8c27-1c8d9add975e\") " pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:15:45.487070 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:45.487070    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:15:45.487292 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:45.487093    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:15:45.487292 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:45.487107    2571 projected.go:196] Error preparing data for projected volume kube-api-access-jhqgg for pod openshift-network-diagnostics/network-check-target-tlc6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:15:45.487292 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:45.487165    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f75b6b6b-23e7-4360-8c27-1c8d9add975e-kube-api-access-jhqgg podName:f75b6b6b-23e7-4360-8c27-1c8d9add975e nodeName:}" failed. No retries permitted until 2026-07-08 21:15:49.487145573 +0000 UTC m=+10.142048272 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jhqgg" (UniqueName: "kubernetes.io/projected/f75b6b6b-23e7-4360-8c27-1c8d9add975e-kube-api-access-jhqgg") pod "network-check-target-tlc6m" (UID: "f75b6b6b-23e7-4360-8c27-1c8d9add975e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:15:45.861918 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:45.861883    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:15:45.862113 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:45.862022    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5tkg" podUID="bcf041d9-9dcf-4edd-b480-dc0051905946"
Jul 08 21:15:45.862419 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:45.862397    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:15:45.862513 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:45.862496    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlc6m" podUID="f75b6b6b-23e7-4360-8c27-1c8d9add975e"
Jul 08 21:15:45.862578 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:45.862553    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:15:45.862627 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:45.862613    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hk4nc" podUID="fed9c17c-f689-4d9f-b52e-7ba52d04948f"
Jul 08 21:15:47.861882 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:47.861850    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:15:47.861882 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:47.861866    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:15:47.862333 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:47.861975    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlc6m" podUID="f75b6b6b-23e7-4360-8c27-1c8d9add975e"
Jul 08 21:15:47.862333 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:47.862034    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hk4nc" podUID="fed9c17c-f689-4d9f-b52e-7ba52d04948f"
Jul 08 21:15:47.862333 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:47.862085    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:15:47.862333 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:47.862149    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5tkg" podUID="bcf041d9-9dcf-4edd-b480-dc0051905946"
Jul 08 21:15:49.420916 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:49.420874    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf041d9-9dcf-4edd-b480-dc0051905946-metrics-certs\") pod \"network-metrics-daemon-w5tkg\" (UID: \"bcf041d9-9dcf-4edd-b480-dc0051905946\") " pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:15:49.420916 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:49.420922    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fed9c17c-f689-4d9f-b52e-7ba52d04948f-original-pull-secret\") pod \"global-pull-secret-syncer-hk4nc\" (UID: \"fed9c17c-f689-4d9f-b52e-7ba52d04948f\") " pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:15:49.421386 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:49.421045    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:15:49.421386 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:49.421088    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:15:49.421386 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:49.421120    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf041d9-9dcf-4edd-b480-dc0051905946-metrics-certs podName:bcf041d9-9dcf-4edd-b480-dc0051905946 nodeName:}" failed. No retries permitted until 2026-07-08 21:15:57.421099495 +0000 UTC m=+18.076002207 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcf041d9-9dcf-4edd-b480-dc0051905946-metrics-certs") pod "network-metrics-daemon-w5tkg" (UID: "bcf041d9-9dcf-4edd-b480-dc0051905946") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:15:49.421386 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:49.421144    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fed9c17c-f689-4d9f-b52e-7ba52d04948f-original-pull-secret podName:fed9c17c-f689-4d9f-b52e-7ba52d04948f nodeName:}" failed. No retries permitted until 2026-07-08 21:15:57.421127476 +0000 UTC m=+18.076030176 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fed9c17c-f689-4d9f-b52e-7ba52d04948f-original-pull-secret") pod "global-pull-secret-syncer-hk4nc" (UID: "fed9c17c-f689-4d9f-b52e-7ba52d04948f") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:15:49.521533 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:49.521500    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhqgg\" (UniqueName: \"kubernetes.io/projected/f75b6b6b-23e7-4360-8c27-1c8d9add975e-kube-api-access-jhqgg\") pod \"network-check-target-tlc6m\" (UID: \"f75b6b6b-23e7-4360-8c27-1c8d9add975e\") " pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:15:49.521721 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:49.521683    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:15:49.521721 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:49.521709    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:15:49.521721 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:49.521718    2571 projected.go:196] Error preparing data for projected volume kube-api-access-jhqgg for pod openshift-network-diagnostics/network-check-target-tlc6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:15:49.521871 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:49.521792    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f75b6b6b-23e7-4360-8c27-1c8d9add975e-kube-api-access-jhqgg podName:f75b6b6b-23e7-4360-8c27-1c8d9add975e nodeName:}" failed. No retries permitted until 2026-07-08 21:15:57.521774822 +0000 UTC m=+18.176677523 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jhqgg" (UniqueName: "kubernetes.io/projected/f75b6b6b-23e7-4360-8c27-1c8d9add975e-kube-api-access-jhqgg") pod "network-check-target-tlc6m" (UID: "f75b6b6b-23e7-4360-8c27-1c8d9add975e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:15:49.862421 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:49.862345    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:15:49.862582 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:49.862446    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlc6m" podUID="f75b6b6b-23e7-4360-8c27-1c8d9add975e"
Jul 08 21:15:49.862844 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:49.862824    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:15:49.863013 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:49.862990    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5tkg" podUID="bcf041d9-9dcf-4edd-b480-dc0051905946"
Jul 08 21:15:49.863077 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:49.863056    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:15:49.863287 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:49.863127    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hk4nc" podUID="fed9c17c-f689-4d9f-b52e-7ba52d04948f"
Jul 08 21:15:51.862480 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:51.862344    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:15:51.863224 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:51.862788    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlc6m" podUID="f75b6b6b-23e7-4360-8c27-1c8d9add975e"
Jul 08 21:15:51.863224 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:51.862349    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:15:51.863224 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:51.862916    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5tkg" podUID="bcf041d9-9dcf-4edd-b480-dc0051905946"
Jul 08 21:15:51.863224 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:51.862349    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:15:51.866128 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:51.863377    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hk4nc" podUID="fed9c17c-f689-4d9f-b52e-7ba52d04948f"
Jul 08 21:15:53.861770 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:53.861561    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:15:53.862251 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:53.861564    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:15:53.862251 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:53.861650    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:15:53.862251 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:53.861932    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hk4nc" podUID="fed9c17c-f689-4d9f-b52e-7ba52d04948f"
Jul 08 21:15:53.862251 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:53.862137    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlc6m" podUID="f75b6b6b-23e7-4360-8c27-1c8d9add975e"
Jul 08 21:15:53.862479 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:53.862386    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5tkg" podUID="bcf041d9-9dcf-4edd-b480-dc0051905946"
Jul 08 21:15:53.933282 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:53.932906    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q6v7s" event={"ID":"13f8f143-b56b-41cc-b6d4-58330207e6d9","Type":"ContainerStarted","Data":"b61b91f22f25a4d0caad186d9f4d15044f6d27df0878f4585f5067af9ca99a32"}
Jul 08 21:15:53.936405 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:53.936367    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7hcjs" event={"ID":"4d0b8ac3-797f-4dfe-bf04-7aafe444c7f8","Type":"ContainerStarted","Data":"e2c83d0ea79b69a08c89c34b05fdffbbac59b281ac5f46166e75c4820cdcfb4e"}
Jul 08 21:15:53.938810 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:53.938779    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kwg77" event={"ID":"db7d97d7-b4b1-4c44-a4e8-be1d3590a217","Type":"ContainerStarted","Data":"cd266efb87a69c38aa80ffc4bd3d35106eeb5c16cf0488ccd7e25590503e8fc1"}
Jul 08 21:15:53.941002 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:53.940858    2571 generic.go:356] "Generic (PLEG): container finished" podID="e4b6b532-b51d-4685-b7d2-ddc06df5c56c" containerID="239ea02101cbced49327ecf677bb140a1eb5553160e20710146095159d6f3259" exitCode=0
Jul 08 21:15:53.941002 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:53.940944    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nq92z" event={"ID":"e4b6b532-b51d-4685-b7d2-ddc06df5c56c","Type":"ContainerDied","Data":"239ea02101cbced49327ecf677bb140a1eb5553160e20710146095159d6f3259"}
Jul 08 21:15:53.942899 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:53.942877    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lwvml" event={"ID":"b260a6a3-7539-4175-b668-a648e3b3a123","Type":"ContainerStarted","Data":"2b51598948a294a4f37b26071593e76de04ad8a85a4f2c0efee94521b4cc2d39"}
Jul 08 21:15:53.945186 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:53.945075    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28fp6" event={"ID":"41ce5641-ba26-475c-82e4-1d606f11a5dd","Type":"ContainerStarted","Data":"0424b9cc71b63bf52be59a3c01bddb9d6f133ebd19bb62262f4aabc04fec9305"}
Jul 08 21:15:53.947502 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:53.947113    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-q6v7s" podStartSLOduration=4.192612657 podStartE2EDuration="14.947096223s" totalImagesPullingTime="10.754483566s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:15:53.946433552 +0000 UTC m=+14.601336272" watchObservedRunningTime="2026-07-08 21:15:53.947096223 +0000 UTC m=+14.601998943"
Jul 08 21:15:53.948369 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:53.948346    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-138.ec2.internal" event={"ID":"0b3dfc5d808bbc14c9960d594b65bdf6","Type":"ContainerStarted","Data":"f8af36e6c960a0ff7a1114f16404523dc18564eef73a9eb6cbe6e09bee1908fa"}
Jul 08 21:15:53.961339 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:53.961289    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7hcjs" podStartSLOduration=4.015937018 podStartE2EDuration="14.961272708s" totalImagesPullingTime="10.94533569s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:15:53.961272795 +0000 UTC m=+14.616175515" watchObservedRunningTime="2026-07-08 21:15:53.961272708 +0000 UTC m=+14.616175419"
Jul 08 21:15:54.005151 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:54.005096    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kwg77" podStartSLOduration=3.268119701 podStartE2EDuration="14.005076436s" totalImagesPullingTime="10.736956735s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:15:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:15:54.003957833 +0000 UTC m=+14.658860550" watchObservedRunningTime="2026-07-08 21:15:54.005076436 +0000 UTC m=+14.659979158"
Jul 08 21:15:54.018056 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:54.018002    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lwvml" podStartSLOduration=4.253233623 podStartE2EDuration="15.017983951s" totalImagesPullingTime="10.764750328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:15:54.017595707 +0000 UTC m=+14.672498425" watchObservedRunningTime="2026-07-08 21:15:54.017983951 +0000 UTC m=+14.672886674"
Jul 08 21:15:54.031587 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:54.031546    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-138.ec2.internal" podStartSLOduration=14.031537088 podStartE2EDuration="14.031537088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:15:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:15:54.031272642 +0000 UTC m=+14.686175361" watchObservedRunningTime="2026-07-08 21:15:54.031537088 +0000 UTC m=+14.686439807"
Jul 08 21:15:54.122271 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:54.122188    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lwvml"
Jul 08 21:15:54.122808 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:54.122782    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lwvml"
Jul 08 21:15:54.952244 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:54.952210    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mb55f" event={"ID":"ddde1ed8-5f18-46d8-a25b-e18091943f8d","Type":"ContainerStarted","Data":"94d26172ab639ced02e8a3a87a923f4790f24731820aa54639d92c99c61cd257"}
Jul 08 21:15:54.966698 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:54.966654    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mb55f" podStartSLOduration=5.184058825 podStartE2EDuration="15.966634498s" totalImagesPullingTime="10.782575673s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:15:54.966599594 +0000 UTC m=+15.621502313" watchObservedRunningTime="2026-07-08 21:15:54.966634498 +0000 UTC m=+15.621537220"
Jul 08 21:15:55.041218 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:55.041180    2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 08 21:15:55.798609 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:55.798504    2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T21:15:55.041200607Z","UUID":"31c12e4a-6db3-44fb-9c4e-381c6ac0570f","Handler":null,"Name":"","Endpoint":""}
Jul 08 21:15:55.800147 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:55.800126    2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 08 21:15:55.800252 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:55.800170    2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 08 21:15:55.861844 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:55.861810    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:15:55.862003 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:55.861951    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5tkg" podUID="bcf041d9-9dcf-4edd-b480-dc0051905946"
Jul 08 21:15:55.862481 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:55.862265    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:15:55.862481 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:55.862362    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hk4nc" podUID="fed9c17c-f689-4d9f-b52e-7ba52d04948f"
Jul 08 21:15:55.862481 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:55.862391    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:15:55.862481 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:55.862441    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlc6m" podUID="f75b6b6b-23e7-4360-8c27-1c8d9add975e"
Jul 08 21:15:55.955695 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:55.955665    2571 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 08 21:15:55.956243 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:55.955665    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28fp6" event={"ID":"41ce5641-ba26-475c-82e4-1d606f11a5dd","Type":"ContainerStarted","Data":"695f9226bcb146cb0292b91d135941f8b7a932874b0f30682ac9f379c011b105"}
Jul 08 21:15:56.717768 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:56.717718    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lwvml"
Jul 08 21:15:56.718610 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:56.718480    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lwvml"
Jul 08 21:15:57.487551 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:57.487509    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf041d9-9dcf-4edd-b480-dc0051905946-metrics-certs\") pod \"network-metrics-daemon-w5tkg\" (UID: \"bcf041d9-9dcf-4edd-b480-dc0051905946\") " pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:15:57.487551 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:57.487555    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fed9c17c-f689-4d9f-b52e-7ba52d04948f-original-pull-secret\") pod \"global-pull-secret-syncer-hk4nc\" (UID: \"fed9c17c-f689-4d9f-b52e-7ba52d04948f\") " pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:15:57.488354 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:57.487684    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:15:57.488354 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:57.487690    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:15:57.488354 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:57.487766    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fed9c17c-f689-4d9f-b52e-7ba52d04948f-original-pull-secret podName:fed9c17c-f689-4d9f-b52e-7ba52d04948f nodeName:}" failed. No retries permitted until 2026-07-08 21:16:13.487729772 +0000 UTC m=+34.142632482 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fed9c17c-f689-4d9f-b52e-7ba52d04948f-original-pull-secret") pod "global-pull-secret-syncer-hk4nc" (UID: "fed9c17c-f689-4d9f-b52e-7ba52d04948f") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:15:57.488354 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:57.487785    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf041d9-9dcf-4edd-b480-dc0051905946-metrics-certs podName:bcf041d9-9dcf-4edd-b480-dc0051905946 nodeName:}" failed. No retries permitted until 2026-07-08 21:16:13.487776306 +0000 UTC m=+34.142679005 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcf041d9-9dcf-4edd-b480-dc0051905946-metrics-certs") pod "network-metrics-daemon-w5tkg" (UID: "bcf041d9-9dcf-4edd-b480-dc0051905946") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:15:57.588150 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:57.588110    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhqgg\" (UniqueName: \"kubernetes.io/projected/f75b6b6b-23e7-4360-8c27-1c8d9add975e-kube-api-access-jhqgg\") pod \"network-check-target-tlc6m\" (UID: \"f75b6b6b-23e7-4360-8c27-1c8d9add975e\") " pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:15:57.588328 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:57.588290    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:15:57.588328 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:57.588318    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:15:57.588433 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:57.588333    2571 projected.go:196] Error preparing data for projected volume kube-api-access-jhqgg for pod openshift-network-diagnostics/network-check-target-tlc6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:15:57.588433 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:57.588390    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f75b6b6b-23e7-4360-8c27-1c8d9add975e-kube-api-access-jhqgg podName:f75b6b6b-23e7-4360-8c27-1c8d9add975e nodeName:}" failed. No retries permitted until 2026-07-08 21:16:13.588377263 +0000 UTC m=+34.243279960 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jhqgg" (UniqueName: "kubernetes.io/projected/f75b6b6b-23e7-4360-8c27-1c8d9add975e-kube-api-access-jhqgg") pod "network-check-target-tlc6m" (UID: "f75b6b6b-23e7-4360-8c27-1c8d9add975e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:15:57.862126 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:57.862048    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:15:57.862126 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:57.862049    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:15:57.862126 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:57.862070    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:15:57.862386 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:57.862178    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hk4nc" podUID="fed9c17c-f689-4d9f-b52e-7ba52d04948f"
Jul 08 21:15:57.862386 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:57.862327    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlc6m" podUID="f75b6b6b-23e7-4360-8c27-1c8d9add975e"
Jul 08 21:15:57.862478 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:57.862406    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5tkg" podUID="bcf041d9-9dcf-4edd-b480-dc0051905946"
Jul 08 21:15:59.862741 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:59.862500    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:15:59.862741 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:59.862589    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:15:59.862741 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:15:59.862631    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:15:59.862741 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:59.862643    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hk4nc" podUID="fed9c17c-f689-4d9f-b52e-7ba52d04948f"
Jul 08 21:15:59.862741 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:59.862702    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlc6m" podUID="f75b6b6b-23e7-4360-8c27-1c8d9add975e"
Jul 08 21:15:59.863413 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:15:59.862826    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5tkg" podUID="bcf041d9-9dcf-4edd-b480-dc0051905946"
Jul 08 21:16:01.862371 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:01.862183    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:16:01.862911 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:01.862184    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:16:01.862911 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:01.862473    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hk4nc" podUID="fed9c17c-f689-4d9f-b52e-7ba52d04948f"
Jul 08 21:16:01.862911 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:01.862519    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlc6m" podUID="f75b6b6b-23e7-4360-8c27-1c8d9add975e"
Jul 08 21:16:01.862911 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:01.862217    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:16:01.862911 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:01.862670    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5tkg" podUID="bcf041d9-9dcf-4edd-b480-dc0051905946"
Jul 08 21:16:03.861783 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:03.861735    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:16:03.861783 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:03.861773    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:16:03.862241 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:03.861735    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:16:03.862241 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:03.861885    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlc6m" podUID="f75b6b6b-23e7-4360-8c27-1c8d9add975e"
Jul 08 21:16:03.862241 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:03.861966    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hk4nc" podUID="fed9c17c-f689-4d9f-b52e-7ba52d04948f"
Jul 08 21:16:03.862241 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:03.862098    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5tkg" podUID="bcf041d9-9dcf-4edd-b480-dc0051905946"
Jul 08 21:16:05.862430 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:05.862397    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:16:05.862882 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:05.862395    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:16:05.862882 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:05.862518    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5tkg" podUID="bcf041d9-9dcf-4edd-b480-dc0051905946"
Jul 08 21:16:05.862882 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:05.862406    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:16:05.862882 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:05.862570    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hk4nc" podUID="fed9c17c-f689-4d9f-b52e-7ba52d04948f"
Jul 08 21:16:05.862882 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:05.862659    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlc6m" podUID="f75b6b6b-23e7-4360-8c27-1c8d9add975e"
Jul 08 21:16:06.977588 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:06.977422    2571 generic.go:356] "Generic (PLEG): container finished" podID="e4b6b532-b51d-4685-b7d2-ddc06df5c56c" containerID="0c6c4ad809feb929df5f7fa5104d3ce8251350deff3c8ed66eef250745eee406" exitCode=0
Jul 08 21:16:06.978051 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:06.977507    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nq92z" event={"ID":"e4b6b532-b51d-4685-b7d2-ddc06df5c56c","Type":"ContainerDied","Data":"0c6c4ad809feb929df5f7fa5104d3ce8251350deff3c8ed66eef250745eee406"}
Jul 08 21:16:06.979649 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:06.979625    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2dxpp" event={"ID":"1180d3c1-505c-468f-81bf-81224aac85b1","Type":"ContainerStarted","Data":"342d89da72036272ced568cdf9395916d79a031f3d06cb0c4111978267cbbd4a"}
Jul 08 21:16:06.982022 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:06.981998    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28fp6" event={"ID":"41ce5641-ba26-475c-82e4-1d606f11a5dd","Type":"ContainerStarted","Data":"a1505749cad233b9d01f174a7d046ed38e95fbdc767f876f84c4a6ce3832ddfa"}
Jul 08 21:16:06.985448 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:06.985423    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm" event={"ID":"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf","Type":"ContainerStarted","Data":"58e10df4b186a2edba7678fb31648cd923821bb096fa9756caf09ced938c53a2"}
Jul 08 21:16:06.985549 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:06.985488    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm" event={"ID":"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf","Type":"ContainerStarted","Data":"bf4cadd8f4491715c1b31ce24567fa08620eb0d017bc615ec2ec1374aaa4ab3f"}
Jul 08 21:16:06.985549 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:06.985524    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm" event={"ID":"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf","Type":"ContainerStarted","Data":"c3b53116330474d7f322309303110b63aa157e6fd4fd25cb68b2f82f2dd254e6"}
Jul 08 21:16:06.985651 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:06.985561    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm" event={"ID":"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf","Type":"ContainerStarted","Data":"2ab8e671bbe8041ec218af46a0e123d67ecf7e52f53fb5d4c112f75719f308b1"}
Jul 08 21:16:06.985651 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:06.985596    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm" event={"ID":"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf","Type":"ContainerStarted","Data":"f1cefb6e6b7fe6f37b1ceb47ca6ae31a49ea2801fa329bfb336af6b9e617def2"}
Jul 08 21:16:06.985651 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:06.985625    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm" event={"ID":"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf","Type":"ContainerStarted","Data":"2039ae3e0db03bf0ecd1b5926cb06ec7e99056568d154269d0e325452ca9b249"}
Jul 08 21:16:07.032521 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:07.032472    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28fp6" podStartSLOduration=4.153059507 podStartE2EDuration="28.032458605s" totalImagesPullingTime="23.879399098s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:15:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:16:07.032313729 +0000 UTC m=+27.687216447" watchObservedRunningTime="2026-07-08 21:16:07.032458605 +0000 UTC m=+27.687361357"
Jul 08 21:16:07.032692 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:07.032622    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2dxpp" podStartSLOduration=3.951688317 podStartE2EDuration="28.032614664s" totalImagesPullingTime="24.080926347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:16:07.016657913 +0000 UTC m=+27.671560632" watchObservedRunningTime="2026-07-08 21:16:07.032614664 +0000 UTC m=+27.687517385"
Jul 08 21:16:07.862224 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:07.862192    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:16:07.862436 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:07.862192    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:16:07.862436 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:07.862314    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5tkg" podUID="bcf041d9-9dcf-4edd-b480-dc0051905946"
Jul 08 21:16:07.862436 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:07.862197    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:16:07.862538 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:07.862455    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlc6m" podUID="f75b6b6b-23e7-4360-8c27-1c8d9add975e"
Jul 08 21:16:07.862652 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:07.862548    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hk4nc" podUID="fed9c17c-f689-4d9f-b52e-7ba52d04948f"
Jul 08 21:16:08.991630 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:08.991597    2571 generic.go:356] "Generic (PLEG): container finished" podID="e4b6b532-b51d-4685-b7d2-ddc06df5c56c" containerID="4e7dcefca84f30e8cd95e63ef198282f52c682dbf29fc44ba5832ca0debf6d20" exitCode=0
Jul 08 21:16:08.992298 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:08.991651    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nq92z" event={"ID":"e4b6b532-b51d-4685-b7d2-ddc06df5c56c","Type":"ContainerDied","Data":"4e7dcefca84f30e8cd95e63ef198282f52c682dbf29fc44ba5832ca0debf6d20"}
Jul 08 21:16:09.862461 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:09.862426    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:16:09.862633 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:09.862518    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlc6m" podUID="f75b6b6b-23e7-4360-8c27-1c8d9add975e"
Jul 08 21:16:09.862633 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:09.862608    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:16:09.862739 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:09.862701    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5tkg" podUID="bcf041d9-9dcf-4edd-b480-dc0051905946"
Jul 08 21:16:09.862802 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:09.862779    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:16:09.862870 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:09.862851    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hk4nc" podUID="fed9c17c-f689-4d9f-b52e-7ba52d04948f"
Jul 08 21:16:09.996509 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:09.996476    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm" event={"ID":"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf","Type":"ContainerStarted","Data":"4961afd951c8fd0ca9a1e65ad432b44e8c47573a199489e062ed599f2d446c8d"}
Jul 08 21:16:11.000455 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:11.000420    2571 generic.go:356] "Generic (PLEG): container finished" podID="e4b6b532-b51d-4685-b7d2-ddc06df5c56c" containerID="31c8244ad986619e096a8c2ec1a572996b69ae1f91a1254c1d4840a68db17e1c" exitCode=0
Jul 08 21:16:11.000975 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:11.000485    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nq92z" event={"ID":"e4b6b532-b51d-4685-b7d2-ddc06df5c56c","Type":"ContainerDied","Data":"31c8244ad986619e096a8c2ec1a572996b69ae1f91a1254c1d4840a68db17e1c"}
Jul 08 21:16:11.862210 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:11.861965    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:16:11.862413 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:11.861963    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:16:11.862413 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:11.862314    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hk4nc" podUID="fed9c17c-f689-4d9f-b52e-7ba52d04948f"
Jul 08 21:16:11.862413 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:11.861970    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:16:11.862413 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:11.862395    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlc6m" podUID="f75b6b6b-23e7-4360-8c27-1c8d9add975e"
Jul 08 21:16:11.862614 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:11.862460    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5tkg" podUID="bcf041d9-9dcf-4edd-b480-dc0051905946"
Jul 08 21:16:12.005673 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:12.005645    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm" event={"ID":"6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf","Type":"ContainerStarted","Data":"b78319bca0c5f110eaf93621256de8ed340f3cd3787305040d6454001e6f9492"}
Jul 08 21:16:12.006107 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:12.005978    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:16:12.006107 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:12.006047    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:16:12.021816 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:12.021793    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:16:12.031657 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:12.031623    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm" podStartSLOduration=8.945500385 podStartE2EDuration="33.031612685s" totalImagesPullingTime="24.0861123s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:16:12.029719925 +0000 UTC m=+32.684622656" watchObservedRunningTime="2026-07-08 21:16:12.031612685 +0000 UTC m=+32.686515417"
Jul 08 21:16:13.008831 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:13.008785    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:16:13.026151 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:13.026122    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:16:13.304078 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:13.303998    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hk4nc"]
Jul 08 21:16:13.304215 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:13.304093    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:16:13.304215 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:13.304174    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hk4nc" podUID="fed9c17c-f689-4d9f-b52e-7ba52d04948f"
Jul 08 21:16:13.310880 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:13.310810    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tlc6m"]
Jul 08 21:16:13.311032 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:13.311015    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:16:13.311217 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:13.311187    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlc6m" podUID="f75b6b6b-23e7-4360-8c27-1c8d9add975e"
Jul 08 21:16:13.311969 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:13.311943    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w5tkg"]
Jul 08 21:16:13.312066 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:13.312047    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:16:13.312137 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:13.312121    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5tkg" podUID="bcf041d9-9dcf-4edd-b480-dc0051905946"
Jul 08 21:16:13.512528 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:13.512495    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf041d9-9dcf-4edd-b480-dc0051905946-metrics-certs\") pod \"network-metrics-daemon-w5tkg\" (UID: \"bcf041d9-9dcf-4edd-b480-dc0051905946\") " pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:16:13.512528 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:13.512532    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fed9c17c-f689-4d9f-b52e-7ba52d04948f-original-pull-secret\") pod \"global-pull-secret-syncer-hk4nc\" (UID: \"fed9c17c-f689-4d9f-b52e-7ba52d04948f\") " pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:16:13.512774 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:13.512635    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:16:13.512774 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:13.512655    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:16:13.512774 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:13.512686    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fed9c17c-f689-4d9f-b52e-7ba52d04948f-original-pull-secret podName:fed9c17c-f689-4d9f-b52e-7ba52d04948f nodeName:}" failed. No retries permitted until 2026-07-08 21:16:45.512673289 +0000 UTC m=+66.167575986 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fed9c17c-f689-4d9f-b52e-7ba52d04948f-original-pull-secret") pod "global-pull-secret-syncer-hk4nc" (UID: "fed9c17c-f689-4d9f-b52e-7ba52d04948f") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:16:13.512774 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:13.512717    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf041d9-9dcf-4edd-b480-dc0051905946-metrics-certs podName:bcf041d9-9dcf-4edd-b480-dc0051905946 nodeName:}" failed. No retries permitted until 2026-07-08 21:16:45.512698927 +0000 UTC m=+66.167601639 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcf041d9-9dcf-4edd-b480-dc0051905946-metrics-certs") pod "network-metrics-daemon-w5tkg" (UID: "bcf041d9-9dcf-4edd-b480-dc0051905946") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:16:13.613971 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:13.613888    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhqgg\" (UniqueName: \"kubernetes.io/projected/f75b6b6b-23e7-4360-8c27-1c8d9add975e-kube-api-access-jhqgg\") pod \"network-check-target-tlc6m\" (UID: \"f75b6b6b-23e7-4360-8c27-1c8d9add975e\") " pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:16:13.614105 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:13.614071    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:16:13.614105 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:13.614095    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:16:13.614105 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:13.614109    2571 projected.go:196] Error preparing data for projected volume kube-api-access-jhqgg for pod openshift-network-diagnostics/network-check-target-tlc6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:16:13.614257 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:13.614174    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f75b6b6b-23e7-4360-8c27-1c8d9add975e-kube-api-access-jhqgg podName:f75b6b6b-23e7-4360-8c27-1c8d9add975e nodeName:}" failed. No retries permitted until 2026-07-08 21:16:45.614154733 +0000 UTC m=+66.269057432 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jhqgg" (UniqueName: "kubernetes.io/projected/f75b6b6b-23e7-4360-8c27-1c8d9add975e-kube-api-access-jhqgg") pod "network-check-target-tlc6m" (UID: "f75b6b6b-23e7-4360-8c27-1c8d9add975e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:16:14.861591 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:14.861559    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:16:14.861591 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:14.861578    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:16:14.862192 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:14.861560    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:16:14.862192 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:14.861694    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5tkg" podUID="bcf041d9-9dcf-4edd-b480-dc0051905946"
Jul 08 21:16:14.862192 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:14.861788    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlc6m" podUID="f75b6b6b-23e7-4360-8c27-1c8d9add975e"
Jul 08 21:16:14.862192 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:14.861843    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hk4nc" podUID="fed9c17c-f689-4d9f-b52e-7ba52d04948f"
Jul 08 21:16:16.862195 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:16.862162    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:16:16.862631 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:16.862281    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hk4nc" podUID="fed9c17c-f689-4d9f-b52e-7ba52d04948f"
Jul 08 21:16:16.862631 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:16.862311    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:16:16.862631 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:16.862311    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:16:16.862631 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:16.862417    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5tkg" podUID="bcf041d9-9dcf-4edd-b480-dc0051905946"
Jul 08 21:16:16.862631 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:16.862531    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlc6m" podUID="f75b6b6b-23e7-4360-8c27-1c8d9add975e"
Jul 08 21:16:18.861990 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:18.861816    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:16:18.862441 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:18.861853    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:16:18.862441 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:18.862063    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5tkg" podUID="bcf041d9-9dcf-4edd-b480-dc0051905946"
Jul 08 21:16:18.862441 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:18.861853    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:16:18.862441 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:18.862130    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tlc6m" podUID="f75b6b6b-23e7-4360-8c27-1c8d9add975e"
Jul 08 21:16:18.862441 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:18.862185    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hk4nc" podUID="fed9c17c-f689-4d9f-b52e-7ba52d04948f"
Jul 08 21:16:19.025428 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:19.025391    2571 generic.go:356] "Generic (PLEG): container finished" podID="e4b6b532-b51d-4685-b7d2-ddc06df5c56c" containerID="5165cfd081e66a42433c87fc02f220a236ceed033f01da16d00b14ed75fb4a2c" exitCode=0
Jul 08 21:16:19.025581 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:19.025462    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nq92z" event={"ID":"e4b6b532-b51d-4685-b7d2-ddc06df5c56c","Type":"ContainerDied","Data":"5165cfd081e66a42433c87fc02f220a236ceed033f01da16d00b14ed75fb4a2c"}
Jul 08 21:16:20.030247 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.030214    2571 generic.go:356] "Generic (PLEG): container finished" podID="e4b6b532-b51d-4685-b7d2-ddc06df5c56c" containerID="70349011ffdd7bd5c4c0628c17f58f00c90c2c6dca177395323aafaeb899c212" exitCode=0
Jul 08 21:16:20.030805 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.030256    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nq92z" event={"ID":"e4b6b532-b51d-4685-b7d2-ddc06df5c56c","Type":"ContainerDied","Data":"70349011ffdd7bd5c4c0628c17f58f00c90c2c6dca177395323aafaeb899c212"}
Jul 08 21:16:20.146597 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.146575    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-138.ec2.internal" event="NodeReady"
Jul 08 21:16:20.146763 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.146735    2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 08 21:16:20.192808 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.192780    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-27wfb"]
Jul 08 21:16:20.221918 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.220525    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8v56v"]
Jul 08 21:16:20.221918 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.220810    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-27wfb"
Jul 08 21:16:20.226456 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.224573    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m6rnx\""
Jul 08 21:16:20.229215 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.226650    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 08 21:16:20.229215 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.226904    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 08 21:16:20.238425 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.238405    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-27wfb"]
Jul 08 21:16:20.238539 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.238439    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8v56v"]
Jul 08 21:16:20.238612 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.238538    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8v56v"
Jul 08 21:16:20.241085 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.241063    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 08 21:16:20.241184 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.241091    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 08 21:16:20.241184 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.241173    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 08 21:16:20.241327 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.241314    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5ltz8\""
Jul 08 21:16:20.360986 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.360906    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h66v\" (UniqueName: \"kubernetes.io/projected/05b59558-56ed-4741-ac0f-2911399956a1-kube-api-access-5h66v\") pod \"ingress-canary-8v56v\" (UID: \"05b59558-56ed-4741-ac0f-2911399956a1\") " pod="openshift-ingress-canary/ingress-canary-8v56v"
Jul 08 21:16:20.360986 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.360947    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-metrics-tls\") pod \"dns-default-27wfb\" (UID: \"f9d47a6b-4d3c-42ba-8965-67b29cfaad5e\") " pod="openshift-dns/dns-default-27wfb"
Jul 08 21:16:20.360986 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.360969    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbkr2\" (UniqueName: \"kubernetes.io/projected/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-kube-api-access-qbkr2\") pod \"dns-default-27wfb\" (UID: \"f9d47a6b-4d3c-42ba-8965-67b29cfaad5e\") " pod="openshift-dns/dns-default-27wfb"
Jul 08 21:16:20.361205 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.361000    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-config-volume\") pod \"dns-default-27wfb\" (UID: \"f9d47a6b-4d3c-42ba-8965-67b29cfaad5e\") " pod="openshift-dns/dns-default-27wfb"
Jul 08 21:16:20.361205 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.361033    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-tmp-dir\") pod \"dns-default-27wfb\" (UID: \"f9d47a6b-4d3c-42ba-8965-67b29cfaad5e\") " pod="openshift-dns/dns-default-27wfb"
Jul 08 21:16:20.361205 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.361058    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05b59558-56ed-4741-ac0f-2911399956a1-cert\") pod \"ingress-canary-8v56v\" (UID: \"05b59558-56ed-4741-ac0f-2911399956a1\") " pod="openshift-ingress-canary/ingress-canary-8v56v"
Jul 08 21:16:20.461720 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.461696    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-config-volume\") pod \"dns-default-27wfb\" (UID: \"f9d47a6b-4d3c-42ba-8965-67b29cfaad5e\") " pod="openshift-dns/dns-default-27wfb"
Jul 08 21:16:20.461832 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.461725    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-tmp-dir\") pod \"dns-default-27wfb\" (UID: \"f9d47a6b-4d3c-42ba-8965-67b29cfaad5e\") " pod="openshift-dns/dns-default-27wfb"
Jul 08 21:16:20.461832 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.461742    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05b59558-56ed-4741-ac0f-2911399956a1-cert\") pod \"ingress-canary-8v56v\" (UID: \"05b59558-56ed-4741-ac0f-2911399956a1\") " pod="openshift-ingress-canary/ingress-canary-8v56v"
Jul 08 21:16:20.461832 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.461816    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h66v\" (UniqueName: \"kubernetes.io/projected/05b59558-56ed-4741-ac0f-2911399956a1-kube-api-access-5h66v\") pod \"ingress-canary-8v56v\" (UID: \"05b59558-56ed-4741-ac0f-2911399956a1\") " pod="openshift-ingress-canary/ingress-canary-8v56v"
Jul 08 21:16:20.461968 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.461834    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-metrics-tls\") pod \"dns-default-27wfb\" (UID: \"f9d47a6b-4d3c-42ba-8965-67b29cfaad5e\") " pod="openshift-dns/dns-default-27wfb"
Jul 08 21:16:20.461968 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.461849    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbkr2\" (UniqueName: \"kubernetes.io/projected/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-kube-api-access-qbkr2\") pod \"dns-default-27wfb\" (UID: \"f9d47a6b-4d3c-42ba-8965-67b29cfaad5e\") " pod="openshift-dns/dns-default-27wfb"
Jul 08 21:16:20.461968 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:20.461955    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:16:20.462110 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:20.462032    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-metrics-tls podName:f9d47a6b-4d3c-42ba-8965-67b29cfaad5e nodeName:}" failed. No retries permitted until 2026-07-08 21:16:20.962012184 +0000 UTC m=+41.616914882 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-metrics-tls") pod "dns-default-27wfb" (UID: "f9d47a6b-4d3c-42ba-8965-67b29cfaad5e") : secret "dns-default-metrics-tls" not found
Jul 08 21:16:20.462110 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.462091    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-tmp-dir\") pod \"dns-default-27wfb\" (UID: \"f9d47a6b-4d3c-42ba-8965-67b29cfaad5e\") " pod="openshift-dns/dns-default-27wfb"
Jul 08 21:16:20.462388 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.462366    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-config-volume\") pod \"dns-default-27wfb\" (UID: \"f9d47a6b-4d3c-42ba-8965-67b29cfaad5e\") " pod="openshift-dns/dns-default-27wfb"
Jul 08 21:16:20.466002 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.465985    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05b59558-56ed-4741-ac0f-2911399956a1-cert\") pod \"ingress-canary-8v56v\" (UID: \"05b59558-56ed-4741-ac0f-2911399956a1\") " pod="openshift-ingress-canary/ingress-canary-8v56v"
Jul 08 21:16:20.470103 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.470084    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbkr2\" (UniqueName: \"kubernetes.io/projected/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-kube-api-access-qbkr2\") pod \"dns-default-27wfb\" (UID: \"f9d47a6b-4d3c-42ba-8965-67b29cfaad5e\") " pod="openshift-dns/dns-default-27wfb"
Jul 08 21:16:20.470323 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.470304    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h66v\" (UniqueName: \"kubernetes.io/projected/05b59558-56ed-4741-ac0f-2911399956a1-kube-api-access-5h66v\") pod \"ingress-canary-8v56v\" (UID: \"05b59558-56ed-4741-ac0f-2911399956a1\") " pod="openshift-ingress-canary/ingress-canary-8v56v"
Jul 08 21:16:20.546181 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.546154    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8v56v"
Jul 08 21:16:20.749517 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.749343    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8v56v"]
Jul 08 21:16:20.753375 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:16:20.753351    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05b59558_56ed_4741_ac0f_2911399956a1.slice/crio-95e296dfd4fac99b5a98f5cef7125f43268f3d907d5684ddad2c3aa978b105c5 WatchSource:0}: Error finding container 95e296dfd4fac99b5a98f5cef7125f43268f3d907d5684ddad2c3aa978b105c5: Status 404 returned error can't find the container with id 95e296dfd4fac99b5a98f5cef7125f43268f3d907d5684ddad2c3aa978b105c5
Jul 08 21:16:20.861583 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.861552    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:16:20.861733 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.861552    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:16:20.861733 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.861670    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:16:20.864147 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.864131    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 21:16:20.864147 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.864141    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nffz7\""
Jul 08 21:16:20.865427 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.865409    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 21:16:20.865521 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.865416    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 21:16:20.865521 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.865441    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9bpbv\""
Jul 08 21:16:20.865521 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.865460    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 21:16:20.965257 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:20.965168    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-metrics-tls\") pod \"dns-default-27wfb\" (UID: \"f9d47a6b-4d3c-42ba-8965-67b29cfaad5e\") " pod="openshift-dns/dns-default-27wfb"
Jul 08 21:16:20.965363 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:20.965267    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:16:20.965363 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:20.965318    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-metrics-tls podName:f9d47a6b-4d3c-42ba-8965-67b29cfaad5e nodeName:}" failed. No retries permitted until 2026-07-08 21:16:21.965303612 +0000 UTC m=+42.620206309 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-metrics-tls") pod "dns-default-27wfb" (UID: "f9d47a6b-4d3c-42ba-8965-67b29cfaad5e") : secret "dns-default-metrics-tls" not found
Jul 08 21:16:21.038548 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:21.038510    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nq92z" event={"ID":"e4b6b532-b51d-4685-b7d2-ddc06df5c56c","Type":"ContainerStarted","Data":"4c2b333e0ac7cd20854508840468eaf97afa63ab732e2b2d383bb129cdf130d5"}
Jul 08 21:16:21.039646 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:21.039621    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8v56v" event={"ID":"05b59558-56ed-4741-ac0f-2911399956a1","Type":"ContainerStarted","Data":"95e296dfd4fac99b5a98f5cef7125f43268f3d907d5684ddad2c3aa978b105c5"}
Jul 08 21:16:21.059229 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:21.059168    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nq92z" podStartSLOduration=9.424581096 podStartE2EDuration="42.059150685s" totalImagesPullingTime="32.634569589s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:15:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:16:21.05781606 +0000 UTC m=+41.712718779" watchObservedRunningTime="2026-07-08 21:16:21.059150685 +0000 UTC m=+41.714053406"
Jul 08 21:16:21.970944 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:21.970908    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-metrics-tls\") pod \"dns-default-27wfb\" (UID: \"f9d47a6b-4d3c-42ba-8965-67b29cfaad5e\") " pod="openshift-dns/dns-default-27wfb"
Jul 08 21:16:21.971171 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:21.971073    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:16:21.971171 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:21.971147    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-metrics-tls podName:f9d47a6b-4d3c-42ba-8965-67b29cfaad5e nodeName:}" failed. No retries permitted until 2026-07-08 21:16:23.971126892 +0000 UTC m=+44.626029591 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-metrics-tls") pod "dns-default-27wfb" (UID: "f9d47a6b-4d3c-42ba-8965-67b29cfaad5e") : secret "dns-default-metrics-tls" not found
Jul 08 21:16:23.986713 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:23.986625    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-metrics-tls\") pod \"dns-default-27wfb\" (UID: \"f9d47a6b-4d3c-42ba-8965-67b29cfaad5e\") " pod="openshift-dns/dns-default-27wfb"
Jul 08 21:16:23.987089 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:23.986769    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:16:23.987089 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:23.986821    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-metrics-tls podName:f9d47a6b-4d3c-42ba-8965-67b29cfaad5e nodeName:}" failed. No retries permitted until 2026-07-08 21:16:27.986807265 +0000 UTC m=+48.641709962 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-metrics-tls") pod "dns-default-27wfb" (UID: "f9d47a6b-4d3c-42ba-8965-67b29cfaad5e") : secret "dns-default-metrics-tls" not found
Jul 08 21:16:24.048984 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:24.048949    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8v56v" event={"ID":"05b59558-56ed-4741-ac0f-2911399956a1","Type":"ContainerStarted","Data":"f880453047b74b2812e837d22a3839a93dd22eec77ca81d5e89dfe484c9b88da"}
Jul 08 21:16:24.064899 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:24.064851    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8v56v" podStartSLOduration=1.082839323 podStartE2EDuration="4.064835519s" totalImagesPullingTime="2.981996196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:16:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:16:24.064088431 +0000 UTC m=+44.718991150" watchObservedRunningTime="2026-07-08 21:16:24.064835519 +0000 UTC m=+44.719738238"
Jul 08 21:16:28.011475 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:28.011435    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-metrics-tls\") pod \"dns-default-27wfb\" (UID: \"f9d47a6b-4d3c-42ba-8965-67b29cfaad5e\") " pod="openshift-dns/dns-default-27wfb"
Jul 08 21:16:28.011865 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:28.011552    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:16:28.011865 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:28.011611    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-metrics-tls podName:f9d47a6b-4d3c-42ba-8965-67b29cfaad5e nodeName:}" failed. No retries permitted until 2026-07-08 21:16:36.011594556 +0000 UTC m=+56.666497259 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-metrics-tls") pod "dns-default-27wfb" (UID: "f9d47a6b-4d3c-42ba-8965-67b29cfaad5e") : secret "dns-default-metrics-tls" not found
Jul 08 21:16:36.068448 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:36.068407    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-metrics-tls\") pod \"dns-default-27wfb\" (UID: \"f9d47a6b-4d3c-42ba-8965-67b29cfaad5e\") " pod="openshift-dns/dns-default-27wfb"
Jul 08 21:16:36.069002 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:36.068524    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:16:36.069002 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:36.068585    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-metrics-tls podName:f9d47a6b-4d3c-42ba-8965-67b29cfaad5e nodeName:}" failed. No retries permitted until 2026-07-08 21:16:52.068570255 +0000 UTC m=+72.723472951 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-metrics-tls") pod "dns-default-27wfb" (UID: "f9d47a6b-4d3c-42ba-8965-67b29cfaad5e") : secret "dns-default-metrics-tls" not found
Jul 08 21:16:40.927106 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:40.927077    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt"]
Jul 08 21:16:40.929590 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:40.929573    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm"]
Jul 08 21:16:40.929719 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:40.929698    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt"
Jul 08 21:16:40.931660 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:40.931640    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm"
Jul 08 21:16:40.932281 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:40.932259    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 08 21:16:40.932392 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:40.932303    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 08 21:16:40.932392 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:40.932332    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 08 21:16:40.932392 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:40.932346    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 08 21:16:40.932392 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:40.932357    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 08 21:16:40.933233 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:40.933214    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 08 21:16:40.933352 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:40.933300    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 08 21:16:40.933763 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:40.933735    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 08 21:16:40.938865 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:40.938847    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm"]
Jul 08 21:16:40.941898 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:40.941881    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt"]
Jul 08 21:16:40.999182 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:40.999154    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c5ae5ff2-3f4b-4db3-a41f-0adf81c103db-ca\") pod \"cluster-proxy-proxy-agent-6bd8c97cd-sfpqt\" (UID: \"c5ae5ff2-3f4b-4db3-a41f-0adf81c103db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt"
Jul 08 21:16:40.999182 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:40.999180    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c5ae5ff2-3f4b-4db3-a41f-0adf81c103db-hub\") pod \"cluster-proxy-proxy-agent-6bd8c97cd-sfpqt\" (UID: \"c5ae5ff2-3f4b-4db3-a41f-0adf81c103db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt"
Jul 08 21:16:40.999345 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:40.999199    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfvtv\" (UniqueName: \"kubernetes.io/projected/c5ae5ff2-3f4b-4db3-a41f-0adf81c103db-kube-api-access-jfvtv\") pod \"cluster-proxy-proxy-agent-6bd8c97cd-sfpqt\" (UID: \"c5ae5ff2-3f4b-4db3-a41f-0adf81c103db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt"
Jul 08 21:16:40.999345 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:40.999249    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c5ae5ff2-3f4b-4db3-a41f-0adf81c103db-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6bd8c97cd-sfpqt\" (UID: \"c5ae5ff2-3f4b-4db3-a41f-0adf81c103db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt"
Jul 08 21:16:40.999345 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:40.999276    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5ae5ff2-3f4b-4db3-a41f-0adf81c103db-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6bd8c97cd-sfpqt\" (UID: \"c5ae5ff2-3f4b-4db3-a41f-0adf81c103db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt"
Jul 08 21:16:40.999345 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:40.999291    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33f6b6b8-8e71-4b71-9a0b-2fe2d231a118-tmp\") pod \"klusterlet-addon-workmgr-8589b6c9f8-tphtm\" (UID: \"33f6b6b8-8e71-4b71-9a0b-2fe2d231a118\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm"
Jul 08 21:16:40.999345 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:40.999319    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5ae5ff2-3f4b-4db3-a41f-0adf81c103db-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6bd8c97cd-sfpqt\" (UID: \"c5ae5ff2-3f4b-4db3-a41f-0adf81c103db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt"
Jul 08 21:16:40.999502 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:40.999357    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9llh4\" (UniqueName: \"kubernetes.io/projected/33f6b6b8-8e71-4b71-9a0b-2fe2d231a118-kube-api-access-9llh4\") pod \"klusterlet-addon-workmgr-8589b6c9f8-tphtm\" (UID: \"33f6b6b8-8e71-4b71-9a0b-2fe2d231a118\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm"
Jul 08 21:16:40.999502 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:40.999394    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/33f6b6b8-8e71-4b71-9a0b-2fe2d231a118-klusterlet-config\") pod \"klusterlet-addon-workmgr-8589b6c9f8-tphtm\" (UID: \"33f6b6b8-8e71-4b71-9a0b-2fe2d231a118\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm"
Jul 08 21:16:41.100038 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:41.100008    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5ae5ff2-3f4b-4db3-a41f-0adf81c103db-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6bd8c97cd-sfpqt\" (UID: \"c5ae5ff2-3f4b-4db3-a41f-0adf81c103db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt"
Jul 08 21:16:41.100038 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:41.100040    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9llh4\" (UniqueName: \"kubernetes.io/projected/33f6b6b8-8e71-4b71-9a0b-2fe2d231a118-kube-api-access-9llh4\") pod \"klusterlet-addon-workmgr-8589b6c9f8-tphtm\" (UID: \"33f6b6b8-8e71-4b71-9a0b-2fe2d231a118\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm"
Jul 08 21:16:41.100217 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:41.100078    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/33f6b6b8-8e71-4b71-9a0b-2fe2d231a118-klusterlet-config\") pod \"klusterlet-addon-workmgr-8589b6c9f8-tphtm\" (UID: \"33f6b6b8-8e71-4b71-9a0b-2fe2d231a118\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm"
Jul 08 21:16:41.100275 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:41.100253    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c5ae5ff2-3f4b-4db3-a41f-0adf81c103db-ca\") pod \"cluster-proxy-proxy-agent-6bd8c97cd-sfpqt\" (UID: \"c5ae5ff2-3f4b-4db3-a41f-0adf81c103db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt"
Jul 08 21:16:41.100314 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:41.100291    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c5ae5ff2-3f4b-4db3-a41f-0adf81c103db-hub\") pod \"cluster-proxy-proxy-agent-6bd8c97cd-sfpqt\" (UID: \"c5ae5ff2-3f4b-4db3-a41f-0adf81c103db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt"
Jul 08 21:16:41.100362 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:41.100320    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfvtv\" (UniqueName: \"kubernetes.io/projected/c5ae5ff2-3f4b-4db3-a41f-0adf81c103db-kube-api-access-jfvtv\") pod \"cluster-proxy-proxy-agent-6bd8c97cd-sfpqt\" (UID: \"c5ae5ff2-3f4b-4db3-a41f-0adf81c103db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt"
Jul 08 21:16:41.100470 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:41.100372    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c5ae5ff2-3f4b-4db3-a41f-0adf81c103db-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6bd8c97cd-sfpqt\" (UID: \"c5ae5ff2-3f4b-4db3-a41f-0adf81c103db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt"
Jul 08 21:16:41.100470 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:41.100389    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5ae5ff2-3f4b-4db3-a41f-0adf81c103db-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6bd8c97cd-sfpqt\" (UID: \"c5ae5ff2-3f4b-4db3-a41f-0adf81c103db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt"
Jul 08 21:16:41.100470 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:41.100413    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33f6b6b8-8e71-4b71-9a0b-2fe2d231a118-tmp\") pod \"klusterlet-addon-workmgr-8589b6c9f8-tphtm\" (UID: \"33f6b6b8-8e71-4b71-9a0b-2fe2d231a118\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm"
Jul 08 21:16:41.100820 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:41.100789    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5ae5ff2-3f4b-4db3-a41f-0adf81c103db-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6bd8c97cd-sfpqt\" (UID: \"c5ae5ff2-3f4b-4db3-a41f-0adf81c103db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt"
Jul 08 21:16:41.100820 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:41.100813    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33f6b6b8-8e71-4b71-9a0b-2fe2d231a118-tmp\") pod \"klusterlet-addon-workmgr-8589b6c9f8-tphtm\" (UID: \"33f6b6b8-8e71-4b71-9a0b-2fe2d231a118\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm"
Jul 08 21:16:41.104376 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:41.104342    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c5ae5ff2-3f4b-4db3-a41f-0adf81c103db-hub\") pod \"cluster-proxy-proxy-agent-6bd8c97cd-sfpqt\" (UID: \"c5ae5ff2-3f4b-4db3-a41f-0adf81c103db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt"
Jul 08 21:16:41.104468 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:41.104377    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c5ae5ff2-3f4b-4db3-a41f-0adf81c103db-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6bd8c97cd-sfpqt\" (UID: \"c5ae5ff2-3f4b-4db3-a41f-0adf81c103db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt"
Jul 08 21:16:41.104468 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:41.104389    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c5ae5ff2-3f4b-4db3-a41f-0adf81c103db-ca\") pod \"cluster-proxy-proxy-agent-6bd8c97cd-sfpqt\" (UID: \"c5ae5ff2-3f4b-4db3-a41f-0adf81c103db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt"
Jul 08 21:16:41.104534 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:41.104484    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5ae5ff2-3f4b-4db3-a41f-0adf81c103db-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6bd8c97cd-sfpqt\" (UID: \"c5ae5ff2-3f4b-4db3-a41f-0adf81c103db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt"
Jul 08 21:16:41.104534 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:41.104515    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/33f6b6b8-8e71-4b71-9a0b-2fe2d231a118-klusterlet-config\") pod \"klusterlet-addon-workmgr-8589b6c9f8-tphtm\" (UID: \"33f6b6b8-8e71-4b71-9a0b-2fe2d231a118\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm"
Jul 08 21:16:41.108621 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:41.108597    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9llh4\" (UniqueName: \"kubernetes.io/projected/33f6b6b8-8e71-4b71-9a0b-2fe2d231a118-kube-api-access-9llh4\") pod \"klusterlet-addon-workmgr-8589b6c9f8-tphtm\" (UID: \"33f6b6b8-8e71-4b71-9a0b-2fe2d231a118\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm"
Jul 08 21:16:41.108742 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:41.108724    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfvtv\" (UniqueName: \"kubernetes.io/projected/c5ae5ff2-3f4b-4db3-a41f-0adf81c103db-kube-api-access-jfvtv\") pod \"cluster-proxy-proxy-agent-6bd8c97cd-sfpqt\" (UID: \"c5ae5ff2-3f4b-4db3-a41f-0adf81c103db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt"
Jul 08 21:16:41.248353 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:41.248267    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt"
Jul 08 21:16:41.253283 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:41.253258    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm"
Jul 08 21:16:41.383067 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:41.383042    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt"]
Jul 08 21:16:41.385531 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:16:41.385505    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5ae5ff2_3f4b_4db3_a41f_0adf81c103db.slice/crio-6a56ef715bab139210a2eb646441ac32c8baff3ce48d07d718b4e28452c45e4c WatchSource:0}: Error finding container 6a56ef715bab139210a2eb646441ac32c8baff3ce48d07d718b4e28452c45e4c: Status 404 returned error can't find the container with id 6a56ef715bab139210a2eb646441ac32c8baff3ce48d07d718b4e28452c45e4c
Jul 08 21:16:41.394044 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:41.394023    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm"]
Jul 08 21:16:41.397004 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:16:41.396981    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33f6b6b8_8e71_4b71_9a0b_2fe2d231a118.slice/crio-9c635fab5f0bca1671f3a249acbac9689f9a1a505233ad0ec5c54f71bf1835c1 WatchSource:0}: Error finding container 9c635fab5f0bca1671f3a249acbac9689f9a1a505233ad0ec5c54f71bf1835c1: Status 404 returned error can't find the container with id 9c635fab5f0bca1671f3a249acbac9689f9a1a505233ad0ec5c54f71bf1835c1
Jul 08 21:16:42.092482 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:42.092443    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt" event={"ID":"c5ae5ff2-3f4b-4db3-a41f-0adf81c103db","Type":"ContainerStarted","Data":"6a56ef715bab139210a2eb646441ac32c8baff3ce48d07d718b4e28452c45e4c"}
Jul 08 21:16:42.095199 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:42.094303    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm" event={"ID":"33f6b6b8-8e71-4b71-9a0b-2fe2d231a118","Type":"ContainerStarted","Data":"9c635fab5f0bca1671f3a249acbac9689f9a1a505233ad0ec5c54f71bf1835c1"}
Jul 08 21:16:45.025250 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:45.025217    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8fjtm"
Jul 08 21:16:45.539903 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:45.539857    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf041d9-9dcf-4edd-b480-dc0051905946-metrics-certs\") pod \"network-metrics-daemon-w5tkg\" (UID: \"bcf041d9-9dcf-4edd-b480-dc0051905946\") " pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:16:45.540093 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:45.539935    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fed9c17c-f689-4d9f-b52e-7ba52d04948f-original-pull-secret\") pod \"global-pull-secret-syncer-hk4nc\" (UID: \"fed9c17c-f689-4d9f-b52e-7ba52d04948f\") " pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:16:45.542893 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:45.542565    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 21:16:45.542893 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:45.542568    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 21:16:45.550727 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:45.550701    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 21:16:45.550864 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:45.550800    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf041d9-9dcf-4edd-b480-dc0051905946-metrics-certs podName:bcf041d9-9dcf-4edd-b480-dc0051905946 nodeName:}" failed. No retries permitted until 2026-07-08 21:17:49.55077988 +0000 UTC m=+130.205682577 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcf041d9-9dcf-4edd-b480-dc0051905946-metrics-certs") pod "network-metrics-daemon-w5tkg" (UID: "bcf041d9-9dcf-4edd-b480-dc0051905946") : secret "metrics-daemon-secret" not found
Jul 08 21:16:45.553353 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:45.553332    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fed9c17c-f689-4d9f-b52e-7ba52d04948f-original-pull-secret\") pod \"global-pull-secret-syncer-hk4nc\" (UID: \"fed9c17c-f689-4d9f-b52e-7ba52d04948f\") " pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:16:45.641337 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:45.641290    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhqgg\" (UniqueName: \"kubernetes.io/projected/f75b6b6b-23e7-4360-8c27-1c8d9add975e-kube-api-access-jhqgg\") pod \"network-check-target-tlc6m\" (UID: \"f75b6b6b-23e7-4360-8c27-1c8d9add975e\") " pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:16:45.644498 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:45.644478    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 21:16:45.654560 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:45.654532    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 21:16:45.665128 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:45.665104    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhqgg\" (UniqueName: \"kubernetes.io/projected/f75b6b6b-23e7-4360-8c27-1c8d9add975e-kube-api-access-jhqgg\") pod \"network-check-target-tlc6m\" (UID: \"f75b6b6b-23e7-4360-8c27-1c8d9add975e\") " pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:16:45.777811 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:45.777775    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hk4nc"
Jul 08 21:16:45.785218 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:45.785195    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9bpbv\""
Jul 08 21:16:45.793199 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:45.793129    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:16:46.889303 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:46.889259    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hk4nc"]
Jul 08 21:16:46.894175 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:16:46.894150    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfed9c17c_f689_4d9f_b52e_7ba52d04948f.slice/crio-fe937b9a52fc116b548e507e55e889ee4acc194bc696f7ed50da44e81fa97713 WatchSource:0}: Error finding container fe937b9a52fc116b548e507e55e889ee4acc194bc696f7ed50da44e81fa97713: Status 404 returned error can't find the container with id fe937b9a52fc116b548e507e55e889ee4acc194bc696f7ed50da44e81fa97713
Jul 08 21:16:46.915061 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:46.915036    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tlc6m"]
Jul 08 21:16:46.916872 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:16:46.916847    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf75b6b6b_23e7_4360_8c27_1c8d9add975e.slice/crio-1cf74b1766912fb8e0f4e7125df16038d32ceee39be497e0c4a3f1be7892db6a WatchSource:0}: Error finding container 1cf74b1766912fb8e0f4e7125df16038d32ceee39be497e0c4a3f1be7892db6a: Status 404 returned error can't find the container with id 1cf74b1766912fb8e0f4e7125df16038d32ceee39be497e0c4a3f1be7892db6a
Jul 08 21:16:47.108404 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:47.108324    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm" event={"ID":"33f6b6b8-8e71-4b71-9a0b-2fe2d231a118","Type":"ContainerStarted","Data":"ad9f157a2f3083c004af26255783332c9d91cd1b6680f44098b51675b9b61bca"}
Jul 08 21:16:47.108560 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:47.108517    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm"
Jul 08 21:16:47.110276 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:47.110254    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm"
Jul 08 21:16:47.110736 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:47.110712    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt" event={"ID":"c5ae5ff2-3f4b-4db3-a41f-0adf81c103db","Type":"ContainerStarted","Data":"3dce161e98f182d87fecca3cb579a0fc34a199517ffca112c3ab87de7ed41cc8"}
Jul 08 21:16:47.110915 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:47.110775    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt" event={"ID":"c5ae5ff2-3f4b-4db3-a41f-0adf81c103db","Type":"ContainerStarted","Data":"5edf1042971b67a3800e11e1975735360d1d0e833b3e433c72387c3319e3411d"}
Jul 08 21:16:47.110915 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:47.110795    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt" event={"ID":"c5ae5ff2-3f4b-4db3-a41f-0adf81c103db","Type":"ContainerStarted","Data":"30d9fb4cafe8f25aa5532b88dbc1298bd951c9f75d1fa578b9ce6c09b2d9d6fb"}
Jul 08 21:16:47.112020 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:47.111994    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tlc6m" event={"ID":"f75b6b6b-23e7-4360-8c27-1c8d9add975e","Type":"ContainerStarted","Data":"1cf74b1766912fb8e0f4e7125df16038d32ceee39be497e0c4a3f1be7892db6a"}
Jul 08 21:16:47.113019 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:47.112994    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hk4nc" event={"ID":"fed9c17c-f689-4d9f-b52e-7ba52d04948f","Type":"ContainerStarted","Data":"fe937b9a52fc116b548e507e55e889ee4acc194bc696f7ed50da44e81fa97713"}
Jul 08 21:16:47.125676 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:47.125636    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm" podStartSLOduration=1.7567781089999999 podStartE2EDuration="7.125625483s" totalImagesPullingTime="5.368847374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:16:47.124265482 +0000 UTC m=+67.779168201" watchObservedRunningTime="2026-07-08 21:16:47.125625483 +0000 UTC m=+67.780528202"
Jul 08 21:16:47.156061 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:47.156022    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt" podStartSLOduration=1.780152008 podStartE2EDuration="7.156003832s" totalImagesPullingTime="5.375851824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:16:47.155844026 +0000 UTC m=+67.810746745" watchObservedRunningTime="2026-07-08 21:16:47.156003832 +0000 UTC m=+67.810906529"
Jul 08 21:16:52.087724 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:52.087679    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-metrics-tls\") pod \"dns-default-27wfb\" (UID: \"f9d47a6b-4d3c-42ba-8965-67b29cfaad5e\") " pod="openshift-dns/dns-default-27wfb"
Jul 08 21:16:52.088136 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:52.087863    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:16:52.088136 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:16:52.087941    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-metrics-tls podName:f9d47a6b-4d3c-42ba-8965-67b29cfaad5e nodeName:}" failed. No retries permitted until 2026-07-08 21:17:24.087920665 +0000 UTC m=+104.742823363 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-metrics-tls") pod "dns-default-27wfb" (UID: "f9d47a6b-4d3c-42ba-8965-67b29cfaad5e") : secret "dns-default-metrics-tls" not found
Jul 08 21:16:53.130803 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:53.130690    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tlc6m" event={"ID":"f75b6b6b-23e7-4360-8c27-1c8d9add975e","Type":"ContainerStarted","Data":"381fa7b434bb415020c9034b80816d2fede0a6296537085737ada6039759aa6d"}
Jul 08 21:16:53.131171 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:53.130828    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:16:53.132036 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:53.132007    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hk4nc" event={"ID":"fed9c17c-f689-4d9f-b52e-7ba52d04948f","Type":"ContainerStarted","Data":"41707e8368a311ca100c0a04ffcef88589b58020a89d9e979b39db2aa1572067"}
Jul 08 21:16:53.145683 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:53.145643    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tlc6m" podStartSLOduration=68.293888996 podStartE2EDuration="1m14.145630335s" totalImagesPullingTime="5.851741339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:16:53.145083913 +0000 UTC m=+73.799986644" watchObservedRunningTime="2026-07-08 21:16:53.145630335 +0000 UTC m=+73.800533054"
Jul 08 21:16:53.159332 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:16:53.159270    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hk4nc" podStartSLOduration=67.279165771 podStartE2EDuration="1m13.159257067s" totalImagesPullingTime="5.880091296s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:15:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:16:53.159143152 +0000 UTC m=+73.814045873" watchObservedRunningTime="2026-07-08 21:16:53.159257067 +0000 UTC m=+73.814159768"
Jul 08 21:17:24.090406 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:17:24.090367    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-metrics-tls\") pod \"dns-default-27wfb\" (UID: \"f9d47a6b-4d3c-42ba-8965-67b29cfaad5e\") " pod="openshift-dns/dns-default-27wfb"
Jul 08 21:17:24.090842 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:17:24.090515    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:17:24.090842 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:17:24.090598    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-metrics-tls podName:f9d47a6b-4d3c-42ba-8965-67b29cfaad5e nodeName:}" failed. No retries permitted until 2026-07-08 21:18:28.090581776 +0000 UTC m=+168.745484473 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-metrics-tls") pod "dns-default-27wfb" (UID: "f9d47a6b-4d3c-42ba-8965-67b29cfaad5e") : secret "dns-default-metrics-tls" not found
Jul 08 21:17:24.138063 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:17:24.138035    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tlc6m"
Jul 08 21:17:49.562291 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:17:49.562242    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf041d9-9dcf-4edd-b480-dc0051905946-metrics-certs\") pod \"network-metrics-daemon-w5tkg\" (UID: \"bcf041d9-9dcf-4edd-b480-dc0051905946\") " pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:17:49.562689 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:17:49.562409    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 21:17:49.562689 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:17:49.562492    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf041d9-9dcf-4edd-b480-dc0051905946-metrics-certs podName:bcf041d9-9dcf-4edd-b480-dc0051905946 nodeName:}" failed. No retries permitted until 2026-07-08 21:19:51.562474416 +0000 UTC m=+252.217377117 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcf041d9-9dcf-4edd-b480-dc0051905946-metrics-certs") pod "network-metrics-daemon-w5tkg" (UID: "bcf041d9-9dcf-4edd-b480-dc0051905946") : secret "metrics-daemon-secret" not found
Jul 08 21:18:23.236040 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:18:23.235982    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-27wfb" podUID="f9d47a6b-4d3c-42ba-8965-67b29cfaad5e"
Jul 08 21:18:23.385757 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:18:23.385726    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-27wfb"
Jul 08 21:18:23.872468 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:18:23.872431    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-w5tkg" podUID="bcf041d9-9dcf-4edd-b480-dc0051905946"
Jul 08 21:18:28.115856 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:18:28.115802    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-metrics-tls\") pod \"dns-default-27wfb\" (UID: \"f9d47a6b-4d3c-42ba-8965-67b29cfaad5e\") " pod="openshift-dns/dns-default-27wfb"
Jul 08 21:18:28.116349 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:18:28.115983    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:18:28.116349 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:18:28.116084    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-metrics-tls podName:f9d47a6b-4d3c-42ba-8965-67b29cfaad5e nodeName:}" failed. No retries permitted until 2026-07-08 21:20:30.116061127 +0000 UTC m=+290.770963836 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-metrics-tls") pod "dns-default-27wfb" (UID: "f9d47a6b-4d3c-42ba-8965-67b29cfaad5e") : secret "dns-default-metrics-tls" not found
Jul 08 21:18:34.861888 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:18:34.861851    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:18:47.109544 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:18:47.109494    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm" podUID="33f6b6b8-8e71-4b71-9a0b-2fe2d231a118" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/readyz\": dial tcp 10.132.0.9:8000: connect: connection refused"
Jul 08 21:18:47.453712 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:18:47.453677    2571 generic.go:356] "Generic (PLEG): container finished" podID="33f6b6b8-8e71-4b71-9a0b-2fe2d231a118" containerID="ad9f157a2f3083c004af26255783332c9d91cd1b6680f44098b51675b9b61bca" exitCode=1
Jul 08 21:18:47.453883 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:18:47.453737    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm" event={"ID":"33f6b6b8-8e71-4b71-9a0b-2fe2d231a118","Type":"ContainerDied","Data":"ad9f157a2f3083c004af26255783332c9d91cd1b6680f44098b51675b9b61bca"}
Jul 08 21:18:47.454039 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:18:47.454027    2571 scope.go:117] "RemoveContainer" containerID="ad9f157a2f3083c004af26255783332c9d91cd1b6680f44098b51675b9b61bca"
Jul 08 21:18:48.458018 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:18:48.457980    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm" event={"ID":"33f6b6b8-8e71-4b71-9a0b-2fe2d231a118","Type":"ContainerStarted","Data":"2a5b59d70aaaf12400aba14844253ac4e28f587a2e75f15f94e0777a47f5cf3c"}
Jul 08 21:18:48.458459 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:18:48.458247    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm"
Jul 08 21:18:48.458915 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:18:48.458896    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm"
Jul 08 21:19:26.510268 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:26.510238    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-67x2p"]
Jul 08 21:19:26.512394 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:26.512378    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-67x2p"
Jul 08 21:19:26.515115 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:26.515097    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 08 21:19:26.515229 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:26.515150    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 08 21:19:26.516196 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:26.516171    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gtvgz\""
Jul 08 21:19:26.516285 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:26.516207    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 08 21:19:26.516285 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:26.516226    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 08 21:19:26.522832 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:26.522812    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-67x2p"]
Jul 08 21:19:26.621316 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:26.621288    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qlgk\" (UniqueName: \"kubernetes.io/projected/36bda6e3-fb2a-45b7-86f1-008dea6ef292-kube-api-access-7qlgk\") pod \"insights-runtime-extractor-67x2p\" (UID: \"36bda6e3-fb2a-45b7-86f1-008dea6ef292\") " pod="openshift-insights/insights-runtime-extractor-67x2p"
Jul 08 21:19:26.621465 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:26.621336    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/36bda6e3-fb2a-45b7-86f1-008dea6ef292-data-volume\") pod \"insights-runtime-extractor-67x2p\" (UID: \"36bda6e3-fb2a-45b7-86f1-008dea6ef292\") " pod="openshift-insights/insights-runtime-extractor-67x2p"
Jul 08 21:19:26.621465 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:26.621361    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/36bda6e3-fb2a-45b7-86f1-008dea6ef292-crio-socket\") pod \"insights-runtime-extractor-67x2p\" (UID: \"36bda6e3-fb2a-45b7-86f1-008dea6ef292\") " pod="openshift-insights/insights-runtime-extractor-67x2p"
Jul 08 21:19:26.621465 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:26.621410    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/36bda6e3-fb2a-45b7-86f1-008dea6ef292-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67x2p\" (UID: \"36bda6e3-fb2a-45b7-86f1-008dea6ef292\") " pod="openshift-insights/insights-runtime-extractor-67x2p"
Jul 08 21:19:26.621465 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:26.621428    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/36bda6e3-fb2a-45b7-86f1-008dea6ef292-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67x2p\" (UID: \"36bda6e3-fb2a-45b7-86f1-008dea6ef292\") " pod="openshift-insights/insights-runtime-extractor-67x2p"
Jul 08 21:19:26.722630 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:26.722604    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qlgk\" (UniqueName: \"kubernetes.io/projected/36bda6e3-fb2a-45b7-86f1-008dea6ef292-kube-api-access-7qlgk\") pod \"insights-runtime-extractor-67x2p\" (UID: \"36bda6e3-fb2a-45b7-86f1-008dea6ef292\") " pod="openshift-insights/insights-runtime-extractor-67x2p"
Jul 08 21:19:26.722807 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:26.722647    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/36bda6e3-fb2a-45b7-86f1-008dea6ef292-data-volume\") pod \"insights-runtime-extractor-67x2p\" (UID: \"36bda6e3-fb2a-45b7-86f1-008dea6ef292\") " pod="openshift-insights/insights-runtime-extractor-67x2p"
Jul 08 21:19:26.722807 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:26.722674    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/36bda6e3-fb2a-45b7-86f1-008dea6ef292-crio-socket\") pod \"insights-runtime-extractor-67x2p\" (UID: \"36bda6e3-fb2a-45b7-86f1-008dea6ef292\") " pod="openshift-insights/insights-runtime-extractor-67x2p"
Jul 08 21:19:26.722807 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:26.722741    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/36bda6e3-fb2a-45b7-86f1-008dea6ef292-crio-socket\") pod \"insights-runtime-extractor-67x2p\" (UID: \"36bda6e3-fb2a-45b7-86f1-008dea6ef292\") " pod="openshift-insights/insights-runtime-extractor-67x2p"
Jul 08 21:19:26.722807 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:26.722795    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/36bda6e3-fb2a-45b7-86f1-008dea6ef292-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67x2p\" (UID: \"36bda6e3-fb2a-45b7-86f1-008dea6ef292\") " pod="openshift-insights/insights-runtime-extractor-67x2p"
Jul 08 21:19:26.723011 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:26.722831    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/36bda6e3-fb2a-45b7-86f1-008dea6ef292-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67x2p\" (UID: \"36bda6e3-fb2a-45b7-86f1-008dea6ef292\") " pod="openshift-insights/insights-runtime-extractor-67x2p"
Jul 08 21:19:26.723011 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:19:26.722859    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 21:19:26.723011 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:19:26.722927    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/36bda6e3-fb2a-45b7-86f1-008dea6ef292-kube-rbac-proxy-cm podName:36bda6e3-fb2a-45b7-86f1-008dea6ef292 nodeName:}" failed. No retries permitted until 2026-07-08 21:19:27.222909677 +0000 UTC m=+227.877812393 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/36bda6e3-fb2a-45b7-86f1-008dea6ef292-kube-rbac-proxy-cm") pod "insights-runtime-extractor-67x2p" (UID: "36bda6e3-fb2a-45b7-86f1-008dea6ef292") : configmap "kube-rbac-proxy" not found
Jul 08 21:19:26.723011 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:19:26.722956    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 21:19:26.723011 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:26.722973    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/36bda6e3-fb2a-45b7-86f1-008dea6ef292-data-volume\") pod \"insights-runtime-extractor-67x2p\" (UID: \"36bda6e3-fb2a-45b7-86f1-008dea6ef292\") " pod="openshift-insights/insights-runtime-extractor-67x2p"
Jul 08 21:19:26.723011 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:19:26.723009    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36bda6e3-fb2a-45b7-86f1-008dea6ef292-insights-runtime-extractor-tls podName:36bda6e3-fb2a-45b7-86f1-008dea6ef292 nodeName:}" failed. No retries permitted until 2026-07-08 21:19:27.222997386 +0000 UTC m=+227.877900083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/36bda6e3-fb2a-45b7-86f1-008dea6ef292-insights-runtime-extractor-tls") pod "insights-runtime-extractor-67x2p" (UID: "36bda6e3-fb2a-45b7-86f1-008dea6ef292") : secret "insights-runtime-extractor-tls" not found
Jul 08 21:19:26.731102 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:26.731077    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qlgk\" (UniqueName: \"kubernetes.io/projected/36bda6e3-fb2a-45b7-86f1-008dea6ef292-kube-api-access-7qlgk\") pod \"insights-runtime-extractor-67x2p\" (UID: \"36bda6e3-fb2a-45b7-86f1-008dea6ef292\") " pod="openshift-insights/insights-runtime-extractor-67x2p"
Jul 08 21:19:27.225561 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:27.225525    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/36bda6e3-fb2a-45b7-86f1-008dea6ef292-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67x2p\" (UID: \"36bda6e3-fb2a-45b7-86f1-008dea6ef292\") " pod="openshift-insights/insights-runtime-extractor-67x2p"
Jul 08 21:19:27.225561 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:27.225559    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/36bda6e3-fb2a-45b7-86f1-008dea6ef292-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67x2p\" (UID: \"36bda6e3-fb2a-45b7-86f1-008dea6ef292\") " pod="openshift-insights/insights-runtime-extractor-67x2p"
Jul 08 21:19:27.225789 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:19:27.225652    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 21:19:27.225789 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:19:27.225651    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 21:19:27.225789 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:19:27.225708    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36bda6e3-fb2a-45b7-86f1-008dea6ef292-insights-runtime-extractor-tls podName:36bda6e3-fb2a-45b7-86f1-008dea6ef292 nodeName:}" failed. No retries permitted until 2026-07-08 21:19:28.225694839 +0000 UTC m=+228.880597536 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/36bda6e3-fb2a-45b7-86f1-008dea6ef292-insights-runtime-extractor-tls") pod "insights-runtime-extractor-67x2p" (UID: "36bda6e3-fb2a-45b7-86f1-008dea6ef292") : secret "insights-runtime-extractor-tls" not found
Jul 08 21:19:27.225789 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:19:27.225729    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/36bda6e3-fb2a-45b7-86f1-008dea6ef292-kube-rbac-proxy-cm podName:36bda6e3-fb2a-45b7-86f1-008dea6ef292 nodeName:}" failed. No retries permitted until 2026-07-08 21:19:28.225716704 +0000 UTC m=+228.880619400 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/36bda6e3-fb2a-45b7-86f1-008dea6ef292-kube-rbac-proxy-cm") pod "insights-runtime-extractor-67x2p" (UID: "36bda6e3-fb2a-45b7-86f1-008dea6ef292") : configmap "kube-rbac-proxy" not found
Jul 08 21:19:28.234830 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:28.234789    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/36bda6e3-fb2a-45b7-86f1-008dea6ef292-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67x2p\" (UID: \"36bda6e3-fb2a-45b7-86f1-008dea6ef292\") " pod="openshift-insights/insights-runtime-extractor-67x2p"
Jul 08 21:19:28.234830 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:28.234832    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/36bda6e3-fb2a-45b7-86f1-008dea6ef292-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67x2p\" (UID: \"36bda6e3-fb2a-45b7-86f1-008dea6ef292\") " pod="openshift-insights/insights-runtime-extractor-67x2p"
Jul 08 21:19:28.235237 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:19:28.234914    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 21:19:28.235237 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:19:28.234934    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 21:19:28.235237 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:19:28.234979    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/36bda6e3-fb2a-45b7-86f1-008dea6ef292-kube-rbac-proxy-cm podName:36bda6e3-fb2a-45b7-86f1-008dea6ef292 nodeName:}" failed. No retries permitted until 2026-07-08 21:19:30.23496415 +0000 UTC m=+230.889866850 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/36bda6e3-fb2a-45b7-86f1-008dea6ef292-kube-rbac-proxy-cm") pod "insights-runtime-extractor-67x2p" (UID: "36bda6e3-fb2a-45b7-86f1-008dea6ef292") : configmap "kube-rbac-proxy" not found
Jul 08 21:19:28.235237 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:19:28.234994    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36bda6e3-fb2a-45b7-86f1-008dea6ef292-insights-runtime-extractor-tls podName:36bda6e3-fb2a-45b7-86f1-008dea6ef292 nodeName:}" failed. No retries permitted until 2026-07-08 21:19:30.234987772 +0000 UTC m=+230.889890468 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/36bda6e3-fb2a-45b7-86f1-008dea6ef292-insights-runtime-extractor-tls") pod "insights-runtime-extractor-67x2p" (UID: "36bda6e3-fb2a-45b7-86f1-008dea6ef292") : secret "insights-runtime-extractor-tls" not found
Jul 08 21:19:28.519925 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:28.519848    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kwg77_db7d97d7-b4b1-4c44-a4e8-be1d3590a217/dns-node-resolver/0.log"
Jul 08 21:19:29.320971 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:29.320940    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q6v7s_13f8f143-b56b-41cc-b6d4-58330207e6d9/node-ca/0.log"
Jul 08 21:19:30.120179 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:30.120150    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8v56v_05b59558-56ed-4741-ac0f-2911399956a1/serve-healthcheck-canary/0.log"
Jul 08 21:19:30.247712 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:30.247683    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/36bda6e3-fb2a-45b7-86f1-008dea6ef292-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67x2p\" (UID: \"36bda6e3-fb2a-45b7-86f1-008dea6ef292\") " pod="openshift-insights/insights-runtime-extractor-67x2p"
Jul 08 21:19:30.247888 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:30.247718    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/36bda6e3-fb2a-45b7-86f1-008dea6ef292-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67x2p\" (UID: \"36bda6e3-fb2a-45b7-86f1-008dea6ef292\") " pod="openshift-insights/insights-runtime-extractor-67x2p"
Jul 08 21:19:30.247888 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:19:30.247828    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 21:19:30.247888 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:19:30.247835    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 21:19:30.247990 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:19:30.247893    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/36bda6e3-fb2a-45b7-86f1-008dea6ef292-kube-rbac-proxy-cm podName:36bda6e3-fb2a-45b7-86f1-008dea6ef292 nodeName:}" failed. No retries permitted until 2026-07-08 21:19:34.247871711 +0000 UTC m=+234.902774423 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/36bda6e3-fb2a-45b7-86f1-008dea6ef292-kube-rbac-proxy-cm") pod "insights-runtime-extractor-67x2p" (UID: "36bda6e3-fb2a-45b7-86f1-008dea6ef292") : configmap "kube-rbac-proxy" not found
Jul 08 21:19:30.247990 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:19:30.247962    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36bda6e3-fb2a-45b7-86f1-008dea6ef292-insights-runtime-extractor-tls podName:36bda6e3-fb2a-45b7-86f1-008dea6ef292 nodeName:}" failed. No retries permitted until 2026-07-08 21:19:34.247940826 +0000 UTC m=+234.902843531 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/36bda6e3-fb2a-45b7-86f1-008dea6ef292-insights-runtime-extractor-tls") pod "insights-runtime-extractor-67x2p" (UID: "36bda6e3-fb2a-45b7-86f1-008dea6ef292") : secret "insights-runtime-extractor-tls" not found
Jul 08 21:19:34.276465 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:34.276430    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/36bda6e3-fb2a-45b7-86f1-008dea6ef292-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67x2p\" (UID: \"36bda6e3-fb2a-45b7-86f1-008dea6ef292\") " pod="openshift-insights/insights-runtime-extractor-67x2p"
Jul 08 21:19:34.276465 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:34.276468    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/36bda6e3-fb2a-45b7-86f1-008dea6ef292-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67x2p\" (UID: \"36bda6e3-fb2a-45b7-86f1-008dea6ef292\") " pod="openshift-insights/insights-runtime-extractor-67x2p"
Jul 08 21:19:34.276985 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:19:34.276551    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 21:19:34.276985 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:19:34.276607    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 21:19:34.276985 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:19:34.276632    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/36bda6e3-fb2a-45b7-86f1-008dea6ef292-kube-rbac-proxy-cm podName:36bda6e3-fb2a-45b7-86f1-008dea6ef292 nodeName:}" failed. No retries permitted until 2026-07-08 21:19:42.276613296 +0000 UTC m=+242.931516015 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/36bda6e3-fb2a-45b7-86f1-008dea6ef292-kube-rbac-proxy-cm") pod "insights-runtime-extractor-67x2p" (UID: "36bda6e3-fb2a-45b7-86f1-008dea6ef292") : configmap "kube-rbac-proxy" not found
Jul 08 21:19:34.276985 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:19:34.276650    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36bda6e3-fb2a-45b7-86f1-008dea6ef292-insights-runtime-extractor-tls podName:36bda6e3-fb2a-45b7-86f1-008dea6ef292 nodeName:}" failed. No retries permitted until 2026-07-08 21:19:42.276642204 +0000 UTC m=+242.931544902 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/36bda6e3-fb2a-45b7-86f1-008dea6ef292-insights-runtime-extractor-tls") pod "insights-runtime-extractor-67x2p" (UID: "36bda6e3-fb2a-45b7-86f1-008dea6ef292") : secret "insights-runtime-extractor-tls" not found
Jul 08 21:19:42.334559 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:42.334522    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/36bda6e3-fb2a-45b7-86f1-008dea6ef292-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67x2p\" (UID: \"36bda6e3-fb2a-45b7-86f1-008dea6ef292\") " pod="openshift-insights/insights-runtime-extractor-67x2p"
Jul 08 21:19:42.335044 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:42.334566    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/36bda6e3-fb2a-45b7-86f1-008dea6ef292-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67x2p\" (UID: \"36bda6e3-fb2a-45b7-86f1-008dea6ef292\") " pod="openshift-insights/insights-runtime-extractor-67x2p"
Jul 08 21:19:42.335188 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:42.335168    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/36bda6e3-fb2a-45b7-86f1-008dea6ef292-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67x2p\" (UID: \"36bda6e3-fb2a-45b7-86f1-008dea6ef292\") " pod="openshift-insights/insights-runtime-extractor-67x2p"
Jul 08 21:19:42.336992 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:42.336976    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/36bda6e3-fb2a-45b7-86f1-008dea6ef292-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67x2p\" (UID: \"36bda6e3-fb2a-45b7-86f1-008dea6ef292\") " pod="openshift-insights/insights-runtime-extractor-67x2p"
Jul 08 21:19:42.423300 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:42.423273    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gtvgz\""
Jul 08 21:19:42.431130 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:42.431112    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-67x2p"
Jul 08 21:19:42.557528 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:42.557494    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-67x2p"]
Jul 08 21:19:42.561169 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:19:42.561142    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36bda6e3_fb2a_45b7_86f1_008dea6ef292.slice/crio-f7cdc68da50ff37c092b9ff78242175ad71e40eecc728cd5102366cef785ab9d WatchSource:0}: Error finding container f7cdc68da50ff37c092b9ff78242175ad71e40eecc728cd5102366cef785ab9d: Status 404 returned error can't find the container with id f7cdc68da50ff37c092b9ff78242175ad71e40eecc728cd5102366cef785ab9d
Jul 08 21:19:42.619691 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:42.619625    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-67x2p" event={"ID":"36bda6e3-fb2a-45b7-86f1-008dea6ef292","Type":"ContainerStarted","Data":"f7cdc68da50ff37c092b9ff78242175ad71e40eecc728cd5102366cef785ab9d"}
Jul 08 21:19:46.635167 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.635136    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-67x2p" event={"ID":"36bda6e3-fb2a-45b7-86f1-008dea6ef292","Type":"ContainerStarted","Data":"fb6df97898871455d37b606f8fb286c7f2f905e8ea7f41a9822e83f999587b9b"}
Jul 08 21:19:46.700412 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.700372    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5ccddc7869-2w579"]
Jul 08 21:19:46.702593 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.702574    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5ccddc7869-2w579"
Jul 08 21:19:46.705210 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.705170    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 08 21:19:46.705210 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.705188    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 08 21:19:46.705381 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.705271    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-t7n5m\""
Jul 08 21:19:46.706149 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.706134    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 08 21:19:46.710245 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.710227    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 08 21:19:46.717685 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.717661    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5ccddc7869-2w579"]
Jul 08 21:19:46.869321 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.869289    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d7f513e3-b4c6-4ece-bbcb-bef29e97319c-image-registry-private-configuration\") pod \"image-registry-5ccddc7869-2w579\" (UID: \"d7f513e3-b4c6-4ece-bbcb-bef29e97319c\") " pod="openshift-image-registry/image-registry-5ccddc7869-2w579"
Jul 08 21:19:46.869321 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.869325    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv24g\" (UniqueName: \"kubernetes.io/projected/d7f513e3-b4c6-4ece-bbcb-bef29e97319c-kube-api-access-vv24g\") pod \"image-registry-5ccddc7869-2w579\" (UID: \"d7f513e3-b4c6-4ece-bbcb-bef29e97319c\") " pod="openshift-image-registry/image-registry-5ccddc7869-2w579"
Jul 08 21:19:46.869542 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.869345    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d7f513e3-b4c6-4ece-bbcb-bef29e97319c-installation-pull-secrets\") pod \"image-registry-5ccddc7869-2w579\" (UID: \"d7f513e3-b4c6-4ece-bbcb-bef29e97319c\") " pod="openshift-image-registry/image-registry-5ccddc7869-2w579"
Jul 08 21:19:46.869542 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.869364    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7f513e3-b4c6-4ece-bbcb-bef29e97319c-registry-tls\") pod \"image-registry-5ccddc7869-2w579\" (UID: \"d7f513e3-b4c6-4ece-bbcb-bef29e97319c\") " pod="openshift-image-registry/image-registry-5ccddc7869-2w579"
Jul 08 21:19:46.869542 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.869411    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d7f513e3-b4c6-4ece-bbcb-bef29e97319c-trusted-ca\") pod \"image-registry-5ccddc7869-2w579\" (UID: \"d7f513e3-b4c6-4ece-bbcb-bef29e97319c\") " pod="openshift-image-registry/image-registry-5ccddc7869-2w579"
Jul 08 21:19:46.869542 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.869519    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7f513e3-b4c6-4ece-bbcb-bef29e97319c-bound-sa-token\") pod \"image-registry-5ccddc7869-2w579\" (UID: \"d7f513e3-b4c6-4ece-bbcb-bef29e97319c\") " pod="openshift-image-registry/image-registry-5ccddc7869-2w579"
Jul 08 21:19:46.869686 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.869546    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d7f513e3-b4c6-4ece-bbcb-bef29e97319c-ca-trust-extracted\") pod \"image-registry-5ccddc7869-2w579\" (UID: \"d7f513e3-b4c6-4ece-bbcb-bef29e97319c\") " pod="openshift-image-registry/image-registry-5ccddc7869-2w579"
Jul 08 21:19:46.869686 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.869571    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d7f513e3-b4c6-4ece-bbcb-bef29e97319c-registry-certificates\") pod \"image-registry-5ccddc7869-2w579\" (UID: \"d7f513e3-b4c6-4ece-bbcb-bef29e97319c\") " pod="openshift-image-registry/image-registry-5ccddc7869-2w579"
Jul 08 21:19:46.969939 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.969902    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d7f513e3-b4c6-4ece-bbcb-bef29e97319c-image-registry-private-configuration\") pod \"image-registry-5ccddc7869-2w579\" (UID: \"d7f513e3-b4c6-4ece-bbcb-bef29e97319c\") " pod="openshift-image-registry/image-registry-5ccddc7869-2w579"
Jul 08 21:19:46.969939 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.969935    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv24g\" (UniqueName: \"kubernetes.io/projected/d7f513e3-b4c6-4ece-bbcb-bef29e97319c-kube-api-access-vv24g\") pod \"image-registry-5ccddc7869-2w579\" (UID: \"d7f513e3-b4c6-4ece-bbcb-bef29e97319c\") " pod="openshift-image-registry/image-registry-5ccddc7869-2w579"
Jul 08 21:19:46.970183 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.969955    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d7f513e3-b4c6-4ece-bbcb-bef29e97319c-installation-pull-secrets\") pod \"image-registry-5ccddc7869-2w579\" (UID: \"d7f513e3-b4c6-4ece-bbcb-bef29e97319c\") " pod="openshift-image-registry/image-registry-5ccddc7869-2w579"
Jul 08 21:19:46.970183 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.969974    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7f513e3-b4c6-4ece-bbcb-bef29e97319c-registry-tls\") pod \"image-registry-5ccddc7869-2w579\" (UID: \"d7f513e3-b4c6-4ece-bbcb-bef29e97319c\") " pod="openshift-image-registry/image-registry-5ccddc7869-2w579"
Jul 08 21:19:46.970183 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.969990    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d7f513e3-b4c6-4ece-bbcb-bef29e97319c-trusted-ca\") pod \"image-registry-5ccddc7869-2w579\" (UID: \"d7f513e3-b4c6-4ece-bbcb-bef29e97319c\") " pod="openshift-image-registry/image-registry-5ccddc7869-2w579"
Jul 08 21:19:46.970183 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.970043    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7f513e3-b4c6-4ece-bbcb-bef29e97319c-bound-sa-token\") pod \"image-registry-5ccddc7869-2w579\" (UID: \"d7f513e3-b4c6-4ece-bbcb-bef29e97319c\") " pod="openshift-image-registry/image-registry-5ccddc7869-2w579"
Jul 08 21:19:46.970183 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.970061    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d7f513e3-b4c6-4ece-bbcb-bef29e97319c-ca-trust-extracted\") pod \"image-registry-5ccddc7869-2w579\" (UID: \"d7f513e3-b4c6-4ece-bbcb-bef29e97319c\") " pod="openshift-image-registry/image-registry-5ccddc7869-2w579"
Jul 08 21:19:46.970183 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.970086    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d7f513e3-b4c6-4ece-bbcb-bef29e97319c-registry-certificates\") pod \"image-registry-5ccddc7869-2w579\" (UID: \"d7f513e3-b4c6-4ece-bbcb-bef29e97319c\") " pod="openshift-image-registry/image-registry-5ccddc7869-2w579"
Jul 08 21:19:46.970885 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.970636    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d7f513e3-b4c6-4ece-bbcb-bef29e97319c-ca-trust-extracted\") pod \"image-registry-5ccddc7869-2w579\" (UID: \"d7f513e3-b4c6-4ece-bbcb-bef29e97319c\") " pod="openshift-image-registry/image-registry-5ccddc7869-2w579"
Jul 08 21:19:46.971057 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.971036    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d7f513e3-b4c6-4ece-bbcb-bef29e97319c-trusted-ca\") pod \"image-registry-5ccddc7869-2w579\" (UID: \"d7f513e3-b4c6-4ece-bbcb-bef29e97319c\") " pod="openshift-image-registry/image-registry-5ccddc7869-2w579"
Jul 08 21:19:46.971428 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.971404    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d7f513e3-b4c6-4ece-bbcb-bef29e97319c-registry-certificates\") pod \"image-registry-5ccddc7869-2w579\" (UID: \"d7f513e3-b4c6-4ece-bbcb-bef29e97319c\") " pod="openshift-image-registry/image-registry-5ccddc7869-2w579"
Jul 08 21:19:46.972530 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.972508    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d7f513e3-b4c6-4ece-bbcb-bef29e97319c-installation-pull-secrets\") pod \"image-registry-5ccddc7869-2w579\" (UID: \"d7f513e3-b4c6-4ece-bbcb-bef29e97319c\") " pod="openshift-image-registry/image-registry-5ccddc7869-2w579"
Jul 08 21:19:46.972641 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.972609    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d7f513e3-b4c6-4ece-bbcb-bef29e97319c-image-registry-private-configuration\") pod \"image-registry-5ccddc7869-2w579\" (UID: \"d7f513e3-b4c6-4ece-bbcb-bef29e97319c\") " pod="openshift-image-registry/image-registry-5ccddc7869-2w579"
Jul 08 21:19:46.972641 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.972622    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7f513e3-b4c6-4ece-bbcb-bef29e97319c-registry-tls\") pod \"image-registry-5ccddc7869-2w579\" (UID: \"d7f513e3-b4c6-4ece-bbcb-bef29e97319c\") " pod="openshift-image-registry/image-registry-5ccddc7869-2w579"
Jul 08 21:19:46.977964 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.977603    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7f513e3-b4c6-4ece-bbcb-bef29e97319c-bound-sa-token\") pod \"image-registry-5ccddc7869-2w579\" (UID: \"d7f513e3-b4c6-4ece-bbcb-bef29e97319c\") " pod="openshift-image-registry/image-registry-5ccddc7869-2w579"
Jul 08 21:19:46.978139 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:46.978023    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv24g\" (UniqueName: \"kubernetes.io/projected/d7f513e3-b4c6-4ece-bbcb-bef29e97319c-kube-api-access-vv24g\") pod \"image-registry-5ccddc7869-2w579\" (UID: \"d7f513e3-b4c6-4ece-bbcb-bef29e97319c\") " pod="openshift-image-registry/image-registry-5ccddc7869-2w579"
Jul 08 21:19:47.012633 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:47.012608    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5ccddc7869-2w579"
Jul 08 21:19:47.136301 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:47.136264    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5ccddc7869-2w579"]
Jul 08 21:19:47.140143 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:19:47.140118    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7f513e3_b4c6_4ece_bbcb_bef29e97319c.slice/crio-0f3b7a5144347edc4776c8066ef5dbe0b0c6c9da863fd8bd6338ff8e37c893d1 WatchSource:0}: Error finding container 0f3b7a5144347edc4776c8066ef5dbe0b0c6c9da863fd8bd6338ff8e37c893d1: Status 404 returned error can't find the container with id 0f3b7a5144347edc4776c8066ef5dbe0b0c6c9da863fd8bd6338ff8e37c893d1
Jul 08 21:19:47.642106 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:47.642060    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-67x2p" event={"ID":"36bda6e3-fb2a-45b7-86f1-008dea6ef292","Type":"ContainerStarted","Data":"f0257e7473763802175b16c233dd0f64a5a801273acfa5aa65e4c932f3346eb3"}
Jul 08 21:19:47.644121 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:47.644093    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5ccddc7869-2w579" event={"ID":"d7f513e3-b4c6-4ece-bbcb-bef29e97319c","Type":"ContainerStarted","Data":"46cda35c759e0c2481cd84b94fa0217230deab755ff92401b79ca5d2d13e6bf6"}
Jul 08 21:19:47.644266 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:47.644141    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5ccddc7869-2w579" event={"ID":"d7f513e3-b4c6-4ece-bbcb-bef29e97319c","Type":"ContainerStarted","Data":"0f3b7a5144347edc4776c8066ef5dbe0b0c6c9da863fd8bd6338ff8e37c893d1"}
Jul 08 21:19:47.644321 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:47.644273    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5ccddc7869-2w579"
Jul 08 21:19:47.662185 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:47.662127    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5ccddc7869-2w579" podStartSLOduration=1.6621086250000001 podStartE2EDuration="1.662108625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:19:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:19:47.661070119 +0000 UTC m=+248.315972839" watchObservedRunningTime="2026-07-08 21:19:47.662108625 +0000 UTC m=+248.317011344"
Jul 08 21:19:49.653094 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:49.653012    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-67x2p" event={"ID":"36bda6e3-fb2a-45b7-86f1-008dea6ef292","Type":"ContainerStarted","Data":"98c859e712d9c8f5cfa67e989d9b0fa3986dc34110cc38c442dd387782a1ec2f"}
Jul 08 21:19:49.668836 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:49.668783    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-67x2p" podStartSLOduration=17.147211835 podStartE2EDuration="23.668738519s" totalImagesPullingTime="6.521526684s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:19:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:19:49.668256508 +0000 UTC m=+250.323159256" watchObservedRunningTime="2026-07-08 21:19:49.668738519 +0000 UTC m=+250.323641243"
Jul 08 21:19:51.602944 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:51.602896    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf041d9-9dcf-4edd-b480-dc0051905946-metrics-certs\") pod \"network-metrics-daemon-w5tkg\" (UID: \"bcf041d9-9dcf-4edd-b480-dc0051905946\") " pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:19:51.605323 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:51.605302    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf041d9-9dcf-4edd-b480-dc0051905946-metrics-certs\") pod \"network-metrics-daemon-w5tkg\" (UID: \"bcf041d9-9dcf-4edd-b480-dc0051905946\") " pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:19:51.665189 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:51.665158    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nffz7\""
Jul 08 21:19:51.673197 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:51.673179    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5tkg"
Jul 08 21:19:51.794475 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:51.794400    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w5tkg"]
Jul 08 21:19:51.796998 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:19:51.796971    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcf041d9_9dcf_4edd_b480_dc0051905946.slice/crio-180e294cbb154bff965ce715f77c0c1e433cd80a2e43c73247608ec694d7b7b8 WatchSource:0}: Error finding container 180e294cbb154bff965ce715f77c0c1e433cd80a2e43c73247608ec694d7b7b8: Status 404 returned error can't find the container with id 180e294cbb154bff965ce715f77c0c1e433cd80a2e43c73247608ec694d7b7b8
Jul 08 21:19:52.663037 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:52.662996    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w5tkg" event={"ID":"bcf041d9-9dcf-4edd-b480-dc0051905946","Type":"ContainerStarted","Data":"180e294cbb154bff965ce715f77c0c1e433cd80a2e43c73247608ec694d7b7b8"}
Jul 08 21:19:53.668374 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:53.668332    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w5tkg" event={"ID":"bcf041d9-9dcf-4edd-b480-dc0051905946","Type":"ContainerStarted","Data":"7d86fad7b7cf7959e84f117a816f2d9e1bd323ffc658bdffc03dbb1fec9778c0"}
Jul 08 21:19:53.668775 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:53.668383    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w5tkg" event={"ID":"bcf041d9-9dcf-4edd-b480-dc0051905946","Type":"ContainerStarted","Data":"7bc7be4fa9b7ffcf4cdc5b5a6114e543eab012aaff3cf187eebe69fe734c66b0"}
Jul 08 21:19:53.685869 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:19:53.685825    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-w5tkg" podStartSLOduration=253.50472029 podStartE2EDuration="4m14.685811307s" totalImagesPullingTime="1.181091017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:19:53.684612537 +0000 UTC m=+254.339515257" watchObservedRunningTime="2026-07-08 21:19:53.685811307 +0000 UTC m=+254.340714025"
Jul 08 21:20:02.943009 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:02.942934    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nthml"]
Jul 08 21:20:02.944909 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:02.944893    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nthml"
Jul 08 21:20:02.947841 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:02.947812    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 08 21:20:02.947841 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:02.947822    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 08 21:20:02.948095 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:02.948075    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 08 21:20:02.948133 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:02.948100    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 08 21:20:02.948907 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:02.948893    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 08 21:20:02.948958 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:02.948926    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-r9fbs\""
Jul 08 21:20:02.949173 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:02.949161    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 08 21:20:02.987501 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:02.987470    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-858dw\" (UniqueName: \"kubernetes.io/projected/a1537a24-4ec5-4832-b85e-d9a579b2b885-kube-api-access-858dw\") pod \"node-exporter-nthml\" (UID: \"a1537a24-4ec5-4832-b85e-d9a579b2b885\") " pod="openshift-monitoring/node-exporter-nthml"
Jul 08 21:20:02.987639 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:02.987511    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a1537a24-4ec5-4832-b85e-d9a579b2b885-node-exporter-wtmp\") pod \"node-exporter-nthml\" (UID: \"a1537a24-4ec5-4832-b85e-d9a579b2b885\") " pod="openshift-monitoring/node-exporter-nthml"
Jul 08 21:20:02.987639 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:02.987535    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a1537a24-4ec5-4832-b85e-d9a579b2b885-node-exporter-tls\") pod \"node-exporter-nthml\" (UID: \"a1537a24-4ec5-4832-b85e-d9a579b2b885\") " pod="openshift-monitoring/node-exporter-nthml"
Jul 08 21:20:02.987639 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:02.987591    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a1537a24-4ec5-4832-b85e-d9a579b2b885-node-exporter-textfile\") pod \"node-exporter-nthml\" (UID: \"a1537a24-4ec5-4832-b85e-d9a579b2b885\") " pod="openshift-monitoring/node-exporter-nthml"
Jul 08 21:20:02.987639 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:02.987617    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a1537a24-4ec5-4832-b85e-d9a579b2b885-node-exporter-accelerators-collector-config\") pod \"node-exporter-nthml\" (UID: \"a1537a24-4ec5-4832-b85e-d9a579b2b885\") " pod="openshift-monitoring/node-exporter-nthml"
Jul 08 21:20:02.987876 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:02.987641    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1537a24-4ec5-4832-b85e-d9a579b2b885-sys\") pod \"node-exporter-nthml\" (UID: \"a1537a24-4ec5-4832-b85e-d9a579b2b885\") " pod="openshift-monitoring/node-exporter-nthml"
Jul 08 21:20:02.987876 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:02.987667    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1537a24-4ec5-4832-b85e-d9a579b2b885-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nthml\" (UID: \"a1537a24-4ec5-4832-b85e-d9a579b2b885\") " pod="openshift-monitoring/node-exporter-nthml"
Jul 08 21:20:02.987876 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:02.987708    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a1537a24-4ec5-4832-b85e-d9a579b2b885-root\") pod \"node-exporter-nthml\" (UID: \"a1537a24-4ec5-4832-b85e-d9a579b2b885\") " pod="openshift-monitoring/node-exporter-nthml"
Jul 08 21:20:02.987876 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:02.987733    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1537a24-4ec5-4832-b85e-d9a579b2b885-metrics-client-ca\") pod \"node-exporter-nthml\" (UID: \"a1537a24-4ec5-4832-b85e-d9a579b2b885\") " pod="openshift-monitoring/node-exporter-nthml"
Jul 08 21:20:03.088509 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:03.088478    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a1537a24-4ec5-4832-b85e-d9a579b2b885-root\") pod \"node-exporter-nthml\" (UID: \"a1537a24-4ec5-4832-b85e-d9a579b2b885\") " pod="openshift-monitoring/node-exporter-nthml"
Jul 08 21:20:03.088509 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:03.088509    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1537a24-4ec5-4832-b85e-d9a579b2b885-metrics-client-ca\") pod \"node-exporter-nthml\" (UID: \"a1537a24-4ec5-4832-b85e-d9a579b2b885\") " pod="openshift-monitoring/node-exporter-nthml"
Jul 08 21:20:03.088722 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:03.088533    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-858dw\" (UniqueName: \"kubernetes.io/projected/a1537a24-4ec5-4832-b85e-d9a579b2b885-kube-api-access-858dw\") pod \"node-exporter-nthml\" (UID: \"a1537a24-4ec5-4832-b85e-d9a579b2b885\") " pod="openshift-monitoring/node-exporter-nthml"
Jul 08 21:20:03.088722 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:03.088583    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a1537a24-4ec5-4832-b85e-d9a579b2b885-node-exporter-wtmp\") pod \"node-exporter-nthml\" (UID: \"a1537a24-4ec5-4832-b85e-d9a579b2b885\") " pod="openshift-monitoring/node-exporter-nthml"
Jul 08 21:20:03.088722 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:03.088631    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a1537a24-4ec5-4832-b85e-d9a579b2b885-node-exporter-tls\") pod \"node-exporter-nthml\" (UID: \"a1537a24-4ec5-4832-b85e-d9a579b2b885\") " pod="openshift-monitoring/node-exporter-nthml"
Jul 08 21:20:03.088722 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:03.088664    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a1537a24-4ec5-4832-b85e-d9a579b2b885-root\") pod \"node-exporter-nthml\" (UID: \"a1537a24-4ec5-4832-b85e-d9a579b2b885\") " pod="openshift-monitoring/node-exporter-nthml"
Jul 08 21:20:03.088722 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:03.088704    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a1537a24-4ec5-4832-b85e-d9a579b2b885-node-exporter-textfile\") pod \"node-exporter-nthml\" (UID: \"a1537a24-4ec5-4832-b85e-d9a579b2b885\") " pod="openshift-monitoring/node-exporter-nthml"
Jul 08 21:20:03.088975 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:03.088793    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a1537a24-4ec5-4832-b85e-d9a579b2b885-node-exporter-wtmp\") pod \"node-exporter-nthml\" (UID: \"a1537a24-4ec5-4832-b85e-d9a579b2b885\") " pod="openshift-monitoring/node-exporter-nthml"
Jul 08 21:20:03.088975 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:03.088837    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a1537a24-4ec5-4832-b85e-d9a579b2b885-node-exporter-accelerators-collector-config\") pod \"node-exporter-nthml\" (UID: \"a1537a24-4ec5-4832-b85e-d9a579b2b885\") " pod="openshift-monitoring/node-exporter-nthml"
Jul 08 21:20:03.088975 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:03.088872    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1537a24-4ec5-4832-b85e-d9a579b2b885-sys\") pod \"node-exporter-nthml\" (UID: \"a1537a24-4ec5-4832-b85e-d9a579b2b885\") " pod="openshift-monitoring/node-exporter-nthml"
Jul 08 21:20:03.088975 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:03.088904    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1537a24-4ec5-4832-b85e-d9a579b2b885-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nthml\" (UID: \"a1537a24-4ec5-4832-b85e-d9a579b2b885\") " pod="openshift-monitoring/node-exporter-nthml"
Jul 08 21:20:03.088975 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:03.088944    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1537a24-4ec5-4832-b85e-d9a579b2b885-sys\") pod \"node-exporter-nthml\" (UID: \"a1537a24-4ec5-4832-b85e-d9a579b2b885\") " pod="openshift-monitoring/node-exporter-nthml"
Jul 08 21:20:03.089217 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:03.088978    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a1537a24-4ec5-4832-b85e-d9a579b2b885-node-exporter-textfile\") pod \"node-exporter-nthml\" (UID: \"a1537a24-4ec5-4832-b85e-d9a579b2b885\") " pod="openshift-monitoring/node-exporter-nthml"
Jul 08 21:20:03.089217 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:03.089150    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1537a24-4ec5-4832-b85e-d9a579b2b885-metrics-client-ca\") pod \"node-exporter-nthml\" (UID: \"a1537a24-4ec5-4832-b85e-d9a579b2b885\") " pod="openshift-monitoring/node-exporter-nthml"
Jul 08 21:20:03.089386 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:03.089363    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a1537a24-4ec5-4832-b85e-d9a579b2b885-node-exporter-accelerators-collector-config\") pod \"node-exporter-nthml\" (UID: \"a1537a24-4ec5-4832-b85e-d9a579b2b885\") " pod="openshift-monitoring/node-exporter-nthml"
Jul 08 21:20:03.091253 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:03.091234    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a1537a24-4ec5-4832-b85e-d9a579b2b885-node-exporter-tls\") pod \"node-exporter-nthml\" (UID: \"a1537a24-4ec5-4832-b85e-d9a579b2b885\") " pod="openshift-monitoring/node-exporter-nthml"
Jul 08 21:20:03.091300 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:03.091242    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1537a24-4ec5-4832-b85e-d9a579b2b885-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nthml\" (UID: \"a1537a24-4ec5-4832-b85e-d9a579b2b885\") " pod="openshift-monitoring/node-exporter-nthml"
Jul 08 21:20:03.097973 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:03.097954    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-858dw\" (UniqueName: \"kubernetes.io/projected/a1537a24-4ec5-4832-b85e-d9a579b2b885-kube-api-access-858dw\") pod \"node-exporter-nthml\" (UID: \"a1537a24-4ec5-4832-b85e-d9a579b2b885\") " pod="openshift-monitoring/node-exporter-nthml"
Jul 08 21:20:03.253658 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:03.253593    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nthml"
Jul 08 21:20:03.266852 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:20:03.266820    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1537a24_4ec5_4832_b85e_d9a579b2b885.slice/crio-5d7c8d5b44009d1f815de17cae835e39174db2de1a9e66c108a4c86282b551c3 WatchSource:0}: Error finding container 5d7c8d5b44009d1f815de17cae835e39174db2de1a9e66c108a4c86282b551c3: Status 404 returned error can't find the container with id 5d7c8d5b44009d1f815de17cae835e39174db2de1a9e66c108a4c86282b551c3
Jul 08 21:20:03.700890 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:03.700858    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nthml" event={"ID":"a1537a24-4ec5-4832-b85e-d9a579b2b885","Type":"ContainerStarted","Data":"5d7c8d5b44009d1f815de17cae835e39174db2de1a9e66c108a4c86282b551c3"}
Jul 08 21:20:04.707064 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:04.707031    2571 generic.go:356] "Generic (PLEG): container finished" podID="a1537a24-4ec5-4832-b85e-d9a579b2b885" containerID="c2124a514dc07dad50e76bf3819af92fba3d2dca80fc5f88fd92b16a9217a529" exitCode=0
Jul 08 21:20:04.707382 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:04.707088    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nthml" event={"ID":"a1537a24-4ec5-4832-b85e-d9a579b2b885","Type":"ContainerDied","Data":"c2124a514dc07dad50e76bf3819af92fba3d2dca80fc5f88fd92b16a9217a529"}
Jul 08 21:20:05.712666 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:05.712623    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nthml" event={"ID":"a1537a24-4ec5-4832-b85e-d9a579b2b885","Type":"ContainerStarted","Data":"253db85da33226c4b63d76fb0f6ffeb9db08ab50b270af4391f33cff3fb4e393"}
Jul 08 21:20:05.713058 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:05.712701    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nthml" event={"ID":"a1537a24-4ec5-4832-b85e-d9a579b2b885","Type":"ContainerStarted","Data":"4b5ececaa4443810fa6020f81d30a2948aeff6107c0acf12b18955e7f8711c5d"}
Jul 08 21:20:05.732853 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:05.732807    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nthml" podStartSLOduration=2.444969005 podStartE2EDuration="3.732793468s" totalImagesPullingTime="1.217981999s" totalInitContainerRuntime="69.842464ms" isStatefulPod=true podCreationTimestamp="2026-07-08 21:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:20:05.732651732 +0000 UTC m=+266.387554451" watchObservedRunningTime="2026-07-08 21:20:05.732793468 +0000 UTC m=+266.387696186"
Jul 08 21:20:07.017219 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:07.017186    2571 patch_prober.go:28] interesting pod/image-registry-5ccddc7869-2w579 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 08 21:20:07.017579 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:07.017234    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5ccddc7869-2w579" podUID="d7f513e3-b4c6-4ece-bbcb-bef29e97319c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 21:20:08.652397 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:08.652360    2571 patch_prober.go:28] interesting pod/image-registry-5ccddc7869-2w579 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 08 21:20:08.652779 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:08.652414    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5ccddc7869-2w579" podUID="d7f513e3-b4c6-4ece-bbcb-bef29e97319c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 21:20:17.016867 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:17.016831    2571 patch_prober.go:28] interesting pod/image-registry-5ccddc7869-2w579 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 08 21:20:17.017293 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:17.016889    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5ccddc7869-2w579" podUID="d7f513e3-b4c6-4ece-bbcb-bef29e97319c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 21:20:18.651782 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:18.651734    2571 patch_prober.go:28] interesting pod/image-registry-5ccddc7869-2w579 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 08 21:20:18.652158 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:18.651804    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5ccddc7869-2w579" podUID="d7f513e3-b4c6-4ece-bbcb-bef29e97319c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 21:20:22.894689 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:22.894656    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9bdfb99f4-6gqc5"]
Jul 08 21:20:22.913763 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:22.913726    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9bdfb99f4-6gqc5"]
Jul 08 21:20:22.913890 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:22.913850    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9bdfb99f4-6gqc5"
Jul 08 21:20:22.916490 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:22.916473    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 08 21:20:22.916714 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:22.916701    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 08 21:20:22.917715 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:22.917693    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 08 21:20:22.917715 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:22.917706    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lwb72\""
Jul 08 21:20:22.917896 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:22.917696    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 08 21:20:22.917896 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:22.917795    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 08 21:20:22.917896 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:22.917819    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 08 21:20:22.918051 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:22.917909    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 08 21:20:23.023083 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:23.023044    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d45cf2b-67af-4cf5-964c-6ae45031ac53-console-oauth-config\") pod \"console-9bdfb99f4-6gqc5\" (UID: \"6d45cf2b-67af-4cf5-964c-6ae45031ac53\") " pod="openshift-console/console-9bdfb99f4-6gqc5"
Jul 08 21:20:23.023083 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:23.023078    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d45cf2b-67af-4cf5-964c-6ae45031ac53-oauth-serving-cert\") pod \"console-9bdfb99f4-6gqc5\" (UID: \"6d45cf2b-67af-4cf5-964c-6ae45031ac53\") " pod="openshift-console/console-9bdfb99f4-6gqc5"
Jul 08 21:20:23.023302 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:23.023096    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db9r2\" (UniqueName: \"kubernetes.io/projected/6d45cf2b-67af-4cf5-964c-6ae45031ac53-kube-api-access-db9r2\") pod \"console-9bdfb99f4-6gqc5\" (UID: \"6d45cf2b-67af-4cf5-964c-6ae45031ac53\") " pod="openshift-console/console-9bdfb99f4-6gqc5"
Jul 08 21:20:23.023302 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:23.023126    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d45cf2b-67af-4cf5-964c-6ae45031ac53-service-ca\") pod \"console-9bdfb99f4-6gqc5\" (UID: \"6d45cf2b-67af-4cf5-964c-6ae45031ac53\") " pod="openshift-console/console-9bdfb99f4-6gqc5"
Jul 08 21:20:23.023302 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:23.023169    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d45cf2b-67af-4cf5-964c-6ae45031ac53-console-config\") pod \"console-9bdfb99f4-6gqc5\" (UID: \"6d45cf2b-67af-4cf5-964c-6ae45031ac53\") " pod="openshift-console/console-9bdfb99f4-6gqc5"
Jul 08 21:20:23.023302 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:23.023202    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d45cf2b-67af-4cf5-964c-6ae45031ac53-console-serving-cert\") pod \"console-9bdfb99f4-6gqc5\" (UID: \"6d45cf2b-67af-4cf5-964c-6ae45031ac53\") " pod="openshift-console/console-9bdfb99f4-6gqc5"
Jul 08 21:20:23.124416 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:23.124380    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d45cf2b-67af-4cf5-964c-6ae45031ac53-console-serving-cert\") pod \"console-9bdfb99f4-6gqc5\" (UID: \"6d45cf2b-67af-4cf5-964c-6ae45031ac53\") " pod="openshift-console/console-9bdfb99f4-6gqc5"
Jul 08 21:20:23.124575 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:23.124448    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d45cf2b-67af-4cf5-964c-6ae45031ac53-console-oauth-config\") pod \"console-9bdfb99f4-6gqc5\" (UID: \"6d45cf2b-67af-4cf5-964c-6ae45031ac53\") " pod="openshift-console/console-9bdfb99f4-6gqc5"
Jul 08 21:20:23.124575 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:23.124467    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d45cf2b-67af-4cf5-964c-6ae45031ac53-oauth-serving-cert\") pod \"console-9bdfb99f4-6gqc5\" (UID: \"6d45cf2b-67af-4cf5-964c-6ae45031ac53\") " pod="openshift-console/console-9bdfb99f4-6gqc5"
Jul 08 21:20:23.124575 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:23.124485    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db9r2\" (UniqueName: \"kubernetes.io/projected/6d45cf2b-67af-4cf5-964c-6ae45031ac53-kube-api-access-db9r2\") pod \"console-9bdfb99f4-6gqc5\" (UID: \"6d45cf2b-67af-4cf5-964c-6ae45031ac53\") " pod="openshift-console/console-9bdfb99f4-6gqc5"
Jul 08 21:20:23.124575 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:23.124506    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d45cf2b-67af-4cf5-964c-6ae45031ac53-service-ca\") pod \"console-9bdfb99f4-6gqc5\" (UID: \"6d45cf2b-67af-4cf5-964c-6ae45031ac53\") " pod="openshift-console/console-9bdfb99f4-6gqc5"
Jul 08 21:20:23.124575 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:23.124524    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d45cf2b-67af-4cf5-964c-6ae45031ac53-console-config\") pod \"console-9bdfb99f4-6gqc5\" (UID: \"6d45cf2b-67af-4cf5-964c-6ae45031ac53\") " pod="openshift-console/console-9bdfb99f4-6gqc5"
Jul 08 21:20:23.125321 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:23.125298    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d45cf2b-67af-4cf5-964c-6ae45031ac53-service-ca\") pod \"console-9bdfb99f4-6gqc5\" (UID: \"6d45cf2b-67af-4cf5-964c-6ae45031ac53\") " pod="openshift-console/console-9bdfb99f4-6gqc5"
Jul 08 21:20:23.125384 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:23.125335    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d45cf2b-67af-4cf5-964c-6ae45031ac53-console-config\") pod \"console-9bdfb99f4-6gqc5\" (UID: \"6d45cf2b-67af-4cf5-964c-6ae45031ac53\") " pod="openshift-console/console-9bdfb99f4-6gqc5"
Jul 08 21:20:23.125548 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:23.125526    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d45cf2b-67af-4cf5-964c-6ae45031ac53-oauth-serving-cert\") pod \"console-9bdfb99f4-6gqc5\" (UID: \"6d45cf2b-67af-4cf5-964c-6ae45031ac53\") " pod="openshift-console/console-9bdfb99f4-6gqc5"
Jul 08 21:20:23.126909 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:23.126892    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d45cf2b-67af-4cf5-964c-6ae45031ac53-console-oauth-config\") pod \"console-9bdfb99f4-6gqc5\" (UID: \"6d45cf2b-67af-4cf5-964c-6ae45031ac53\") " pod="openshift-console/console-9bdfb99f4-6gqc5"
Jul 08 21:20:23.126990 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:23.126943    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d45cf2b-67af-4cf5-964c-6ae45031ac53-console-serving-cert\") pod \"console-9bdfb99f4-6gqc5\" (UID: \"6d45cf2b-67af-4cf5-964c-6ae45031ac53\") " pod="openshift-console/console-9bdfb99f4-6gqc5"
Jul 08 21:20:23.132184 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:23.132165    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-db9r2\" (UniqueName: \"kubernetes.io/projected/6d45cf2b-67af-4cf5-964c-6ae45031ac53-kube-api-access-db9r2\") pod \"console-9bdfb99f4-6gqc5\" (UID: \"6d45cf2b-67af-4cf5-964c-6ae45031ac53\") " pod="openshift-console/console-9bdfb99f4-6gqc5"
Jul 08 21:20:23.222990 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:23.222951    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9bdfb99f4-6gqc5"
Jul 08 21:20:23.346046 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:23.346021    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9bdfb99f4-6gqc5"]
Jul 08 21:20:23.348405 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:20:23.348374    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d45cf2b_67af_4cf5_964c_6ae45031ac53.slice/crio-63d3ca5ef7c0b67f2810d6e7c8f646b610ed4b3a7769e55e59bdf9d3e7ad61bd WatchSource:0}: Error finding container 63d3ca5ef7c0b67f2810d6e7c8f646b610ed4b3a7769e55e59bdf9d3e7ad61bd: Status 404 returned error can't find the container with id 63d3ca5ef7c0b67f2810d6e7c8f646b610ed4b3a7769e55e59bdf9d3e7ad61bd
Jul 08 21:20:23.768422 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:23.768388    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9bdfb99f4-6gqc5" event={"ID":"6d45cf2b-67af-4cf5-964c-6ae45031ac53","Type":"ContainerStarted","Data":"63d3ca5ef7c0b67f2810d6e7c8f646b610ed4b3a7769e55e59bdf9d3e7ad61bd"}
Jul 08 21:20:26.386579 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:20:26.386534    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-27wfb" podUID="f9d47a6b-4d3c-42ba-8965-67b29cfaad5e"
Jul 08 21:20:26.780131 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:26.780096    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-27wfb"
Jul 08 21:20:27.016797 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:27.016771    2571 patch_prober.go:28] interesting pod/image-registry-5ccddc7869-2w579 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 08 21:20:27.016886 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:27.016827    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5ccddc7869-2w579" podUID="d7f513e3-b4c6-4ece-bbcb-bef29e97319c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 21:20:27.016886 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:27.016869    2571 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-5ccddc7869-2w579"
Jul 08 21:20:27.017386 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:27.017347    2571 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"46cda35c759e0c2481cd84b94fa0217230deab755ff92401b79ca5d2d13e6bf6"} pod="openshift-image-registry/image-registry-5ccddc7869-2w579" containerMessage="Container registry failed liveness probe, will be restarted"
Jul 08 21:20:27.022208 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:27.022172    2571 patch_prober.go:28] interesting pod/image-registry-5ccddc7869-2w579 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 08 21:20:27.022309 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:27.022226    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5ccddc7869-2w579" podUID="d7f513e3-b4c6-4ece-bbcb-bef29e97319c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 21:20:27.784334 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:27.784295    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9bdfb99f4-6gqc5" event={"ID":"6d45cf2b-67af-4cf5-964c-6ae45031ac53","Type":"ContainerStarted","Data":"dc04c6d4aee5df2499f2585b059e939f915654efaa09edbd90f28264476a59ba"}
Jul 08 21:20:27.802505 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:27.802457    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9bdfb99f4-6gqc5" podStartSLOduration=2.198679138 podStartE2EDuration="5.802442582s" totalImagesPullingTime="3.603763444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:20:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:20:27.800398393 +0000 UTC m=+288.455301127" watchObservedRunningTime="2026-07-08 21:20:27.802442582 +0000 UTC m=+288.457345300"
Jul 08 21:20:29.287805 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:29.287776    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cf4f9bc85-dqrxh"]
Jul 08 21:20:29.289717 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:29.289701    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf4f9bc85-dqrxh"
Jul 08 21:20:29.297137 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:29.297117    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 08 21:20:29.300795 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:29.300772    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cf4f9bc85-dqrxh"]
Jul 08 21:20:29.373731 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:29.373704    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d456378-13d3-45b0-af4b-3b2beb50d66d-console-config\") pod \"console-6cf4f9bc85-dqrxh\" (UID: \"1d456378-13d3-45b0-af4b-3b2beb50d66d\") " pod="openshift-console/console-6cf4f9bc85-dqrxh"
Jul 08 21:20:29.373869 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:29.373736    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d456378-13d3-45b0-af4b-3b2beb50d66d-oauth-serving-cert\") pod \"console-6cf4f9bc85-dqrxh\" (UID: \"1d456378-13d3-45b0-af4b-3b2beb50d66d\") " pod="openshift-console/console-6cf4f9bc85-dqrxh"
Jul 08 21:20:29.373869 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:29.373811    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d456378-13d3-45b0-af4b-3b2beb50d66d-console-oauth-config\") pod \"console-6cf4f9bc85-dqrxh\" (UID: \"1d456378-13d3-45b0-af4b-3b2beb50d66d\") " pod="openshift-console/console-6cf4f9bc85-dqrxh"
Jul 08 21:20:29.373869 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:29.373844    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d456378-13d3-45b0-af4b-3b2beb50d66d-console-serving-cert\") pod \"console-6cf4f9bc85-dqrxh\" (UID: \"1d456378-13d3-45b0-af4b-3b2beb50d66d\") " pod="openshift-console/console-6cf4f9bc85-dqrxh"
Jul 08 21:20:29.373869 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:29.373866    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d456378-13d3-45b0-af4b-3b2beb50d66d-service-ca\") pod \"console-6cf4f9bc85-dqrxh\" (UID: \"1d456378-13d3-45b0-af4b-3b2beb50d66d\") " pod="openshift-console/console-6cf4f9bc85-dqrxh"
Jul 08 21:20:29.374044 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:29.373892    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d456378-13d3-45b0-af4b-3b2beb50d66d-trusted-ca-bundle\") pod \"console-6cf4f9bc85-dqrxh\" (UID: \"1d456378-13d3-45b0-af4b-3b2beb50d66d\") " pod="openshift-console/console-6cf4f9bc85-dqrxh"
Jul 08 21:20:29.374044 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:29.373926    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7sll\" (UniqueName: \"kubernetes.io/projected/1d456378-13d3-45b0-af4b-3b2beb50d66d-kube-api-access-m7sll\") pod \"console-6cf4f9bc85-dqrxh\" (UID: \"1d456378-13d3-45b0-af4b-3b2beb50d66d\") " pod="openshift-console/console-6cf4f9bc85-dqrxh"
Jul 08 21:20:29.474603 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:29.474575    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d456378-13d3-45b0-af4b-3b2beb50d66d-trusted-ca-bundle\") pod \"console-6cf4f9bc85-dqrxh\" (UID: \"1d456378-13d3-45b0-af4b-3b2beb50d66d\") " pod="openshift-console/console-6cf4f9bc85-dqrxh"
Jul 08 21:20:29.474715 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:29.474615    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7sll\" (UniqueName: \"kubernetes.io/projected/1d456378-13d3-45b0-af4b-3b2beb50d66d-kube-api-access-m7sll\") pod \"console-6cf4f9bc85-dqrxh\" (UID: \"1d456378-13d3-45b0-af4b-3b2beb50d66d\") " pod="openshift-console/console-6cf4f9bc85-dqrxh"
Jul 08 21:20:29.474715 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:29.474638    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d456378-13d3-45b0-af4b-3b2beb50d66d-console-config\") pod \"console-6cf4f9bc85-dqrxh\" (UID: \"1d456378-13d3-45b0-af4b-3b2beb50d66d\") " pod="openshift-console/console-6cf4f9bc85-dqrxh"
Jul 08 21:20:29.474715 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:29.474666    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d456378-13d3-45b0-af4b-3b2beb50d66d-oauth-serving-cert\") pod \"console-6cf4f9bc85-dqrxh\" (UID: \"1d456378-13d3-45b0-af4b-3b2beb50d66d\") " pod="openshift-console/console-6cf4f9bc85-dqrxh"
Jul 08 21:20:29.474890 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:29.474795    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d456378-13d3-45b0-af4b-3b2beb50d66d-console-oauth-config\") pod \"console-6cf4f9bc85-dqrxh\" (UID: \"1d456378-13d3-45b0-af4b-3b2beb50d66d\") " pod="openshift-console/console-6cf4f9bc85-dqrxh"
Jul 08 21:20:29.474890 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:29.474847    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d456378-13d3-45b0-af4b-3b2beb50d66d-console-serving-cert\") pod \"console-6cf4f9bc85-dqrxh\" (UID: \"1d456378-13d3-45b0-af4b-3b2beb50d66d\") " pod="openshift-console/console-6cf4f9bc85-dqrxh"
Jul 08 21:20:29.474890 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:29.474879    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d456378-13d3-45b0-af4b-3b2beb50d66d-service-ca\") pod \"console-6cf4f9bc85-dqrxh\" (UID: \"1d456378-13d3-45b0-af4b-3b2beb50d66d\") " pod="openshift-console/console-6cf4f9bc85-dqrxh"
Jul 08 21:20:29.475412 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:29.475382    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d456378-13d3-45b0-af4b-3b2beb50d66d-console-config\") pod \"console-6cf4f9bc85-dqrxh\" (UID: \"1d456378-13d3-45b0-af4b-3b2beb50d66d\") " pod="openshift-console/console-6cf4f9bc85-dqrxh"
Jul 08 21:20:29.475515 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:29.475415    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d456378-13d3-45b0-af4b-3b2beb50d66d-oauth-serving-cert\") pod \"console-6cf4f9bc85-dqrxh\" (UID: \"1d456378-13d3-45b0-af4b-3b2beb50d66d\") " pod="openshift-console/console-6cf4f9bc85-dqrxh"
Jul 08 21:20:29.475515 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:29.475422    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d456378-13d3-45b0-af4b-3b2beb50d66d-trusted-ca-bundle\") pod \"console-6cf4f9bc85-dqrxh\" (UID: \"1d456378-13d3-45b0-af4b-3b2beb50d66d\") " pod="openshift-console/console-6cf4f9bc85-dqrxh"
Jul 08 21:20:29.475515 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:29.475478    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d456378-13d3-45b0-af4b-3b2beb50d66d-service-ca\") pod \"console-6cf4f9bc85-dqrxh\" (UID: \"1d456378-13d3-45b0-af4b-3b2beb50d66d\") " pod="openshift-console/console-6cf4f9bc85-dqrxh"
Jul 08 21:20:29.477442 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:29.477421    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d456378-13d3-45b0-af4b-3b2beb50d66d-console-serving-cert\") pod \"console-6cf4f9bc85-dqrxh\" (UID: \"1d456378-13d3-45b0-af4b-3b2beb50d66d\") " pod="openshift-console/console-6cf4f9bc85-dqrxh"
Jul 08 21:20:29.477518 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:29.477455    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d456378-13d3-45b0-af4b-3b2beb50d66d-console-oauth-config\") pod \"console-6cf4f9bc85-dqrxh\" (UID: \"1d456378-13d3-45b0-af4b-3b2beb50d66d\") " pod="openshift-console/console-6cf4f9bc85-dqrxh"
Jul 08 21:20:29.481957 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:29.481937    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7sll\" (UniqueName: \"kubernetes.io/projected/1d456378-13d3-45b0-af4b-3b2beb50d66d-kube-api-access-m7sll\") pod \"console-6cf4f9bc85-dqrxh\" (UID: \"1d456378-13d3-45b0-af4b-3b2beb50d66d\") " pod="openshift-console/console-6cf4f9bc85-dqrxh"
Jul 08 21:20:29.598696 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:29.598621    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf4f9bc85-dqrxh"
Jul 08 21:20:29.719686 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:29.719663    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cf4f9bc85-dqrxh"]
Jul 08 21:20:29.722044 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:20:29.722016    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d456378_13d3_45b0_af4b_3b2beb50d66d.slice/crio-56b3062355831209c6ffae323f793b8d377ef97b40526236f09d46aa71f086e9 WatchSource:0}: Error finding container 56b3062355831209c6ffae323f793b8d377ef97b40526236f09d46aa71f086e9: Status 404 returned error can't find the container with id 56b3062355831209c6ffae323f793b8d377ef97b40526236f09d46aa71f086e9
Jul 08 21:20:29.793046 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:29.793017    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf4f9bc85-dqrxh" event={"ID":"1d456378-13d3-45b0-af4b-3b2beb50d66d","Type":"ContainerStarted","Data":"e88a758de4dbdc994ba31c714068a9e6ee9b4cab7671e031e8211d272093fe10"}
Jul 08 21:20:29.793146 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:29.793069    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf4f9bc85-dqrxh" event={"ID":"1d456378-13d3-45b0-af4b-3b2beb50d66d","Type":"ContainerStarted","Data":"56b3062355831209c6ffae323f793b8d377ef97b40526236f09d46aa71f086e9"}
Jul 08 21:20:29.810846 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:29.810801    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6cf4f9bc85-dqrxh" podStartSLOduration=0.810787811 podStartE2EDuration="810.787811ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:20:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:20:29.809500565 +0000 UTC m=+290.464403288" watchObservedRunningTime="2026-07-08 21:20:29.810787811 +0000 UTC m=+290.465690530"
Jul 08 21:20:30.179990 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:30.179947    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-metrics-tls\") pod \"dns-default-27wfb\" (UID: \"f9d47a6b-4d3c-42ba-8965-67b29cfaad5e\") " pod="openshift-dns/dns-default-27wfb"
Jul 08 21:20:30.182428 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:30.182400    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9d47a6b-4d3c-42ba-8965-67b29cfaad5e-metrics-tls\") pod \"dns-default-27wfb\" (UID: \"f9d47a6b-4d3c-42ba-8965-67b29cfaad5e\") " pod="openshift-dns/dns-default-27wfb"
Jul 08 21:20:30.382791 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:30.382764    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m6rnx\""
Jul 08 21:20:30.390530 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:30.390513    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-27wfb"
Jul 08 21:20:30.508878 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:30.508849    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-27wfb"]
Jul 08 21:20:30.511610 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:20:30.511580    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9d47a6b_4d3c_42ba_8965_67b29cfaad5e.slice/crio-c9e3926cf2c1b89c977c7a13a28ff5ce85824150b748aab2a1675fa3178e22e0 WatchSource:0}: Error finding container c9e3926cf2c1b89c977c7a13a28ff5ce85824150b748aab2a1675fa3178e22e0: Status 404 returned error can't find the container with id c9e3926cf2c1b89c977c7a13a28ff5ce85824150b748aab2a1675fa3178e22e0
Jul 08 21:20:30.797775 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:30.797677    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-27wfb" event={"ID":"f9d47a6b-4d3c-42ba-8965-67b29cfaad5e","Type":"ContainerStarted","Data":"c9e3926cf2c1b89c977c7a13a28ff5ce85824150b748aab2a1675fa3178e22e0"}
Jul 08 21:20:31.249832 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:31.249790    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt" podUID="c5ae5ff2-3f4b-4db3-a41f-0adf81c103db" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 08 21:20:32.806013 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:32.805976    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-27wfb" event={"ID":"f9d47a6b-4d3c-42ba-8965-67b29cfaad5e","Type":"ContainerStarted","Data":"eaa0c9cd02159a8ff227f6b3c2bef8283724da2418af68b25ecb0d78c9a0d6c7"}
Jul 08 21:20:32.806471 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:32.806031    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-27wfb" event={"ID":"f9d47a6b-4d3c-42ba-8965-67b29cfaad5e","Type":"ContainerStarted","Data":"95f8aac2078bd91f44d7c82b4d3c089b41f8bd4f2f870e388a0abb147e0c0537"}
Jul 08 21:20:32.806471 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:32.806110    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-27wfb"
Jul 08 21:20:32.822993 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:32.822950    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-27wfb" podStartSLOduration=251.301284774 podStartE2EDuration="4m12.822936487s" totalImagesPullingTime="1.521651713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:16:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:20:32.821322965 +0000 UTC m=+293.476225696" watchObservedRunningTime="2026-07-08 21:20:32.822936487 +0000 UTC m=+293.477839252"
Jul 08 21:20:33.223314 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:33.223285    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9bdfb99f4-6gqc5"
Jul 08 21:20:33.223488 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:33.223341    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9bdfb99f4-6gqc5"
Jul 08 21:20:33.224857 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:33.224832    2571 patch_prober.go:28] interesting pod/console-9bdfb99f4-6gqc5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.12:8443/health\": dial tcp 10.132.0.12:8443: connect: connection refused" start-of-body=
Jul 08 21:20:33.224970 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:33.224872    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-9bdfb99f4-6gqc5" podUID="6d45cf2b-67af-4cf5-964c-6ae45031ac53" containerName="console" probeResult="failure" output="Get \"https://10.132.0.12:8443/health\": dial tcp 10.132.0.12:8443: connect: connection refused"
Jul 08 21:20:37.021744 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:37.021711    2571 patch_prober.go:28] interesting pod/image-registry-5ccddc7869-2w579 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 08 21:20:37.022104 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:37.021782    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5ccddc7869-2w579" podUID="d7f513e3-b4c6-4ece-bbcb-bef29e97319c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 21:20:39.599048 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:39.599000    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cf4f9bc85-dqrxh"
Jul 08 21:20:39.599048 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:39.599066    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cf4f9bc85-dqrxh"
Jul 08 21:20:39.600305 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:39.600282    2571 patch_prober.go:28] interesting pod/console-6cf4f9bc85-dqrxh container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.13:8443/health\": dial tcp 10.132.0.13:8443: connect: connection refused" start-of-body=
Jul 08 21:20:39.600393 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:39.600325    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6cf4f9bc85-dqrxh" podUID="1d456378-13d3-45b0-af4b-3b2beb50d66d" containerName="console" probeResult="failure" output="Get \"https://10.132.0.13:8443/health\": dial tcp 10.132.0.13:8443: connect: connection refused"
Jul 08 21:20:39.754578 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:39.754539    2571 kubelet.go:1648] "Image garbage collection succeeded"
Jul 08 21:20:41.249736 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:41.249700    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt" podUID="c5ae5ff2-3f4b-4db3-a41f-0adf81c103db" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 08 21:20:42.811558 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:42.811531    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-27wfb"
Jul 08 21:20:43.227180 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:43.227154    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9bdfb99f4-6gqc5"
Jul 08 21:20:43.231160 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:43.231135    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9bdfb99f4-6gqc5"
Jul 08 21:20:47.021377 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:47.021343    2571 patch_prober.go:28] interesting pod/image-registry-5ccddc7869-2w579 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 08 21:20:47.021739 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:47.021398    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5ccddc7869-2w579" podUID="d7f513e3-b4c6-4ece-bbcb-bef29e97319c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 21:20:47.856836 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:47.856728    2571 generic.go:356] "Generic (PLEG): container finished" podID="33f6b6b8-8e71-4b71-9a0b-2fe2d231a118" containerID="2a5b59d70aaaf12400aba14844253ac4e28f587a2e75f15f94e0777a47f5cf3c" exitCode=1
Jul 08 21:20:47.856836 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:47.856813    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm" event={"ID":"33f6b6b8-8e71-4b71-9a0b-2fe2d231a118","Type":"ContainerDied","Data":"2a5b59d70aaaf12400aba14844253ac4e28f587a2e75f15f94e0777a47f5cf3c"}
Jul 08 21:20:47.857054 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:47.856905    2571 scope.go:117] "RemoveContainer" containerID="ad9f157a2f3083c004af26255783332c9d91cd1b6680f44098b51675b9b61bca"
Jul 08 21:20:47.857237 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:47.857223    2571 scope.go:117] "RemoveContainer" containerID="2a5b59d70aaaf12400aba14844253ac4e28f587a2e75f15f94e0777a47f5cf3c"
Jul 08 21:20:47.857455 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:20:47.857433    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-8589b6c9f8-tphtm_open-cluster-management-agent-addon(33f6b6b8-8e71-4b71-9a0b-2fe2d231a118)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm" podUID="33f6b6b8-8e71-4b71-9a0b-2fe2d231a118"
Jul 08 21:20:48.459035 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:48.458998    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm"
Jul 08 21:20:48.861245 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:48.861156    2571 scope.go:117] "RemoveContainer" containerID="2a5b59d70aaaf12400aba14844253ac4e28f587a2e75f15f94e0777a47f5cf3c"
Jul 08 21:20:48.861404 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:20:48.861355    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-8589b6c9f8-tphtm_open-cluster-management-agent-addon(33f6b6b8-8e71-4b71-9a0b-2fe2d231a118)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm" podUID="33f6b6b8-8e71-4b71-9a0b-2fe2d231a118"
Jul 08 21:20:49.602873 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:49.602840    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6cf4f9bc85-dqrxh"
Jul 08 21:20:49.606459 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:49.606437    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6cf4f9bc85-dqrxh"
Jul 08 21:20:49.664794 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:49.664741    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9bdfb99f4-6gqc5"]
Jul 08 21:20:51.249918 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:51.249880    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt" podUID="c5ae5ff2-3f4b-4db3-a41f-0adf81c103db" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 08 21:20:51.250272 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:51.249947    2571 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt"
Jul 08 21:20:51.250376 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:51.250361    2571 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"3dce161e98f182d87fecca3cb579a0fc34a199517ffca112c3ab87de7ed41cc8"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 08 21:20:51.250413 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:51.250396    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt" podUID="c5ae5ff2-3f4b-4db3-a41f-0adf81c103db" containerName="service-proxy" containerID="cri-o://3dce161e98f182d87fecca3cb579a0fc34a199517ffca112c3ab87de7ed41cc8" gracePeriod=30
Jul 08 21:20:51.253887 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:51.253865    2571 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm"
Jul 08 21:20:51.254247 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:51.254233    2571 scope.go:117] "RemoveContainer" containerID="2a5b59d70aaaf12400aba14844253ac4e28f587a2e75f15f94e0777a47f5cf3c"
Jul 08 21:20:51.254414 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:20:51.254395    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-8589b6c9f8-tphtm_open-cluster-management-agent-addon(33f6b6b8-8e71-4b71-9a0b-2fe2d231a118)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm" podUID="33f6b6b8-8e71-4b71-9a0b-2fe2d231a118"
Jul 08 21:20:51.877424 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:51.877392    2571 generic.go:356] "Generic (PLEG): container finished" podID="c5ae5ff2-3f4b-4db3-a41f-0adf81c103db" containerID="3dce161e98f182d87fecca3cb579a0fc34a199517ffca112c3ab87de7ed41cc8" exitCode=2
Jul 08 21:20:51.877585 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:51.877440    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt" event={"ID":"c5ae5ff2-3f4b-4db3-a41f-0adf81c103db","Type":"ContainerDied","Data":"3dce161e98f182d87fecca3cb579a0fc34a199517ffca112c3ab87de7ed41cc8"}
Jul 08 21:20:51.877585 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:51.877470    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bd8c97cd-sfpqt" event={"ID":"c5ae5ff2-3f4b-4db3-a41f-0adf81c103db","Type":"ContainerStarted","Data":"0351cbef9d70c4b1f189c109b1e597abbc822f7472010fd581b7119c02477225"}
Jul 08 21:20:52.039658 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:52.039626    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5ccddc7869-2w579" podUID="d7f513e3-b4c6-4ece-bbcb-bef29e97319c" containerName="registry" containerID="cri-o://46cda35c759e0c2481cd84b94fa0217230deab755ff92401b79ca5d2d13e6bf6" gracePeriod=30
Jul 08 21:20:52.780178 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:52.780148    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-27wfb_f9d47a6b-4d3c-42ba-8965-67b29cfaad5e/dns/0.log"
Jul 08 21:20:52.980475 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:52.980454    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-27wfb_f9d47a6b-4d3c-42ba-8965-67b29cfaad5e/kube-rbac-proxy/0.log"
Jul 08 21:20:53.886910 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:53.886878    2571 generic.go:356] "Generic (PLEG): container finished" podID="d7f513e3-b4c6-4ece-bbcb-bef29e97319c" containerID="46cda35c759e0c2481cd84b94fa0217230deab755ff92401b79ca5d2d13e6bf6" exitCode=0
Jul 08 21:20:53.887282 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:53.886957    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5ccddc7869-2w579" event={"ID":"d7f513e3-b4c6-4ece-bbcb-bef29e97319c","Type":"ContainerDied","Data":"46cda35c759e0c2481cd84b94fa0217230deab755ff92401b79ca5d2d13e6bf6"}
Jul 08 21:20:53.887282 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:53.887000    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5ccddc7869-2w579" event={"ID":"d7f513e3-b4c6-4ece-bbcb-bef29e97319c","Type":"ContainerStarted","Data":"2b11f6bad36608f408732f4bb3e1cab1cf75e5815ee67feeba1ef5d76b7ab80c"}
Jul 08 21:20:53.887282 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:53.887144    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5ccddc7869-2w579"
Jul 08 21:20:54.179922 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:54.179892    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kwg77_db7d97d7-b4b1-4c44-a4e8-be1d3590a217/dns-node-resolver/0.log"
Jul 08 21:20:54.780207 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:20:54.780184    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8v56v_05b59558-56ed-4741-ac0f-2911399956a1/serve-healthcheck-canary/0.log"
Jul 08 21:21:02.862142 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:02.862117    2571 scope.go:117] "RemoveContainer" containerID="2a5b59d70aaaf12400aba14844253ac4e28f587a2e75f15f94e0777a47f5cf3c"
Jul 08 21:21:03.922625 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:03.922587    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm" event={"ID":"33f6b6b8-8e71-4b71-9a0b-2fe2d231a118","Type":"ContainerStarted","Data":"c859815b38d71c602363f8476d836cc5fc30abddf7620acf29d3330db26eeaf8"}
Jul 08 21:21:03.923009 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:03.922980    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm"
Jul 08 21:21:03.924535 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:03.924512    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8589b6c9f8-tphtm"
Jul 08 21:21:14.688780 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:14.688719    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-9bdfb99f4-6gqc5" podUID="6d45cf2b-67af-4cf5-964c-6ae45031ac53" containerName="console" containerID="cri-o://dc04c6d4aee5df2499f2585b059e939f915654efaa09edbd90f28264476a59ba" gracePeriod=15
Jul 08 21:21:14.894493 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:14.894468    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5ccddc7869-2w579"
Jul 08 21:21:14.945524 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:14.945461    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9bdfb99f4-6gqc5"
Jul 08 21:21:14.960345 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:14.960314    2571 generic.go:356] "Generic (PLEG): container finished" podID="6d45cf2b-67af-4cf5-964c-6ae45031ac53" containerID="dc04c6d4aee5df2499f2585b059e939f915654efaa09edbd90f28264476a59ba" exitCode=0
Jul 08 21:21:14.960503 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:14.960364    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9bdfb99f4-6gqc5"
Jul 08 21:21:14.960503 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:14.960363    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9bdfb99f4-6gqc5" event={"ID":"6d45cf2b-67af-4cf5-964c-6ae45031ac53","Type":"ContainerDied","Data":"dc04c6d4aee5df2499f2585b059e939f915654efaa09edbd90f28264476a59ba"}
Jul 08 21:21:14.960503 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:14.960488    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9bdfb99f4-6gqc5" event={"ID":"6d45cf2b-67af-4cf5-964c-6ae45031ac53","Type":"ContainerDied","Data":"63d3ca5ef7c0b67f2810d6e7c8f646b610ed4b3a7769e55e59bdf9d3e7ad61bd"}
Jul 08 21:21:14.960683 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:14.960509    2571 scope.go:117] "RemoveContainer" containerID="dc04c6d4aee5df2499f2585b059e939f915654efaa09edbd90f28264476a59ba"
Jul 08 21:21:14.969599 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:14.969554    2571 scope.go:117] "RemoveContainer" containerID="dc04c6d4aee5df2499f2585b059e939f915654efaa09edbd90f28264476a59ba"
Jul 08 21:21:14.969935 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:21:14.969904    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc04c6d4aee5df2499f2585b059e939f915654efaa09edbd90f28264476a59ba\": container with ID starting with dc04c6d4aee5df2499f2585b059e939f915654efaa09edbd90f28264476a59ba not found: ID does not exist" containerID="dc04c6d4aee5df2499f2585b059e939f915654efaa09edbd90f28264476a59ba"
Jul 08 21:21:14.970063 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:14.969947    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc04c6d4aee5df2499f2585b059e939f915654efaa09edbd90f28264476a59ba"} err="failed to get container status \"dc04c6d4aee5df2499f2585b059e939f915654efaa09edbd90f28264476a59ba\": rpc error: code = NotFound desc = could not find container \"dc04c6d4aee5df2499f2585b059e939f915654efaa09edbd90f28264476a59ba\": container with ID starting with dc04c6d4aee5df2499f2585b059e939f915654efaa09edbd90f28264476a59ba not found: ID does not exist"
Jul 08 21:21:15.009561 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:15.009535    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d45cf2b-67af-4cf5-964c-6ae45031ac53-service-ca\") pod \"6d45cf2b-67af-4cf5-964c-6ae45031ac53\" (UID: \"6d45cf2b-67af-4cf5-964c-6ae45031ac53\") "
Jul 08 21:21:15.009709 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:15.009573    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d45cf2b-67af-4cf5-964c-6ae45031ac53-console-oauth-config\") pod \"6d45cf2b-67af-4cf5-964c-6ae45031ac53\" (UID: \"6d45cf2b-67af-4cf5-964c-6ae45031ac53\") "
Jul 08 21:21:15.009709 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:15.009610    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d45cf2b-67af-4cf5-964c-6ae45031ac53-console-config\") pod \"6d45cf2b-67af-4cf5-964c-6ae45031ac53\" (UID: \"6d45cf2b-67af-4cf5-964c-6ae45031ac53\") "
Jul 08 21:21:15.009709 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:15.009635    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d45cf2b-67af-4cf5-964c-6ae45031ac53-console-serving-cert\") pod \"6d45cf2b-67af-4cf5-964c-6ae45031ac53\" (UID: \"6d45cf2b-67af-4cf5-964c-6ae45031ac53\") "
Jul 08 21:21:15.009709 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:15.009672    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-db9r2\" (UniqueName: \"kubernetes.io/projected/6d45cf2b-67af-4cf5-964c-6ae45031ac53-kube-api-access-db9r2\") pod \"6d45cf2b-67af-4cf5-964c-6ae45031ac53\" (UID: \"6d45cf2b-67af-4cf5-964c-6ae45031ac53\") "
Jul 08 21:21:15.009709 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:15.009700    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d45cf2b-67af-4cf5-964c-6ae45031ac53-oauth-serving-cert\") pod \"6d45cf2b-67af-4cf5-964c-6ae45031ac53\" (UID: \"6d45cf2b-67af-4cf5-964c-6ae45031ac53\") "
Jul 08 21:21:15.010123 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:15.010097    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d45cf2b-67af-4cf5-964c-6ae45031ac53-console-config" (OuterVolumeSpecName: "console-config") pod "6d45cf2b-67af-4cf5-964c-6ae45031ac53" (UID: "6d45cf2b-67af-4cf5-964c-6ae45031ac53"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:21:15.010123 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:15.010014    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d45cf2b-67af-4cf5-964c-6ae45031ac53-service-ca" (OuterVolumeSpecName: "service-ca") pod "6d45cf2b-67af-4cf5-964c-6ae45031ac53" (UID: "6d45cf2b-67af-4cf5-964c-6ae45031ac53"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:21:15.010255 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:15.010152    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d45cf2b-67af-4cf5-964c-6ae45031ac53-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6d45cf2b-67af-4cf5-964c-6ae45031ac53" (UID: "6d45cf2b-67af-4cf5-964c-6ae45031ac53"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:21:15.012131 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:15.012108    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d45cf2b-67af-4cf5-964c-6ae45031ac53-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6d45cf2b-67af-4cf5-964c-6ae45031ac53" (UID: "6d45cf2b-67af-4cf5-964c-6ae45031ac53"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:21:15.012243 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:15.012217    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d45cf2b-67af-4cf5-964c-6ae45031ac53-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6d45cf2b-67af-4cf5-964c-6ae45031ac53" (UID: "6d45cf2b-67af-4cf5-964c-6ae45031ac53"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:21:15.012243 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:15.012231    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d45cf2b-67af-4cf5-964c-6ae45031ac53-kube-api-access-db9r2" (OuterVolumeSpecName: "kube-api-access-db9r2") pod "6d45cf2b-67af-4cf5-964c-6ae45031ac53" (UID: "6d45cf2b-67af-4cf5-964c-6ae45031ac53"). InnerVolumeSpecName "kube-api-access-db9r2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:21:15.111041 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:15.111007    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d45cf2b-67af-4cf5-964c-6ae45031ac53-console-serving-cert\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:21:15.111041 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:15.111034    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-db9r2\" (UniqueName: \"kubernetes.io/projected/6d45cf2b-67af-4cf5-964c-6ae45031ac53-kube-api-access-db9r2\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:21:15.111041 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:15.111044    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d45cf2b-67af-4cf5-964c-6ae45031ac53-oauth-serving-cert\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:21:15.111259 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:15.111061    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d45cf2b-67af-4cf5-964c-6ae45031ac53-service-ca\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:21:15.111259 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:15.111072    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d45cf2b-67af-4cf5-964c-6ae45031ac53-console-oauth-config\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:21:15.111259 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:15.111080    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d45cf2b-67af-4cf5-964c-6ae45031ac53-console-config\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:21:15.284300 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:15.284270    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9bdfb99f4-6gqc5"]
Jul 08 21:21:15.287378 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:15.287353    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9bdfb99f4-6gqc5"]
Jul 08 21:21:15.866364 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:15.866332    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d45cf2b-67af-4cf5-964c-6ae45031ac53" path="/var/lib/kubelet/pods/6d45cf2b-67af-4cf5-964c-6ae45031ac53/volumes"
Jul 08 21:21:31.612986 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:31.612912    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bc84b4cc6-xl2qs"]
Jul 08 21:21:31.613413 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:31.613141    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d45cf2b-67af-4cf5-964c-6ae45031ac53" containerName="console"
Jul 08 21:21:31.613413 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:31.613152    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d45cf2b-67af-4cf5-964c-6ae45031ac53" containerName="console"
Jul 08 21:21:31.613413 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:31.613219    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d45cf2b-67af-4cf5-964c-6ae45031ac53" containerName="console"
Jul 08 21:21:31.615930 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:31.615914    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bc84b4cc6-xl2qs"
Jul 08 21:21:31.627041 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:31.627018    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bc84b4cc6-xl2qs"]
Jul 08 21:21:31.729455 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:31.729424    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e797262f-402e-4955-9e00-43d6346f1440-console-oauth-config\") pod \"console-bc84b4cc6-xl2qs\" (UID: \"e797262f-402e-4955-9e00-43d6346f1440\") " pod="openshift-console/console-bc84b4cc6-xl2qs"
Jul 08 21:21:31.729455 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:31.729456    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e797262f-402e-4955-9e00-43d6346f1440-console-config\") pod \"console-bc84b4cc6-xl2qs\" (UID: \"e797262f-402e-4955-9e00-43d6346f1440\") " pod="openshift-console/console-bc84b4cc6-xl2qs"
Jul 08 21:21:31.729671 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:31.729474    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e797262f-402e-4955-9e00-43d6346f1440-service-ca\") pod \"console-bc84b4cc6-xl2qs\" (UID: \"e797262f-402e-4955-9e00-43d6346f1440\") " pod="openshift-console/console-bc84b4cc6-xl2qs"
Jul 08 21:21:31.729671 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:31.729498    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e797262f-402e-4955-9e00-43d6346f1440-trusted-ca-bundle\") pod \"console-bc84b4cc6-xl2qs\" (UID: \"e797262f-402e-4955-9e00-43d6346f1440\") " pod="openshift-console/console-bc84b4cc6-xl2qs"
Jul 08 21:21:31.729671 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:31.729566    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e797262f-402e-4955-9e00-43d6346f1440-oauth-serving-cert\") pod \"console-bc84b4cc6-xl2qs\" (UID: \"e797262f-402e-4955-9e00-43d6346f1440\") " pod="openshift-console/console-bc84b4cc6-xl2qs"
Jul 08 21:21:31.729671 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:31.729633    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks8sb\" (UniqueName: \"kubernetes.io/projected/e797262f-402e-4955-9e00-43d6346f1440-kube-api-access-ks8sb\") pod \"console-bc84b4cc6-xl2qs\" (UID: \"e797262f-402e-4955-9e00-43d6346f1440\") " pod="openshift-console/console-bc84b4cc6-xl2qs"
Jul 08 21:21:31.729671 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:31.729658    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e797262f-402e-4955-9e00-43d6346f1440-console-serving-cert\") pod \"console-bc84b4cc6-xl2qs\" (UID: \"e797262f-402e-4955-9e00-43d6346f1440\") " pod="openshift-console/console-bc84b4cc6-xl2qs"
Jul 08 21:21:31.830408 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:31.830372    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e797262f-402e-4955-9e00-43d6346f1440-console-oauth-config\") pod \"console-bc84b4cc6-xl2qs\" (UID: \"e797262f-402e-4955-9e00-43d6346f1440\") " pod="openshift-console/console-bc84b4cc6-xl2qs"
Jul 08 21:21:31.830408 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:31.830407    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e797262f-402e-4955-9e00-43d6346f1440-console-config\") pod \"console-bc84b4cc6-xl2qs\" (UID: \"e797262f-402e-4955-9e00-43d6346f1440\") " pod="openshift-console/console-bc84b4cc6-xl2qs"
Jul 08 21:21:31.830547 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:31.830425    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e797262f-402e-4955-9e00-43d6346f1440-service-ca\") pod \"console-bc84b4cc6-xl2qs\" (UID: \"e797262f-402e-4955-9e00-43d6346f1440\") " pod="openshift-console/console-bc84b4cc6-xl2qs"
Jul 08 21:21:31.830547 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:31.830450    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e797262f-402e-4955-9e00-43d6346f1440-trusted-ca-bundle\") pod \"console-bc84b4cc6-xl2qs\" (UID: \"e797262f-402e-4955-9e00-43d6346f1440\") " pod="openshift-console/console-bc84b4cc6-xl2qs"
Jul 08 21:21:31.830547 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:31.830477    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e797262f-402e-4955-9e00-43d6346f1440-oauth-serving-cert\") pod \"console-bc84b4cc6-xl2qs\" (UID: \"e797262f-402e-4955-9e00-43d6346f1440\") " pod="openshift-console/console-bc84b4cc6-xl2qs"
Jul 08 21:21:31.830547 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:31.830531    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks8sb\" (UniqueName: \"kubernetes.io/projected/e797262f-402e-4955-9e00-43d6346f1440-kube-api-access-ks8sb\") pod \"console-bc84b4cc6-xl2qs\" (UID: \"e797262f-402e-4955-9e00-43d6346f1440\") " pod="openshift-console/console-bc84b4cc6-xl2qs"
Jul 08 21:21:31.830723 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:31.830562    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e797262f-402e-4955-9e00-43d6346f1440-console-serving-cert\") pod \"console-bc84b4cc6-xl2qs\" (UID: \"e797262f-402e-4955-9e00-43d6346f1440\") " pod="openshift-console/console-bc84b4cc6-xl2qs"
Jul 08 21:21:31.831290 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:31.831178    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e797262f-402e-4955-9e00-43d6346f1440-oauth-serving-cert\") pod \"console-bc84b4cc6-xl2qs\" (UID: \"e797262f-402e-4955-9e00-43d6346f1440\") " pod="openshift-console/console-bc84b4cc6-xl2qs"
Jul 08 21:21:31.831466 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:31.831390    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e797262f-402e-4955-9e00-43d6346f1440-service-ca\") pod \"console-bc84b4cc6-xl2qs\" (UID: \"e797262f-402e-4955-9e00-43d6346f1440\") " pod="openshift-console/console-bc84b4cc6-xl2qs"
Jul 08 21:21:31.831466 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:31.831411    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e797262f-402e-4955-9e00-43d6346f1440-trusted-ca-bundle\") pod \"console-bc84b4cc6-xl2qs\" (UID: \"e797262f-402e-4955-9e00-43d6346f1440\") " pod="openshift-console/console-bc84b4cc6-xl2qs"
Jul 08 21:21:31.831586 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:31.831495    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e797262f-402e-4955-9e00-43d6346f1440-console-config\") pod \"console-bc84b4cc6-xl2qs\" (UID: \"e797262f-402e-4955-9e00-43d6346f1440\") " pod="openshift-console/console-bc84b4cc6-xl2qs"
Jul 08 21:21:31.833083 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:31.833063    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e797262f-402e-4955-9e00-43d6346f1440-console-serving-cert\") pod \"console-bc84b4cc6-xl2qs\" (UID: \"e797262f-402e-4955-9e00-43d6346f1440\") " pod="openshift-console/console-bc84b4cc6-xl2qs"
Jul 08 21:21:31.833186 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:31.833104    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e797262f-402e-4955-9e00-43d6346f1440-console-oauth-config\") pod \"console-bc84b4cc6-xl2qs\" (UID: \"e797262f-402e-4955-9e00-43d6346f1440\") " pod="openshift-console/console-bc84b4cc6-xl2qs"
Jul 08 21:21:31.839162 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:31.839143    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks8sb\" (UniqueName: \"kubernetes.io/projected/e797262f-402e-4955-9e00-43d6346f1440-kube-api-access-ks8sb\") pod \"console-bc84b4cc6-xl2qs\" (UID: \"e797262f-402e-4955-9e00-43d6346f1440\") " pod="openshift-console/console-bc84b4cc6-xl2qs"
Jul 08 21:21:31.924840 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:31.924801    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bc84b4cc6-xl2qs"
Jul 08 21:21:32.055466 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:32.055437    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bc84b4cc6-xl2qs"]
Jul 08 21:21:32.058452 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:21:32.058422    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode797262f_402e_4955_9e00_43d6346f1440.slice/crio-e7bc593a13b3d3b7f1695a7c4da6bd4183ce6f3a1055af7027b33b3516082afb WatchSource:0}: Error finding container e7bc593a13b3d3b7f1695a7c4da6bd4183ce6f3a1055af7027b33b3516082afb: Status 404 returned error can't find the container with id e7bc593a13b3d3b7f1695a7c4da6bd4183ce6f3a1055af7027b33b3516082afb
Jul 08 21:21:33.022041 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:33.022012    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bc84b4cc6-xl2qs" event={"ID":"e797262f-402e-4955-9e00-43d6346f1440","Type":"ContainerStarted","Data":"a68bf2d74a508a735d3997c3e7e28704935abe7441bdcc8ba7f27dbfabf9ee1b"}
Jul 08 21:21:33.022383 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:33.022055    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bc84b4cc6-xl2qs" event={"ID":"e797262f-402e-4955-9e00-43d6346f1440","Type":"ContainerStarted","Data":"e7bc593a13b3d3b7f1695a7c4da6bd4183ce6f3a1055af7027b33b3516082afb"}
Jul 08 21:21:41.925138 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:41.925106    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bc84b4cc6-xl2qs"
Jul 08 21:21:41.925540 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:41.925168    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bc84b4cc6-xl2qs"
Jul 08 21:21:41.929930 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:41.929908    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bc84b4cc6-xl2qs"
Jul 08 21:21:41.947015 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:41.946966    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bc84b4cc6-xl2qs" podStartSLOduration=10.946953698 podStartE2EDuration="10.946953698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:21:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:21:33.039480141 +0000 UTC m=+353.694382862" watchObservedRunningTime="2026-07-08 21:21:41.946953698 +0000 UTC m=+362.601856417"
Jul 08 21:21:42.054373 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:42.054349    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bc84b4cc6-xl2qs"
Jul 08 21:21:42.100316 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:21:42.100284    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cf4f9bc85-dqrxh"]
Jul 08 21:22:07.120681 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:07.120613    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6cf4f9bc85-dqrxh" podUID="1d456378-13d3-45b0-af4b-3b2beb50d66d" containerName="console" containerID="cri-o://e88a758de4dbdc994ba31c714068a9e6ee9b4cab7671e031e8211d272093fe10" gracePeriod=15
Jul 08 21:22:07.355662 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:07.355641    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf4f9bc85-dqrxh"
Jul 08 21:22:07.492889 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:07.492859    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d456378-13d3-45b0-af4b-3b2beb50d66d-console-oauth-config\") pod \"1d456378-13d3-45b0-af4b-3b2beb50d66d\" (UID: \"1d456378-13d3-45b0-af4b-3b2beb50d66d\") "
Jul 08 21:22:07.493050 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:07.492896    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d456378-13d3-45b0-af4b-3b2beb50d66d-service-ca\") pod \"1d456378-13d3-45b0-af4b-3b2beb50d66d\" (UID: \"1d456378-13d3-45b0-af4b-3b2beb50d66d\") "
Jul 08 21:22:07.493050 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:07.492939    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d456378-13d3-45b0-af4b-3b2beb50d66d-oauth-serving-cert\") pod \"1d456378-13d3-45b0-af4b-3b2beb50d66d\" (UID: \"1d456378-13d3-45b0-af4b-3b2beb50d66d\") "
Jul 08 21:22:07.493050 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:07.492956    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7sll\" (UniqueName: \"kubernetes.io/projected/1d456378-13d3-45b0-af4b-3b2beb50d66d-kube-api-access-m7sll\") pod \"1d456378-13d3-45b0-af4b-3b2beb50d66d\" (UID: \"1d456378-13d3-45b0-af4b-3b2beb50d66d\") "
Jul 08 21:22:07.493050 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:07.492986    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d456378-13d3-45b0-af4b-3b2beb50d66d-console-serving-cert\") pod \"1d456378-13d3-45b0-af4b-3b2beb50d66d\" (UID: \"1d456378-13d3-45b0-af4b-3b2beb50d66d\") "
Jul 08 21:22:07.493050 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:07.493005    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d456378-13d3-45b0-af4b-3b2beb50d66d-trusted-ca-bundle\") pod \"1d456378-13d3-45b0-af4b-3b2beb50d66d\" (UID: \"1d456378-13d3-45b0-af4b-3b2beb50d66d\") "
Jul 08 21:22:07.493050 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:07.493037    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d456378-13d3-45b0-af4b-3b2beb50d66d-console-config\") pod \"1d456378-13d3-45b0-af4b-3b2beb50d66d\" (UID: \"1d456378-13d3-45b0-af4b-3b2beb50d66d\") "
Jul 08 21:22:07.493351 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:07.493309    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d456378-13d3-45b0-af4b-3b2beb50d66d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1d456378-13d3-45b0-af4b-3b2beb50d66d" (UID: "1d456378-13d3-45b0-af4b-3b2beb50d66d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:22:07.493351 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:07.493327    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d456378-13d3-45b0-af4b-3b2beb50d66d-service-ca" (OuterVolumeSpecName: "service-ca") pod "1d456378-13d3-45b0-af4b-3b2beb50d66d" (UID: "1d456378-13d3-45b0-af4b-3b2beb50d66d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:22:07.493525 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:07.493500    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d456378-13d3-45b0-af4b-3b2beb50d66d-console-config" (OuterVolumeSpecName: "console-config") pod "1d456378-13d3-45b0-af4b-3b2beb50d66d" (UID: "1d456378-13d3-45b0-af4b-3b2beb50d66d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:22:07.493582 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:07.493534    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d456378-13d3-45b0-af4b-3b2beb50d66d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1d456378-13d3-45b0-af4b-3b2beb50d66d" (UID: "1d456378-13d3-45b0-af4b-3b2beb50d66d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:22:07.495163 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:07.495141    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d456378-13d3-45b0-af4b-3b2beb50d66d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1d456378-13d3-45b0-af4b-3b2beb50d66d" (UID: "1d456378-13d3-45b0-af4b-3b2beb50d66d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:22:07.495303 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:07.495279    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d456378-13d3-45b0-af4b-3b2beb50d66d-kube-api-access-m7sll" (OuterVolumeSpecName: "kube-api-access-m7sll") pod "1d456378-13d3-45b0-af4b-3b2beb50d66d" (UID: "1d456378-13d3-45b0-af4b-3b2beb50d66d"). InnerVolumeSpecName "kube-api-access-m7sll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:22:07.495366 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:07.495345    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d456378-13d3-45b0-af4b-3b2beb50d66d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1d456378-13d3-45b0-af4b-3b2beb50d66d" (UID: "1d456378-13d3-45b0-af4b-3b2beb50d66d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:22:07.594415 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:07.594385    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d456378-13d3-45b0-af4b-3b2beb50d66d-oauth-serving-cert\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:22:07.594415 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:07.594411    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7sll\" (UniqueName: \"kubernetes.io/projected/1d456378-13d3-45b0-af4b-3b2beb50d66d-kube-api-access-m7sll\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:22:07.594415 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:07.594421    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d456378-13d3-45b0-af4b-3b2beb50d66d-console-serving-cert\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:22:07.594596 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:07.594430    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d456378-13d3-45b0-af4b-3b2beb50d66d-trusted-ca-bundle\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:22:07.594596 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:07.594440    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d456378-13d3-45b0-af4b-3b2beb50d66d-console-config\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:22:07.594596 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:07.594448    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d456378-13d3-45b0-af4b-3b2beb50d66d-console-oauth-config\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:22:07.594596 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:07.594455    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d456378-13d3-45b0-af4b-3b2beb50d66d-service-ca\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:22:08.138684 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:08.138598    2571 generic.go:356] "Generic (PLEG): container finished" podID="1d456378-13d3-45b0-af4b-3b2beb50d66d" containerID="e88a758de4dbdc994ba31c714068a9e6ee9b4cab7671e031e8211d272093fe10" exitCode=0
Jul 08 21:22:08.138684 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:08.138645    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf4f9bc85-dqrxh"
Jul 08 21:22:08.138684 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:08.138656    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf4f9bc85-dqrxh" event={"ID":"1d456378-13d3-45b0-af4b-3b2beb50d66d","Type":"ContainerDied","Data":"e88a758de4dbdc994ba31c714068a9e6ee9b4cab7671e031e8211d272093fe10"}
Jul 08 21:22:08.139187 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:08.138694    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf4f9bc85-dqrxh" event={"ID":"1d456378-13d3-45b0-af4b-3b2beb50d66d","Type":"ContainerDied","Data":"56b3062355831209c6ffae323f793b8d377ef97b40526236f09d46aa71f086e9"}
Jul 08 21:22:08.139187 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:08.138713    2571 scope.go:117] "RemoveContainer" containerID="e88a758de4dbdc994ba31c714068a9e6ee9b4cab7671e031e8211d272093fe10"
Jul 08 21:22:08.146461 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:08.146415    2571 scope.go:117] "RemoveContainer" containerID="e88a758de4dbdc994ba31c714068a9e6ee9b4cab7671e031e8211d272093fe10"
Jul 08 21:22:08.146763 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:22:08.146725    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e88a758de4dbdc994ba31c714068a9e6ee9b4cab7671e031e8211d272093fe10\": container with ID starting with e88a758de4dbdc994ba31c714068a9e6ee9b4cab7671e031e8211d272093fe10 not found: ID does not exist" containerID="e88a758de4dbdc994ba31c714068a9e6ee9b4cab7671e031e8211d272093fe10"
Jul 08 21:22:08.146867 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:08.146773    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e88a758de4dbdc994ba31c714068a9e6ee9b4cab7671e031e8211d272093fe10"} err="failed to get container status \"e88a758de4dbdc994ba31c714068a9e6ee9b4cab7671e031e8211d272093fe10\": rpc error: code = NotFound desc = could not find container \"e88a758de4dbdc994ba31c714068a9e6ee9b4cab7671e031e8211d272093fe10\": container with ID starting with e88a758de4dbdc994ba31c714068a9e6ee9b4cab7671e031e8211d272093fe10 not found: ID does not exist"
Jul 08 21:22:08.153508 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:08.153488    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cf4f9bc85-dqrxh"]
Jul 08 21:22:08.161544 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:08.161525    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cf4f9bc85-dqrxh"]
Jul 08 21:22:09.865492 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:22:09.865455    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d456378-13d3-45b0-af4b-3b2beb50d66d" path="/var/lib/kubelet/pods/1d456378-13d3-45b0-af4b-3b2beb50d66d/volumes"
Jul 08 21:23:02.607132 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:02.607054    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d54b6fc9-q7jxw"]
Jul 08 21:23:02.607557 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:02.607299    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d456378-13d3-45b0-af4b-3b2beb50d66d" containerName="console"
Jul 08 21:23:02.607557 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:02.607310    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d456378-13d3-45b0-af4b-3b2beb50d66d" containerName="console"
Jul 08 21:23:02.607557 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:02.607359    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d456378-13d3-45b0-af4b-3b2beb50d66d" containerName="console"
Jul 08 21:23:02.609204 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:02.609188    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d54b6fc9-q7jxw"
Jul 08 21:23:02.623170 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:02.623150    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d54b6fc9-q7jxw"]
Jul 08 21:23:02.673404 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:02.673372    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04297402-de9c-4200-9ab8-df442c4eb549-console-serving-cert\") pod \"console-d54b6fc9-q7jxw\" (UID: \"04297402-de9c-4200-9ab8-df442c4eb549\") " pod="openshift-console/console-d54b6fc9-q7jxw"
Jul 08 21:23:02.673404 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:02.673408    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04297402-de9c-4200-9ab8-df442c4eb549-console-config\") pod \"console-d54b6fc9-q7jxw\" (UID: \"04297402-de9c-4200-9ab8-df442c4eb549\") " pod="openshift-console/console-d54b6fc9-q7jxw"
Jul 08 21:23:02.673606 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:02.673434    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04297402-de9c-4200-9ab8-df442c4eb549-oauth-serving-cert\") pod \"console-d54b6fc9-q7jxw\" (UID: \"04297402-de9c-4200-9ab8-df442c4eb549\") " pod="openshift-console/console-d54b6fc9-q7jxw"
Jul 08 21:23:02.673606 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:02.673506    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04297402-de9c-4200-9ab8-df442c4eb549-service-ca\") pod \"console-d54b6fc9-q7jxw\" (UID: \"04297402-de9c-4200-9ab8-df442c4eb549\") " pod="openshift-console/console-d54b6fc9-q7jxw"
Jul 08 21:23:02.673606 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:02.673544    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7n5j\" (UniqueName: \"kubernetes.io/projected/04297402-de9c-4200-9ab8-df442c4eb549-kube-api-access-d7n5j\") pod \"console-d54b6fc9-q7jxw\" (UID: \"04297402-de9c-4200-9ab8-df442c4eb549\") " pod="openshift-console/console-d54b6fc9-q7jxw"
Jul 08 21:23:02.673606 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:02.673577    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04297402-de9c-4200-9ab8-df442c4eb549-console-oauth-config\") pod \"console-d54b6fc9-q7jxw\" (UID: \"04297402-de9c-4200-9ab8-df442c4eb549\") " pod="openshift-console/console-d54b6fc9-q7jxw"
Jul 08 21:23:02.673736 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:02.673604    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04297402-de9c-4200-9ab8-df442c4eb549-trusted-ca-bundle\") pod \"console-d54b6fc9-q7jxw\" (UID: \"04297402-de9c-4200-9ab8-df442c4eb549\") " pod="openshift-console/console-d54b6fc9-q7jxw"
Jul 08 21:23:02.774837 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:02.774805    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04297402-de9c-4200-9ab8-df442c4eb549-console-serving-cert\") pod \"console-d54b6fc9-q7jxw\" (UID: \"04297402-de9c-4200-9ab8-df442c4eb549\") " pod="openshift-console/console-d54b6fc9-q7jxw"
Jul 08 21:23:02.774837 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:02.774837    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04297402-de9c-4200-9ab8-df442c4eb549-console-config\") pod \"console-d54b6fc9-q7jxw\" (UID: \"04297402-de9c-4200-9ab8-df442c4eb549\") " pod="openshift-console/console-d54b6fc9-q7jxw"
Jul 08 21:23:02.775035 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:02.774864    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04297402-de9c-4200-9ab8-df442c4eb549-oauth-serving-cert\") pod \"console-d54b6fc9-q7jxw\" (UID: \"04297402-de9c-4200-9ab8-df442c4eb549\") " pod="openshift-console/console-d54b6fc9-q7jxw"
Jul 08 21:23:02.775035 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:02.774893    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04297402-de9c-4200-9ab8-df442c4eb549-service-ca\") pod \"console-d54b6fc9-q7jxw\" (UID: \"04297402-de9c-4200-9ab8-df442c4eb549\") " pod="openshift-console/console-d54b6fc9-q7jxw"
Jul 08 21:23:02.775035 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:02.775012    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7n5j\" (UniqueName: \"kubernetes.io/projected/04297402-de9c-4200-9ab8-df442c4eb549-kube-api-access-d7n5j\") pod \"console-d54b6fc9-q7jxw\" (UID: \"04297402-de9c-4200-9ab8-df442c4eb549\") " pod="openshift-console/console-d54b6fc9-q7jxw"
Jul 08 21:23:02.775159 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:02.775075    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04297402-de9c-4200-9ab8-df442c4eb549-console-oauth-config\") pod \"console-d54b6fc9-q7jxw\" (UID: \"04297402-de9c-4200-9ab8-df442c4eb549\") " pod="openshift-console/console-d54b6fc9-q7jxw"
Jul 08 21:23:02.775159 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:02.775118    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04297402-de9c-4200-9ab8-df442c4eb549-trusted-ca-bundle\") pod \"console-d54b6fc9-q7jxw\" (UID: \"04297402-de9c-4200-9ab8-df442c4eb549\") " pod="openshift-console/console-d54b6fc9-q7jxw"
Jul 08 21:23:02.775599 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:02.775569    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04297402-de9c-4200-9ab8-df442c4eb549-service-ca\") pod \"console-d54b6fc9-q7jxw\" (UID: \"04297402-de9c-4200-9ab8-df442c4eb549\") " pod="openshift-console/console-d54b6fc9-q7jxw"
Jul 08 21:23:02.775735 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:02.775648    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04297402-de9c-4200-9ab8-df442c4eb549-console-config\") pod \"console-d54b6fc9-q7jxw\" (UID: \"04297402-de9c-4200-9ab8-df442c4eb549\") " pod="openshift-console/console-d54b6fc9-q7jxw"
Jul 08 21:23:02.775735 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:02.775654    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04297402-de9c-4200-9ab8-df442c4eb549-oauth-serving-cert\") pod \"console-d54b6fc9-q7jxw\" (UID: \"04297402-de9c-4200-9ab8-df442c4eb549\") " pod="openshift-console/console-d54b6fc9-q7jxw"
Jul 08 21:23:02.776169 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:02.776145    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04297402-de9c-4200-9ab8-df442c4eb549-trusted-ca-bundle\") pod \"console-d54b6fc9-q7jxw\" (UID: \"04297402-de9c-4200-9ab8-df442c4eb549\") " pod="openshift-console/console-d54b6fc9-q7jxw"
Jul 08 21:23:02.777502 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:02.777480    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04297402-de9c-4200-9ab8-df442c4eb549-console-serving-cert\") pod \"console-d54b6fc9-q7jxw\" (UID: \"04297402-de9c-4200-9ab8-df442c4eb549\") " pod="openshift-console/console-d54b6fc9-q7jxw"
Jul 08 21:23:02.777695 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:02.777663    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04297402-de9c-4200-9ab8-df442c4eb549-console-oauth-config\") pod \"console-d54b6fc9-q7jxw\" (UID: \"04297402-de9c-4200-9ab8-df442c4eb549\") " pod="openshift-console/console-d54b6fc9-q7jxw"
Jul 08 21:23:02.784037 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:02.784015    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7n5j\" (UniqueName: \"kubernetes.io/projected/04297402-de9c-4200-9ab8-df442c4eb549-kube-api-access-d7n5j\") pod \"console-d54b6fc9-q7jxw\" (UID: \"04297402-de9c-4200-9ab8-df442c4eb549\") " pod="openshift-console/console-d54b6fc9-q7jxw"
Jul 08 21:23:02.917975 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:02.917948    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d54b6fc9-q7jxw"
Jul 08 21:23:03.048470 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:03.048441    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d54b6fc9-q7jxw"]
Jul 08 21:23:03.052026 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:23:03.051981    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04297402_de9c_4200_9ab8_df442c4eb549.slice/crio-2657b03088284f7c21d6fe45563facdea29c80203e9f9d7ed2a79be0fb754bd0 WatchSource:0}: Error finding container 2657b03088284f7c21d6fe45563facdea29c80203e9f9d7ed2a79be0fb754bd0: Status 404 returned error can't find the container with id 2657b03088284f7c21d6fe45563facdea29c80203e9f9d7ed2a79be0fb754bd0
Jul 08 21:23:03.320234 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:03.320143    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d54b6fc9-q7jxw" event={"ID":"04297402-de9c-4200-9ab8-df442c4eb549","Type":"ContainerStarted","Data":"650c33631427a7033e8dfe63cabe7923dd77f8330ba6aa9dd53275d99bfaf75f"}
Jul 08 21:23:03.320234 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:03.320190    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d54b6fc9-q7jxw" event={"ID":"04297402-de9c-4200-9ab8-df442c4eb549","Type":"ContainerStarted","Data":"2657b03088284f7c21d6fe45563facdea29c80203e9f9d7ed2a79be0fb754bd0"}
Jul 08 21:23:03.336140 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:03.336089    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d54b6fc9-q7jxw" podStartSLOduration=1.336075001 podStartE2EDuration="1.336075001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:23:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:23:03.335254274 +0000 UTC m=+443.990156992" watchObservedRunningTime="2026-07-08 21:23:03.336075001 +0000 UTC m=+443.990977719"
Jul 08 21:23:12.918589 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:12.918553    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d54b6fc9-q7jxw"
Jul 08 21:23:12.919064 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:12.918607    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d54b6fc9-q7jxw"
Jul 08 21:23:12.923288 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:12.923267    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d54b6fc9-q7jxw"
Jul 08 21:23:13.360599 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:13.360524    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d54b6fc9-q7jxw"
Jul 08 21:23:13.407413 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:13.407388    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bc84b4cc6-xl2qs"]
Jul 08 21:23:38.428238 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:38.428195    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-bc84b4cc6-xl2qs" podUID="e797262f-402e-4955-9e00-43d6346f1440" containerName="console" containerID="cri-o://a68bf2d74a508a735d3997c3e7e28704935abe7441bdcc8ba7f27dbfabf9ee1b" gracePeriod=15
Jul 08 21:23:38.669695 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:38.669670    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bc84b4cc6-xl2qs"
Jul 08 21:23:38.814534 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:38.814439    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e797262f-402e-4955-9e00-43d6346f1440-trusted-ca-bundle\") pod \"e797262f-402e-4955-9e00-43d6346f1440\" (UID: \"e797262f-402e-4955-9e00-43d6346f1440\") "
Jul 08 21:23:38.814534 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:38.814483    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ks8sb\" (UniqueName: \"kubernetes.io/projected/e797262f-402e-4955-9e00-43d6346f1440-kube-api-access-ks8sb\") pod \"e797262f-402e-4955-9e00-43d6346f1440\" (UID: \"e797262f-402e-4955-9e00-43d6346f1440\") "
Jul 08 21:23:38.814534 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:38.814512    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e797262f-402e-4955-9e00-43d6346f1440-console-oauth-config\") pod \"e797262f-402e-4955-9e00-43d6346f1440\" (UID: \"e797262f-402e-4955-9e00-43d6346f1440\") "
Jul 08 21:23:38.814834 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:38.814547    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e797262f-402e-4955-9e00-43d6346f1440-oauth-serving-cert\") pod \"e797262f-402e-4955-9e00-43d6346f1440\" (UID: \"e797262f-402e-4955-9e00-43d6346f1440\") "
Jul 08 21:23:38.814834 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:38.814590    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e797262f-402e-4955-9e00-43d6346f1440-console-serving-cert\") pod \"e797262f-402e-4955-9e00-43d6346f1440\" (UID: \"e797262f-402e-4955-9e00-43d6346f1440\") "
Jul 08 21:23:38.814834 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:38.814630    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e797262f-402e-4955-9e00-43d6346f1440-console-config\") pod \"e797262f-402e-4955-9e00-43d6346f1440\" (UID: \"e797262f-402e-4955-9e00-43d6346f1440\") "
Jul 08 21:23:38.814834 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:38.814652    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e797262f-402e-4955-9e00-43d6346f1440-service-ca\") pod \"e797262f-402e-4955-9e00-43d6346f1440\" (UID: \"e797262f-402e-4955-9e00-43d6346f1440\") "
Jul 08 21:23:38.815073 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:38.815040    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e797262f-402e-4955-9e00-43d6346f1440-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e797262f-402e-4955-9e00-43d6346f1440" (UID: "e797262f-402e-4955-9e00-43d6346f1440"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:23:38.815141 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:38.815076    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e797262f-402e-4955-9e00-43d6346f1440-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e797262f-402e-4955-9e00-43d6346f1440" (UID: "e797262f-402e-4955-9e00-43d6346f1440"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:23:38.815141 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:38.815078    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e797262f-402e-4955-9e00-43d6346f1440-console-config" (OuterVolumeSpecName: "console-config") pod "e797262f-402e-4955-9e00-43d6346f1440" (UID: "e797262f-402e-4955-9e00-43d6346f1440"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:23:38.815221 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:38.815137    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e797262f-402e-4955-9e00-43d6346f1440-service-ca" (OuterVolumeSpecName: "service-ca") pod "e797262f-402e-4955-9e00-43d6346f1440" (UID: "e797262f-402e-4955-9e00-43d6346f1440"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:23:38.816851 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:38.816818    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e797262f-402e-4955-9e00-43d6346f1440-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e797262f-402e-4955-9e00-43d6346f1440" (UID: "e797262f-402e-4955-9e00-43d6346f1440"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:23:38.817239 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:38.817220    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e797262f-402e-4955-9e00-43d6346f1440-kube-api-access-ks8sb" (OuterVolumeSpecName: "kube-api-access-ks8sb") pod "e797262f-402e-4955-9e00-43d6346f1440" (UID: "e797262f-402e-4955-9e00-43d6346f1440"). InnerVolumeSpecName "kube-api-access-ks8sb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:23:38.817239 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:38.817220    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e797262f-402e-4955-9e00-43d6346f1440-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e797262f-402e-4955-9e00-43d6346f1440" (UID: "e797262f-402e-4955-9e00-43d6346f1440"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:23:38.915699 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:38.915671    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e797262f-402e-4955-9e00-43d6346f1440-trusted-ca-bundle\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:23:38.915699 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:38.915695    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ks8sb\" (UniqueName: \"kubernetes.io/projected/e797262f-402e-4955-9e00-43d6346f1440-kube-api-access-ks8sb\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:23:38.915699 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:38.915703    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e797262f-402e-4955-9e00-43d6346f1440-console-oauth-config\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:23:38.915890 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:38.915712    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e797262f-402e-4955-9e00-43d6346f1440-oauth-serving-cert\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:23:38.915890 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:38.915721    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e797262f-402e-4955-9e00-43d6346f1440-console-serving-cert\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:23:38.915890 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:38.915729    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e797262f-402e-4955-9e00-43d6346f1440-console-config\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:23:38.915890 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:38.915737    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e797262f-402e-4955-9e00-43d6346f1440-service-ca\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:23:39.441657 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:39.441618    2571 generic.go:356] "Generic (PLEG): container finished" podID="e797262f-402e-4955-9e00-43d6346f1440" containerID="a68bf2d74a508a735d3997c3e7e28704935abe7441bdcc8ba7f27dbfabf9ee1b" exitCode=0
Jul 08 21:23:39.442050 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:39.441664    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bc84b4cc6-xl2qs"
Jul 08 21:23:39.442050 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:39.441700    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bc84b4cc6-xl2qs" event={"ID":"e797262f-402e-4955-9e00-43d6346f1440","Type":"ContainerDied","Data":"a68bf2d74a508a735d3997c3e7e28704935abe7441bdcc8ba7f27dbfabf9ee1b"}
Jul 08 21:23:39.442050 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:39.441770    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bc84b4cc6-xl2qs" event={"ID":"e797262f-402e-4955-9e00-43d6346f1440","Type":"ContainerDied","Data":"e7bc593a13b3d3b7f1695a7c4da6bd4183ce6f3a1055af7027b33b3516082afb"}
Jul 08 21:23:39.442050 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:39.441792    2571 scope.go:117] "RemoveContainer" containerID="a68bf2d74a508a735d3997c3e7e28704935abe7441bdcc8ba7f27dbfabf9ee1b"
Jul 08 21:23:39.449911 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:39.449891    2571 scope.go:117] "RemoveContainer" containerID="a68bf2d74a508a735d3997c3e7e28704935abe7441bdcc8ba7f27dbfabf9ee1b"
Jul 08 21:23:39.450161 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:23:39.450141    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a68bf2d74a508a735d3997c3e7e28704935abe7441bdcc8ba7f27dbfabf9ee1b\": container with ID starting with a68bf2d74a508a735d3997c3e7e28704935abe7441bdcc8ba7f27dbfabf9ee1b not found: ID does not exist" containerID="a68bf2d74a508a735d3997c3e7e28704935abe7441bdcc8ba7f27dbfabf9ee1b"
Jul 08 21:23:39.450225 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:39.450172    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a68bf2d74a508a735d3997c3e7e28704935abe7441bdcc8ba7f27dbfabf9ee1b"} err="failed to get container status \"a68bf2d74a508a735d3997c3e7e28704935abe7441bdcc8ba7f27dbfabf9ee1b\": rpc error: code = NotFound desc = could not find container \"a68bf2d74a508a735d3997c3e7e28704935abe7441bdcc8ba7f27dbfabf9ee1b\": container with ID starting with a68bf2d74a508a735d3997c3e7e28704935abe7441bdcc8ba7f27dbfabf9ee1b not found: ID does not exist"
Jul 08 21:23:39.460957 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:39.460938    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bc84b4cc6-xl2qs"]
Jul 08 21:23:39.463391 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:39.463372    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bc84b4cc6-xl2qs"]
Jul 08 21:23:39.870399 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:23:39.870368    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e797262f-402e-4955-9e00-43d6346f1440" path="/var/lib/kubelet/pods/e797262f-402e-4955-9e00-43d6346f1440/volumes"
Jul 08 21:24:57.313307 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:24:57.313267    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c9df76854-glzbx"]
Jul 08 21:24:57.313766 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:24:57.313520    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e797262f-402e-4955-9e00-43d6346f1440" containerName="console"
Jul 08 21:24:57.313766 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:24:57.313531    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e797262f-402e-4955-9e00-43d6346f1440" containerName="console"
Jul 08 21:24:57.313766 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:24:57.313575    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e797262f-402e-4955-9e00-43d6346f1440" containerName="console"
Jul 08 21:24:57.316597 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:24:57.316579    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c9df76854-glzbx"
Jul 08 21:24:57.319193 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:24:57.319172    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 08 21:24:57.319298 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:24:57.319173    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-k5x2r\""
Jul 08 21:24:57.319359 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:24:57.319321    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 08 21:24:57.319359 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:24:57.319321    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 08 21:24:57.319437 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:24:57.319403    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 08 21:24:57.330362 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:24:57.330342    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c9df76854-glzbx"]
Jul 08 21:24:57.359424 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:24:57.359395    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1f1b72ca-8176-434f-a907-ebf26051b348-manifests\") pod \"opendatahub-operator-controller-manager-c9df76854-glzbx\" (UID: \"1f1b72ca-8176-434f-a907-ebf26051b348\") " pod="opendatahub/opendatahub-operator-controller-manager-c9df76854-glzbx"
Jul 08 21:24:57.359535 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:24:57.359446    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1f1b72ca-8176-434f-a907-ebf26051b348-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c9df76854-glzbx\" (UID: \"1f1b72ca-8176-434f-a907-ebf26051b348\") " pod="opendatahub/opendatahub-operator-controller-manager-c9df76854-glzbx"
Jul 08 21:24:57.359535 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:24:57.359476    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1f1b72ca-8176-434f-a907-ebf26051b348-webhook-cert\") pod \"opendatahub-operator-controller-manager-c9df76854-glzbx\" (UID: \"1f1b72ca-8176-434f-a907-ebf26051b348\") " pod="opendatahub/opendatahub-operator-controller-manager-c9df76854-glzbx"
Jul 08 21:24:57.359535 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:24:57.359515    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2zfv\" (UniqueName: \"kubernetes.io/projected/1f1b72ca-8176-434f-a907-ebf26051b348-kube-api-access-b2zfv\") pod \"opendatahub-operator-controller-manager-c9df76854-glzbx\" (UID: \"1f1b72ca-8176-434f-a907-ebf26051b348\") " pod="opendatahub/opendatahub-operator-controller-manager-c9df76854-glzbx"
Jul 08 21:24:57.359666 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:24:57.359542    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f1b72ca-8176-434f-a907-ebf26051b348-tmp\") pod \"opendatahub-operator-controller-manager-c9df76854-glzbx\" (UID: \"1f1b72ca-8176-434f-a907-ebf26051b348\") " pod="opendatahub/opendatahub-operator-controller-manager-c9df76854-glzbx"
Jul 08 21:24:57.459851 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:24:57.459826    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1f1b72ca-8176-434f-a907-ebf26051b348-manifests\") pod \"opendatahub-operator-controller-manager-c9df76854-glzbx\" (UID: \"1f1b72ca-8176-434f-a907-ebf26051b348\") " pod="opendatahub/opendatahub-operator-controller-manager-c9df76854-glzbx"
Jul 08 21:24:57.459961 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:24:57.459868    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1f1b72ca-8176-434f-a907-ebf26051b348-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c9df76854-glzbx\" (UID: \"1f1b72ca-8176-434f-a907-ebf26051b348\") " pod="opendatahub/opendatahub-operator-controller-manager-c9df76854-glzbx"
Jul 08 21:24:57.459961 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:24:57.459892    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1f1b72ca-8176-434f-a907-ebf26051b348-webhook-cert\") pod \"opendatahub-operator-controller-manager-c9df76854-glzbx\" (UID: \"1f1b72ca-8176-434f-a907-ebf26051b348\") " pod="opendatahub/opendatahub-operator-controller-manager-c9df76854-glzbx"
Jul 08 21:24:57.459961 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:24:57.459920    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2zfv\" (UniqueName: \"kubernetes.io/projected/1f1b72ca-8176-434f-a907-ebf26051b348-kube-api-access-b2zfv\") pod \"opendatahub-operator-controller-manager-c9df76854-glzbx\" (UID: \"1f1b72ca-8176-434f-a907-ebf26051b348\") " pod="opendatahub/opendatahub-operator-controller-manager-c9df76854-glzbx"
Jul 08 21:24:57.459961 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:24:57.459944    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f1b72ca-8176-434f-a907-ebf26051b348-tmp\") pod \"opendatahub-operator-controller-manager-c9df76854-glzbx\" (UID: \"1f1b72ca-8176-434f-a907-ebf26051b348\") " pod="opendatahub/opendatahub-operator-controller-manager-c9df76854-glzbx"
Jul 08 21:24:57.460290 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:24:57.460263    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1f1b72ca-8176-434f-a907-ebf26051b348-manifests\") pod \"opendatahub-operator-controller-manager-c9df76854-glzbx\" (UID: \"1f1b72ca-8176-434f-a907-ebf26051b348\") " pod="opendatahub/opendatahub-operator-controller-manager-c9df76854-glzbx"
Jul 08 21:24:57.462285 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:24:57.462262    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f1b72ca-8176-434f-a907-ebf26051b348-tmp\") pod \"opendatahub-operator-controller-manager-c9df76854-glzbx\" (UID: \"1f1b72ca-8176-434f-a907-ebf26051b348\") " pod="opendatahub/opendatahub-operator-controller-manager-c9df76854-glzbx"
Jul 08 21:24:57.462551 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:24:57.462533    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1f1b72ca-8176-434f-a907-ebf26051b348-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c9df76854-glzbx\" (UID: \"1f1b72ca-8176-434f-a907-ebf26051b348\") " pod="opendatahub/opendatahub-operator-controller-manager-c9df76854-glzbx"
Jul 08 21:24:57.462634 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:24:57.462624    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1f1b72ca-8176-434f-a907-ebf26051b348-webhook-cert\") pod \"opendatahub-operator-controller-manager-c9df76854-glzbx\" (UID: \"1f1b72ca-8176-434f-a907-ebf26051b348\") " pod="opendatahub/opendatahub-operator-controller-manager-c9df76854-glzbx"
Jul 08 21:24:57.469439 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:24:57.469420    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2zfv\" (UniqueName: \"kubernetes.io/projected/1f1b72ca-8176-434f-a907-ebf26051b348-kube-api-access-b2zfv\") pod \"opendatahub-operator-controller-manager-c9df76854-glzbx\" (UID: \"1f1b72ca-8176-434f-a907-ebf26051b348\") " pod="opendatahub/opendatahub-operator-controller-manager-c9df76854-glzbx"
Jul 08 21:24:57.626187 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:24:57.626103    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c9df76854-glzbx"
Jul 08 21:24:57.761137 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:24:57.761109    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c9df76854-glzbx"]
Jul 08 21:24:57.764015 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:24:57.763991    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f1b72ca_8176_434f_a907_ebf26051b348.slice/crio-c6f325b336017b7d470becb878b556debc71daffb393313e07f29c61dbbb3d89 WatchSource:0}: Error finding container c6f325b336017b7d470becb878b556debc71daffb393313e07f29c61dbbb3d89: Status 404 returned error can't find the container with id c6f325b336017b7d470becb878b556debc71daffb393313e07f29c61dbbb3d89
Jul 08 21:24:57.765709 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:24:57.765693    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 21:24:58.711166 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:24:58.711118    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c9df76854-glzbx" event={"ID":"1f1b72ca-8176-434f-a907-ebf26051b348","Type":"ContainerStarted","Data":"c6f325b336017b7d470becb878b556debc71daffb393313e07f29c61dbbb3d89"}
Jul 08 21:25:01.723838 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:01.723801    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c9df76854-glzbx" event={"ID":"1f1b72ca-8176-434f-a907-ebf26051b348","Type":"ContainerStarted","Data":"0f686af6caccc1271f6f523e5f0c0599dc5ecf0e2f9b0054c94d8a4e8f23c8d6"}
Jul 08 21:25:02.728824 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:02.728783    2571 generic.go:356] "Generic (PLEG): container finished" podID="1f1b72ca-8176-434f-a907-ebf26051b348" containerID="0f686af6caccc1271f6f523e5f0c0599dc5ecf0e2f9b0054c94d8a4e8f23c8d6" exitCode=0
Jul 08 21:25:02.729263 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:02.728829    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c9df76854-glzbx" event={"ID":"1f1b72ca-8176-434f-a907-ebf26051b348","Type":"ContainerDied","Data":"0f686af6caccc1271f6f523e5f0c0599dc5ecf0e2f9b0054c94d8a4e8f23c8d6"}
Jul 08 21:25:03.733769 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:03.733705    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c9df76854-glzbx" event={"ID":"1f1b72ca-8176-434f-a907-ebf26051b348","Type":"ContainerStarted","Data":"b9fb72df4ca3e841d8e61555856ccc963c29d64f8ec42c5f0089c509a564a6d6"}
Jul 08 21:25:03.734117 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:03.733836    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-c9df76854-glzbx"
Jul 08 21:25:03.757256 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:03.757211    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-c9df76854-glzbx" podStartSLOduration=2.197967646 podStartE2EDuration="6.757198784s" totalImagesPullingTime="3.545507241s" totalInitContainerRuntime="1.013723897s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:24:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:25:03.755172087 +0000 UTC m=+564.410074823" watchObservedRunningTime="2026-07-08 21:25:03.757198784 +0000 UTC m=+564.412101503"
Jul 08 21:25:14.739857 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:14.739827    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-c9df76854-glzbx"
Jul 08 21:25:16.221823 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:16.221788    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cdf98c45c-jvqn7"]
Jul 08 21:25:16.231234 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:16.231209    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cdf98c45c-jvqn7"
Jul 08 21:25:16.234238 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:16.234208    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 08 21:25:16.234238 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:16.234232    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 08 21:25:16.234424 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:16.234232    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 08 21:25:16.234424 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:16.234316    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 08 21:25:16.234424 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:16.234214    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 08 21:25:16.234719 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:16.234701    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cdf98c45c-jvqn7"]
Jul 08 21:25:16.234952 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:16.234934    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-c5h42\""
Jul 08 21:25:16.303482 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:16.303451    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/58e9ed4e-ec3b-4619-b38d-9f47ddd37da8-manager-config\") pod \"lws-controller-manager-5cdf98c45c-jvqn7\" (UID: \"58e9ed4e-ec3b-4619-b38d-9f47ddd37da8\") " pod="openshift-lws-operator/lws-controller-manager-5cdf98c45c-jvqn7"
Jul 08 21:25:16.303648 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:16.303535    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58e9ed4e-ec3b-4619-b38d-9f47ddd37da8-cert\") pod \"lws-controller-manager-5cdf98c45c-jvqn7\" (UID: \"58e9ed4e-ec3b-4619-b38d-9f47ddd37da8\") " pod="openshift-lws-operator/lws-controller-manager-5cdf98c45c-jvqn7"
Jul 08 21:25:16.303648 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:16.303560    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmgvn\" (UniqueName: \"kubernetes.io/projected/58e9ed4e-ec3b-4619-b38d-9f47ddd37da8-kube-api-access-nmgvn\") pod \"lws-controller-manager-5cdf98c45c-jvqn7\" (UID: \"58e9ed4e-ec3b-4619-b38d-9f47ddd37da8\") " pod="openshift-lws-operator/lws-controller-manager-5cdf98c45c-jvqn7"
Jul 08 21:25:16.303648 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:16.303595    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/58e9ed4e-ec3b-4619-b38d-9f47ddd37da8-metrics-cert\") pod \"lws-controller-manager-5cdf98c45c-jvqn7\" (UID: \"58e9ed4e-ec3b-4619-b38d-9f47ddd37da8\") " pod="openshift-lws-operator/lws-controller-manager-5cdf98c45c-jvqn7"
Jul 08 21:25:16.404270 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:16.404235    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58e9ed4e-ec3b-4619-b38d-9f47ddd37da8-cert\") pod \"lws-controller-manager-5cdf98c45c-jvqn7\" (UID: \"58e9ed4e-ec3b-4619-b38d-9f47ddd37da8\") " pod="openshift-lws-operator/lws-controller-manager-5cdf98c45c-jvqn7"
Jul 08 21:25:16.404270 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:16.404269    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmgvn\" (UniqueName: \"kubernetes.io/projected/58e9ed4e-ec3b-4619-b38d-9f47ddd37da8-kube-api-access-nmgvn\") pod \"lws-controller-manager-5cdf98c45c-jvqn7\" (UID: \"58e9ed4e-ec3b-4619-b38d-9f47ddd37da8\") " pod="openshift-lws-operator/lws-controller-manager-5cdf98c45c-jvqn7"
Jul 08 21:25:16.404485 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:16.404298    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/58e9ed4e-ec3b-4619-b38d-9f47ddd37da8-metrics-cert\") pod \"lws-controller-manager-5cdf98c45c-jvqn7\" (UID: \"58e9ed4e-ec3b-4619-b38d-9f47ddd37da8\") " pod="openshift-lws-operator/lws-controller-manager-5cdf98c45c-jvqn7"
Jul 08 21:25:16.404485 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:16.404336    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/58e9ed4e-ec3b-4619-b38d-9f47ddd37da8-manager-config\") pod \"lws-controller-manager-5cdf98c45c-jvqn7\" (UID: \"58e9ed4e-ec3b-4619-b38d-9f47ddd37da8\") " pod="openshift-lws-operator/lws-controller-manager-5cdf98c45c-jvqn7"
Jul 08 21:25:16.405084 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:16.405056    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/58e9ed4e-ec3b-4619-b38d-9f47ddd37da8-manager-config\") pod \"lws-controller-manager-5cdf98c45c-jvqn7\" (UID: \"58e9ed4e-ec3b-4619-b38d-9f47ddd37da8\") " pod="openshift-lws-operator/lws-controller-manager-5cdf98c45c-jvqn7"
Jul 08 21:25:16.407106 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:16.407081    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58e9ed4e-ec3b-4619-b38d-9f47ddd37da8-cert\") pod \"lws-controller-manager-5cdf98c45c-jvqn7\" (UID: \"58e9ed4e-ec3b-4619-b38d-9f47ddd37da8\") " pod="openshift-lws-operator/lws-controller-manager-5cdf98c45c-jvqn7"
Jul 08 21:25:16.407208 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:16.407081    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/58e9ed4e-ec3b-4619-b38d-9f47ddd37da8-metrics-cert\") pod \"lws-controller-manager-5cdf98c45c-jvqn7\" (UID: \"58e9ed4e-ec3b-4619-b38d-9f47ddd37da8\") " pod="openshift-lws-operator/lws-controller-manager-5cdf98c45c-jvqn7"
Jul 08 21:25:16.424719 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:16.424690    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmgvn\" (UniqueName: \"kubernetes.io/projected/58e9ed4e-ec3b-4619-b38d-9f47ddd37da8-kube-api-access-nmgvn\") pod \"lws-controller-manager-5cdf98c45c-jvqn7\" (UID: \"58e9ed4e-ec3b-4619-b38d-9f47ddd37da8\") " pod="openshift-lws-operator/lws-controller-manager-5cdf98c45c-jvqn7"
Jul 08 21:25:16.541477 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:16.541398    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cdf98c45c-jvqn7"
Jul 08 21:25:16.680144 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:16.680115    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cdf98c45c-jvqn7"]
Jul 08 21:25:16.682973 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:25:16.682944    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58e9ed4e_ec3b_4619_b38d_9f47ddd37da8.slice/crio-2f174da24611d5d56c74ea6c3e11cc0c2b5196447ed48412d5d99684c3146cc1 WatchSource:0}: Error finding container 2f174da24611d5d56c74ea6c3e11cc0c2b5196447ed48412d5d99684c3146cc1: Status 404 returned error can't find the container with id 2f174da24611d5d56c74ea6c3e11cc0c2b5196447ed48412d5d99684c3146cc1
Jul 08 21:25:16.780806 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:16.780775    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cdf98c45c-jvqn7" event={"ID":"58e9ed4e-ec3b-4619-b38d-9f47ddd37da8","Type":"ContainerStarted","Data":"2f174da24611d5d56c74ea6c3e11cc0c2b5196447ed48412d5d99684c3146cc1"}
Jul 08 21:25:19.794333 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:19.794299    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cdf98c45c-jvqn7" event={"ID":"58e9ed4e-ec3b-4619-b38d-9f47ddd37da8","Type":"ContainerStarted","Data":"d4008bdfa49409a08b6c44717bcfea932fe265280c690ae65faebf6df6f6ff2f"}
Jul 08 21:25:19.794805 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:19.794431    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5cdf98c45c-jvqn7"
Jul 08 21:25:19.809984 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:19.809940    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5cdf98c45c-jvqn7" podStartSLOduration=1.527671388 podStartE2EDuration="3.809926228s" totalImagesPullingTime="2.28225484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:25:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:25:19.809600752 +0000 UTC m=+580.464503483" watchObservedRunningTime="2026-07-08 21:25:19.809926228 +0000 UTC m=+580.464828949"
Jul 08 21:25:25.168824 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.168782    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"]
Jul 08 21:25:25.171936 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.171919    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:25.174497 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.174478    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 08 21:25:25.174603 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.174528    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-gjknb\""
Jul 08 21:25:25.174883 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.174867    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 08 21:25:25.175740 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.175720    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 08 21:25:25.184329 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.184311    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"]
Jul 08 21:25:25.272253 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.272226    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w6jfj\" (UID: \"a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:25.272253 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.272257    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w6jfj\" (UID: \"a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:25.272449 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.272277    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w6jfj\" (UID: \"a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:25.272449 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.272294    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w6jfj\" (UID: \"a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:25.272449 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.272378    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w6jfj\" (UID: \"a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:25.272449 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.272417    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w6jfj\" (UID: \"a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:25.272449 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.272435    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w6jfj\" (UID: \"a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:25.272623 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.272454    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z79j2\" (UniqueName: \"kubernetes.io/projected/a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a-kube-api-access-z79j2\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w6jfj\" (UID: \"a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:25.272623 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.272512    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w6jfj\" (UID: \"a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:25.373875 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.373842    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w6jfj\" (UID: \"a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:25.374005 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.373881    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w6jfj\" (UID: \"a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:25.374005 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.373902    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w6jfj\" (UID: \"a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:25.374005 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.373930    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w6jfj\" (UID: \"a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:25.374005 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.373965    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z79j2\" (UniqueName: \"kubernetes.io/projected/a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a-kube-api-access-z79j2\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w6jfj\" (UID: \"a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:25.374161 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.374108    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w6jfj\" (UID: \"a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:25.374205 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.374169    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w6jfj\" (UID: \"a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:25.374205 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.374197    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w6jfj\" (UID: \"a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:25.374321 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.374222    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w6jfj\" (UID: \"a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:25.374321 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.374293    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w6jfj\" (UID: \"a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:25.374425 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.374374    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w6jfj\" (UID: \"a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:25.374509 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.374487    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w6jfj\" (UID: \"a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:25.374642 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.374620    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w6jfj\" (UID: \"a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:25.374866 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.374851    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w6jfj\" (UID: \"a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:25.376423 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.376403    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w6jfj\" (UID: \"a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:25.376586 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.376568    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w6jfj\" (UID: \"a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:25.388188 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.388159    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w6jfj\" (UID: \"a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:25.388442 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.388422    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z79j2\" (UniqueName: \"kubernetes.io/projected/a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a-kube-api-access-z79j2\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678w6jfj\" (UID: \"a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:25.482271 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.482201    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:25.615537 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.615500    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"]
Jul 08 21:25:25.619248 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:25:25.619197    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda781ecff_a5bb_49bf_a5fb_899e6ecbaf6a.slice/crio-2284546b73838e25ec4f1d293945ecf5b7897e47a39abe62ecf470cb7775d68b WatchSource:0}: Error finding container 2284546b73838e25ec4f1d293945ecf5b7897e47a39abe62ecf470cb7775d68b: Status 404 returned error can't find the container with id 2284546b73838e25ec4f1d293945ecf5b7897e47a39abe62ecf470cb7775d68b
Jul 08 21:25:25.748803 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.748711    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j"]
Jul 08 21:25:25.752689 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.752674    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j"
Jul 08 21:25:25.755500 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.755482    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kxqv8\""
Jul 08 21:25:25.755789 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.755772    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 08 21:25:25.756103 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.756088    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 08 21:25:25.756312 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.756287    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 08 21:25:25.762899 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.762881    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j"]
Jul 08 21:25:25.815511 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.815488    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj" event={"ID":"a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a","Type":"ContainerStarted","Data":"2284546b73838e25ec4f1d293945ecf5b7897e47a39abe62ecf470cb7775d68b"}
Jul 08 21:25:25.878454 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.878429    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/10fcf54e-2728-4ef6-8770-5eee8b0c521e-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-vv62j\" (UID: \"10fcf54e-2728-4ef6-8770-5eee8b0c521e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j"
Jul 08 21:25:25.878571 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.878458    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql2d2\" (UniqueName: \"kubernetes.io/projected/10fcf54e-2728-4ef6-8770-5eee8b0c521e-kube-api-access-ql2d2\") pod \"istiod-openshift-gateway-94bb8fbfd-vv62j\" (UID: \"10fcf54e-2728-4ef6-8770-5eee8b0c521e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j"
Jul 08 21:25:25.878571 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.878483    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/10fcf54e-2728-4ef6-8770-5eee8b0c521e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-vv62j\" (UID: \"10fcf54e-2728-4ef6-8770-5eee8b0c521e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j"
Jul 08 21:25:25.878571 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.878553    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/10fcf54e-2728-4ef6-8770-5eee8b0c521e-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-vv62j\" (UID: \"10fcf54e-2728-4ef6-8770-5eee8b0c521e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j"
Jul 08 21:25:25.878693 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.878580    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/10fcf54e-2728-4ef6-8770-5eee8b0c521e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-vv62j\" (UID: \"10fcf54e-2728-4ef6-8770-5eee8b0c521e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j"
Jul 08 21:25:25.878693 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.878603    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10fcf54e-2728-4ef6-8770-5eee8b0c521e-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-vv62j\" (UID: \"10fcf54e-2728-4ef6-8770-5eee8b0c521e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j"
Jul 08 21:25:25.878693 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.878627    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/10fcf54e-2728-4ef6-8770-5eee8b0c521e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-vv62j\" (UID: \"10fcf54e-2728-4ef6-8770-5eee8b0c521e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j"
Jul 08 21:25:25.979382 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.979346    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/10fcf54e-2728-4ef6-8770-5eee8b0c521e-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-vv62j\" (UID: \"10fcf54e-2728-4ef6-8770-5eee8b0c521e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j"
Jul 08 21:25:25.979382 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.979378    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql2d2\" (UniqueName: \"kubernetes.io/projected/10fcf54e-2728-4ef6-8770-5eee8b0c521e-kube-api-access-ql2d2\") pod \"istiod-openshift-gateway-94bb8fbfd-vv62j\" (UID: \"10fcf54e-2728-4ef6-8770-5eee8b0c521e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j"
Jul 08 21:25:25.979571 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.979401    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/10fcf54e-2728-4ef6-8770-5eee8b0c521e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-vv62j\" (UID: \"10fcf54e-2728-4ef6-8770-5eee8b0c521e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j"
Jul 08 21:25:25.979571 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.979431    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/10fcf54e-2728-4ef6-8770-5eee8b0c521e-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-vv62j\" (UID: \"10fcf54e-2728-4ef6-8770-5eee8b0c521e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j"
Jul 08 21:25:25.979571 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.979459    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/10fcf54e-2728-4ef6-8770-5eee8b0c521e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-vv62j\" (UID: \"10fcf54e-2728-4ef6-8770-5eee8b0c521e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j"
Jul 08 21:25:25.979571 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.979484    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10fcf54e-2728-4ef6-8770-5eee8b0c521e-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-vv62j\" (UID: \"10fcf54e-2728-4ef6-8770-5eee8b0c521e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j"
Jul 08 21:25:25.979779 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.979595    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/10fcf54e-2728-4ef6-8770-5eee8b0c521e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-vv62j\" (UID: \"10fcf54e-2728-4ef6-8770-5eee8b0c521e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j"
Jul 08 21:25:25.980560 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.980534    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/10fcf54e-2728-4ef6-8770-5eee8b0c521e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-vv62j\" (UID: \"10fcf54e-2728-4ef6-8770-5eee8b0c521e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j"
Jul 08 21:25:25.982012 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.981979    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/10fcf54e-2728-4ef6-8770-5eee8b0c521e-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-vv62j\" (UID: \"10fcf54e-2728-4ef6-8770-5eee8b0c521e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j"
Jul 08 21:25:25.982101 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.982054    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/10fcf54e-2728-4ef6-8770-5eee8b0c521e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-vv62j\" (UID: \"10fcf54e-2728-4ef6-8770-5eee8b0c521e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j"
Jul 08 21:25:25.982101 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.982092    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/10fcf54e-2728-4ef6-8770-5eee8b0c521e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-vv62j\" (UID: \"10fcf54e-2728-4ef6-8770-5eee8b0c521e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j"
Jul 08 21:25:25.982232 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.982214    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/10fcf54e-2728-4ef6-8770-5eee8b0c521e-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-vv62j\" (UID: \"10fcf54e-2728-4ef6-8770-5eee8b0c521e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j"
Jul 08 21:25:25.988515 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.988493    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10fcf54e-2728-4ef6-8770-5eee8b0c521e-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-vv62j\" (UID: \"10fcf54e-2728-4ef6-8770-5eee8b0c521e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j"
Jul 08 21:25:25.988576 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:25.988503    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql2d2\" (UniqueName: \"kubernetes.io/projected/10fcf54e-2728-4ef6-8770-5eee8b0c521e-kube-api-access-ql2d2\") pod \"istiod-openshift-gateway-94bb8fbfd-vv62j\" (UID: \"10fcf54e-2728-4ef6-8770-5eee8b0c521e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j"
Jul 08 21:25:26.062079 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:26.062023    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j"
Jul 08 21:25:26.191670 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:26.191640    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j"]
Jul 08 21:25:26.194320 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:25:26.194293    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10fcf54e_2728_4ef6_8770_5eee8b0c521e.slice/crio-9b016d1a501a0e31e9c75f96432e2b8e6b2ece51dead79e2cd816430f864315f WatchSource:0}: Error finding container 9b016d1a501a0e31e9c75f96432e2b8e6b2ece51dead79e2cd816430f864315f: Status 404 returned error can't find the container with id 9b016d1a501a0e31e9c75f96432e2b8e6b2ece51dead79e2cd816430f864315f
Jul 08 21:25:26.823447 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:26.823380    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j" event={"ID":"10fcf54e-2728-4ef6-8770-5eee8b0c521e","Type":"ContainerStarted","Data":"9b016d1a501a0e31e9c75f96432e2b8e6b2ece51dead79e2cd816430f864315f"}
Jul 08 21:25:29.903004 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:29.902953    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 21:25:29.903231 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:29.903046    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 21:25:29.907884 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:29.907841    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 21:25:29.907978 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:29.907909    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 21:25:29.907978 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:29.907954    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 21:25:30.799737 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:30.799706    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5cdf98c45c-jvqn7"
Jul 08 21:25:30.841249 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:30.841204    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj" event={"ID":"a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a","Type":"ContainerStarted","Data":"400950a879e903e43b008cb14ef85db13bbbfcf5417ffeda01a45859fd5b2ed3"}
Jul 08 21:25:30.842820 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:30.842797    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j" event={"ID":"10fcf54e-2728-4ef6-8770-5eee8b0c521e","Type":"ContainerStarted","Data":"b1263352b2fd353cf82fcaa7ebbf549c9a8f1a387d5a844f9273c1eeafeca97a"}
Jul 08 21:25:30.843003 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:30.842985    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j"
Jul 08 21:25:30.844485 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:30.844460    2571 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-vv62j container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 08 21:25:30.844583 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:30.844506    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j" podUID="10fcf54e-2728-4ef6-8770-5eee8b0c521e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 21:25:30.873372 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:30.873308    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj" podStartSLOduration=1.587234528 podStartE2EDuration="5.873286697s" totalImagesPullingTime="4.286052169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:25:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:25:30.872068482 +0000 UTC m=+591.526971219" watchObservedRunningTime="2026-07-08 21:25:30.873286697 +0000 UTC m=+591.528189417"
Jul 08 21:25:30.893564 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:30.893512    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j" podStartSLOduration=2.187120405 podStartE2EDuration="5.893495518s" totalImagesPullingTime="3.706375113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:25:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:25:30.892853663 +0000 UTC m=+591.547756423" watchObservedRunningTime="2026-07-08 21:25:30.893495518 +0000 UTC m=+591.548398237"
Jul 08 21:25:31.482386 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:31.482352    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:31.486891 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:31.486864    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:31.847189 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:31.847097    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:25:31.847653 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:31.847631    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-vv62j"
Jul 08 21:25:31.848183 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:25:31.848168    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678w6jfj"
Jul 08 21:26:33.754774 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:33.754721    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b869b8c56-l98h9"]
Jul 08 21:26:33.756793 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:33.756776    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b869b8c56-l98h9"
Jul 08 21:26:33.770024 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:33.769997    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b869b8c56-l98h9"]
Jul 08 21:26:33.869894 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:33.869863    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/961c8721-db96-4a0e-b1d1-62601f66cbd6-console-serving-cert\") pod \"console-5b869b8c56-l98h9\" (UID: \"961c8721-db96-4a0e-b1d1-62601f66cbd6\") " pod="openshift-console/console-5b869b8c56-l98h9"
Jul 08 21:26:33.870042 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:33.869913    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r7rx\" (UniqueName: \"kubernetes.io/projected/961c8721-db96-4a0e-b1d1-62601f66cbd6-kube-api-access-7r7rx\") pod \"console-5b869b8c56-l98h9\" (UID: \"961c8721-db96-4a0e-b1d1-62601f66cbd6\") " pod="openshift-console/console-5b869b8c56-l98h9"
Jul 08 21:26:33.870042 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:33.869956    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/961c8721-db96-4a0e-b1d1-62601f66cbd6-oauth-serving-cert\") pod \"console-5b869b8c56-l98h9\" (UID: \"961c8721-db96-4a0e-b1d1-62601f66cbd6\") " pod="openshift-console/console-5b869b8c56-l98h9"
Jul 08 21:26:33.870042 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:33.869973    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/961c8721-db96-4a0e-b1d1-62601f66cbd6-console-oauth-config\") pod \"console-5b869b8c56-l98h9\" (UID: \"961c8721-db96-4a0e-b1d1-62601f66cbd6\") " pod="openshift-console/console-5b869b8c56-l98h9"
Jul 08 21:26:33.870042 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:33.870000    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/961c8721-db96-4a0e-b1d1-62601f66cbd6-console-config\") pod \"console-5b869b8c56-l98h9\" (UID: \"961c8721-db96-4a0e-b1d1-62601f66cbd6\") " pod="openshift-console/console-5b869b8c56-l98h9"
Jul 08 21:26:33.870042 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:33.870023    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/961c8721-db96-4a0e-b1d1-62601f66cbd6-trusted-ca-bundle\") pod \"console-5b869b8c56-l98h9\" (UID: \"961c8721-db96-4a0e-b1d1-62601f66cbd6\") " pod="openshift-console/console-5b869b8c56-l98h9"
Jul 08 21:26:33.870042 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:33.870040    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/961c8721-db96-4a0e-b1d1-62601f66cbd6-service-ca\") pod \"console-5b869b8c56-l98h9\" (UID: \"961c8721-db96-4a0e-b1d1-62601f66cbd6\") " pod="openshift-console/console-5b869b8c56-l98h9"
Jul 08 21:26:33.970627 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:33.970601    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/961c8721-db96-4a0e-b1d1-62601f66cbd6-trusted-ca-bundle\") pod \"console-5b869b8c56-l98h9\" (UID: \"961c8721-db96-4a0e-b1d1-62601f66cbd6\") " pod="openshift-console/console-5b869b8c56-l98h9"
Jul 08 21:26:33.970796 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:33.970632    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/961c8721-db96-4a0e-b1d1-62601f66cbd6-service-ca\") pod \"console-5b869b8c56-l98h9\" (UID: \"961c8721-db96-4a0e-b1d1-62601f66cbd6\") " pod="openshift-console/console-5b869b8c56-l98h9"
Jul 08 21:26:33.970796 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:33.970657    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/961c8721-db96-4a0e-b1d1-62601f66cbd6-console-serving-cert\") pod \"console-5b869b8c56-l98h9\" (UID: \"961c8721-db96-4a0e-b1d1-62601f66cbd6\") " pod="openshift-console/console-5b869b8c56-l98h9"
Jul 08 21:26:33.970876 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:33.970799    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r7rx\" (UniqueName: \"kubernetes.io/projected/961c8721-db96-4a0e-b1d1-62601f66cbd6-kube-api-access-7r7rx\") pod \"console-5b869b8c56-l98h9\" (UID: \"961c8721-db96-4a0e-b1d1-62601f66cbd6\") " pod="openshift-console/console-5b869b8c56-l98h9"
Jul 08 21:26:33.970876 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:33.970848    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/961c8721-db96-4a0e-b1d1-62601f66cbd6-oauth-serving-cert\") pod \"console-5b869b8c56-l98h9\" (UID: \"961c8721-db96-4a0e-b1d1-62601f66cbd6\") " pod="openshift-console/console-5b869b8c56-l98h9"
Jul 08 21:26:33.971036 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:33.970871    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/961c8721-db96-4a0e-b1d1-62601f66cbd6-console-oauth-config\") pod \"console-5b869b8c56-l98h9\" (UID: \"961c8721-db96-4a0e-b1d1-62601f66cbd6\") " pod="openshift-console/console-5b869b8c56-l98h9"
Jul 08 21:26:33.971036 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:33.970910    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/961c8721-db96-4a0e-b1d1-62601f66cbd6-console-config\") pod \"console-5b869b8c56-l98h9\" (UID: \"961c8721-db96-4a0e-b1d1-62601f66cbd6\") " pod="openshift-console/console-5b869b8c56-l98h9"
Jul 08 21:26:33.971425 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:33.971401    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/961c8721-db96-4a0e-b1d1-62601f66cbd6-service-ca\") pod \"console-5b869b8c56-l98h9\" (UID: \"961c8721-db96-4a0e-b1d1-62601f66cbd6\") " pod="openshift-console/console-5b869b8c56-l98h9"
Jul 08 21:26:33.971534 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:33.971509    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/961c8721-db96-4a0e-b1d1-62601f66cbd6-oauth-serving-cert\") pod \"console-5b869b8c56-l98h9\" (UID: \"961c8721-db96-4a0e-b1d1-62601f66cbd6\") " pod="openshift-console/console-5b869b8c56-l98h9"
Jul 08 21:26:33.971589 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:33.971544    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/961c8721-db96-4a0e-b1d1-62601f66cbd6-trusted-ca-bundle\") pod \"console-5b869b8c56-l98h9\" (UID: \"961c8721-db96-4a0e-b1d1-62601f66cbd6\") " pod="openshift-console/console-5b869b8c56-l98h9"
Jul 08 21:26:33.971821 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:33.971801    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/961c8721-db96-4a0e-b1d1-62601f66cbd6-console-config\") pod \"console-5b869b8c56-l98h9\" (UID: \"961c8721-db96-4a0e-b1d1-62601f66cbd6\") " pod="openshift-console/console-5b869b8c56-l98h9"
Jul 08 21:26:33.973363 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:33.973345    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/961c8721-db96-4a0e-b1d1-62601f66cbd6-console-oauth-config\") pod \"console-5b869b8c56-l98h9\" (UID: \"961c8721-db96-4a0e-b1d1-62601f66cbd6\") " pod="openshift-console/console-5b869b8c56-l98h9"
Jul 08 21:26:33.973412 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:33.973391    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/961c8721-db96-4a0e-b1d1-62601f66cbd6-console-serving-cert\") pod \"console-5b869b8c56-l98h9\" (UID: \"961c8721-db96-4a0e-b1d1-62601f66cbd6\") " pod="openshift-console/console-5b869b8c56-l98h9"
Jul 08 21:26:33.978401 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:33.978380    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r7rx\" (UniqueName: \"kubernetes.io/projected/961c8721-db96-4a0e-b1d1-62601f66cbd6-kube-api-access-7r7rx\") pod \"console-5b869b8c56-l98h9\" (UID: \"961c8721-db96-4a0e-b1d1-62601f66cbd6\") " pod="openshift-console/console-5b869b8c56-l98h9"
Jul 08 21:26:34.065100 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:34.065036    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b869b8c56-l98h9"
Jul 08 21:26:34.192936 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:34.192903    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b869b8c56-l98h9"]
Jul 08 21:26:34.195663 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:26:34.195630    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod961c8721_db96_4a0e_b1d1_62601f66cbd6.slice/crio-4bebff5368ac1f915c5787605428d78e8830c5b6d43a15f3277cafe1661b329a WatchSource:0}: Error finding container 4bebff5368ac1f915c5787605428d78e8830c5b6d43a15f3277cafe1661b329a: Status 404 returned error can't find the container with id 4bebff5368ac1f915c5787605428d78e8830c5b6d43a15f3277cafe1661b329a
Jul 08 21:26:35.070653 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:35.070614    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b869b8c56-l98h9" event={"ID":"961c8721-db96-4a0e-b1d1-62601f66cbd6","Type":"ContainerStarted","Data":"928ff176b925589269f4b332bf21a61d020359703dc12780e6e50b37a15b0c71"}
Jul 08 21:26:35.071054 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:35.070675    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b869b8c56-l98h9" event={"ID":"961c8721-db96-4a0e-b1d1-62601f66cbd6","Type":"ContainerStarted","Data":"4bebff5368ac1f915c5787605428d78e8830c5b6d43a15f3277cafe1661b329a"}
Jul 08 21:26:35.088863 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:35.088814    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b869b8c56-l98h9" podStartSLOduration=2.088799098 podStartE2EDuration="2.088799098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:26:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:26:35.087941696 +0000 UTC m=+655.742844416" watchObservedRunningTime="2026-07-08 21:26:35.088799098 +0000 UTC m=+655.743701839"
Jul 08 21:26:44.066073 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:44.066021    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b869b8c56-l98h9"
Jul 08 21:26:44.066449 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:44.066118    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b869b8c56-l98h9"
Jul 08 21:26:44.070694 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:44.070673    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b869b8c56-l98h9"
Jul 08 21:26:44.104635 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:44.104614    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b869b8c56-l98h9"
Jul 08 21:26:44.148255 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:26:44.148223    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d54b6fc9-q7jxw"]
Jul 08 21:27:09.176334 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:09.176285    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-d54b6fc9-q7jxw" podUID="04297402-de9c-4200-9ab8-df442c4eb549" containerName="console" containerID="cri-o://650c33631427a7033e8dfe63cabe7923dd77f8330ba6aa9dd53275d99bfaf75f" gracePeriod=15
Jul 08 21:27:09.414648 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:09.414619    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d54b6fc9-q7jxw"
Jul 08 21:27:09.460439 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:09.460365    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04297402-de9c-4200-9ab8-df442c4eb549-service-ca\") pod \"04297402-de9c-4200-9ab8-df442c4eb549\" (UID: \"04297402-de9c-4200-9ab8-df442c4eb549\") "
Jul 08 21:27:09.460439 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:09.460400    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04297402-de9c-4200-9ab8-df442c4eb549-console-config\") pod \"04297402-de9c-4200-9ab8-df442c4eb549\" (UID: \"04297402-de9c-4200-9ab8-df442c4eb549\") "
Jul 08 21:27:09.460439 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:09.460428    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04297402-de9c-4200-9ab8-df442c4eb549-trusted-ca-bundle\") pod \"04297402-de9c-4200-9ab8-df442c4eb549\" (UID: \"04297402-de9c-4200-9ab8-df442c4eb549\") "
Jul 08 21:27:09.460707 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:09.460503    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04297402-de9c-4200-9ab8-df442c4eb549-console-serving-cert\") pod \"04297402-de9c-4200-9ab8-df442c4eb549\" (UID: \"04297402-de9c-4200-9ab8-df442c4eb549\") "
Jul 08 21:27:09.460707 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:09.460556    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04297402-de9c-4200-9ab8-df442c4eb549-oauth-serving-cert\") pod \"04297402-de9c-4200-9ab8-df442c4eb549\" (UID: \"04297402-de9c-4200-9ab8-df442c4eb549\") "
Jul 08 21:27:09.460707 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:09.460591    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7n5j\" (UniqueName: \"kubernetes.io/projected/04297402-de9c-4200-9ab8-df442c4eb549-kube-api-access-d7n5j\") pod \"04297402-de9c-4200-9ab8-df442c4eb549\" (UID: \"04297402-de9c-4200-9ab8-df442c4eb549\") "
Jul 08 21:27:09.460707 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:09.460616    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04297402-de9c-4200-9ab8-df442c4eb549-console-oauth-config\") pod \"04297402-de9c-4200-9ab8-df442c4eb549\" (UID: \"04297402-de9c-4200-9ab8-df442c4eb549\") "
Jul 08 21:27:09.460943 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:09.460793    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04297402-de9c-4200-9ab8-df442c4eb549-service-ca" (OuterVolumeSpecName: "service-ca") pod "04297402-de9c-4200-9ab8-df442c4eb549" (UID: "04297402-de9c-4200-9ab8-df442c4eb549"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:27:09.460943 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:09.460884    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04297402-de9c-4200-9ab8-df442c4eb549-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "04297402-de9c-4200-9ab8-df442c4eb549" (UID: "04297402-de9c-4200-9ab8-df442c4eb549"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:27:09.461041 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:09.460967    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04297402-de9c-4200-9ab8-df442c4eb549-console-config" (OuterVolumeSpecName: "console-config") pod "04297402-de9c-4200-9ab8-df442c4eb549" (UID: "04297402-de9c-4200-9ab8-df442c4eb549"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:27:09.461041 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:09.461015    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04297402-de9c-4200-9ab8-df442c4eb549-service-ca\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:27:09.461041 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:09.461036    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04297402-de9c-4200-9ab8-df442c4eb549-trusted-ca-bundle\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:27:09.461147 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:09.461051    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04297402-de9c-4200-9ab8-df442c4eb549-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "04297402-de9c-4200-9ab8-df442c4eb549" (UID: "04297402-de9c-4200-9ab8-df442c4eb549"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:27:09.463007 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:09.462984    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04297402-de9c-4200-9ab8-df442c4eb549-kube-api-access-d7n5j" (OuterVolumeSpecName: "kube-api-access-d7n5j") pod "04297402-de9c-4200-9ab8-df442c4eb549" (UID: "04297402-de9c-4200-9ab8-df442c4eb549"). InnerVolumeSpecName "kube-api-access-d7n5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:27:09.463007 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:09.463000    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04297402-de9c-4200-9ab8-df442c4eb549-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "04297402-de9c-4200-9ab8-df442c4eb549" (UID: "04297402-de9c-4200-9ab8-df442c4eb549"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:27:09.463121 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:09.463033    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04297402-de9c-4200-9ab8-df442c4eb549-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "04297402-de9c-4200-9ab8-df442c4eb549" (UID: "04297402-de9c-4200-9ab8-df442c4eb549"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:27:09.561661 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:09.561628    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04297402-de9c-4200-9ab8-df442c4eb549-oauth-serving-cert\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:27:09.561661 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:09.561656    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7n5j\" (UniqueName: \"kubernetes.io/projected/04297402-de9c-4200-9ab8-df442c4eb549-kube-api-access-d7n5j\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:27:09.561661 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:09.561666    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04297402-de9c-4200-9ab8-df442c4eb549-console-oauth-config\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:27:09.561914 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:09.561674    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04297402-de9c-4200-9ab8-df442c4eb549-console-config\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:27:09.561914 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:09.561684    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04297402-de9c-4200-9ab8-df442c4eb549-console-serving-cert\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:27:10.197597 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:10.197556    2571 generic.go:356] "Generic (PLEG): container finished" podID="04297402-de9c-4200-9ab8-df442c4eb549" containerID="650c33631427a7033e8dfe63cabe7923dd77f8330ba6aa9dd53275d99bfaf75f" exitCode=0
Jul 08 21:27:10.198023 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:10.197620    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d54b6fc9-q7jxw"
Jul 08 21:27:10.198023 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:10.197639    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d54b6fc9-q7jxw" event={"ID":"04297402-de9c-4200-9ab8-df442c4eb549","Type":"ContainerDied","Data":"650c33631427a7033e8dfe63cabe7923dd77f8330ba6aa9dd53275d99bfaf75f"}
Jul 08 21:27:10.198023 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:10.197718    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d54b6fc9-q7jxw" event={"ID":"04297402-de9c-4200-9ab8-df442c4eb549","Type":"ContainerDied","Data":"2657b03088284f7c21d6fe45563facdea29c80203e9f9d7ed2a79be0fb754bd0"}
Jul 08 21:27:10.198023 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:10.197740    2571 scope.go:117] "RemoveContainer" containerID="650c33631427a7033e8dfe63cabe7923dd77f8330ba6aa9dd53275d99bfaf75f"
Jul 08 21:27:10.205734 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:10.205715    2571 scope.go:117] "RemoveContainer" containerID="650c33631427a7033e8dfe63cabe7923dd77f8330ba6aa9dd53275d99bfaf75f"
Jul 08 21:27:10.206074 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:27:10.206056    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"650c33631427a7033e8dfe63cabe7923dd77f8330ba6aa9dd53275d99bfaf75f\": container with ID starting with 650c33631427a7033e8dfe63cabe7923dd77f8330ba6aa9dd53275d99bfaf75f not found: ID does not exist" containerID="650c33631427a7033e8dfe63cabe7923dd77f8330ba6aa9dd53275d99bfaf75f"
Jul 08 21:27:10.206145 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:10.206084    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"650c33631427a7033e8dfe63cabe7923dd77f8330ba6aa9dd53275d99bfaf75f"} err="failed to get container status \"650c33631427a7033e8dfe63cabe7923dd77f8330ba6aa9dd53275d99bfaf75f\": rpc error: code = NotFound desc = could not find container \"650c33631427a7033e8dfe63cabe7923dd77f8330ba6aa9dd53275d99bfaf75f\": container with ID starting with 650c33631427a7033e8dfe63cabe7923dd77f8330ba6aa9dd53275d99bfaf75f not found: ID does not exist"
Jul 08 21:27:10.215425 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:10.215402    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d54b6fc9-q7jxw"]
Jul 08 21:27:10.219263 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:10.219243    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d54b6fc9-q7jxw"]
Jul 08 21:27:11.866246 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:27:11.866206    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04297402-de9c-4200-9ab8-df442c4eb549" path="/var/lib/kubelet/pods/04297402-de9c-4200-9ab8-df442c4eb549/volumes"
Jul 08 21:29:20.396489 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:20.396416    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-z6vwr"]
Jul 08 21:29:20.396962 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:20.396662    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04297402-de9c-4200-9ab8-df442c4eb549" containerName="console"
Jul 08 21:29:20.396962 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:20.396672    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="04297402-de9c-4200-9ab8-df442c4eb549" containerName="console"
Jul 08 21:29:20.396962 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:20.396720    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="04297402-de9c-4200-9ab8-df442c4eb549" containerName="console"
Jul 08 21:29:20.399429 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:20.399414    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-z6vwr"
Jul 08 21:29:20.401830 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:20.401809    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-7xfqv\""
Jul 08 21:29:20.401934 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:20.401810    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 08 21:29:20.408384 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:20.408362    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-z6vwr"]
Jul 08 21:29:20.545012 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:20.544981    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmllj\" (UniqueName: \"kubernetes.io/projected/3e8fb17d-87f4-4915-8f6f-4dd686d63740-kube-api-access-bmllj\") pod \"payload-pre-processing-7964457696-z6vwr\" (UID: \"3e8fb17d-87f4-4915-8f6f-4dd686d63740\") " pod="openshift-ingress/payload-pre-processing-7964457696-z6vwr"
Jul 08 21:29:20.545177 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:20.545023    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e8fb17d-87f4-4915-8f6f-4dd686d63740-plugins-config-volume\") pod \"payload-pre-processing-7964457696-z6vwr\" (UID: \"3e8fb17d-87f4-4915-8f6f-4dd686d63740\") " pod="openshift-ingress/payload-pre-processing-7964457696-z6vwr"
Jul 08 21:29:20.646253 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:20.646223    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmllj\" (UniqueName: \"kubernetes.io/projected/3e8fb17d-87f4-4915-8f6f-4dd686d63740-kube-api-access-bmllj\") pod \"payload-pre-processing-7964457696-z6vwr\" (UID: \"3e8fb17d-87f4-4915-8f6f-4dd686d63740\") " pod="openshift-ingress/payload-pre-processing-7964457696-z6vwr"
Jul 08 21:29:20.646373 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:20.646265    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e8fb17d-87f4-4915-8f6f-4dd686d63740-plugins-config-volume\") pod \"payload-pre-processing-7964457696-z6vwr\" (UID: \"3e8fb17d-87f4-4915-8f6f-4dd686d63740\") " pod="openshift-ingress/payload-pre-processing-7964457696-z6vwr"
Jul 08 21:29:20.647020 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:20.646977    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e8fb17d-87f4-4915-8f6f-4dd686d63740-plugins-config-volume\") pod \"payload-pre-processing-7964457696-z6vwr\" (UID: \"3e8fb17d-87f4-4915-8f6f-4dd686d63740\") " pod="openshift-ingress/payload-pre-processing-7964457696-z6vwr"
Jul 08 21:29:20.653936 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:20.653914    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmllj\" (UniqueName: \"kubernetes.io/projected/3e8fb17d-87f4-4915-8f6f-4dd686d63740-kube-api-access-bmllj\") pod \"payload-pre-processing-7964457696-z6vwr\" (UID: \"3e8fb17d-87f4-4915-8f6f-4dd686d63740\") " pod="openshift-ingress/payload-pre-processing-7964457696-z6vwr"
Jul 08 21:29:20.709949 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:20.709920    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-z6vwr"
Jul 08 21:29:20.836997 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:20.836957    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-z6vwr"]
Jul 08 21:29:20.840167 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:29:20.840130    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e8fb17d_87f4_4915_8f6f_4dd686d63740.slice/crio-6bda0c6a186a3c17f0f79f8750d40d62ad1e70ad090bbb089022b84ce482e6ba WatchSource:0}: Error finding container 6bda0c6a186a3c17f0f79f8750d40d62ad1e70ad090bbb089022b84ce482e6ba: Status 404 returned error can't find the container with id 6bda0c6a186a3c17f0f79f8750d40d62ad1e70ad090bbb089022b84ce482e6ba
Jul 08 21:29:21.665166 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:21.665125    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-z6vwr" event={"ID":"3e8fb17d-87f4-4915-8f6f-4dd686d63740","Type":"ContainerStarted","Data":"6bda0c6a186a3c17f0f79f8750d40d62ad1e70ad090bbb089022b84ce482e6ba"}
Jul 08 21:29:22.670592 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:22.670560    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-z6vwr" event={"ID":"3e8fb17d-87f4-4915-8f6f-4dd686d63740","Type":"ContainerStarted","Data":"6ad4f6b0d7cc91914bd8139fa136832868f8aff9f3b5dfe9f4a100503e4aeed9"}
Jul 08 21:29:22.670977 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:22.670684    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-z6vwr"
Jul 08 21:29:22.685769 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:22.685702    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-z6vwr" podStartSLOduration=1.3754922139999999 podStartE2EDuration="2.685688528s" totalImagesPullingTime="1.310196314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:29:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:29:22.684324224 +0000 UTC m=+823.339226944" watchObservedRunningTime="2026-07-08 21:29:22.685688528 +0000 UTC m=+823.340591246"
Jul 08 21:29:33.676590 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:33.676562    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-z6vwr"
Jul 08 21:29:37.411289 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:37.411262    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b"]
Jul 08 21:29:37.414288 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:37.414268    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b"
Jul 08 21:29:37.416983 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:37.416942    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 08 21:29:37.416983 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:37.416958    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 08 21:29:37.417160 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:37.416959    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-74w8c\""
Jul 08 21:29:37.417894 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:37.417878    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 08 21:29:37.425929 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:37.425907    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b"]
Jul 08 21:29:37.484108 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:37.484078    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/884bdfaa-7763-46e5-9066-c131c6bac079-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b\" (UID: \"884bdfaa-7763-46e5-9066-c131c6bac079\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b"
Jul 08 21:29:37.484229 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:37.484114    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/884bdfaa-7763-46e5-9066-c131c6bac079-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b\" (UID: \"884bdfaa-7763-46e5-9066-c131c6bac079\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b"
Jul 08 21:29:37.484229 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:37.484152    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/884bdfaa-7763-46e5-9066-c131c6bac079-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b\" (UID: \"884bdfaa-7763-46e5-9066-c131c6bac079\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b"
Jul 08 21:29:37.484229 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:37.484176    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7czqf\" (UniqueName: \"kubernetes.io/projected/884bdfaa-7763-46e5-9066-c131c6bac079-kube-api-access-7czqf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b\" (UID: \"884bdfaa-7763-46e5-9066-c131c6bac079\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b"
Jul 08 21:29:37.484331 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:37.484237    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/884bdfaa-7763-46e5-9066-c131c6bac079-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b\" (UID: \"884bdfaa-7763-46e5-9066-c131c6bac079\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b"
Jul 08 21:29:37.484331 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:37.484265    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/884bdfaa-7763-46e5-9066-c131c6bac079-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b\" (UID: \"884bdfaa-7763-46e5-9066-c131c6bac079\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b"
Jul 08 21:29:37.584875 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:37.584839    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/884bdfaa-7763-46e5-9066-c131c6bac079-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b\" (UID: \"884bdfaa-7763-46e5-9066-c131c6bac079\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b"
Jul 08 21:29:37.585028 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:37.584886    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/884bdfaa-7763-46e5-9066-c131c6bac079-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b\" (UID: \"884bdfaa-7763-46e5-9066-c131c6bac079\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b"
Jul 08 21:29:37.585028 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:37.584918    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/884bdfaa-7763-46e5-9066-c131c6bac079-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b\" (UID: \"884bdfaa-7763-46e5-9066-c131c6bac079\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b"
Jul 08 21:29:37.585028 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:37.584954    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/884bdfaa-7763-46e5-9066-c131c6bac079-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b\" (UID: \"884bdfaa-7763-46e5-9066-c131c6bac079\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b"
Jul 08 21:29:37.585028 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:37.584999    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/884bdfaa-7763-46e5-9066-c131c6bac079-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b\" (UID: \"884bdfaa-7763-46e5-9066-c131c6bac079\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b"
Jul 08 21:29:37.585233 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:37.585124    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7czqf\" (UniqueName: \"kubernetes.io/projected/884bdfaa-7763-46e5-9066-c131c6bac079-kube-api-access-7czqf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b\" (UID: \"884bdfaa-7763-46e5-9066-c131c6bac079\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b"
Jul 08 21:29:37.585410 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:37.585381    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/884bdfaa-7763-46e5-9066-c131c6bac079-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b\" (UID: \"884bdfaa-7763-46e5-9066-c131c6bac079\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b"
Jul 08 21:29:37.585521 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:37.585413    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/884bdfaa-7763-46e5-9066-c131c6bac079-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b\" (UID: \"884bdfaa-7763-46e5-9066-c131c6bac079\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b"
Jul 08 21:29:37.585521 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:37.585426    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/884bdfaa-7763-46e5-9066-c131c6bac079-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b\" (UID: \"884bdfaa-7763-46e5-9066-c131c6bac079\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b"
Jul 08 21:29:37.587356 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:37.587335    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/884bdfaa-7763-46e5-9066-c131c6bac079-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b\" (UID: \"884bdfaa-7763-46e5-9066-c131c6bac079\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b"
Jul 08 21:29:37.587492 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:37.587478    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/884bdfaa-7763-46e5-9066-c131c6bac079-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b\" (UID: \"884bdfaa-7763-46e5-9066-c131c6bac079\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b"
Jul 08 21:29:37.592398 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:37.592380    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7czqf\" (UniqueName: \"kubernetes.io/projected/884bdfaa-7763-46e5-9066-c131c6bac079-kube-api-access-7czqf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b\" (UID: \"884bdfaa-7763-46e5-9066-c131c6bac079\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b"
Jul 08 21:29:37.724810 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:37.724730    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b"
Jul 08 21:29:37.851867 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:37.851844    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b"]
Jul 08 21:29:37.854037 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:29:37.854010    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod884bdfaa_7763_46e5_9066_c131c6bac079.slice/crio-326fc36c27901dce2ddd707653c1468347c38e20c8c2d50da637cb0d19802ec4 WatchSource:0}: Error finding container 326fc36c27901dce2ddd707653c1468347c38e20c8c2d50da637cb0d19802ec4: Status 404 returned error can't find the container with id 326fc36c27901dce2ddd707653c1468347c38e20c8c2d50da637cb0d19802ec4
Jul 08 21:29:38.730249 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:38.730211    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b" event={"ID":"884bdfaa-7763-46e5-9066-c131c6bac079","Type":"ContainerStarted","Data":"326fc36c27901dce2ddd707653c1468347c38e20c8c2d50da637cb0d19802ec4"}
Jul 08 21:29:39.735058 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:39.735029    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b" event={"ID":"884bdfaa-7763-46e5-9066-c131c6bac079","Type":"ContainerStarted","Data":"cdb363258111818d2a7cc99f84a4df11eb0db6b0b48d19f1c0c0bbb8b0664574"}
Jul 08 21:29:39.750303 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:39.750248    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b" podStartSLOduration=1.589907876 podStartE2EDuration="2.750230264s" totalImagesPullingTime="1.160322388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:29:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:29:39.750085227 +0000 UTC m=+840.404987947" watchObservedRunningTime="2026-07-08 21:29:39.750230264 +0000 UTC m=+840.405132984"
Jul 08 21:29:44.024360 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:44.024327    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-96rbk"]
Jul 08 21:29:44.027679 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:44.027661    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-96rbk"
Jul 08 21:29:44.030132 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:44.030112    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 08 21:29:44.035517 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:44.035497    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-96rbk"]
Jul 08 21:29:44.136586 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:44.136556    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac779ec6-8e35-4426-9c9e-e24e0a0e5378-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-96rbk\" (UID: \"ac779ec6-8e35-4426-9c9e-e24e0a0e5378\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-96rbk"
Jul 08 21:29:44.136773 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:44.136612    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac779ec6-8e35-4426-9c9e-e24e0a0e5378-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-96rbk\" (UID: \"ac779ec6-8e35-4426-9c9e-e24e0a0e5378\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-96rbk"
Jul 08 21:29:44.136773 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:44.136654    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac779ec6-8e35-4426-9c9e-e24e0a0e5378-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-96rbk\" (UID: \"ac779ec6-8e35-4426-9c9e-e24e0a0e5378\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-96rbk"
Jul 08 21:29:44.136773 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:44.136682    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac779ec6-8e35-4426-9c9e-e24e0a0e5378-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-96rbk\" (UID: \"ac779ec6-8e35-4426-9c9e-e24e0a0e5378\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-96rbk"
Jul 08 21:29:44.136905 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:44.136790    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dw8s\" (UniqueName: \"kubernetes.io/projected/ac779ec6-8e35-4426-9c9e-e24e0a0e5378-kube-api-access-9dw8s\") pod \"e2e-distinct-simulated-kserve-59975d69f9-96rbk\" (UID: \"ac779ec6-8e35-4426-9c9e-e24e0a0e5378\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-96rbk"
Jul 08 21:29:44.136905 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:44.136834    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac779ec6-8e35-4426-9c9e-e24e0a0e5378-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-96rbk\" (UID: \"ac779ec6-8e35-4426-9c9e-e24e0a0e5378\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-96rbk"
Jul 08 21:29:44.237623 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:44.237590    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac779ec6-8e35-4426-9c9e-e24e0a0e5378-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-96rbk\" (UID: \"ac779ec6-8e35-4426-9c9e-e24e0a0e5378\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-96rbk"
Jul 08 21:29:44.237806 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:44.237648    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac779ec6-8e35-4426-9c9e-e24e0a0e5378-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-96rbk\" (UID: \"ac779ec6-8e35-4426-9c9e-e24e0a0e5378\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-96rbk"
Jul 08 21:29:44.237806 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:44.237675    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac779ec6-8e35-4426-9c9e-e24e0a0e5378-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-96rbk\" (UID: \"ac779ec6-8e35-4426-9c9e-e24e0a0e5378\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-96rbk"
Jul 08 21:29:44.237806 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:44.237690    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac779ec6-8e35-4426-9c9e-e24e0a0e5378-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-96rbk\" (UID: \"ac779ec6-8e35-4426-9c9e-e24e0a0e5378\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-96rbk"
Jul 08 21:29:44.237806 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:44.237710    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac779ec6-8e35-4426-9c9e-e24e0a0e5378-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-96rbk\" (UID: \"ac779ec6-8e35-4426-9c9e-e24e0a0e5378\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-96rbk"
Jul 08 21:29:44.237999 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:44.237824    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dw8s\" (UniqueName: \"kubernetes.io/projected/ac779ec6-8e35-4426-9c9e-e24e0a0e5378-kube-api-access-9dw8s\") pod \"e2e-distinct-simulated-kserve-59975d69f9-96rbk\" (UID: \"ac779ec6-8e35-4426-9c9e-e24e0a0e5378\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-96rbk"
Jul 08 21:29:44.238225 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:44.238190    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac779ec6-8e35-4426-9c9e-e24e0a0e5378-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-96rbk\" (UID: \"ac779ec6-8e35-4426-9c9e-e24e0a0e5378\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-96rbk"
Jul 08 21:29:44.238225 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:44.238226    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac779ec6-8e35-4426-9c9e-e24e0a0e5378-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-96rbk\" (UID: \"ac779ec6-8e35-4426-9c9e-e24e0a0e5378\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-96rbk"
Jul 08 21:29:44.238387 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:44.238258    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac779ec6-8e35-4426-9c9e-e24e0a0e5378-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-96rbk\" (UID: \"ac779ec6-8e35-4426-9c9e-e24e0a0e5378\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-96rbk"
Jul 08 21:29:44.240059 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:44.240040    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac779ec6-8e35-4426-9c9e-e24e0a0e5378-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-96rbk\" (UID: \"ac779ec6-8e35-4426-9c9e-e24e0a0e5378\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-96rbk"
Jul 08 21:29:44.240198 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:44.240179    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac779ec6-8e35-4426-9c9e-e24e0a0e5378-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-96rbk\" (UID: \"ac779ec6-8e35-4426-9c9e-e24e0a0e5378\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-96rbk"
Jul 08 21:29:44.245935 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:44.245911    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dw8s\" (UniqueName: \"kubernetes.io/projected/ac779ec6-8e35-4426-9c9e-e24e0a0e5378-kube-api-access-9dw8s\") pod \"e2e-distinct-simulated-kserve-59975d69f9-96rbk\" (UID: \"ac779ec6-8e35-4426-9c9e-e24e0a0e5378\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-96rbk"
Jul 08 21:29:44.338229 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:44.338160    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-96rbk"
Jul 08 21:29:44.464352 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:44.464324    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-96rbk"]
Jul 08 21:29:44.467915 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:29:44.467882    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac779ec6_8e35_4426_9c9e_e24e0a0e5378.slice/crio-452aaa99b354e6118b540f8e613d2a643645876d1584a4f1db3cd5a340b418cb WatchSource:0}: Error finding container 452aaa99b354e6118b540f8e613d2a643645876d1584a4f1db3cd5a340b418cb: Status 404 returned error can't find the container with id 452aaa99b354e6118b540f8e613d2a643645876d1584a4f1db3cd5a340b418cb
Jul 08 21:29:44.755126 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:44.755096    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-96rbk" event={"ID":"ac779ec6-8e35-4426-9c9e-e24e0a0e5378","Type":"ContainerStarted","Data":"68015167aaedc17c14450d631bcebc7fa67e5a01c849f65586159f7d2396161a"}
Jul 08 21:29:44.755279 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:44.755143    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-96rbk" event={"ID":"ac779ec6-8e35-4426-9c9e-e24e0a0e5378","Type":"ContainerStarted","Data":"452aaa99b354e6118b540f8e613d2a643645876d1584a4f1db3cd5a340b418cb"}
Jul 08 21:29:44.771698 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:44.771647    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-96rbk" podStartSLOduration=0.60643751 podStartE2EDuration="771.62299ms" totalImagesPullingTime="165.18548ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:29:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:29:44.77037061 +0000 UTC m=+845.425273330" watchObservedRunningTime="2026-07-08 21:29:44.77162299 +0000 UTC m=+845.426525738"
Jul 08 21:29:47.725117 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:47.725084    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b"
Jul 08 21:29:47.725574 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:47.725171    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b"
Jul 08 21:29:47.737349 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:47.737324    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b"
Jul 08 21:29:47.778457 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:47.778431    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b"
Jul 08 21:29:54.338923 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:54.338889    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-96rbk"
Jul 08 21:29:54.339324 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:54.338972    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-96rbk"
Jul 08 21:29:54.351186 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:54.351159    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-96rbk"
Jul 08 21:29:54.807162 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:54.807135    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-96rbk"
Jul 08 21:29:58.426042 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:58.426010    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh"]
Jul 08 21:29:58.428981 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:58.428960    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh"
Jul 08 21:29:58.431595 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:58.431568    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 08 21:29:58.437563 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:58.437544    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh"]
Jul 08 21:29:58.557894 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:58.557837    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8e00acf-fbef-44d5-b265-b7b1d592a932-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh\" (UID: \"d8e00acf-fbef-44d5-b265-b7b1d592a932\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh"
Jul 08 21:29:58.558072 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:58.557925    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8e00acf-fbef-44d5-b265-b7b1d592a932-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh\" (UID: \"d8e00acf-fbef-44d5-b265-b7b1d592a932\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh"
Jul 08 21:29:58.558072 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:58.557951    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8e00acf-fbef-44d5-b265-b7b1d592a932-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh\" (UID: \"d8e00acf-fbef-44d5-b265-b7b1d592a932\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh"
Jul 08 21:29:58.558072 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:58.557975    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tqpn\" (UniqueName: \"kubernetes.io/projected/d8e00acf-fbef-44d5-b265-b7b1d592a932-kube-api-access-2tqpn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh\" (UID: \"d8e00acf-fbef-44d5-b265-b7b1d592a932\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh"
Jul 08 21:29:58.558072 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:58.558057    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8e00acf-fbef-44d5-b265-b7b1d592a932-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh\" (UID: \"d8e00acf-fbef-44d5-b265-b7b1d592a932\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh"
Jul 08 21:29:58.558257 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:58.558088    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8e00acf-fbef-44d5-b265-b7b1d592a932-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh\" (UID: \"d8e00acf-fbef-44d5-b265-b7b1d592a932\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh"
Jul 08 21:29:58.659124 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:58.659089    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8e00acf-fbef-44d5-b265-b7b1d592a932-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh\" (UID: \"d8e00acf-fbef-44d5-b265-b7b1d592a932\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh"
Jul 08 21:29:58.659124 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:58.659127    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8e00acf-fbef-44d5-b265-b7b1d592a932-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh\" (UID: \"d8e00acf-fbef-44d5-b265-b7b1d592a932\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh"
Jul 08 21:29:58.659348 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:58.659158    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8e00acf-fbef-44d5-b265-b7b1d592a932-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh\" (UID: \"d8e00acf-fbef-44d5-b265-b7b1d592a932\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh"
Jul 08 21:29:58.659348 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:58.659189    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8e00acf-fbef-44d5-b265-b7b1d592a932-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh\" (UID: \"d8e00acf-fbef-44d5-b265-b7b1d592a932\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh"
Jul 08 21:29:58.659348 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:58.659206    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8e00acf-fbef-44d5-b265-b7b1d592a932-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh\" (UID: \"d8e00acf-fbef-44d5-b265-b7b1d592a932\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh"
Jul 08 21:29:58.659348 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:58.659223    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tqpn\" (UniqueName: \"kubernetes.io/projected/d8e00acf-fbef-44d5-b265-b7b1d592a932-kube-api-access-2tqpn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh\" (UID: \"d8e00acf-fbef-44d5-b265-b7b1d592a932\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh"
Jul 08 21:29:58.665611 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:58.659968    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8e00acf-fbef-44d5-b265-b7b1d592a932-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh\" (UID: \"d8e00acf-fbef-44d5-b265-b7b1d592a932\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh"
Jul 08 21:29:58.665611 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:58.660036    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8e00acf-fbef-44d5-b265-b7b1d592a932-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh\" (UID: \"d8e00acf-fbef-44d5-b265-b7b1d592a932\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh"
Jul 08 21:29:58.665611 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:58.660354    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8e00acf-fbef-44d5-b265-b7b1d592a932-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh\" (UID: \"d8e00acf-fbef-44d5-b265-b7b1d592a932\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh"
Jul 08 21:29:58.665611 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:58.662642    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8e00acf-fbef-44d5-b265-b7b1d592a932-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh\" (UID: \"d8e00acf-fbef-44d5-b265-b7b1d592a932\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh"
Jul 08 21:29:58.665611 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:58.663011    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8e00acf-fbef-44d5-b265-b7b1d592a932-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh\" (UID: \"d8e00acf-fbef-44d5-b265-b7b1d592a932\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh"
Jul 08 21:29:58.668923 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:58.668900    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tqpn\" (UniqueName: \"kubernetes.io/projected/d8e00acf-fbef-44d5-b265-b7b1d592a932-kube-api-access-2tqpn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh\" (UID: \"d8e00acf-fbef-44d5-b265-b7b1d592a932\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh"
Jul 08 21:29:58.742020 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:58.741940    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh"
Jul 08 21:29:58.874156 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:58.874129    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh"]
Jul 08 21:29:58.875874 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:29:58.875851    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8e00acf_fbef_44d5_b265_b7b1d592a932.slice/crio-52749c20fb03e966107a0b0869851d5e4279e81389ab97f7136ff0fe83e40af6 WatchSource:0}: Error finding container 52749c20fb03e966107a0b0869851d5e4279e81389ab97f7136ff0fe83e40af6: Status 404 returned error can't find the container with id 52749c20fb03e966107a0b0869851d5e4279e81389ab97f7136ff0fe83e40af6
Jul 08 21:29:58.877594 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:58.877578    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 21:29:59.818058 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:59.818023    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh" event={"ID":"d8e00acf-fbef-44d5-b265-b7b1d592a932","Type":"ContainerStarted","Data":"10b6edf9f23c6bf067cc7b471129999432cbc1a2b2408ea73131c8feb6e5316c"}
Jul 08 21:29:59.818524 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:59.818072    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh" event={"ID":"d8e00acf-fbef-44d5-b265-b7b1d592a932","Type":"ContainerStarted","Data":"52749c20fb03e966107a0b0869851d5e4279e81389ab97f7136ff0fe83e40af6"}
Jul 08 21:29:59.834375 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:29:59.834327    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh" podStartSLOduration=1.615991256 podStartE2EDuration="1.834312773s" totalImagesPullingTime="218.321517ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:29:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:29:59.833019873 +0000 UTC m=+860.487922610" watchObservedRunningTime="2026-07-08 21:29:59.834312773 +0000 UTC m=+860.489215491"
Jul 08 21:30:08.742986 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:30:08.742942    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh"
Jul 08 21:30:08.743446 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:30:08.743007    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh"
Jul 08 21:30:08.755570 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:30:08.755544    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh"
Jul 08 21:30:08.867056 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:30:08.867026    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh"
Jul 08 21:44:45.331505 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:45.331471    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e9244d19-66d95cd675-79nln"]
Jul 08 21:44:45.334596 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:45.334577    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9244d19-66d95cd675-79nln"
Jul 08 21:44:45.337214 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:45.337193    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-e9244d19-serving-cert\""
Jul 08 21:44:45.337324 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:45.337268    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 21:44:45.338140 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:45.338112    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-xdh9f\""
Jul 08 21:44:45.338140 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:45.338114    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 21:44:45.344053 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:45.344033    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e9244d19-66d95cd675-79nln"]
Jul 08 21:44:45.468670 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:45.468640    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fc8ab4c-6d18-4748-8455-914a0c1ee7b1-maas-api-tls\") pod \"maas-api-e2e-ait-e9244d19-66d95cd675-79nln\" (UID: \"5fc8ab4c-6d18-4748-8455-914a0c1ee7b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9244d19-66d95cd675-79nln"
Jul 08 21:44:45.468670 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:45.468671    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q65s\" (UniqueName: \"kubernetes.io/projected/5fc8ab4c-6d18-4748-8455-914a0c1ee7b1-kube-api-access-9q65s\") pod \"maas-api-e2e-ait-e9244d19-66d95cd675-79nln\" (UID: \"5fc8ab4c-6d18-4748-8455-914a0c1ee7b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9244d19-66d95cd675-79nln"
Jul 08 21:44:45.468880 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:45.468719    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fc8ab4c-6d18-4748-8455-914a0c1ee7b1-openshift-service-ca\") pod \"maas-api-e2e-ait-e9244d19-66d95cd675-79nln\" (UID: \"5fc8ab4c-6d18-4748-8455-914a0c1ee7b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9244d19-66d95cd675-79nln"
Jul 08 21:44:45.569355 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:45.569320    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fc8ab4c-6d18-4748-8455-914a0c1ee7b1-maas-api-tls\") pod \"maas-api-e2e-ait-e9244d19-66d95cd675-79nln\" (UID: \"5fc8ab4c-6d18-4748-8455-914a0c1ee7b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9244d19-66d95cd675-79nln"
Jul 08 21:44:45.569355 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:45.569357    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q65s\" (UniqueName: \"kubernetes.io/projected/5fc8ab4c-6d18-4748-8455-914a0c1ee7b1-kube-api-access-9q65s\") pod \"maas-api-e2e-ait-e9244d19-66d95cd675-79nln\" (UID: \"5fc8ab4c-6d18-4748-8455-914a0c1ee7b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9244d19-66d95cd675-79nln"
Jul 08 21:44:45.569553 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:45.569407    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fc8ab4c-6d18-4748-8455-914a0c1ee7b1-openshift-service-ca\") pod \"maas-api-e2e-ait-e9244d19-66d95cd675-79nln\" (UID: \"5fc8ab4c-6d18-4748-8455-914a0c1ee7b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9244d19-66d95cd675-79nln"
Jul 08 21:44:45.570069 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:45.570043    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fc8ab4c-6d18-4748-8455-914a0c1ee7b1-openshift-service-ca\") pod \"maas-api-e2e-ait-e9244d19-66d95cd675-79nln\" (UID: \"5fc8ab4c-6d18-4748-8455-914a0c1ee7b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9244d19-66d95cd675-79nln"
Jul 08 21:44:45.571836 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:45.571817    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fc8ab4c-6d18-4748-8455-914a0c1ee7b1-maas-api-tls\") pod \"maas-api-e2e-ait-e9244d19-66d95cd675-79nln\" (UID: \"5fc8ab4c-6d18-4748-8455-914a0c1ee7b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9244d19-66d95cd675-79nln"
Jul 08 21:44:45.579723 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:45.579703    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q65s\" (UniqueName: \"kubernetes.io/projected/5fc8ab4c-6d18-4748-8455-914a0c1ee7b1-kube-api-access-9q65s\") pod \"maas-api-e2e-ait-e9244d19-66d95cd675-79nln\" (UID: \"5fc8ab4c-6d18-4748-8455-914a0c1ee7b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9244d19-66d95cd675-79nln"
Jul 08 21:44:45.645442 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:45.645385    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9244d19-66d95cd675-79nln"
Jul 08 21:44:45.779551 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:45.779527    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e9244d19-66d95cd675-79nln"]
Jul 08 21:44:45.782063 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:44:45.782035    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fc8ab4c_6d18_4748_8455_914a0c1ee7b1.slice/crio-a9596287c49b1506cddbbd381499d42f36ccae8493d1935f3f7e9ce1f7f1385b WatchSource:0}: Error finding container a9596287c49b1506cddbbd381499d42f36ccae8493d1935f3f7e9ce1f7f1385b: Status 404 returned error can't find the container with id a9596287c49b1506cddbbd381499d42f36ccae8493d1935f3f7e9ce1f7f1385b
Jul 08 21:44:45.783562 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:45.783541    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 21:44:46.420266 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:46.420232    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9244d19-66d95cd675-79nln" event={"ID":"5fc8ab4c-6d18-4748-8455-914a0c1ee7b1","Type":"ContainerStarted","Data":"a9596287c49b1506cddbbd381499d42f36ccae8493d1935f3f7e9ce1f7f1385b"}
Jul 08 21:44:49.439986 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:49.439952    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9244d19-66d95cd675-79nln" event={"ID":"5fc8ab4c-6d18-4748-8455-914a0c1ee7b1","Type":"ContainerStarted","Data":"06d6cb8eee67f723273d1f0e4b584d997927e652f35dc7da53b7ee4b96191ea6"}
Jul 08 21:44:49.440397 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:49.440108    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9244d19-66d95cd675-79nln"
Jul 08 21:44:49.459155 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:49.459111    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9244d19-66d95cd675-79nln" podStartSLOduration=1.819429915 podStartE2EDuration="4.459098292s" totalImagesPullingTime="2.639668377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:44:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:44:49.457927981 +0000 UTC m=+1750.112830701" watchObservedRunningTime="2026-07-08 21:44:49.459098292 +0000 UTC m=+1750.114001012"
Jul 08 21:44:50.483718 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:50.483687    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e9244d19-66d95cd675-79nln"]
Jul 08 21:44:50.510834 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:44:50.510805    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-e9244d19-serving-cert: secret "maas-api-e2e-ait-e9244d19-serving-cert" not found
Jul 08 21:44:50.510973 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:44:50.510873    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fc8ab4c-6d18-4748-8455-914a0c1ee7b1-maas-api-tls podName:5fc8ab4c-6d18-4748-8455-914a0c1ee7b1 nodeName:}" failed. No retries permitted until 2026-07-08 21:44:51.010854424 +0000 UTC m=+1751.665757134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5fc8ab4c-6d18-4748-8455-914a0c1ee7b1-maas-api-tls") pod "maas-api-e2e-ait-e9244d19-66d95cd675-79nln" (UID: "5fc8ab4c-6d18-4748-8455-914a0c1ee7b1") : secret "maas-api-e2e-ait-e9244d19-serving-cert" not found
Jul 08 21:44:51.016510 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:44:51.016475    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-e9244d19-serving-cert: secret "maas-api-e2e-ait-e9244d19-serving-cert" not found
Jul 08 21:44:51.016674 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:44:51.016545    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fc8ab4c-6d18-4748-8455-914a0c1ee7b1-maas-api-tls podName:5fc8ab4c-6d18-4748-8455-914a0c1ee7b1 nodeName:}" failed. No retries permitted until 2026-07-08 21:44:52.016530275 +0000 UTC m=+1752.671432973 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5fc8ab4c-6d18-4748-8455-914a0c1ee7b1-maas-api-tls") pod "maas-api-e2e-ait-e9244d19-66d95cd675-79nln" (UID: "5fc8ab4c-6d18-4748-8455-914a0c1ee7b1") : secret "maas-api-e2e-ait-e9244d19-serving-cert" not found
Jul 08 21:44:51.448126 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:51.448088    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9244d19-66d95cd675-79nln" podUID="5fc8ab4c-6d18-4748-8455-914a0c1ee7b1" containerName="maas-api" containerID="cri-o://06d6cb8eee67f723273d1f0e4b584d997927e652f35dc7da53b7ee4b96191ea6" gracePeriod=30
Jul 08 21:44:51.696571 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:51.696549    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9244d19-66d95cd675-79nln"
Jul 08 21:44:51.822672 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:51.822590    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fc8ab4c-6d18-4748-8455-914a0c1ee7b1-openshift-service-ca\") pod \"5fc8ab4c-6d18-4748-8455-914a0c1ee7b1\" (UID: \"5fc8ab4c-6d18-4748-8455-914a0c1ee7b1\") "
Jul 08 21:44:51.822846 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:51.822681    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fc8ab4c-6d18-4748-8455-914a0c1ee7b1-maas-api-tls\") pod \"5fc8ab4c-6d18-4748-8455-914a0c1ee7b1\" (UID: \"5fc8ab4c-6d18-4748-8455-914a0c1ee7b1\") "
Jul 08 21:44:51.822846 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:51.822740    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9q65s\" (UniqueName: \"kubernetes.io/projected/5fc8ab4c-6d18-4748-8455-914a0c1ee7b1-kube-api-access-9q65s\") pod \"5fc8ab4c-6d18-4748-8455-914a0c1ee7b1\" (UID: \"5fc8ab4c-6d18-4748-8455-914a0c1ee7b1\") "
Jul 08 21:44:51.822961 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:51.822909    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fc8ab4c-6d18-4748-8455-914a0c1ee7b1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5fc8ab4c-6d18-4748-8455-914a0c1ee7b1" (UID: "5fc8ab4c-6d18-4748-8455-914a0c1ee7b1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:44:51.824947 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:51.824919    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fc8ab4c-6d18-4748-8455-914a0c1ee7b1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5fc8ab4c-6d18-4748-8455-914a0c1ee7b1" (UID: "5fc8ab4c-6d18-4748-8455-914a0c1ee7b1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:44:51.825051 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:51.824980    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fc8ab4c-6d18-4748-8455-914a0c1ee7b1-kube-api-access-9q65s" (OuterVolumeSpecName: "kube-api-access-9q65s") pod "5fc8ab4c-6d18-4748-8455-914a0c1ee7b1" (UID: "5fc8ab4c-6d18-4748-8455-914a0c1ee7b1"). InnerVolumeSpecName "kube-api-access-9q65s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:44:51.923744 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:51.923717    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fc8ab4c-6d18-4748-8455-914a0c1ee7b1-maas-api-tls\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:44:51.923744 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:51.923742    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9q65s\" (UniqueName: \"kubernetes.io/projected/5fc8ab4c-6d18-4748-8455-914a0c1ee7b1-kube-api-access-9q65s\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:44:51.923930 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:51.923775    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fc8ab4c-6d18-4748-8455-914a0c1ee7b1-openshift-service-ca\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:44:52.453559 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:52.453525    2571 generic.go:356] "Generic (PLEG): container finished" podID="5fc8ab4c-6d18-4748-8455-914a0c1ee7b1" containerID="06d6cb8eee67f723273d1f0e4b584d997927e652f35dc7da53b7ee4b96191ea6" exitCode=0
Jul 08 21:44:52.453721 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:52.453565    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9244d19-66d95cd675-79nln" event={"ID":"5fc8ab4c-6d18-4748-8455-914a0c1ee7b1","Type":"ContainerDied","Data":"06d6cb8eee67f723273d1f0e4b584d997927e652f35dc7da53b7ee4b96191ea6"}
Jul 08 21:44:52.453721 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:52.453574    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9244d19-66d95cd675-79nln"
Jul 08 21:44:52.453721 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:52.453607    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e9244d19-66d95cd675-79nln" event={"ID":"5fc8ab4c-6d18-4748-8455-914a0c1ee7b1","Type":"ContainerDied","Data":"a9596287c49b1506cddbbd381499d42f36ccae8493d1935f3f7e9ce1f7f1385b"}
Jul 08 21:44:52.453721 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:52.453628    2571 scope.go:117] "RemoveContainer" containerID="06d6cb8eee67f723273d1f0e4b584d997927e652f35dc7da53b7ee4b96191ea6"
Jul 08 21:44:52.461870 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:52.461851    2571 scope.go:117] "RemoveContainer" containerID="06d6cb8eee67f723273d1f0e4b584d997927e652f35dc7da53b7ee4b96191ea6"
Jul 08 21:44:52.462165 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:44:52.462137    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06d6cb8eee67f723273d1f0e4b584d997927e652f35dc7da53b7ee4b96191ea6\": container with ID starting with 06d6cb8eee67f723273d1f0e4b584d997927e652f35dc7da53b7ee4b96191ea6 not found: ID does not exist" containerID="06d6cb8eee67f723273d1f0e4b584d997927e652f35dc7da53b7ee4b96191ea6"
Jul 08 21:44:52.462245 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:52.462174    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06d6cb8eee67f723273d1f0e4b584d997927e652f35dc7da53b7ee4b96191ea6"} err="failed to get container status \"06d6cb8eee67f723273d1f0e4b584d997927e652f35dc7da53b7ee4b96191ea6\": rpc error: code = NotFound desc = could not find container \"06d6cb8eee67f723273d1f0e4b584d997927e652f35dc7da53b7ee4b96191ea6\": container with ID starting with 06d6cb8eee67f723273d1f0e4b584d997927e652f35dc7da53b7ee4b96191ea6 not found: ID does not exist"
Jul 08 21:44:52.477905 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:52.477880    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e9244d19-66d95cd675-79nln"]
Jul 08 21:44:52.486574 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:52.486550    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e9244d19-66d95cd675-79nln"]
Jul 08 21:44:53.867306 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:53.867275    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fc8ab4c-6d18-4748-8455-914a0c1ee7b1" path="/var/lib/kubelet/pods/5fc8ab4c-6d18-4748-8455-914a0c1ee7b1/volumes"
Jul 08 21:44:57.429770 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:57.429714    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw"]
Jul 08 21:44:57.430160 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:57.430144    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fc8ab4c-6d18-4748-8455-914a0c1ee7b1" containerName="maas-api"
Jul 08 21:44:57.430204 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:57.430164    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fc8ab4c-6d18-4748-8455-914a0c1ee7b1" containerName="maas-api"
Jul 08 21:44:57.430260 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:57.430249    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fc8ab4c-6d18-4748-8455-914a0c1ee7b1" containerName="maas-api"
Jul 08 21:44:57.434790 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:57.434772    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw"
Jul 08 21:44:57.437409 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:57.437387    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-f9434df5-serving-cert\""
Jul 08 21:44:57.437981 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:57.437961    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-xdh9f\""
Jul 08 21:44:57.438628 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:57.438614    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 21:44:57.438723 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:57.438707    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 21:44:57.442943 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:57.442920    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw"]
Jul 08 21:44:57.570270 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:57.570232    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhzn4\" (UniqueName: \"kubernetes.io/projected/a129d9b5-4afa-44c3-8367-94d7396c59d2-kube-api-access-hhzn4\") pod \"maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw\" (UID: \"a129d9b5-4afa-44c3-8367-94d7396c59d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw"
Jul 08 21:44:57.570457 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:57.570295    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a129d9b5-4afa-44c3-8367-94d7396c59d2-openshift-service-ca\") pod \"maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw\" (UID: \"a129d9b5-4afa-44c3-8367-94d7396c59d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw"
Jul 08 21:44:57.570457 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:57.570433    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a129d9b5-4afa-44c3-8367-94d7396c59d2-maas-api-tls\") pod \"maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw\" (UID: \"a129d9b5-4afa-44c3-8367-94d7396c59d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw"
Jul 08 21:44:57.671454 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:57.671423    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a129d9b5-4afa-44c3-8367-94d7396c59d2-maas-api-tls\") pod \"maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw\" (UID: \"a129d9b5-4afa-44c3-8367-94d7396c59d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw"
Jul 08 21:44:57.671615 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:57.671463    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhzn4\" (UniqueName: \"kubernetes.io/projected/a129d9b5-4afa-44c3-8367-94d7396c59d2-kube-api-access-hhzn4\") pod \"maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw\" (UID: \"a129d9b5-4afa-44c3-8367-94d7396c59d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw"
Jul 08 21:44:57.671615 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:57.671489    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a129d9b5-4afa-44c3-8367-94d7396c59d2-openshift-service-ca\") pod \"maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw\" (UID: \"a129d9b5-4afa-44c3-8367-94d7396c59d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw"
Jul 08 21:44:57.672149 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:57.672129    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a129d9b5-4afa-44c3-8367-94d7396c59d2-openshift-service-ca\") pod \"maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw\" (UID: \"a129d9b5-4afa-44c3-8367-94d7396c59d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw"
Jul 08 21:44:57.674042 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:57.674022    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a129d9b5-4afa-44c3-8367-94d7396c59d2-maas-api-tls\") pod \"maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw\" (UID: \"a129d9b5-4afa-44c3-8367-94d7396c59d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw"
Jul 08 21:44:57.685062 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:57.685007    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhzn4\" (UniqueName: \"kubernetes.io/projected/a129d9b5-4afa-44c3-8367-94d7396c59d2-kube-api-access-hhzn4\") pod \"maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw\" (UID: \"a129d9b5-4afa-44c3-8367-94d7396c59d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw"
Jul 08 21:44:57.746323 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:57.746295    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw"
Jul 08 21:44:57.887957 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:57.887924    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw"]
Jul 08 21:44:57.890687 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:44:57.890660    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda129d9b5_4afa_44c3_8367_94d7396c59d2.slice/crio-611a7bdc7e8d0317ae8f8e503082754f2d500c71acd00f7d440aed8bedf0f17e WatchSource:0}: Error finding container 611a7bdc7e8d0317ae8f8e503082754f2d500c71acd00f7d440aed8bedf0f17e: Status 404 returned error can't find the container with id 611a7bdc7e8d0317ae8f8e503082754f2d500c71acd00f7d440aed8bedf0f17e
Jul 08 21:44:58.481204 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:58.481174    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw" event={"ID":"a129d9b5-4afa-44c3-8367-94d7396c59d2","Type":"ContainerStarted","Data":"611a7bdc7e8d0317ae8f8e503082754f2d500c71acd00f7d440aed8bedf0f17e"}
Jul 08 21:44:59.487129 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:59.487086    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw" event={"ID":"a129d9b5-4afa-44c3-8367-94d7396c59d2","Type":"ContainerStarted","Data":"77a0ccd7b0666ac20dd2811f19ad0399db6cc9c55cb377177f48d7c3a184fcbe"}
Jul 08 21:44:59.487551 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:59.487209    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw"
Jul 08 21:44:59.504588 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:44:59.504534    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw" podStartSLOduration=1.794208082 podStartE2EDuration="2.504513573s" totalImagesPullingTime="710.305491ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:44:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:44:59.5024786 +0000 UTC m=+1760.157381333" watchObservedRunningTime="2026-07-08 21:44:59.504513573 +0000 UTC m=+1760.159416294"
Jul 08 21:45:00.127961 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:00.127930    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f9434df5-29725785-pwlgt"]
Jul 08 21:45:00.131111 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:00.131095    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f9434df5-29725785-pwlgt"
Jul 08 21:45:00.139713 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:00.139689    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f9434df5-29725785-pwlgt"]
Jul 08 21:45:00.301883 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:00.301825    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkgd4\" (UniqueName: \"kubernetes.io/projected/a89d9fa0-740b-4a0e-88d1-2fc344159491-kube-api-access-zkgd4\") pod \"maas-api-key-cleanup-e2e-ait-f9434df5-29725785-pwlgt\" (UID: \"a89d9fa0-740b-4a0e-88d1-2fc344159491\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f9434df5-29725785-pwlgt"
Jul 08 21:45:00.402491 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:00.402411    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkgd4\" (UniqueName: \"kubernetes.io/projected/a89d9fa0-740b-4a0e-88d1-2fc344159491-kube-api-access-zkgd4\") pod \"maas-api-key-cleanup-e2e-ait-f9434df5-29725785-pwlgt\" (UID: \"a89d9fa0-740b-4a0e-88d1-2fc344159491\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f9434df5-29725785-pwlgt"
Jul 08 21:45:00.411982 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:00.411955    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkgd4\" (UniqueName: \"kubernetes.io/projected/a89d9fa0-740b-4a0e-88d1-2fc344159491-kube-api-access-zkgd4\") pod \"maas-api-key-cleanup-e2e-ait-f9434df5-29725785-pwlgt\" (UID: \"a89d9fa0-740b-4a0e-88d1-2fc344159491\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f9434df5-29725785-pwlgt"
Jul 08 21:45:00.442330 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:00.442295    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f9434df5-29725785-pwlgt"
Jul 08 21:45:00.574844 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:00.574816    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f9434df5-29725785-pwlgt"]
Jul 08 21:45:00.575950 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:45:00.575923    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda89d9fa0_740b_4a0e_88d1_2fc344159491.slice/crio-92f8d9f3a0a8968a1e42473aec7a542d38e97ee991d4bc88a6dc873f1cc794c3 WatchSource:0}: Error finding container 92f8d9f3a0a8968a1e42473aec7a542d38e97ee991d4bc88a6dc873f1cc794c3: Status 404 returned error can't find the container with id 92f8d9f3a0a8968a1e42473aec7a542d38e97ee991d4bc88a6dc873f1cc794c3
Jul 08 21:45:01.497495 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:01.497457    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f9434df5-29725785-pwlgt" event={"ID":"a89d9fa0-740b-4a0e-88d1-2fc344159491","Type":"ContainerStarted","Data":"92f8d9f3a0a8968a1e42473aec7a542d38e97ee991d4bc88a6dc873f1cc794c3"}
Jul 08 21:45:02.874107 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:02.874078    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw"]
Jul 08 21:45:02.874518 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:02.874237    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw" podUID="a129d9b5-4afa-44c3-8367-94d7396c59d2" containerName="maas-api" containerID="cri-o://77a0ccd7b0666ac20dd2811f19ad0399db6cc9c55cb377177f48d7c3a184fcbe" gracePeriod=30
Jul 08 21:45:02.903455 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:02.903434    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f9434df5-29725785-pwlgt"]
Jul 08 21:45:03.111238 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:03.111217    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw"
Jul 08 21:45:03.230082 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:03.230053    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a129d9b5-4afa-44c3-8367-94d7396c59d2-openshift-service-ca\") pod \"a129d9b5-4afa-44c3-8367-94d7396c59d2\" (UID: \"a129d9b5-4afa-44c3-8367-94d7396c59d2\") "
Jul 08 21:45:03.230215 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:03.230161    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a129d9b5-4afa-44c3-8367-94d7396c59d2-maas-api-tls\") pod \"a129d9b5-4afa-44c3-8367-94d7396c59d2\" (UID: \"a129d9b5-4afa-44c3-8367-94d7396c59d2\") "
Jul 08 21:45:03.230264 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:03.230211    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhzn4\" (UniqueName: \"kubernetes.io/projected/a129d9b5-4afa-44c3-8367-94d7396c59d2-kube-api-access-hhzn4\") pod \"a129d9b5-4afa-44c3-8367-94d7396c59d2\" (UID: \"a129d9b5-4afa-44c3-8367-94d7396c59d2\") "
Jul 08 21:45:03.230449 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:03.230428    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a129d9b5-4afa-44c3-8367-94d7396c59d2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a129d9b5-4afa-44c3-8367-94d7396c59d2" (UID: "a129d9b5-4afa-44c3-8367-94d7396c59d2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:45:03.280177 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:03.280114    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a129d9b5-4afa-44c3-8367-94d7396c59d2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a129d9b5-4afa-44c3-8367-94d7396c59d2" (UID: "a129d9b5-4afa-44c3-8367-94d7396c59d2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:45:03.280177 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:03.280139    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a129d9b5-4afa-44c3-8367-94d7396c59d2-kube-api-access-hhzn4" (OuterVolumeSpecName: "kube-api-access-hhzn4") pod "a129d9b5-4afa-44c3-8367-94d7396c59d2" (UID: "a129d9b5-4afa-44c3-8367-94d7396c59d2"). InnerVolumeSpecName "kube-api-access-hhzn4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:45:03.331540 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:03.331514    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a129d9b5-4afa-44c3-8367-94d7396c59d2-openshift-service-ca\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:45:03.331540 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:03.331538    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a129d9b5-4afa-44c3-8367-94d7396c59d2-maas-api-tls\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:45:03.331656 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:03.331547    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhzn4\" (UniqueName: \"kubernetes.io/projected/a129d9b5-4afa-44c3-8367-94d7396c59d2-kube-api-access-hhzn4\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:45:03.507988 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:03.507956    2571 generic.go:356] "Generic (PLEG): container finished" podID="a129d9b5-4afa-44c3-8367-94d7396c59d2" containerID="77a0ccd7b0666ac20dd2811f19ad0399db6cc9c55cb377177f48d7c3a184fcbe" exitCode=0
Jul 08 21:45:03.508163 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:03.508003    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw"
Jul 08 21:45:03.508163 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:03.508042    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw" event={"ID":"a129d9b5-4afa-44c3-8367-94d7396c59d2","Type":"ContainerDied","Data":"77a0ccd7b0666ac20dd2811f19ad0399db6cc9c55cb377177f48d7c3a184fcbe"}
Jul 08 21:45:03.508163 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:03.508099    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw" event={"ID":"a129d9b5-4afa-44c3-8367-94d7396c59d2","Type":"ContainerDied","Data":"611a7bdc7e8d0317ae8f8e503082754f2d500c71acd00f7d440aed8bedf0f17e"}
Jul 08 21:45:03.508163 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:03.508129    2571 scope.go:117] "RemoveContainer" containerID="77a0ccd7b0666ac20dd2811f19ad0399db6cc9c55cb377177f48d7c3a184fcbe"
Jul 08 21:45:03.509679 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:03.509642    2571 generic.go:356] "Generic (PLEG): container finished" podID="a89d9fa0-740b-4a0e-88d1-2fc344159491" containerID="72bb51c9f34c4a37dc07b292a5b40f66eedbd562ac42382cd25832e9584e8a01" exitCode=6
Jul 08 21:45:03.509807 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:03.509737    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f9434df5-29725785-pwlgt" event={"ID":"a89d9fa0-740b-4a0e-88d1-2fc344159491","Type":"ContainerDied","Data":"72bb51c9f34c4a37dc07b292a5b40f66eedbd562ac42382cd25832e9584e8a01"}
Jul 08 21:45:03.517419 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:03.517404    2571 scope.go:117] "RemoveContainer" containerID="77a0ccd7b0666ac20dd2811f19ad0399db6cc9c55cb377177f48d7c3a184fcbe"
Jul 08 21:45:03.517681 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:45:03.517665    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77a0ccd7b0666ac20dd2811f19ad0399db6cc9c55cb377177f48d7c3a184fcbe\": container with ID starting with 77a0ccd7b0666ac20dd2811f19ad0399db6cc9c55cb377177f48d7c3a184fcbe not found: ID does not exist" containerID="77a0ccd7b0666ac20dd2811f19ad0399db6cc9c55cb377177f48d7c3a184fcbe"
Jul 08 21:45:03.517724 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:03.517690    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77a0ccd7b0666ac20dd2811f19ad0399db6cc9c55cb377177f48d7c3a184fcbe"} err="failed to get container status \"77a0ccd7b0666ac20dd2811f19ad0399db6cc9c55cb377177f48d7c3a184fcbe\": rpc error: code = NotFound desc = could not find container \"77a0ccd7b0666ac20dd2811f19ad0399db6cc9c55cb377177f48d7c3a184fcbe\": container with ID starting with 77a0ccd7b0666ac20dd2811f19ad0399db6cc9c55cb377177f48d7c3a184fcbe not found: ID does not exist"
Jul 08 21:45:03.538863 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:03.538792    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw"]
Jul 08 21:45:03.544603 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:03.544577    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f9434df5-6b77d47dfd-5jqcw"]
Jul 08 21:45:03.627556 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:03.627532    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f9434df5-29725785-pwlgt"
Jul 08 21:45:03.735654 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:03.735635    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkgd4\" (UniqueName: \"kubernetes.io/projected/a89d9fa0-740b-4a0e-88d1-2fc344159491-kube-api-access-zkgd4\") pod \"a89d9fa0-740b-4a0e-88d1-2fc344159491\" (UID: \"a89d9fa0-740b-4a0e-88d1-2fc344159491\") "
Jul 08 21:45:03.737913 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:03.737884    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a89d9fa0-740b-4a0e-88d1-2fc344159491-kube-api-access-zkgd4" (OuterVolumeSpecName: "kube-api-access-zkgd4") pod "a89d9fa0-740b-4a0e-88d1-2fc344159491" (UID: "a89d9fa0-740b-4a0e-88d1-2fc344159491"). InnerVolumeSpecName "kube-api-access-zkgd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:45:03.836463 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:03.836397    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkgd4\" (UniqueName: \"kubernetes.io/projected/a89d9fa0-740b-4a0e-88d1-2fc344159491-kube-api-access-zkgd4\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:45:03.866547 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:03.866515    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a129d9b5-4afa-44c3-8367-94d7396c59d2" path="/var/lib/kubelet/pods/a129d9b5-4afa-44c3-8367-94d7396c59d2/volumes"
Jul 08 21:45:04.516393 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:04.516363    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f9434df5-29725785-pwlgt"
Jul 08 21:45:04.516393 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:04.516372    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f9434df5-29725785-pwlgt" event={"ID":"a89d9fa0-740b-4a0e-88d1-2fc344159491","Type":"ContainerDied","Data":"92f8d9f3a0a8968a1e42473aec7a542d38e97ee991d4bc88a6dc873f1cc794c3"}
Jul 08 21:45:04.516910 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:04.516434    2571 scope.go:117] "RemoveContainer" containerID="72bb51c9f34c4a37dc07b292a5b40f66eedbd562ac42382cd25832e9584e8a01"
Jul 08 21:45:04.531794 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:04.531770    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f9434df5-29725785-pwlgt"]
Jul 08 21:45:04.535452 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:04.535426    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f9434df5-29725785-pwlgt"]
Jul 08 21:45:05.867247 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:05.867211    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a89d9fa0-740b-4a0e-88d1-2fc344159491" path="/var/lib/kubelet/pods/a89d9fa0-740b-4a0e-88d1-2fc344159491/volumes"
Jul 08 21:45:14.702293 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.702262    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"]
Jul 08 21:45:14.702806 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.702599    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a129d9b5-4afa-44c3-8367-94d7396c59d2" containerName="maas-api"
Jul 08 21:45:14.702806 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.702612    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a129d9b5-4afa-44c3-8367-94d7396c59d2" containerName="maas-api"
Jul 08 21:45:14.702806 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.702628    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a89d9fa0-740b-4a0e-88d1-2fc344159491" containerName="cleanup"
Jul 08 21:45:14.702806 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.702635    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a89d9fa0-740b-4a0e-88d1-2fc344159491" containerName="cleanup"
Jul 08 21:45:14.702806 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.702691    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a89d9fa0-740b-4a0e-88d1-2fc344159491" containerName="cleanup"
Jul 08 21:45:14.702806 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.702701    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a129d9b5-4afa-44c3-8367-94d7396c59d2" containerName="maas-api"
Jul 08 21:45:14.705622 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.705598    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:14.710088 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.710069    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-04bc267c-openshift-default-dockercfg-hkvd7\""
Jul 08 21:45:14.719033 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.719002    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"]
Jul 08 21:45:14.719120 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.719087    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4aa4652d-73a6-4b65-b705-3149dbeef412-istio-token\") pod \"e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") " pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:14.719162 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.719125    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4aa4652d-73a6-4b65-b705-3149dbeef412-istiod-ca-cert\") pod \"e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") " pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:14.719245 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.719224    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4aa4652d-73a6-4b65-b705-3149dbeef412-istio-data\") pod \"e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") " pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:14.719286 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.719271    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4aa4652d-73a6-4b65-b705-3149dbeef412-workload-socket\") pod \"e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") " pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:14.719342 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.719326    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4aa4652d-73a6-4b65-b705-3149dbeef412-credential-socket\") pod \"e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") " pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:14.719373 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.719357    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4aa4652d-73a6-4b65-b705-3149dbeef412-workload-certs\") pod \"e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") " pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:14.719408 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.719380    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4aa4652d-73a6-4b65-b705-3149dbeef412-istio-envoy\") pod \"e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") " pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:14.719440 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.719405    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wbcg\" (UniqueName: \"kubernetes.io/projected/4aa4652d-73a6-4b65-b705-3149dbeef412-kube-api-access-5wbcg\") pod \"e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") " pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:14.719473 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.719435    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4aa4652d-73a6-4b65-b705-3149dbeef412-istio-podinfo\") pod \"e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") " pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:14.820331 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.820290    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4aa4652d-73a6-4b65-b705-3149dbeef412-istio-data\") pod \"e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") " pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:14.820506 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.820341    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4aa4652d-73a6-4b65-b705-3149dbeef412-workload-socket\") pod \"e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") " pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:14.820506 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.820362    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4aa4652d-73a6-4b65-b705-3149dbeef412-credential-socket\") pod \"e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") " pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:14.820506 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.820385    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4aa4652d-73a6-4b65-b705-3149dbeef412-workload-certs\") pod \"e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") " pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:14.820506 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.820407    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4aa4652d-73a6-4b65-b705-3149dbeef412-istio-envoy\") pod \"e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") " pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:14.820506 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.820431    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wbcg\" (UniqueName: \"kubernetes.io/projected/4aa4652d-73a6-4b65-b705-3149dbeef412-kube-api-access-5wbcg\") pod \"e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") " pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:14.820506 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.820460    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4aa4652d-73a6-4b65-b705-3149dbeef412-istio-podinfo\") pod \"e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") " pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:14.820975 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.820555    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4aa4652d-73a6-4b65-b705-3149dbeef412-istio-token\") pod \"e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") " pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:14.820975 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.820581    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4aa4652d-73a6-4b65-b705-3149dbeef412-istiod-ca-cert\") pod \"e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") " pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:14.821181 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.821153    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4aa4652d-73a6-4b65-b705-3149dbeef412-credential-socket\") pod \"e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") " pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:14.821290 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.821216    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4aa4652d-73a6-4b65-b705-3149dbeef412-istio-data\") pod \"e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") " pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:14.821290 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.821261    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4aa4652d-73a6-4b65-b705-3149dbeef412-workload-certs\") pod \"e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") " pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:14.821387 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.821313    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4aa4652d-73a6-4b65-b705-3149dbeef412-workload-socket\") pod \"e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") " pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:14.821889 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.821863    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4aa4652d-73a6-4b65-b705-3149dbeef412-istiod-ca-cert\") pod \"e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") " pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:14.823373 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.823342    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4aa4652d-73a6-4b65-b705-3149dbeef412-istio-envoy\") pod \"e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") " pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:14.823839 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.823811    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4aa4652d-73a6-4b65-b705-3149dbeef412-istio-podinfo\") pod \"e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") " pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:14.832345 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.832324    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wbcg\" (UniqueName: \"kubernetes.io/projected/4aa4652d-73a6-4b65-b705-3149dbeef412-kube-api-access-5wbcg\") pod \"e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") " pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:14.832474 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:14.832455    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4aa4652d-73a6-4b65-b705-3149dbeef412-istio-token\") pod \"e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") " pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:15.016416 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:15.016336    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:15.147150 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:15.147118    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"]
Jul 08 21:45:15.149126 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:45:15.149101    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aa4652d_73a6_4b65_b705_3149dbeef412.slice/crio-757d6e9855f680e7c8536b9300068e67bd663e45ce36a8c66d865e39260b8b12 WatchSource:0}: Error finding container 757d6e9855f680e7c8536b9300068e67bd663e45ce36a8c66d865e39260b8b12: Status 404 returned error can't find the container with id 757d6e9855f680e7c8536b9300068e67bd663e45ce36a8c66d865e39260b8b12
Jul 08 21:45:15.151135 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:15.151080    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 21:45:15.151232 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:15.151180    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 21:45:15.151232 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:15.151223    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 21:45:15.569638 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:15.569598    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r" event={"ID":"4aa4652d-73a6-4b65-b705-3149dbeef412","Type":"ContainerStarted","Data":"c416e421183369b177e87d7d96f67e8aab0c849a8f6e1e3c60535cdaec244c2c"}
Jul 08 21:45:15.569955 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:15.569660    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r" event={"ID":"4aa4652d-73a6-4b65-b705-3149dbeef412","Type":"ContainerStarted","Data":"757d6e9855f680e7c8536b9300068e67bd663e45ce36a8c66d865e39260b8b12"}
Jul 08 21:45:15.590616 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:15.590563    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r" podStartSLOduration=1.590548015 podStartE2EDuration="1.590548015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:45:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:45:15.58940595 +0000 UTC m=+1776.244308671" watchObservedRunningTime="2026-07-08 21:45:15.590548015 +0000 UTC m=+1776.245450734"
Jul 08 21:45:16.017411 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:16.017377    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:16.022174 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:16.022151    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:16.574248 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:16.574205    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:16.575099 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:16.575081    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:20.529074 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:20.529039    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"]
Jul 08 21:45:20.529535 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:20.529221    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r" podUID="4aa4652d-73a6-4b65-b705-3149dbeef412" containerName="istio-proxy" containerID="cri-o://c416e421183369b177e87d7d96f67e8aab0c849a8f6e1e3c60535cdaec244c2c" gracePeriod=30
Jul 08 21:45:25.782152 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:25.782127    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:25.814059 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:25.813991    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4aa4652d-73a6-4b65-b705-3149dbeef412-credential-socket\") pod \"4aa4652d-73a6-4b65-b705-3149dbeef412\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") "
Jul 08 21:45:25.814185 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:25.814062    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4aa4652d-73a6-4b65-b705-3149dbeef412-istio-envoy\") pod \"4aa4652d-73a6-4b65-b705-3149dbeef412\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") "
Jul 08 21:45:25.814185 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:25.814090    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4aa4652d-73a6-4b65-b705-3149dbeef412-istio-podinfo\") pod \"4aa4652d-73a6-4b65-b705-3149dbeef412\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") "
Jul 08 21:45:25.814185 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:25.814161    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4aa4652d-73a6-4b65-b705-3149dbeef412-istiod-ca-cert\") pod \"4aa4652d-73a6-4b65-b705-3149dbeef412\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") "
Jul 08 21:45:25.814331 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:25.814191    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4aa4652d-73a6-4b65-b705-3149dbeef412-workload-socket\") pod \"4aa4652d-73a6-4b65-b705-3149dbeef412\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") "
Jul 08 21:45:25.814331 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:25.814214    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4aa4652d-73a6-4b65-b705-3149dbeef412-workload-certs\") pod \"4aa4652d-73a6-4b65-b705-3149dbeef412\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") "
Jul 08 21:45:25.814331 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:25.814240    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wbcg\" (UniqueName: \"kubernetes.io/projected/4aa4652d-73a6-4b65-b705-3149dbeef412-kube-api-access-5wbcg\") pod \"4aa4652d-73a6-4b65-b705-3149dbeef412\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") "
Jul 08 21:45:25.814331 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:25.814255    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4aa4652d-73a6-4b65-b705-3149dbeef412-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4aa4652d-73a6-4b65-b705-3149dbeef412" (UID: "4aa4652d-73a6-4b65-b705-3149dbeef412"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:45:25.814331 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:25.814318    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4aa4652d-73a6-4b65-b705-3149dbeef412-istio-data\") pod \"4aa4652d-73a6-4b65-b705-3149dbeef412\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") "
Jul 08 21:45:25.814575 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:25.814371    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4aa4652d-73a6-4b65-b705-3149dbeef412-istio-token\") pod \"4aa4652d-73a6-4b65-b705-3149dbeef412\" (UID: \"4aa4652d-73a6-4b65-b705-3149dbeef412\") "
Jul 08 21:45:25.814575 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:25.814448    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4aa4652d-73a6-4b65-b705-3149dbeef412-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4aa4652d-73a6-4b65-b705-3149dbeef412" (UID: "4aa4652d-73a6-4b65-b705-3149dbeef412"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:45:25.814575 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:25.814486    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4aa4652d-73a6-4b65-b705-3149dbeef412-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4aa4652d-73a6-4b65-b705-3149dbeef412" (UID: "4aa4652d-73a6-4b65-b705-3149dbeef412"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:45:25.814716 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:25.814579    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4aa4652d-73a6-4b65-b705-3149dbeef412-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4aa4652d-73a6-4b65-b705-3149dbeef412" (UID: "4aa4652d-73a6-4b65-b705-3149dbeef412"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:45:25.814716 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:25.814648    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4aa4652d-73a6-4b65-b705-3149dbeef412-credential-socket\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:45:25.814716 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:25.814660    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4aa4652d-73a6-4b65-b705-3149dbeef412-istio-data" (OuterVolumeSpecName: "istio-data") pod "4aa4652d-73a6-4b65-b705-3149dbeef412" (UID: "4aa4652d-73a6-4b65-b705-3149dbeef412"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:45:25.814716 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:25.814666    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4aa4652d-73a6-4b65-b705-3149dbeef412-workload-socket\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:45:25.814953 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:25.814715    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4aa4652d-73a6-4b65-b705-3149dbeef412-workload-certs\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:45:25.816522 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:25.816491    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4aa4652d-73a6-4b65-b705-3149dbeef412-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4aa4652d-73a6-4b65-b705-3149dbeef412" (UID: "4aa4652d-73a6-4b65-b705-3149dbeef412"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:45:25.816613 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:25.816574    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4aa4652d-73a6-4b65-b705-3149dbeef412-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4aa4652d-73a6-4b65-b705-3149dbeef412" (UID: "4aa4652d-73a6-4b65-b705-3149dbeef412"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 21:45:25.816711 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:25.816691    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4aa4652d-73a6-4b65-b705-3149dbeef412-kube-api-access-5wbcg" (OuterVolumeSpecName: "kube-api-access-5wbcg") pod "4aa4652d-73a6-4b65-b705-3149dbeef412" (UID: "4aa4652d-73a6-4b65-b705-3149dbeef412"). InnerVolumeSpecName "kube-api-access-5wbcg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:45:25.816917 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:25.816901    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4aa4652d-73a6-4b65-b705-3149dbeef412-istio-token" (OuterVolumeSpecName: "istio-token") pod "4aa4652d-73a6-4b65-b705-3149dbeef412" (UID: "4aa4652d-73a6-4b65-b705-3149dbeef412"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:45:25.916037 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:25.916006    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4aa4652d-73a6-4b65-b705-3149dbeef412-istio-data\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:45:25.916037 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:25.916031    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4aa4652d-73a6-4b65-b705-3149dbeef412-istio-token\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:45:25.916197 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:25.916043    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4aa4652d-73a6-4b65-b705-3149dbeef412-istio-envoy\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:45:25.916197 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:25.916055    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4aa4652d-73a6-4b65-b705-3149dbeef412-istio-podinfo\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:45:25.916197 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:25.916066    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4aa4652d-73a6-4b65-b705-3149dbeef412-istiod-ca-cert\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:45:25.916197 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:25.916078    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wbcg\" (UniqueName: \"kubernetes.io/projected/4aa4652d-73a6-4b65-b705-3149dbeef412-kube-api-access-5wbcg\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:45:26.615668 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:26.615629    2571 generic.go:356] "Generic (PLEG): container finished" podID="4aa4652d-73a6-4b65-b705-3149dbeef412" containerID="c416e421183369b177e87d7d96f67e8aab0c849a8f6e1e3c60535cdaec244c2c" exitCode=0
Jul 08 21:45:26.615862 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:26.615681    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"
Jul 08 21:45:26.615862 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:26.615711    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r" event={"ID":"4aa4652d-73a6-4b65-b705-3149dbeef412","Type":"ContainerDied","Data":"c416e421183369b177e87d7d96f67e8aab0c849a8f6e1e3c60535cdaec244c2c"}
Jul 08 21:45:26.615862 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:26.615787    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r" event={"ID":"4aa4652d-73a6-4b65-b705-3149dbeef412","Type":"ContainerDied","Data":"757d6e9855f680e7c8536b9300068e67bd663e45ce36a8c66d865e39260b8b12"}
Jul 08 21:45:26.615862 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:26.615812    2571 scope.go:117] "RemoveContainer" containerID="c416e421183369b177e87d7d96f67e8aab0c849a8f6e1e3c60535cdaec244c2c"
Jul 08 21:45:26.624243 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:26.624221    2571 scope.go:117] "RemoveContainer" containerID="c416e421183369b177e87d7d96f67e8aab0c849a8f6e1e3c60535cdaec244c2c"
Jul 08 21:45:26.624518 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:45:26.624495    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c416e421183369b177e87d7d96f67e8aab0c849a8f6e1e3c60535cdaec244c2c\": container with ID starting with c416e421183369b177e87d7d96f67e8aab0c849a8f6e1e3c60535cdaec244c2c not found: ID does not exist" containerID="c416e421183369b177e87d7d96f67e8aab0c849a8f6e1e3c60535cdaec244c2c"
Jul 08 21:45:26.624581 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:26.624532    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c416e421183369b177e87d7d96f67e8aab0c849a8f6e1e3c60535cdaec244c2c"} err="failed to get container status \"c416e421183369b177e87d7d96f67e8aab0c849a8f6e1e3c60535cdaec244c2c\": rpc error: code = NotFound desc = could not find container \"c416e421183369b177e87d7d96f67e8aab0c849a8f6e1e3c60535cdaec244c2c\": container with ID starting with c416e421183369b177e87d7d96f67e8aab0c849a8f6e1e3c60535cdaec244c2c not found: ID does not exist"
Jul 08 21:45:26.633881 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:26.633853    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"]
Jul 08 21:45:26.638637 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:26.638617    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-04bc267c-openshift-default-868df9cbc5-x7h6r"]
Jul 08 21:45:27.872304 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:45:27.872274    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4aa4652d-73a6-4b65-b705-3149dbeef412" path="/var/lib/kubelet/pods/4aa4652d-73a6-4b65-b705-3149dbeef412/volumes"
Jul 08 21:47:04.337682 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:04.337588    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk"]
Jul 08 21:47:04.338104 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:04.337913    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4aa4652d-73a6-4b65-b705-3149dbeef412" containerName="istio-proxy"
Jul 08 21:47:04.338104 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:04.337928    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4aa4652d-73a6-4b65-b705-3149dbeef412" containerName="istio-proxy"
Jul 08 21:47:04.338104 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:04.337983    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="4aa4652d-73a6-4b65-b705-3149dbeef412" containerName="istio-proxy"
Jul 08 21:47:04.341502 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:04.341479    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk"
Jul 08 21:47:04.344243 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:04.344225    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 21:47:04.344346 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:04.344256    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-xdh9f\""
Jul 08 21:47:04.345236 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:04.345210    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 21:47:04.345327 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:04.345212    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-72a2d6e4-serving-cert\""
Jul 08 21:47:04.350193 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:04.350135    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk"]
Jul 08 21:47:04.494988 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:04.494958    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22719574-329e-4f80-885a-5e4418497a75-maas-api-tls\") pod \"maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk\" (UID: \"22719574-329e-4f80-885a-5e4418497a75\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk"
Jul 08 21:47:04.495158 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:04.494996    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzfq5\" (UniqueName: \"kubernetes.io/projected/22719574-329e-4f80-885a-5e4418497a75-kube-api-access-pzfq5\") pod \"maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk\" (UID: \"22719574-329e-4f80-885a-5e4418497a75\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk"
Jul 08 21:47:04.495158 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:04.495059    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22719574-329e-4f80-885a-5e4418497a75-openshift-service-ca\") pod \"maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk\" (UID: \"22719574-329e-4f80-885a-5e4418497a75\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk"
Jul 08 21:47:04.596416 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:04.596328    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22719574-329e-4f80-885a-5e4418497a75-maas-api-tls\") pod \"maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk\" (UID: \"22719574-329e-4f80-885a-5e4418497a75\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk"
Jul 08 21:47:04.596416 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:04.596385    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzfq5\" (UniqueName: \"kubernetes.io/projected/22719574-329e-4f80-885a-5e4418497a75-kube-api-access-pzfq5\") pod \"maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk\" (UID: \"22719574-329e-4f80-885a-5e4418497a75\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk"
Jul 08 21:47:04.596716 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:04.596445    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22719574-329e-4f80-885a-5e4418497a75-openshift-service-ca\") pod \"maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk\" (UID: \"22719574-329e-4f80-885a-5e4418497a75\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk"
Jul 08 21:47:04.597240 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:04.597166    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22719574-329e-4f80-885a-5e4418497a75-openshift-service-ca\") pod \"maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk\" (UID: \"22719574-329e-4f80-885a-5e4418497a75\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk"
Jul 08 21:47:04.598972 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:04.598950    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22719574-329e-4f80-885a-5e4418497a75-maas-api-tls\") pod \"maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk\" (UID: \"22719574-329e-4f80-885a-5e4418497a75\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk"
Jul 08 21:47:04.605546 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:04.605526    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzfq5\" (UniqueName: \"kubernetes.io/projected/22719574-329e-4f80-885a-5e4418497a75-kube-api-access-pzfq5\") pod \"maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk\" (UID: \"22719574-329e-4f80-885a-5e4418497a75\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk"
Jul 08 21:47:04.653656 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:04.653627    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk"
Jul 08 21:47:04.786205 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:04.786180    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk"]
Jul 08 21:47:04.788649 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:47:04.788618    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22719574_329e_4f80_885a_5e4418497a75.slice/crio-7bc477f214605740b592f99744398ebf9078773100f0011220d6ea3ee7a76d97 WatchSource:0}: Error finding container 7bc477f214605740b592f99744398ebf9078773100f0011220d6ea3ee7a76d97: Status 404 returned error can't find the container with id 7bc477f214605740b592f99744398ebf9078773100f0011220d6ea3ee7a76d97
Jul 08 21:47:05.003094 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:05.003056    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk" event={"ID":"22719574-329e-4f80-885a-5e4418497a75","Type":"ContainerStarted","Data":"7bc477f214605740b592f99744398ebf9078773100f0011220d6ea3ee7a76d97"}
Jul 08 21:47:06.008422 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:06.008386    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk" event={"ID":"22719574-329e-4f80-885a-5e4418497a75","Type":"ContainerStarted","Data":"6d0d060661d6dcf846880a20485f91857f4aeb5a1344df173e9388a9841ca1e7"}
Jul 08 21:47:06.008923 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:06.008505    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk"
Jul 08 21:47:06.026807 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:06.026739    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk" podStartSLOduration=1.45252602 podStartE2EDuration="2.026725744s" totalImagesPullingTime="574.199724ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:47:06.024862114 +0000 UTC m=+1886.679764832" watchObservedRunningTime="2026-07-08 21:47:06.026725744 +0000 UTC m=+1886.681628480"
Jul 08 21:47:12.019693 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:12.019655    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk"
Jul 08 21:47:16.354550 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:16.354519    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk"]
Jul 08 21:47:16.354952 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:16.354720    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk" podUID="22719574-329e-4f80-885a-5e4418497a75" containerName="maas-api" containerID="cri-o://6d0d060661d6dcf846880a20485f91857f4aeb5a1344df173e9388a9841ca1e7" gracePeriod=30
Jul 08 21:47:16.591553 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:16.591525    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk"
Jul 08 21:47:16.699966 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:16.699939    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22719574-329e-4f80-885a-5e4418497a75-openshift-service-ca\") pod \"22719574-329e-4f80-885a-5e4418497a75\" (UID: \"22719574-329e-4f80-885a-5e4418497a75\") "
Jul 08 21:47:16.700112 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:16.700015    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzfq5\" (UniqueName: \"kubernetes.io/projected/22719574-329e-4f80-885a-5e4418497a75-kube-api-access-pzfq5\") pod \"22719574-329e-4f80-885a-5e4418497a75\" (UID: \"22719574-329e-4f80-885a-5e4418497a75\") "
Jul 08 21:47:16.700112 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:16.700048    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22719574-329e-4f80-885a-5e4418497a75-maas-api-tls\") pod \"22719574-329e-4f80-885a-5e4418497a75\" (UID: \"22719574-329e-4f80-885a-5e4418497a75\") "
Jul 08 21:47:16.700327 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:16.700301    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22719574-329e-4f80-885a-5e4418497a75-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "22719574-329e-4f80-885a-5e4418497a75" (UID: "22719574-329e-4f80-885a-5e4418497a75"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:47:16.702217 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:16.702193    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22719574-329e-4f80-885a-5e4418497a75-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "22719574-329e-4f80-885a-5e4418497a75" (UID: "22719574-329e-4f80-885a-5e4418497a75"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:47:16.702316 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:16.702195    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22719574-329e-4f80-885a-5e4418497a75-kube-api-access-pzfq5" (OuterVolumeSpecName: "kube-api-access-pzfq5") pod "22719574-329e-4f80-885a-5e4418497a75" (UID: "22719574-329e-4f80-885a-5e4418497a75"). InnerVolumeSpecName "kube-api-access-pzfq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:47:16.801237 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:16.801206    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzfq5\" (UniqueName: \"kubernetes.io/projected/22719574-329e-4f80-885a-5e4418497a75-kube-api-access-pzfq5\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:47:16.801237 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:16.801230    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22719574-329e-4f80-885a-5e4418497a75-maas-api-tls\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:47:16.801237 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:16.801239    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22719574-329e-4f80-885a-5e4418497a75-openshift-service-ca\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:47:17.052697 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:17.052603    2571 generic.go:356] "Generic (PLEG): container finished" podID="22719574-329e-4f80-885a-5e4418497a75" containerID="6d0d060661d6dcf846880a20485f91857f4aeb5a1344df173e9388a9841ca1e7" exitCode=0
Jul 08 21:47:17.052697 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:17.052649    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk"
Jul 08 21:47:17.052954 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:17.052698    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk" event={"ID":"22719574-329e-4f80-885a-5e4418497a75","Type":"ContainerDied","Data":"6d0d060661d6dcf846880a20485f91857f4aeb5a1344df173e9388a9841ca1e7"}
Jul 08 21:47:17.052954 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:17.052778    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk" event={"ID":"22719574-329e-4f80-885a-5e4418497a75","Type":"ContainerDied","Data":"7bc477f214605740b592f99744398ebf9078773100f0011220d6ea3ee7a76d97"}
Jul 08 21:47:17.052954 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:17.052811    2571 scope.go:117] "RemoveContainer" containerID="6d0d060661d6dcf846880a20485f91857f4aeb5a1344df173e9388a9841ca1e7"
Jul 08 21:47:17.063202 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:17.063179    2571 scope.go:117] "RemoveContainer" containerID="6d0d060661d6dcf846880a20485f91857f4aeb5a1344df173e9388a9841ca1e7"
Jul 08 21:47:17.063452 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:47:17.063434    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d0d060661d6dcf846880a20485f91857f4aeb5a1344df173e9388a9841ca1e7\": container with ID starting with 6d0d060661d6dcf846880a20485f91857f4aeb5a1344df173e9388a9841ca1e7 not found: ID does not exist" containerID="6d0d060661d6dcf846880a20485f91857f4aeb5a1344df173e9388a9841ca1e7"
Jul 08 21:47:17.063511 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:17.063461    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d0d060661d6dcf846880a20485f91857f4aeb5a1344df173e9388a9841ca1e7"} err="failed to get container status \"6d0d060661d6dcf846880a20485f91857f4aeb5a1344df173e9388a9841ca1e7\": rpc error: code = NotFound desc = could not find container \"6d0d060661d6dcf846880a20485f91857f4aeb5a1344df173e9388a9841ca1e7\": container with ID starting with 6d0d060661d6dcf846880a20485f91857f4aeb5a1344df173e9388a9841ca1e7 not found: ID does not exist"
Jul 08 21:47:17.075843 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:17.075811    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk"]
Jul 08 21:47:17.081547 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:17.081521    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-72a2d6e4-5f887f6bf7-t9xkk"]
Jul 08 21:47:17.866932 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:17.866901    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22719574-329e-4f80-885a-5e4418497a75" path="/var/lib/kubelet/pods/22719574-329e-4f80-885a-5e4418497a75/volumes"
Jul 08 21:47:44.456023 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:44.455990    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb"]
Jul 08 21:47:44.456387 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:44.456281    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22719574-329e-4f80-885a-5e4418497a75" containerName="maas-api"
Jul 08 21:47:44.456387 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:44.456292    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="22719574-329e-4f80-885a-5e4418497a75" containerName="maas-api"
Jul 08 21:47:44.456387 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:44.456357    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="22719574-329e-4f80-885a-5e4418497a75" containerName="maas-api"
Jul 08 21:47:44.459124 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:44.459107    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb"
Jul 08 21:47:44.461838 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:44.461820    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 21:47:44.462859 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:44.462842    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-xdh9f\""
Jul 08 21:47:44.462952 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:44.462843    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-e9b10366-serving-cert\""
Jul 08 21:47:44.462952 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:44.462844    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 21:47:44.470610 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:44.470587    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb"]
Jul 08 21:47:44.518065 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:44.518035    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spj4w\" (UniqueName: \"kubernetes.io/projected/3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1-kube-api-access-spj4w\") pod \"maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb\" (UID: \"3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb"
Jul 08 21:47:44.518186 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:44.518085    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1-maas-api-tls\") pod \"maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb\" (UID: \"3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb"
Jul 08 21:47:44.518186 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:44.518155    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1-openshift-service-ca\") pod \"maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb\" (UID: \"3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb"
Jul 08 21:47:44.619376 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:44.619340    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1-openshift-service-ca\") pod \"maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb\" (UID: \"3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb"
Jul 08 21:47:44.619527 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:44.619391    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spj4w\" (UniqueName: \"kubernetes.io/projected/3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1-kube-api-access-spj4w\") pod \"maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb\" (UID: \"3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb"
Jul 08 21:47:44.619527 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:44.619433    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1-maas-api-tls\") pod \"maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb\" (UID: \"3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb"
Jul 08 21:47:44.619597 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:47:44.619544    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-e9b10366-serving-cert: secret "maas-api-e2e-mt-e9b10366-serving-cert" not found
Jul 08 21:47:44.619630 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:47:44.619614    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1-maas-api-tls podName:3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1 nodeName:}" failed. No retries permitted until 2026-07-08 21:47:45.119592521 +0000 UTC m=+1925.774495219 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1-maas-api-tls") pod "maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb" (UID: "3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1") : secret "maas-api-e2e-mt-e9b10366-serving-cert" not found
Jul 08 21:47:44.620021 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:44.619999    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1-openshift-service-ca\") pod \"maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb\" (UID: \"3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb"
Jul 08 21:47:44.632065 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:44.632038    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spj4w\" (UniqueName: \"kubernetes.io/projected/3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1-kube-api-access-spj4w\") pod \"maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb\" (UID: \"3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb"
Jul 08 21:47:45.123631 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:45.123594    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1-maas-api-tls\") pod \"maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb\" (UID: \"3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb"
Jul 08 21:47:45.126192 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:45.126168    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1-maas-api-tls\") pod \"maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb\" (UID: \"3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb"
Jul 08 21:47:45.369832 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:45.369802    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb"
Jul 08 21:47:45.501493 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:45.501470    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb"]
Jul 08 21:47:45.503291 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:47:45.503262    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f8d6210_9506_4f3f_80ec_bf7d7f7b3ed1.slice/crio-98b91cc595ef7d0bc78e45e668190dbb085e3b64b79c7e043f47239b924902bb WatchSource:0}: Error finding container 98b91cc595ef7d0bc78e45e668190dbb085e3b64b79c7e043f47239b924902bb: Status 404 returned error can't find the container with id 98b91cc595ef7d0bc78e45e668190dbb085e3b64b79c7e043f47239b924902bb
Jul 08 21:47:46.178862 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:46.178820    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb" event={"ID":"3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1","Type":"ContainerStarted","Data":"f6ce6d895448723a115ab27b01103a654442357ab311b3eb3921c4446e3b0cec"}
Jul 08 21:47:46.179010 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:46.178888    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb" event={"ID":"3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1","Type":"ContainerStarted","Data":"98b91cc595ef7d0bc78e45e668190dbb085e3b64b79c7e043f47239b924902bb"}
Jul 08 21:47:46.179010 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:46.179003    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb"
Jul 08 21:47:46.196536 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:46.196484    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb" podStartSLOduration=1.865772301 podStartE2EDuration="2.196466457s" totalImagesPullingTime="330.694156ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:47:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:47:46.196427482 +0000 UTC m=+1926.851330212" watchObservedRunningTime="2026-07-08 21:47:46.196466457 +0000 UTC m=+1926.851369177"
Jul 08 21:47:52.188171 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:47:52.188144    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb"
Jul 08 21:48:21.725008 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:48:21.724972    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb"]
Jul 08 21:48:21.725549 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:48:21.725233    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb" podUID="3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1" containerName="maas-api" containerID="cri-o://f6ce6d895448723a115ab27b01103a654442357ab311b3eb3921c4446e3b0cec" gracePeriod=30
Jul 08 21:48:21.972588 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:48:21.972561    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb"
Jul 08 21:48:22.018408 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:48:22.018328    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1-maas-api-tls\") pod \"3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1\" (UID: \"3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1\") "
Jul 08 21:48:22.018408 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:48:22.018398    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spj4w\" (UniqueName: \"kubernetes.io/projected/3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1-kube-api-access-spj4w\") pod \"3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1\" (UID: \"3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1\") "
Jul 08 21:48:22.018613 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:48:22.018467    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1-openshift-service-ca\") pod \"3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1\" (UID: \"3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1\") "
Jul 08 21:48:22.018844 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:48:22.018817    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1" (UID: "3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:48:22.020501 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:48:22.020476    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1" (UID: "3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:48:22.020572 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:48:22.020531    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1-kube-api-access-spj4w" (OuterVolumeSpecName: "kube-api-access-spj4w") pod "3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1" (UID: "3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1"). InnerVolumeSpecName "kube-api-access-spj4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:48:22.119384 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:48:22.119351    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spj4w\" (UniqueName: \"kubernetes.io/projected/3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1-kube-api-access-spj4w\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:48:22.119384 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:48:22.119378    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1-openshift-service-ca\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:48:22.119384 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:48:22.119388    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1-maas-api-tls\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:48:22.326284 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:48:22.326200    2571 generic.go:356] "Generic (PLEG): container finished" podID="3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1" containerID="f6ce6d895448723a115ab27b01103a654442357ab311b3eb3921c4446e3b0cec" exitCode=0
Jul 08 21:48:22.326284 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:48:22.326242    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb"
Jul 08 21:48:22.326284 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:48:22.326276    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb" event={"ID":"3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1","Type":"ContainerDied","Data":"f6ce6d895448723a115ab27b01103a654442357ab311b3eb3921c4446e3b0cec"}
Jul 08 21:48:22.326512 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:48:22.326319    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb" event={"ID":"3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1","Type":"ContainerDied","Data":"98b91cc595ef7d0bc78e45e668190dbb085e3b64b79c7e043f47239b924902bb"}
Jul 08 21:48:22.326512 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:48:22.326342    2571 scope.go:117] "RemoveContainer" containerID="f6ce6d895448723a115ab27b01103a654442357ab311b3eb3921c4446e3b0cec"
Jul 08 21:48:22.334601 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:48:22.334586    2571 scope.go:117] "RemoveContainer" containerID="f6ce6d895448723a115ab27b01103a654442357ab311b3eb3921c4446e3b0cec"
Jul 08 21:48:22.334861 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:48:22.334842    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6ce6d895448723a115ab27b01103a654442357ab311b3eb3921c4446e3b0cec\": container with ID starting with f6ce6d895448723a115ab27b01103a654442357ab311b3eb3921c4446e3b0cec not found: ID does not exist" containerID="f6ce6d895448723a115ab27b01103a654442357ab311b3eb3921c4446e3b0cec"
Jul 08 21:48:22.334923 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:48:22.334871    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6ce6d895448723a115ab27b01103a654442357ab311b3eb3921c4446e3b0cec"} err="failed to get container status \"f6ce6d895448723a115ab27b01103a654442357ab311b3eb3921c4446e3b0cec\": rpc error: code = NotFound desc = could not find container \"f6ce6d895448723a115ab27b01103a654442357ab311b3eb3921c4446e3b0cec\": container with ID starting with f6ce6d895448723a115ab27b01103a654442357ab311b3eb3921c4446e3b0cec not found: ID does not exist"
Jul 08 21:48:22.347404 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:48:22.347382    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb"]
Jul 08 21:48:22.350980 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:48:22.350961    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e9b10366-6fbc74f684-8kzkb"]
Jul 08 21:48:23.867844 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:48:23.867814    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1" path="/var/lib/kubelet/pods/3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1/volumes"
Jul 08 21:50:13.327400 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:13.327322    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw"]
Jul 08 21:50:13.328255 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:13.328224    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1" containerName="maas-api"
Jul 08 21:50:13.328379 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:13.328260    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1" containerName="maas-api"
Jul 08 21:50:13.331223 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:13.328459    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f8d6210-9506-4f3f-80ec-bf7d7f7b3ed1" containerName="maas-api"
Jul 08 21:50:13.333591 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:13.333566    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw"
Jul 08 21:50:13.336443 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:13.336421    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-66014e-serving-cert\""
Jul 08 21:50:13.336573 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:13.336550    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 21:50:13.336638 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:13.336614    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 21:50:13.337618 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:13.337599    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-xdh9f\""
Jul 08 21:50:13.342880 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:13.342526    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw"]
Jul 08 21:50:13.394457 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:13.394426    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtnnz\" (UniqueName: \"kubernetes.io/projected/b4b78716-d516-4900-b447-33487d25dfa5-kube-api-access-rtnnz\") pod \"maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw\" (UID: \"b4b78716-d516-4900-b447-33487d25dfa5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw"
Jul 08 21:50:13.394581 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:13.394469    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4b78716-d516-4900-b447-33487d25dfa5-maas-api-tls\") pod \"maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw\" (UID: \"b4b78716-d516-4900-b447-33487d25dfa5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw"
Jul 08 21:50:13.394581 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:13.394554    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4b78716-d516-4900-b447-33487d25dfa5-openshift-service-ca\") pod \"maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw\" (UID: \"b4b78716-d516-4900-b447-33487d25dfa5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw"
Jul 08 21:50:13.494965 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:13.494932    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4b78716-d516-4900-b447-33487d25dfa5-maas-api-tls\") pod \"maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw\" (UID: \"b4b78716-d516-4900-b447-33487d25dfa5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw"
Jul 08 21:50:13.495112 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:13.494993    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4b78716-d516-4900-b447-33487d25dfa5-openshift-service-ca\") pod \"maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw\" (UID: \"b4b78716-d516-4900-b447-33487d25dfa5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw"
Jul 08 21:50:13.495112 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:13.495033    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtnnz\" (UniqueName: \"kubernetes.io/projected/b4b78716-d516-4900-b447-33487d25dfa5-kube-api-access-rtnnz\") pod \"maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw\" (UID: \"b4b78716-d516-4900-b447-33487d25dfa5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw"
Jul 08 21:50:13.495112 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:50:13.495078    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-66014e-serving-cert: secret "maas-api-e2e-inf-a-66014e-serving-cert" not found
Jul 08 21:50:13.495241 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:50:13.495159    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4b78716-d516-4900-b447-33487d25dfa5-maas-api-tls podName:b4b78716-d516-4900-b447-33487d25dfa5 nodeName:}" failed. No retries permitted until 2026-07-08 21:50:13.995137544 +0000 UTC m=+2074.650040241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b4b78716-d516-4900-b447-33487d25dfa5-maas-api-tls") pod "maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw" (UID: "b4b78716-d516-4900-b447-33487d25dfa5") : secret "maas-api-e2e-inf-a-66014e-serving-cert" not found
Jul 08 21:50:13.495583 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:13.495564    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4b78716-d516-4900-b447-33487d25dfa5-openshift-service-ca\") pod \"maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw\" (UID: \"b4b78716-d516-4900-b447-33487d25dfa5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw"
Jul 08 21:50:13.503842 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:13.503813    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtnnz\" (UniqueName: \"kubernetes.io/projected/b4b78716-d516-4900-b447-33487d25dfa5-kube-api-access-rtnnz\") pod \"maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw\" (UID: \"b4b78716-d516-4900-b447-33487d25dfa5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw"
Jul 08 21:50:14.000896 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:14.000857    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4b78716-d516-4900-b447-33487d25dfa5-maas-api-tls\") pod \"maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw\" (UID: \"b4b78716-d516-4900-b447-33487d25dfa5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw"
Jul 08 21:50:14.003362 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:14.003339    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4b78716-d516-4900-b447-33487d25dfa5-maas-api-tls\") pod \"maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw\" (UID: \"b4b78716-d516-4900-b447-33487d25dfa5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw"
Jul 08 21:50:14.247063 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:14.247027    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw"
Jul 08 21:50:14.375581 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:14.375557    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw"]
Jul 08 21:50:14.378236 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:50:14.378207    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4b78716_d516_4900_b447_33487d25dfa5.slice/crio-bcd98477642bf4a99f981068cbbcba2b495bb92bc5abdf9b9a5bad89a072fe3f WatchSource:0}: Error finding container bcd98477642bf4a99f981068cbbcba2b495bb92bc5abdf9b9a5bad89a072fe3f: Status 404 returned error can't find the container with id bcd98477642bf4a99f981068cbbcba2b495bb92bc5abdf9b9a5bad89a072fe3f
Jul 08 21:50:14.379622 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:14.379604    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 21:50:14.778763 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:14.778709    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw" event={"ID":"b4b78716-d516-4900-b447-33487d25dfa5","Type":"ContainerStarted","Data":"bcd98477642bf4a99f981068cbbcba2b495bb92bc5abdf9b9a5bad89a072fe3f"}
Jul 08 21:50:15.783948 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:15.783912    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw" event={"ID":"b4b78716-d516-4900-b447-33487d25dfa5","Type":"ContainerStarted","Data":"34f60c6e0d3f2fe9f657eb1250e37d2b6814fc62f256aea27612fc744641eed3"}
Jul 08 21:50:15.784497 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:15.784039    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw"
Jul 08 21:50:15.801110 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:15.801049    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw" podStartSLOduration=2.237151255 podStartE2EDuration="2.801035487s" totalImagesPullingTime="563.884232ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:50:15.801013074 +0000 UTC m=+2076.455915792" watchObservedRunningTime="2026-07-08 21:50:15.801035487 +0000 UTC m=+2076.455938226"
Jul 08 21:50:18.248986 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.248948    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"]
Jul 08 21:50:18.252348 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.252328    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:18.255124 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.255102    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-9b1f52-openshift-default-dockercfg-fxsdw\""
Jul 08 21:50:18.263400 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.263378    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"]
Jul 08 21:50:18.339023 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.338991    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-istio-data\") pod \"e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") " pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:18.339160 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.339055    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-workload-socket\") pod \"e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") " pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:18.339160 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.339073    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzzrh\" (UniqueName: \"kubernetes.io/projected/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-kube-api-access-lzzrh\") pod \"e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") " pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:18.339160 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.339096    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-istiod-ca-cert\") pod \"e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") " pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:18.339160 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.339119    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-istio-envoy\") pod \"e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") " pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:18.339160 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.339152    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-istio-podinfo\") pod \"e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") " pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:18.339325 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.339178    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-istio-token\") pod \"e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") " pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:18.339325 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.339197    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-credential-socket\") pod \"e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") " pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:18.339325 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.339230    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-workload-certs\") pod \"e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") " pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:18.440010 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.439975    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-credential-socket\") pod \"e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") " pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:18.440197 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.440040    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-workload-certs\") pod \"e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") " pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:18.440197 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.440082    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-istio-data\") pod \"e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") " pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:18.440197 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.440149    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-workload-socket\") pod \"e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") " pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:18.440197 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.440172    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzzrh\" (UniqueName: \"kubernetes.io/projected/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-kube-api-access-lzzrh\") pod \"e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") " pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:18.440197 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.440196    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-istiod-ca-cert\") pod \"e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") " pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:18.440435 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.440304    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-istio-envoy\") pod \"e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") " pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:18.440435 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.440357    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-istio-podinfo\") pod \"e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") " pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:18.440435 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.440391    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-istio-token\") pod \"e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") " pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:18.440588 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.440444    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-credential-socket\") pod \"e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") " pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:18.440588 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.440565    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-workload-certs\") pod \"e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") " pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:18.440674 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.440628    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-workload-socket\") pod \"e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") " pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:18.440733 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.440710    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-istio-data\") pod \"e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") " pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:18.440881 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.440863    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-istiod-ca-cert\") pod \"e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") " pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:18.442724 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.442701    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-istio-envoy\") pod \"e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") " pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:18.442970 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.442950    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-istio-podinfo\") pod \"e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") " pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:18.447789 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.447770    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-istio-token\") pod \"e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") " pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:18.447989 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.447969    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzzrh\" (UniqueName: \"kubernetes.io/projected/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-kube-api-access-lzzrh\") pod \"e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") " pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:18.563039 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.562970    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:18.695256 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.695224    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"]
Jul 08 21:50:18.697794 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:50:18.697763    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93cd8422_f6c1_4ba6_a4ea_144fcab5271d.slice/crio-ea3630f8bb1639c957b6a7ee27eebb4b098fb86db12f17593ca9ba8315e4fa0a WatchSource:0}: Error finding container ea3630f8bb1639c957b6a7ee27eebb4b098fb86db12f17593ca9ba8315e4fa0a: Status 404 returned error can't find the container with id ea3630f8bb1639c957b6a7ee27eebb4b098fb86db12f17593ca9ba8315e4fa0a
Jul 08 21:50:18.700046 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.700018    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 21:50:18.700103 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.700087    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 21:50:18.700143 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.700116    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 21:50:18.797823 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.797783    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg" event={"ID":"93cd8422-f6c1-4ba6-a4ea-144fcab5271d","Type":"ContainerStarted","Data":"5f42328fdbee1f7d8852cbd5957f691f5cd8fe04c1141701370e4595ae33426d"}
Jul 08 21:50:18.798003 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.797852    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg" event={"ID":"93cd8422-f6c1-4ba6-a4ea-144fcab5271d","Type":"ContainerStarted","Data":"ea3630f8bb1639c957b6a7ee27eebb4b098fb86db12f17593ca9ba8315e4fa0a"}
Jul 08 21:50:18.815689 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:18.815538    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg" podStartSLOduration=0.815519352 podStartE2EDuration="815.519352ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:50:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:50:18.815196753 +0000 UTC m=+2079.470099513" watchObservedRunningTime="2026-07-08 21:50:18.815519352 +0000 UTC m=+2079.470422072"
Jul 08 21:50:19.563476 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:19.563439    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:19.567901 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:19.567877    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:19.801677 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:19.801638    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:19.802582 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:19.802563    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:20.932031 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:20.932002    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp"]
Jul 08 21:50:20.935376 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:20.935356    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp"
Jul 08 21:50:20.937844 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:20.937824    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-9b1f52-serving-cert\""
Jul 08 21:50:20.947447 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:20.947427    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp"]
Jul 08 21:50:21.060713 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:21.060683    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce453e85-485f-44cf-a78a-81ca69a6790a-maas-api-tls\") pod \"maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp\" (UID: \"ce453e85-485f-44cf-a78a-81ca69a6790a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp"
Jul 08 21:50:21.060916 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:21.060720    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce453e85-485f-44cf-a78a-81ca69a6790a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp\" (UID: \"ce453e85-485f-44cf-a78a-81ca69a6790a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp"
Jul 08 21:50:21.060916 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:21.060868    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgjvp\" (UniqueName: \"kubernetes.io/projected/ce453e85-485f-44cf-a78a-81ca69a6790a-kube-api-access-dgjvp\") pod \"maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp\" (UID: \"ce453e85-485f-44cf-a78a-81ca69a6790a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp"
Jul 08 21:50:21.161400 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:21.161367    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgjvp\" (UniqueName: \"kubernetes.io/projected/ce453e85-485f-44cf-a78a-81ca69a6790a-kube-api-access-dgjvp\") pod \"maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp\" (UID: \"ce453e85-485f-44cf-a78a-81ca69a6790a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp"
Jul 08 21:50:21.161578 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:21.161421    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce453e85-485f-44cf-a78a-81ca69a6790a-maas-api-tls\") pod \"maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp\" (UID: \"ce453e85-485f-44cf-a78a-81ca69a6790a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp"
Jul 08 21:50:21.161578 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:21.161546    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce453e85-485f-44cf-a78a-81ca69a6790a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp\" (UID: \"ce453e85-485f-44cf-a78a-81ca69a6790a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp"
Jul 08 21:50:21.162145 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:21.162124    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce453e85-485f-44cf-a78a-81ca69a6790a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp\" (UID: \"ce453e85-485f-44cf-a78a-81ca69a6790a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp"
Jul 08 21:50:21.163882 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:21.163865    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce453e85-485f-44cf-a78a-81ca69a6790a-maas-api-tls\") pod \"maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp\" (UID: \"ce453e85-485f-44cf-a78a-81ca69a6790a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp"
Jul 08 21:50:21.174321 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:21.174302    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgjvp\" (UniqueName: \"kubernetes.io/projected/ce453e85-485f-44cf-a78a-81ca69a6790a-kube-api-access-dgjvp\") pod \"maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp\" (UID: \"ce453e85-485f-44cf-a78a-81ca69a6790a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp"
Jul 08 21:50:21.245509 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:21.245449    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp"
Jul 08 21:50:21.374918 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:21.374896    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp"]
Jul 08 21:50:21.377094 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:50:21.377062    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce453e85_485f_44cf_a78a_81ca69a6790a.slice/crio-b764ef1249f234bab121a75b06781a467e8bb544e8bc5a93b757abe121e98047 WatchSource:0}: Error finding container b764ef1249f234bab121a75b06781a467e8bb544e8bc5a93b757abe121e98047: Status 404 returned error can't find the container with id b764ef1249f234bab121a75b06781a467e8bb544e8bc5a93b757abe121e98047
Jul 08 21:50:21.792636 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:21.792605    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw"
Jul 08 21:50:21.811916 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:21.811885    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp" event={"ID":"ce453e85-485f-44cf-a78a-81ca69a6790a","Type":"ContainerStarted","Data":"b764ef1249f234bab121a75b06781a467e8bb544e8bc5a93b757abe121e98047"}
Jul 08 21:50:22.817999 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:22.817966    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp" event={"ID":"ce453e85-485f-44cf-a78a-81ca69a6790a","Type":"ContainerStarted","Data":"69d58d61972246d50b30c07443a7abc569071cf7a318152b88c8a484884aa929"}
Jul 08 21:50:22.818370 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:22.818087    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp"
Jul 08 21:50:22.835286 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:22.835231    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp" podStartSLOduration=2.287588004 podStartE2EDuration="2.835211823s" totalImagesPullingTime="547.623819ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:50:22.833328064 +0000 UTC m=+2083.488230783" watchObservedRunningTime="2026-07-08 21:50:22.835211823 +0000 UTC m=+2083.490114543"
Jul 08 21:50:28.828493 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:28.828463    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp"
Jul 08 21:50:38.890433 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:38.890400    2571 generic.go:356] "Generic (PLEG): container finished" podID="93cd8422-f6c1-4ba6-a4ea-144fcab5271d" containerID="5f42328fdbee1f7d8852cbd5957f691f5cd8fe04c1141701370e4595ae33426d" exitCode=0
Jul 08 21:50:38.890917 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:38.890480    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg" event={"ID":"93cd8422-f6c1-4ba6-a4ea-144fcab5271d","Type":"ContainerDied","Data":"5f42328fdbee1f7d8852cbd5957f691f5cd8fe04c1141701370e4595ae33426d"}
Jul 08 21:50:38.890917 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:38.890846    2571 scope.go:117] "RemoveContainer" containerID="5f42328fdbee1f7d8852cbd5957f691f5cd8fe04c1141701370e4595ae33426d"
Jul 08 21:50:38.891822 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:38.891795    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 21:50:38.891934 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:38.891857    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 21:50:38.891934 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:38.891887    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 21:50:39.910312 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:39.910276    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg" event={"ID":"93cd8422-f6c1-4ba6-a4ea-144fcab5271d","Type":"ContainerStarted","Data":"c9de7b71ef537ff21bd04615732b13f68120771ea061fd78e3bffdb84b121afa"}
Jul 08 21:50:40.564114 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:40.564082    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:40.564292 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:40.564241    2571 patch_prober.go:28] interesting pod/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 08 21:50:40.564341 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:40.564296    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg" podUID="93cd8422-f6c1-4ba6-a4ea-144fcab5271d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 08 21:50:41.564078 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:41.564037    2571 patch_prober.go:28] interesting pod/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 08 21:50:41.564444 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:41.564105    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg" podUID="93cd8422-f6c1-4ba6-a4ea-144fcab5271d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 08 21:50:42.563955 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:42.563918    2571 patch_prober.go:28] interesting pod/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 08 21:50:42.564140 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:42.563983    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg" podUID="93cd8422-f6c1-4ba6-a4ea-144fcab5271d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 08 21:50:43.563768 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:43.563710    2571 patch_prober.go:28] interesting pod/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 08 21:50:43.563944 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:43.563798    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg" podUID="93cd8422-f6c1-4ba6-a4ea-144fcab5271d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 08 21:50:44.567080 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:44.567042    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:44.567449 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:44.567425    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:50:44.568078 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:50:44.568058    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:51:10.480302 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:10.480267    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw"]
Jul 08 21:51:10.480880 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:10.480511    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw" podUID="b4b78716-d516-4900-b447-33487d25dfa5" containerName="maas-api" containerID="cri-o://34f60c6e0d3f2fe9f657eb1250e37d2b6814fc62f256aea27612fc744641eed3" gracePeriod=30
Jul 08 21:51:10.718337 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:10.718312    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw"
Jul 08 21:51:10.888423 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:10.888316    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4b78716-d516-4900-b447-33487d25dfa5-openshift-service-ca\") pod \"b4b78716-d516-4900-b447-33487d25dfa5\" (UID: \"b4b78716-d516-4900-b447-33487d25dfa5\") "
Jul 08 21:51:10.888423 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:10.888374    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtnnz\" (UniqueName: \"kubernetes.io/projected/b4b78716-d516-4900-b447-33487d25dfa5-kube-api-access-rtnnz\") pod \"b4b78716-d516-4900-b447-33487d25dfa5\" (UID: \"b4b78716-d516-4900-b447-33487d25dfa5\") "
Jul 08 21:51:10.888668 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:10.888453    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4b78716-d516-4900-b447-33487d25dfa5-maas-api-tls\") pod \"b4b78716-d516-4900-b447-33487d25dfa5\" (UID: \"b4b78716-d516-4900-b447-33487d25dfa5\") "
Jul 08 21:51:10.888726 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:10.888670    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4b78716-d516-4900-b447-33487d25dfa5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b4b78716-d516-4900-b447-33487d25dfa5" (UID: "b4b78716-d516-4900-b447-33487d25dfa5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:51:10.890772 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:10.890729    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4b78716-d516-4900-b447-33487d25dfa5-kube-api-access-rtnnz" (OuterVolumeSpecName: "kube-api-access-rtnnz") pod "b4b78716-d516-4900-b447-33487d25dfa5" (UID: "b4b78716-d516-4900-b447-33487d25dfa5"). InnerVolumeSpecName "kube-api-access-rtnnz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:51:10.890856 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:10.890766    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4b78716-d516-4900-b447-33487d25dfa5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b4b78716-d516-4900-b447-33487d25dfa5" (UID: "b4b78716-d516-4900-b447-33487d25dfa5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:51:10.989291 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:10.989246    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4b78716-d516-4900-b447-33487d25dfa5-openshift-service-ca\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:51:10.989291 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:10.989286    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtnnz\" (UniqueName: \"kubernetes.io/projected/b4b78716-d516-4900-b447-33487d25dfa5-kube-api-access-rtnnz\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:51:10.989291 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:10.989296    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4b78716-d516-4900-b447-33487d25dfa5-maas-api-tls\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:51:11.042949 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:11.042916    2571 generic.go:356] "Generic (PLEG): container finished" podID="b4b78716-d516-4900-b447-33487d25dfa5" containerID="34f60c6e0d3f2fe9f657eb1250e37d2b6814fc62f256aea27612fc744641eed3" exitCode=0
Jul 08 21:51:11.043073 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:11.042962    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw"
Jul 08 21:51:11.043073 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:11.043009    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw" event={"ID":"b4b78716-d516-4900-b447-33487d25dfa5","Type":"ContainerDied","Data":"34f60c6e0d3f2fe9f657eb1250e37d2b6814fc62f256aea27612fc744641eed3"}
Jul 08 21:51:11.043073 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:11.043063    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw" event={"ID":"b4b78716-d516-4900-b447-33487d25dfa5","Type":"ContainerDied","Data":"bcd98477642bf4a99f981068cbbcba2b495bb92bc5abdf9b9a5bad89a072fe3f"}
Jul 08 21:51:11.043179 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:11.043090    2571 scope.go:117] "RemoveContainer" containerID="34f60c6e0d3f2fe9f657eb1250e37d2b6814fc62f256aea27612fc744641eed3"
Jul 08 21:51:11.052475 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:11.052454    2571 scope.go:117] "RemoveContainer" containerID="34f60c6e0d3f2fe9f657eb1250e37d2b6814fc62f256aea27612fc744641eed3"
Jul 08 21:51:11.052743 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:51:11.052723    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34f60c6e0d3f2fe9f657eb1250e37d2b6814fc62f256aea27612fc744641eed3\": container with ID starting with 34f60c6e0d3f2fe9f657eb1250e37d2b6814fc62f256aea27612fc744641eed3 not found: ID does not exist" containerID="34f60c6e0d3f2fe9f657eb1250e37d2b6814fc62f256aea27612fc744641eed3"
Jul 08 21:51:11.052861 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:11.052766    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34f60c6e0d3f2fe9f657eb1250e37d2b6814fc62f256aea27612fc744641eed3"} err="failed to get container status \"34f60c6e0d3f2fe9f657eb1250e37d2b6814fc62f256aea27612fc744641eed3\": rpc error: code = NotFound desc = could not find container \"34f60c6e0d3f2fe9f657eb1250e37d2b6814fc62f256aea27612fc744641eed3\": container with ID starting with 34f60c6e0d3f2fe9f657eb1250e37d2b6814fc62f256aea27612fc744641eed3 not found: ID does not exist"
Jul 08 21:51:11.065233 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:11.065211    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw"]
Jul 08 21:51:11.071128 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:11.071106    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-66014e-77b5bc4d8b-6d6qw"]
Jul 08 21:51:11.866762 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:11.866710    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4b78716-d516-4900-b447-33487d25dfa5" path="/var/lib/kubelet/pods/b4b78716-d516-4900-b447-33487d25dfa5/volumes"
Jul 08 21:51:53.532783 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:53.532736    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp"]
Jul 08 21:51:53.533262 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:53.532973    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp" podUID="ce453e85-485f-44cf-a78a-81ca69a6790a" containerName="maas-api" containerID="cri-o://69d58d61972246d50b30c07443a7abc569071cf7a318152b88c8a484884aa929" gracePeriod=30
Jul 08 21:51:53.823311 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:53.823280    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp" podUID="ce453e85-485f-44cf-a78a-81ca69a6790a" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.33:8443/health\": dial tcp 10.132.0.33:8443: connect: connection refused"
Jul 08 21:51:53.980857 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:53.980834    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp"
Jul 08 21:51:54.032779 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:54.032733    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce453e85-485f-44cf-a78a-81ca69a6790a-maas-api-tls\") pod \"ce453e85-485f-44cf-a78a-81ca69a6790a\" (UID: \"ce453e85-485f-44cf-a78a-81ca69a6790a\") "
Jul 08 21:51:54.032915 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:54.032796    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgjvp\" (UniqueName: \"kubernetes.io/projected/ce453e85-485f-44cf-a78a-81ca69a6790a-kube-api-access-dgjvp\") pod \"ce453e85-485f-44cf-a78a-81ca69a6790a\" (UID: \"ce453e85-485f-44cf-a78a-81ca69a6790a\") "
Jul 08 21:51:54.032915 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:54.032841    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce453e85-485f-44cf-a78a-81ca69a6790a-openshift-service-ca\") pod \"ce453e85-485f-44cf-a78a-81ca69a6790a\" (UID: \"ce453e85-485f-44cf-a78a-81ca69a6790a\") "
Jul 08 21:51:54.033255 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:54.033229    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce453e85-485f-44cf-a78a-81ca69a6790a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ce453e85-485f-44cf-a78a-81ca69a6790a" (UID: "ce453e85-485f-44cf-a78a-81ca69a6790a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:51:54.034970 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:54.034950    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce453e85-485f-44cf-a78a-81ca69a6790a-kube-api-access-dgjvp" (OuterVolumeSpecName: "kube-api-access-dgjvp") pod "ce453e85-485f-44cf-a78a-81ca69a6790a" (UID: "ce453e85-485f-44cf-a78a-81ca69a6790a"). InnerVolumeSpecName "kube-api-access-dgjvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:51:54.035041 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:54.035025    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce453e85-485f-44cf-a78a-81ca69a6790a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ce453e85-485f-44cf-a78a-81ca69a6790a" (UID: "ce453e85-485f-44cf-a78a-81ca69a6790a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:51:54.134103 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:54.134049    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce453e85-485f-44cf-a78a-81ca69a6790a-maas-api-tls\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:51:54.134103 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:54.134069    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgjvp\" (UniqueName: \"kubernetes.io/projected/ce453e85-485f-44cf-a78a-81ca69a6790a-kube-api-access-dgjvp\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:51:54.134103 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:54.134078    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce453e85-485f-44cf-a78a-81ca69a6790a-openshift-service-ca\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:51:54.234973 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:54.234936    2571 generic.go:356] "Generic (PLEG): container finished" podID="ce453e85-485f-44cf-a78a-81ca69a6790a" containerID="69d58d61972246d50b30c07443a7abc569071cf7a318152b88c8a484884aa929" exitCode=0
Jul 08 21:51:54.235112 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:54.234989    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp"
Jul 08 21:51:54.235112 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:54.235026    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp" event={"ID":"ce453e85-485f-44cf-a78a-81ca69a6790a","Type":"ContainerDied","Data":"69d58d61972246d50b30c07443a7abc569071cf7a318152b88c8a484884aa929"}
Jul 08 21:51:54.235112 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:54.235099    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp" event={"ID":"ce453e85-485f-44cf-a78a-81ca69a6790a","Type":"ContainerDied","Data":"b764ef1249f234bab121a75b06781a467e8bb544e8bc5a93b757abe121e98047"}
Jul 08 21:51:54.235215 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:54.235146    2571 scope.go:117] "RemoveContainer" containerID="69d58d61972246d50b30c07443a7abc569071cf7a318152b88c8a484884aa929"
Jul 08 21:51:54.243738 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:54.243716    2571 scope.go:117] "RemoveContainer" containerID="69d58d61972246d50b30c07443a7abc569071cf7a318152b88c8a484884aa929"
Jul 08 21:51:54.244127 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:51:54.244103    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69d58d61972246d50b30c07443a7abc569071cf7a318152b88c8a484884aa929\": container with ID starting with 69d58d61972246d50b30c07443a7abc569071cf7a318152b88c8a484884aa929 not found: ID does not exist" containerID="69d58d61972246d50b30c07443a7abc569071cf7a318152b88c8a484884aa929"
Jul 08 21:51:54.244191 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:54.244147    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69d58d61972246d50b30c07443a7abc569071cf7a318152b88c8a484884aa929"} err="failed to get container status \"69d58d61972246d50b30c07443a7abc569071cf7a318152b88c8a484884aa929\": rpc error: code = NotFound desc = could not find container \"69d58d61972246d50b30c07443a7abc569071cf7a318152b88c8a484884aa929\": container with ID starting with 69d58d61972246d50b30c07443a7abc569071cf7a318152b88c8a484884aa929 not found: ID does not exist"
Jul 08 21:51:54.254931 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:54.254906    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp"]
Jul 08 21:51:54.258848 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:54.258828    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9b1f52-5cd89b4f7d-qf5mp"]
Jul 08 21:51:55.867872 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:55.867838    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce453e85-485f-44cf-a78a-81ca69a6790a" path="/var/lib/kubelet/pods/ce453e85-485f-44cf-a78a-81ca69a6790a/volumes"
Jul 08 21:51:59.336042 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:59.336009    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"]
Jul 08 21:51:59.336404 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:59.336253    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg" podUID="93cd8422-f6c1-4ba6-a4ea-144fcab5271d" containerName="istio-proxy" containerID="cri-o://c9de7b71ef537ff21bd04615732b13f68120771ea061fd78e3bffdb84b121afa" gracePeriod=30
Jul 08 21:51:59.569715 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:59.569674    2571 patch_prober.go:28] interesting pod/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 08 21:51:59.569880 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:51:59.569767    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg" podUID="93cd8422-f6c1-4ba6-a4ea-144fcab5271d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 21:52:03.734668 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:03.734633    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws"]
Jul 08 21:52:03.735037 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:03.734933    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4b78716-d516-4900-b447-33487d25dfa5" containerName="maas-api"
Jul 08 21:52:03.735037 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:03.734944    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4b78716-d516-4900-b447-33487d25dfa5" containerName="maas-api"
Jul 08 21:52:03.735037 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:03.734960    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce453e85-485f-44cf-a78a-81ca69a6790a" containerName="maas-api"
Jul 08 21:52:03.735037 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:03.734966    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce453e85-485f-44cf-a78a-81ca69a6790a" containerName="maas-api"
Jul 08 21:52:03.735037 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:03.735016    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce453e85-485f-44cf-a78a-81ca69a6790a" containerName="maas-api"
Jul 08 21:52:03.735037 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:03.735026    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4b78716-d516-4900-b447-33487d25dfa5" containerName="maas-api"
Jul 08 21:52:03.739347 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:03.739331    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws"
Jul 08 21:52:03.742010 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:03.741967    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 21:52:03.742240 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:03.742224    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-880ef2-serving-cert\""
Jul 08 21:52:03.743099 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:03.743081    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 21:52:03.743197 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:03.743114    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-xdh9f\""
Jul 08 21:52:03.748244 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:03.748223    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws"]
Jul 08 21:52:03.810064 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:03.810035    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkc5k\" (UniqueName: \"kubernetes.io/projected/e8d41a02-1e49-4e87-a1e4-260eb041bf4f-kube-api-access-vkc5k\") pod \"maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws\" (UID: \"e8d41a02-1e49-4e87-a1e4-260eb041bf4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws"
Jul 08 21:52:03.810194 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:03.810085    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8d41a02-1e49-4e87-a1e4-260eb041bf4f-openshift-service-ca\") pod \"maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws\" (UID: \"e8d41a02-1e49-4e87-a1e4-260eb041bf4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws"
Jul 08 21:52:03.810194 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:03.810169    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8d41a02-1e49-4e87-a1e4-260eb041bf4f-maas-api-tls\") pod \"maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws\" (UID: \"e8d41a02-1e49-4e87-a1e4-260eb041bf4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws"
Jul 08 21:52:03.911278 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:03.911249    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8d41a02-1e49-4e87-a1e4-260eb041bf4f-openshift-service-ca\") pod \"maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws\" (UID: \"e8d41a02-1e49-4e87-a1e4-260eb041bf4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws"
Jul 08 21:52:03.911473 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:03.911302    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8d41a02-1e49-4e87-a1e4-260eb041bf4f-maas-api-tls\") pod \"maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws\" (UID: \"e8d41a02-1e49-4e87-a1e4-260eb041bf4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws"
Jul 08 21:52:03.911473 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:03.911346    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkc5k\" (UniqueName: \"kubernetes.io/projected/e8d41a02-1e49-4e87-a1e4-260eb041bf4f-kube-api-access-vkc5k\") pod \"maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws\" (UID: \"e8d41a02-1e49-4e87-a1e4-260eb041bf4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws"
Jul 08 21:52:03.911946 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:03.911925    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8d41a02-1e49-4e87-a1e4-260eb041bf4f-openshift-service-ca\") pod \"maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws\" (UID: \"e8d41a02-1e49-4e87-a1e4-260eb041bf4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws"
Jul 08 21:52:03.913839 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:03.913819    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8d41a02-1e49-4e87-a1e4-260eb041bf4f-maas-api-tls\") pod \"maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws\" (UID: \"e8d41a02-1e49-4e87-a1e4-260eb041bf4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws"
Jul 08 21:52:03.928500 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:03.928475    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkc5k\" (UniqueName: \"kubernetes.io/projected/e8d41a02-1e49-4e87-a1e4-260eb041bf4f-kube-api-access-vkc5k\") pod \"maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws\" (UID: \"e8d41a02-1e49-4e87-a1e4-260eb041bf4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws"
Jul 08 21:52:04.050405 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.050341    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws"
Jul 08 21:52:04.182298 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.182264    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws"]
Jul 08 21:52:04.185302 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:52:04.185277    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8d41a02_1e49_4e87_a1e4_260eb041bf4f.slice/crio-714144e7a74542c86a2c609ed39b902fbf55a2018a3f59b518d4ce284a5047f0 WatchSource:0}: Error finding container 714144e7a74542c86a2c609ed39b902fbf55a2018a3f59b518d4ce284a5047f0: Status 404 returned error can't find the container with id 714144e7a74542c86a2c609ed39b902fbf55a2018a3f59b518d4ce284a5047f0
Jul 08 21:52:04.287429 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.287396    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws" event={"ID":"e8d41a02-1e49-4e87-a1e4-260eb041bf4f","Type":"ContainerStarted","Data":"714144e7a74542c86a2c609ed39b902fbf55a2018a3f59b518d4ce284a5047f0"}
Jul 08 21:52:04.573565 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.573539    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:52:04.719639 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.719607    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-istio-data\") pod \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") "
Jul 08 21:52:04.719639 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.719641    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzzrh\" (UniqueName: \"kubernetes.io/projected/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-kube-api-access-lzzrh\") pod \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") "
Jul 08 21:52:04.719925 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.719703    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-credential-socket\") pod \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") "
Jul 08 21:52:04.719925 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.719732    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-istio-envoy\") pod \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") "
Jul 08 21:52:04.719925 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.719774    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-workload-socket\") pod \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") "
Jul 08 21:52:04.719925 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.719801    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-istio-token\") pod \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") "
Jul 08 21:52:04.719925 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.719866    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-istiod-ca-cert\") pod \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") "
Jul 08 21:52:04.719925 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.719890    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-workload-certs\") pod \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") "
Jul 08 21:52:04.719925 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.719925    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-istio-podinfo\") pod \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\" (UID: \"93cd8422-f6c1-4ba6-a4ea-144fcab5271d\") "
Jul 08 21:52:04.720253 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.719999    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "93cd8422-f6c1-4ba6-a4ea-144fcab5271d" (UID: "93cd8422-f6c1-4ba6-a4ea-144fcab5271d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:52:04.720305 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.720261    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-credential-socket\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:52:04.720356 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.720302    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "93cd8422-f6c1-4ba6-a4ea-144fcab5271d" (UID: "93cd8422-f6c1-4ba6-a4ea-144fcab5271d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:52:04.720406 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.720348    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "93cd8422-f6c1-4ba6-a4ea-144fcab5271d" (UID: "93cd8422-f6c1-4ba6-a4ea-144fcab5271d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:52:04.720644 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.720605    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "93cd8422-f6c1-4ba6-a4ea-144fcab5271d" (UID: "93cd8422-f6c1-4ba6-a4ea-144fcab5271d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:52:04.720644 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.720617    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-istio-data" (OuterVolumeSpecName: "istio-data") pod "93cd8422-f6c1-4ba6-a4ea-144fcab5271d" (UID: "93cd8422-f6c1-4ba6-a4ea-144fcab5271d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:52:04.721968 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.721946    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "93cd8422-f6c1-4ba6-a4ea-144fcab5271d" (UID: "93cd8422-f6c1-4ba6-a4ea-144fcab5271d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:52:04.721968 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.721952    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-kube-api-access-lzzrh" (OuterVolumeSpecName: "kube-api-access-lzzrh") pod "93cd8422-f6c1-4ba6-a4ea-144fcab5271d" (UID: "93cd8422-f6c1-4ba6-a4ea-144fcab5271d"). InnerVolumeSpecName "kube-api-access-lzzrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:52:04.722598 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.722580    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "93cd8422-f6c1-4ba6-a4ea-144fcab5271d" (UID: "93cd8422-f6c1-4ba6-a4ea-144fcab5271d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 21:52:04.722598 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.722587    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-istio-token" (OuterVolumeSpecName: "istio-token") pod "93cd8422-f6c1-4ba6-a4ea-144fcab5271d" (UID: "93cd8422-f6c1-4ba6-a4ea-144fcab5271d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:52:04.821590 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.821566    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-istio-envoy\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:52:04.821590 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.821589    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-workload-socket\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:52:04.821946 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.821598    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-istio-token\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:52:04.821946 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.821607    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-istiod-ca-cert\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:52:04.821946 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.821615    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-workload-certs\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:52:04.821946 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.821622    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-istio-podinfo\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:52:04.821946 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.821629    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-istio-data\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:52:04.821946 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:04.821637    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzzrh\" (UniqueName: \"kubernetes.io/projected/93cd8422-f6c1-4ba6-a4ea-144fcab5271d-kube-api-access-lzzrh\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:52:05.292943 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:05.292855    2571 generic.go:356] "Generic (PLEG): container finished" podID="93cd8422-f6c1-4ba6-a4ea-144fcab5271d" containerID="c9de7b71ef537ff21bd04615732b13f68120771ea061fd78e3bffdb84b121afa" exitCode=0
Jul 08 21:52:05.292943 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:05.292932    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"
Jul 08 21:52:05.293146 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:05.292943    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg" event={"ID":"93cd8422-f6c1-4ba6-a4ea-144fcab5271d","Type":"ContainerDied","Data":"c9de7b71ef537ff21bd04615732b13f68120771ea061fd78e3bffdb84b121afa"}
Jul 08 21:52:05.293146 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:05.293019    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg" event={"ID":"93cd8422-f6c1-4ba6-a4ea-144fcab5271d","Type":"ContainerDied","Data":"ea3630f8bb1639c957b6a7ee27eebb4b098fb86db12f17593ca9ba8315e4fa0a"}
Jul 08 21:52:05.293146 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:05.293056    2571 scope.go:117] "RemoveContainer" containerID="c9de7b71ef537ff21bd04615732b13f68120771ea061fd78e3bffdb84b121afa"
Jul 08 21:52:05.294567 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:05.294525    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws" event={"ID":"e8d41a02-1e49-4e87-a1e4-260eb041bf4f","Type":"ContainerStarted","Data":"67559d189eabc8322b365f67178fe3ee1e787c73a69285f911e97ea519d728e2"}
Jul 08 21:52:05.294699 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:05.294604    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws"
Jul 08 21:52:05.304038 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:05.304022    2571 scope.go:117] "RemoveContainer" containerID="5f42328fdbee1f7d8852cbd5957f691f5cd8fe04c1141701370e4595ae33426d"
Jul 08 21:52:05.311796 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:05.311776    2571 scope.go:117] "RemoveContainer" containerID="c9de7b71ef537ff21bd04615732b13f68120771ea061fd78e3bffdb84b121afa"
Jul 08 21:52:05.312028 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:52:05.312009    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9de7b71ef537ff21bd04615732b13f68120771ea061fd78e3bffdb84b121afa\": container with ID starting with c9de7b71ef537ff21bd04615732b13f68120771ea061fd78e3bffdb84b121afa not found: ID does not exist" containerID="c9de7b71ef537ff21bd04615732b13f68120771ea061fd78e3bffdb84b121afa"
Jul 08 21:52:05.312078 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:05.312035    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9de7b71ef537ff21bd04615732b13f68120771ea061fd78e3bffdb84b121afa"} err="failed to get container status \"c9de7b71ef537ff21bd04615732b13f68120771ea061fd78e3bffdb84b121afa\": rpc error: code = NotFound desc = could not find container \"c9de7b71ef537ff21bd04615732b13f68120771ea061fd78e3bffdb84b121afa\": container with ID starting with c9de7b71ef537ff21bd04615732b13f68120771ea061fd78e3bffdb84b121afa not found: ID does not exist"
Jul 08 21:52:05.312078 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:05.312051    2571 scope.go:117] "RemoveContainer" containerID="5f42328fdbee1f7d8852cbd5957f691f5cd8fe04c1141701370e4595ae33426d"
Jul 08 21:52:05.312270 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:52:05.312255    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f42328fdbee1f7d8852cbd5957f691f5cd8fe04c1141701370e4595ae33426d\": container with ID starting with 5f42328fdbee1f7d8852cbd5957f691f5cd8fe04c1141701370e4595ae33426d not found: ID does not exist" containerID="5f42328fdbee1f7d8852cbd5957f691f5cd8fe04c1141701370e4595ae33426d"
Jul 08 21:52:05.312309 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:05.312274    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f42328fdbee1f7d8852cbd5957f691f5cd8fe04c1141701370e4595ae33426d"} err="failed to get container status \"5f42328fdbee1f7d8852cbd5957f691f5cd8fe04c1141701370e4595ae33426d\": rpc error: code = NotFound desc = could not find container \"5f42328fdbee1f7d8852cbd5957f691f5cd8fe04c1141701370e4595ae33426d\": container with ID starting with 5f42328fdbee1f7d8852cbd5957f691f5cd8fe04c1141701370e4595ae33426d not found: ID does not exist"
Jul 08 21:52:05.316644 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:05.316605    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws" podStartSLOduration=1.909003885 podStartE2EDuration="2.316592092s" totalImagesPullingTime="407.588207ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:52:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:52:05.314897661 +0000 UTC m=+2185.969800390" watchObservedRunningTime="2026-07-08 21:52:05.316592092 +0000 UTC m=+2185.971495170"
Jul 08 21:52:05.329103 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:05.329081    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"]
Jul 08 21:52:05.335463 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:05.335439    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-9b1f52-openshift-default-c6db9657-755mg"]
Jul 08 21:52:05.867187 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:05.867149    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93cd8422-f6c1-4ba6-a4ea-144fcab5271d" path="/var/lib/kubelet/pods/93cd8422-f6c1-4ba6-a4ea-144fcab5271d/volumes"
Jul 08 21:52:11.304407 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:11.304380    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws"
Jul 08 21:52:11.958404 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:11.958362    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk"]
Jul 08 21:52:11.958821 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:11.958805    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93cd8422-f6c1-4ba6-a4ea-144fcab5271d" containerName="istio-proxy"
Jul 08 21:52:11.958872 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:11.958825    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="93cd8422-f6c1-4ba6-a4ea-144fcab5271d" containerName="istio-proxy"
Jul 08 21:52:11.958872 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:11.958843    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93cd8422-f6c1-4ba6-a4ea-144fcab5271d" containerName="istio-proxy"
Jul 08 21:52:11.958872 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:11.958851    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="93cd8422-f6c1-4ba6-a4ea-144fcab5271d" containerName="istio-proxy"
Jul 08 21:52:11.958961 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:11.958952    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="93cd8422-f6c1-4ba6-a4ea-144fcab5271d" containerName="istio-proxy"
Jul 08 21:52:11.958993 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:11.958966    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="93cd8422-f6c1-4ba6-a4ea-144fcab5271d" containerName="istio-proxy"
Jul 08 21:52:11.963346 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:11.963328    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk"
Jul 08 21:52:11.965614 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:11.965593    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-1d5f65-serving-cert\""
Jul 08 21:52:11.972553 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:11.972456    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk"]
Jul 08 21:52:12.090917 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:12.090883    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e23866d-ade3-41d7-8c1f-8deed7ac4257-maas-api-tls\") pod \"maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk\" (UID: \"6e23866d-ade3-41d7-8c1f-8deed7ac4257\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk"
Jul 08 21:52:12.091079 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:12.090965    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e23866d-ade3-41d7-8c1f-8deed7ac4257-openshift-service-ca\") pod \"maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk\" (UID: \"6e23866d-ade3-41d7-8c1f-8deed7ac4257\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk"
Jul 08 21:52:12.091079 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:12.090993    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lqm9\" (UniqueName: \"kubernetes.io/projected/6e23866d-ade3-41d7-8c1f-8deed7ac4257-kube-api-access-6lqm9\") pod \"maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk\" (UID: \"6e23866d-ade3-41d7-8c1f-8deed7ac4257\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk"
Jul 08 21:52:12.191498 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:12.191468    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e23866d-ade3-41d7-8c1f-8deed7ac4257-openshift-service-ca\") pod \"maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk\" (UID: \"6e23866d-ade3-41d7-8c1f-8deed7ac4257\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk"
Jul 08 21:52:12.191498 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:12.191501    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lqm9\" (UniqueName: \"kubernetes.io/projected/6e23866d-ade3-41d7-8c1f-8deed7ac4257-kube-api-access-6lqm9\") pod \"maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk\" (UID: \"6e23866d-ade3-41d7-8c1f-8deed7ac4257\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk"
Jul 08 21:52:12.191690 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:12.191634    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e23866d-ade3-41d7-8c1f-8deed7ac4257-maas-api-tls\") pod \"maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk\" (UID: \"6e23866d-ade3-41d7-8c1f-8deed7ac4257\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk"
Jul 08 21:52:12.192173 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:12.192153    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e23866d-ade3-41d7-8c1f-8deed7ac4257-openshift-service-ca\") pod \"maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk\" (UID: \"6e23866d-ade3-41d7-8c1f-8deed7ac4257\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk"
Jul 08 21:52:12.194085 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:12.194055    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e23866d-ade3-41d7-8c1f-8deed7ac4257-maas-api-tls\") pod \"maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk\" (UID: \"6e23866d-ade3-41d7-8c1f-8deed7ac4257\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk"
Jul 08 21:52:12.202636 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:12.202606    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lqm9\" (UniqueName: \"kubernetes.io/projected/6e23866d-ade3-41d7-8c1f-8deed7ac4257-kube-api-access-6lqm9\") pod \"maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk\" (UID: \"6e23866d-ade3-41d7-8c1f-8deed7ac4257\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk"
Jul 08 21:52:12.274332 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:12.274255    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk"
Jul 08 21:52:12.410313 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:12.410294    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk"]
Jul 08 21:52:12.412449 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:52:12.412423    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e23866d_ade3_41d7_8c1f_8deed7ac4257.slice/crio-5dc911e22b1971f27b47a03285b315ca8bd42903aa940961255104908ac31fdb WatchSource:0}: Error finding container 5dc911e22b1971f27b47a03285b315ca8bd42903aa940961255104908ac31fdb: Status 404 returned error can't find the container with id 5dc911e22b1971f27b47a03285b315ca8bd42903aa940961255104908ac31fdb
Jul 08 21:52:13.328448 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:13.328412    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk" event={"ID":"6e23866d-ade3-41d7-8c1f-8deed7ac4257","Type":"ContainerStarted","Data":"c012009519a9a65f5fd2f545300f5319193ad7563651210ab7d3555df37dd865"}
Jul 08 21:52:13.328613 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:13.328463    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk" event={"ID":"6e23866d-ade3-41d7-8c1f-8deed7ac4257","Type":"ContainerStarted","Data":"5dc911e22b1971f27b47a03285b315ca8bd42903aa940961255104908ac31fdb"}
Jul 08 21:52:13.328613 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:13.328509    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk"
Jul 08 21:52:13.344283 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:13.344238    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk" podStartSLOduration=1.915176721 podStartE2EDuration="2.344225857s" totalImagesPullingTime="429.049136ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:52:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:52:13.34339648 +0000 UTC m=+2193.998299200" watchObservedRunningTime="2026-07-08 21:52:13.344225857 +0000 UTC m=+2193.999128576"
Jul 08 21:52:19.338521 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:19.338487    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk"
Jul 08 21:52:25.266837 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:25.266803    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws"]
Jul 08 21:52:25.267315 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:25.267100    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws" podUID="e8d41a02-1e49-4e87-a1e4-260eb041bf4f" containerName="maas-api" containerID="cri-o://67559d189eabc8322b365f67178fe3ee1e787c73a69285f911e97ea519d728e2" gracePeriod=30
Jul 08 21:52:25.381952 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:25.381924    2571 generic.go:356] "Generic (PLEG): container finished" podID="e8d41a02-1e49-4e87-a1e4-260eb041bf4f" containerID="67559d189eabc8322b365f67178fe3ee1e787c73a69285f911e97ea519d728e2" exitCode=0
Jul 08 21:52:25.382087 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:25.381989    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws" event={"ID":"e8d41a02-1e49-4e87-a1e4-260eb041bf4f","Type":"ContainerDied","Data":"67559d189eabc8322b365f67178fe3ee1e787c73a69285f911e97ea519d728e2"}
Jul 08 21:52:25.513103 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:25.513076    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws"
Jul 08 21:52:25.598212 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:25.598142    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkc5k\" (UniqueName: \"kubernetes.io/projected/e8d41a02-1e49-4e87-a1e4-260eb041bf4f-kube-api-access-vkc5k\") pod \"e8d41a02-1e49-4e87-a1e4-260eb041bf4f\" (UID: \"e8d41a02-1e49-4e87-a1e4-260eb041bf4f\") "
Jul 08 21:52:25.598212 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:25.598180    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8d41a02-1e49-4e87-a1e4-260eb041bf4f-openshift-service-ca\") pod \"e8d41a02-1e49-4e87-a1e4-260eb041bf4f\" (UID: \"e8d41a02-1e49-4e87-a1e4-260eb041bf4f\") "
Jul 08 21:52:25.598415 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:25.598236    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8d41a02-1e49-4e87-a1e4-260eb041bf4f-maas-api-tls\") pod \"e8d41a02-1e49-4e87-a1e4-260eb041bf4f\" (UID: \"e8d41a02-1e49-4e87-a1e4-260eb041bf4f\") "
Jul 08 21:52:25.598595 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:25.598569    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8d41a02-1e49-4e87-a1e4-260eb041bf4f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e8d41a02-1e49-4e87-a1e4-260eb041bf4f" (UID: "e8d41a02-1e49-4e87-a1e4-260eb041bf4f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:52:25.600331 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:25.600301    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8d41a02-1e49-4e87-a1e4-260eb041bf4f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e8d41a02-1e49-4e87-a1e4-260eb041bf4f" (UID: "e8d41a02-1e49-4e87-a1e4-260eb041bf4f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:52:25.600331 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:25.600304    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8d41a02-1e49-4e87-a1e4-260eb041bf4f-kube-api-access-vkc5k" (OuterVolumeSpecName: "kube-api-access-vkc5k") pod "e8d41a02-1e49-4e87-a1e4-260eb041bf4f" (UID: "e8d41a02-1e49-4e87-a1e4-260eb041bf4f"). InnerVolumeSpecName "kube-api-access-vkc5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:52:25.699591 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:25.699563    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8d41a02-1e49-4e87-a1e4-260eb041bf4f-maas-api-tls\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:52:25.699591 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:25.699586    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkc5k\" (UniqueName: \"kubernetes.io/projected/e8d41a02-1e49-4e87-a1e4-260eb041bf4f-kube-api-access-vkc5k\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:52:25.699735 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:25.699597    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8d41a02-1e49-4e87-a1e4-260eb041bf4f-openshift-service-ca\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:52:26.386943 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:26.386914    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws"
Jul 08 21:52:26.386943 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:26.386920    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws" event={"ID":"e8d41a02-1e49-4e87-a1e4-260eb041bf4f","Type":"ContainerDied","Data":"714144e7a74542c86a2c609ed39b902fbf55a2018a3f59b518d4ce284a5047f0"}
Jul 08 21:52:26.387455 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:26.386973    2571 scope.go:117] "RemoveContainer" containerID="67559d189eabc8322b365f67178fe3ee1e787c73a69285f911e97ea519d728e2"
Jul 08 21:52:26.403278 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:26.403256    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws"]
Jul 08 21:52:26.404558 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:26.404541    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-880ef2-5f49fbdbd8-4vsws"]
Jul 08 21:52:27.868263 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:27.868224    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8d41a02-1e49-4e87-a1e4-260eb041bf4f" path="/var/lib/kubelet/pods/e8d41a02-1e49-4e87-a1e4-260eb041bf4f/volumes"
Jul 08 21:52:32.020260 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:32.020210    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk"]
Jul 08 21:52:32.021017 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:32.020974    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk" podUID="6e23866d-ade3-41d7-8c1f-8deed7ac4257" containerName="maas-api" containerID="cri-o://c012009519a9a65f5fd2f545300f5319193ad7563651210ab7d3555df37dd865" gracePeriod=30
Jul 08 21:52:32.270078 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:32.270053    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk"
Jul 08 21:52:32.356586 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:32.356517    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e23866d-ade3-41d7-8c1f-8deed7ac4257-maas-api-tls\") pod \"6e23866d-ade3-41d7-8c1f-8deed7ac4257\" (UID: \"6e23866d-ade3-41d7-8c1f-8deed7ac4257\") "
Jul 08 21:52:32.356717 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:32.356583    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e23866d-ade3-41d7-8c1f-8deed7ac4257-openshift-service-ca\") pod \"6e23866d-ade3-41d7-8c1f-8deed7ac4257\" (UID: \"6e23866d-ade3-41d7-8c1f-8deed7ac4257\") "
Jul 08 21:52:32.356717 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:32.356644    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lqm9\" (UniqueName: \"kubernetes.io/projected/6e23866d-ade3-41d7-8c1f-8deed7ac4257-kube-api-access-6lqm9\") pod \"6e23866d-ade3-41d7-8c1f-8deed7ac4257\" (UID: \"6e23866d-ade3-41d7-8c1f-8deed7ac4257\") "
Jul 08 21:52:32.356905 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:32.356884    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e23866d-ade3-41d7-8c1f-8deed7ac4257-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6e23866d-ade3-41d7-8c1f-8deed7ac4257" (UID: "6e23866d-ade3-41d7-8c1f-8deed7ac4257"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:52:32.358841 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:32.358814    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e23866d-ade3-41d7-8c1f-8deed7ac4257-kube-api-access-6lqm9" (OuterVolumeSpecName: "kube-api-access-6lqm9") pod "6e23866d-ade3-41d7-8c1f-8deed7ac4257" (UID: "6e23866d-ade3-41d7-8c1f-8deed7ac4257"). InnerVolumeSpecName "kube-api-access-6lqm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:52:32.358942 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:32.358915    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e23866d-ade3-41d7-8c1f-8deed7ac4257-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6e23866d-ade3-41d7-8c1f-8deed7ac4257" (UID: "6e23866d-ade3-41d7-8c1f-8deed7ac4257"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:52:32.414629 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:32.414602    2571 generic.go:356] "Generic (PLEG): container finished" podID="6e23866d-ade3-41d7-8c1f-8deed7ac4257" containerID="c012009519a9a65f5fd2f545300f5319193ad7563651210ab7d3555df37dd865" exitCode=0
Jul 08 21:52:32.414777 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:32.414649    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk"
Jul 08 21:52:32.414777 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:32.414667    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk" event={"ID":"6e23866d-ade3-41d7-8c1f-8deed7ac4257","Type":"ContainerDied","Data":"c012009519a9a65f5fd2f545300f5319193ad7563651210ab7d3555df37dd865"}
Jul 08 21:52:32.414777 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:32.414712    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk" event={"ID":"6e23866d-ade3-41d7-8c1f-8deed7ac4257","Type":"ContainerDied","Data":"5dc911e22b1971f27b47a03285b315ca8bd42903aa940961255104908ac31fdb"}
Jul 08 21:52:32.414777 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:32.414736    2571 scope.go:117] "RemoveContainer" containerID="c012009519a9a65f5fd2f545300f5319193ad7563651210ab7d3555df37dd865"
Jul 08 21:52:32.422874 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:32.422859    2571 scope.go:117] "RemoveContainer" containerID="c012009519a9a65f5fd2f545300f5319193ad7563651210ab7d3555df37dd865"
Jul 08 21:52:32.423116 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:52:32.423100    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c012009519a9a65f5fd2f545300f5319193ad7563651210ab7d3555df37dd865\": container with ID starting with c012009519a9a65f5fd2f545300f5319193ad7563651210ab7d3555df37dd865 not found: ID does not exist" containerID="c012009519a9a65f5fd2f545300f5319193ad7563651210ab7d3555df37dd865"
Jul 08 21:52:32.423163 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:32.423123    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c012009519a9a65f5fd2f545300f5319193ad7563651210ab7d3555df37dd865"} err="failed to get container status \"c012009519a9a65f5fd2f545300f5319193ad7563651210ab7d3555df37dd865\": rpc error: code = NotFound desc = could not find container \"c012009519a9a65f5fd2f545300f5319193ad7563651210ab7d3555df37dd865\": container with ID starting with c012009519a9a65f5fd2f545300f5319193ad7563651210ab7d3555df37dd865 not found: ID does not exist"
Jul 08 21:52:32.437268 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:32.437245    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk"]
Jul 08 21:52:32.438507 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:32.438488    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1d5f65-5b8cc9777-7h8xk"]
Jul 08 21:52:32.457551 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:32.457531    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e23866d-ade3-41d7-8c1f-8deed7ac4257-openshift-service-ca\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:52:32.457551 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:32.457553    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lqm9\" (UniqueName: \"kubernetes.io/projected/6e23866d-ade3-41d7-8c1f-8deed7ac4257-kube-api-access-6lqm9\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:52:32.457700 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:32.457563    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e23866d-ade3-41d7-8c1f-8deed7ac4257-maas-api-tls\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:52:33.866817 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:33.866782    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e23866d-ade3-41d7-8c1f-8deed7ac4257" path="/var/lib/kubelet/pods/6e23866d-ade3-41d7-8c1f-8deed7ac4257/volumes"
Jul 08 21:52:38.463161 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.463122    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"]
Jul 08 21:52:38.463516 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.463404    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e23866d-ade3-41d7-8c1f-8deed7ac4257" containerName="maas-api"
Jul 08 21:52:38.463516 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.463414    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e23866d-ade3-41d7-8c1f-8deed7ac4257" containerName="maas-api"
Jul 08 21:52:38.463516 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.463428    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8d41a02-1e49-4e87-a1e4-260eb041bf4f" containerName="maas-api"
Jul 08 21:52:38.463516 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.463433    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8d41a02-1e49-4e87-a1e4-260eb041bf4f" containerName="maas-api"
Jul 08 21:52:38.463516 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.463492    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e23866d-ade3-41d7-8c1f-8deed7ac4257" containerName="maas-api"
Jul 08 21:52:38.463516 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.463497    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8d41a02-1e49-4e87-a1e4-260eb041bf4f" containerName="maas-api"
Jul 08 21:52:38.467604 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.467583    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:38.470035 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.470017    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-e45deb-openshift-default-dockercfg-nwmmq\""
Jul 08 21:52:38.477334 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.477312    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"]
Jul 08 21:52:38.508379 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.508349    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77c14260-4e78-48cd-b2f0-918ae3485ae7-credential-socket\") pod \"e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") " pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:38.508379 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.508380    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77c14260-4e78-48cd-b2f0-918ae3485ae7-istiod-ca-cert\") pod \"e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") " pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:38.508557 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.508413    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77c14260-4e78-48cd-b2f0-918ae3485ae7-istio-podinfo\") pod \"e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") " pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:38.508557 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.508500    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77c14260-4e78-48cd-b2f0-918ae3485ae7-istio-token\") pod \"e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") " pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:38.508557 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.508553    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkgxk\" (UniqueName: \"kubernetes.io/projected/77c14260-4e78-48cd-b2f0-918ae3485ae7-kube-api-access-hkgxk\") pod \"e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") " pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:38.508676 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.508578    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77c14260-4e78-48cd-b2f0-918ae3485ae7-istio-data\") pod \"e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") " pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:38.508676 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.508606    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77c14260-4e78-48cd-b2f0-918ae3485ae7-workload-socket\") pod \"e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") " pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:38.508676 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.508628    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77c14260-4e78-48cd-b2f0-918ae3485ae7-istio-envoy\") pod \"e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") " pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:38.509122 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.508674    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77c14260-4e78-48cd-b2f0-918ae3485ae7-workload-certs\") pod \"e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") " pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:38.609680 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.609644    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77c14260-4e78-48cd-b2f0-918ae3485ae7-credential-socket\") pod \"e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") " pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:38.609680 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.609680    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77c14260-4e78-48cd-b2f0-918ae3485ae7-istiod-ca-cert\") pod \"e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") " pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:38.609932 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.609723    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77c14260-4e78-48cd-b2f0-918ae3485ae7-istio-podinfo\") pod \"e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") " pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:38.609932 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.609789    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77c14260-4e78-48cd-b2f0-918ae3485ae7-istio-token\") pod \"e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") " pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:38.609932 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.609825    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkgxk\" (UniqueName: \"kubernetes.io/projected/77c14260-4e78-48cd-b2f0-918ae3485ae7-kube-api-access-hkgxk\") pod \"e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") " pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:38.609932 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.609856    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77c14260-4e78-48cd-b2f0-918ae3485ae7-istio-data\") pod \"e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") " pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:38.609932 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.609887    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77c14260-4e78-48cd-b2f0-918ae3485ae7-workload-socket\") pod \"e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") " pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:38.609932 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.609913    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77c14260-4e78-48cd-b2f0-918ae3485ae7-istio-envoy\") pod \"e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") " pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:38.610251 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.609962    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77c14260-4e78-48cd-b2f0-918ae3485ae7-workload-certs\") pod \"e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") " pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:38.610251 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.610144    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77c14260-4e78-48cd-b2f0-918ae3485ae7-credential-socket\") pod \"e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") " pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:38.610359 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.610292    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77c14260-4e78-48cd-b2f0-918ae3485ae7-istio-data\") pod \"e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") " pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:38.610359 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.610304    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77c14260-4e78-48cd-b2f0-918ae3485ae7-workload-socket\") pod \"e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") " pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:38.610459 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.610351    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77c14260-4e78-48cd-b2f0-918ae3485ae7-workload-certs\") pod \"e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") " pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:38.610528 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.610509    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77c14260-4e78-48cd-b2f0-918ae3485ae7-istiod-ca-cert\") pod \"e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") " pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:38.612314 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.612289    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77c14260-4e78-48cd-b2f0-918ae3485ae7-istio-envoy\") pod \"e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") " pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:38.612489 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.612470    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77c14260-4e78-48cd-b2f0-918ae3485ae7-istio-podinfo\") pod \"e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") " pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:38.618118 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.618094    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77c14260-4e78-48cd-b2f0-918ae3485ae7-istio-token\") pod \"e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") " pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:38.618406 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.618386    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkgxk\" (UniqueName: \"kubernetes.io/projected/77c14260-4e78-48cd-b2f0-918ae3485ae7-kube-api-access-hkgxk\") pod \"e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") " pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:38.778524 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.778443    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:38.909517 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.909489    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"]
Jul 08 21:52:38.912032 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:52:38.912008    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77c14260_4e78_48cd_b2f0_918ae3485ae7.slice/crio-3a55d0182a18f21d5787b861224c63f9b5b417829d88e86a019318fbe1f5f113 WatchSource:0}: Error finding container 3a55d0182a18f21d5787b861224c63f9b5b417829d88e86a019318fbe1f5f113: Status 404 returned error can't find the container with id 3a55d0182a18f21d5787b861224c63f9b5b417829d88e86a019318fbe1f5f113
Jul 08 21:52:38.914042 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.914012    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 21:52:38.914116 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.914083    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 21:52:38.914151 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:38.914112    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 21:52:39.447182 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:39.447144    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2" event={"ID":"77c14260-4e78-48cd-b2f0-918ae3485ae7","Type":"ContainerStarted","Data":"e6b842a7dec54684676ddf81f3c118a0e6d7955a97d38c80519a476ac2c42ab6"}
Jul 08 21:52:39.447356 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:39.447196    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2" event={"ID":"77c14260-4e78-48cd-b2f0-918ae3485ae7","Type":"ContainerStarted","Data":"3a55d0182a18f21d5787b861224c63f9b5b417829d88e86a019318fbe1f5f113"}
Jul 08 21:52:39.467894 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:39.467843    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2" podStartSLOduration=1.467826784 podStartE2EDuration="1.467826784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:52:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:52:39.467283932 +0000 UTC m=+2220.122186653" watchObservedRunningTime="2026-07-08 21:52:39.467826784 +0000 UTC m=+2220.122729502"
Jul 08 21:52:39.779410 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:39.779334    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:39.784145 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:39.784126    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:40.452131 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:40.452096    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:40.452901 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:40.452882    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:41.632372 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:41.632335    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv"]
Jul 08 21:52:41.637062 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:41.637039    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv"
Jul 08 21:52:41.639523 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:41.639502    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-xdh9f\""
Jul 08 21:52:41.639523 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:41.639521    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 21:52:41.639697 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:41.639523    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-e45deb-serving-cert\""
Jul 08 21:52:41.640509 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:41.640495    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 21:52:41.645690 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:41.645667    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv"]
Jul 08 21:52:41.735792 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:41.735739    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5e5e760-4597-4789-9d5a-37cb23d8a573-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv\" (UID: \"d5e5e760-4597-4789-9d5a-37cb23d8a573\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv"
Jul 08 21:52:41.735971 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:41.735852    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5e5e760-4597-4789-9d5a-37cb23d8a573-maas-api-tls\") pod \"maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv\" (UID: \"d5e5e760-4597-4789-9d5a-37cb23d8a573\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv"
Jul 08 21:52:41.735971 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:41.735915    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6f4f\" (UniqueName: \"kubernetes.io/projected/d5e5e760-4597-4789-9d5a-37cb23d8a573-kube-api-access-h6f4f\") pod \"maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv\" (UID: \"d5e5e760-4597-4789-9d5a-37cb23d8a573\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv"
Jul 08 21:52:41.837099 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:41.837065    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5e5e760-4597-4789-9d5a-37cb23d8a573-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv\" (UID: \"d5e5e760-4597-4789-9d5a-37cb23d8a573\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv"
Jul 08 21:52:41.837271 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:41.837108    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5e5e760-4597-4789-9d5a-37cb23d8a573-maas-api-tls\") pod \"maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv\" (UID: \"d5e5e760-4597-4789-9d5a-37cb23d8a573\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv"
Jul 08 21:52:41.837271 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:52:41.837216    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-e45deb-serving-cert: secret "maas-api-e2e-shared-a-e45deb-serving-cert" not found
Jul 08 21:52:41.837271 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:41.837236    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6f4f\" (UniqueName: \"kubernetes.io/projected/d5e5e760-4597-4789-9d5a-37cb23d8a573-kube-api-access-h6f4f\") pod \"maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv\" (UID: \"d5e5e760-4597-4789-9d5a-37cb23d8a573\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv"
Jul 08 21:52:41.837271 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:52:41.837266    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e5e760-4597-4789-9d5a-37cb23d8a573-maas-api-tls podName:d5e5e760-4597-4789-9d5a-37cb23d8a573 nodeName:}" failed. No retries permitted until 2026-07-08 21:52:42.337250499 +0000 UTC m=+2222.992153196 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d5e5e760-4597-4789-9d5a-37cb23d8a573-maas-api-tls") pod "maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv" (UID: "d5e5e760-4597-4789-9d5a-37cb23d8a573") : secret "maas-api-e2e-shared-a-e45deb-serving-cert" not found
Jul 08 21:52:41.837815 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:41.837794    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5e5e760-4597-4789-9d5a-37cb23d8a573-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv\" (UID: \"d5e5e760-4597-4789-9d5a-37cb23d8a573\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv"
Jul 08 21:52:41.845219 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:41.845198    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6f4f\" (UniqueName: \"kubernetes.io/projected/d5e5e760-4597-4789-9d5a-37cb23d8a573-kube-api-access-h6f4f\") pod \"maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv\" (UID: \"d5e5e760-4597-4789-9d5a-37cb23d8a573\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv"
Jul 08 21:52:42.341938 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:42.341898    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5e5e760-4597-4789-9d5a-37cb23d8a573-maas-api-tls\") pod \"maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv\" (UID: \"d5e5e760-4597-4789-9d5a-37cb23d8a573\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv"
Jul 08 21:52:42.344459 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:42.344433    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5e5e760-4597-4789-9d5a-37cb23d8a573-maas-api-tls\") pod \"maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv\" (UID: \"d5e5e760-4597-4789-9d5a-37cb23d8a573\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv"
Jul 08 21:52:42.548557 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:42.548522    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv"
Jul 08 21:52:42.679139 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:42.679116    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv"]
Jul 08 21:52:42.681441 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:52:42.681414    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5e5e760_4597_4789_9d5a_37cb23d8a573.slice/crio-a4f0a9942f3527ea22071da9f938ba5299149c2d41c7f0b8072c30fcddd372bf WatchSource:0}: Error finding container a4f0a9942f3527ea22071da9f938ba5299149c2d41c7f0b8072c30fcddd372bf: Status 404 returned error can't find the container with id a4f0a9942f3527ea22071da9f938ba5299149c2d41c7f0b8072c30fcddd372bf
Jul 08 21:52:43.466624 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:43.466589    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv" event={"ID":"d5e5e760-4597-4789-9d5a-37cb23d8a573","Type":"ContainerStarted","Data":"090c4506a7e44337d39825dd41e67f015d2ca87ac0ea73a3b230d0813041355d"}
Jul 08 21:52:43.466814 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:43.466668    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv" event={"ID":"d5e5e760-4597-4789-9d5a-37cb23d8a573","Type":"ContainerStarted","Data":"a4f0a9942f3527ea22071da9f938ba5299149c2d41c7f0b8072c30fcddd372bf"}
Jul 08 21:52:43.466814 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:43.466734    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv"
Jul 08 21:52:43.484029 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:43.483985    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv" podStartSLOduration=2.1564921200000002 podStartE2EDuration="2.483970101s" totalImagesPullingTime="327.477981ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:52:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:52:43.482096752 +0000 UTC m=+2224.136999471" watchObservedRunningTime="2026-07-08 21:52:43.483970101 +0000 UTC m=+2224.138872819"
Jul 08 21:52:49.475498 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:49.475466    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv"
Jul 08 21:52:50.114540 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:50.114509    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc"]
Jul 08 21:52:50.117691 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:50.117671    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc"
Jul 08 21:52:50.120291 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:50.120267    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-dc8a59-serving-cert\""
Jul 08 21:52:50.129902 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:50.129883    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc"]
Jul 08 21:52:50.211374 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:50.211327    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b42c6654-6a60-4db6-8132-981f4a3f0530-maas-api-tls\") pod \"maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc\" (UID: \"b42c6654-6a60-4db6-8132-981f4a3f0530\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc"
Jul 08 21:52:50.211374 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:50.211390    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b42c6654-6a60-4db6-8132-981f4a3f0530-openshift-service-ca\") pod \"maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc\" (UID: \"b42c6654-6a60-4db6-8132-981f4a3f0530\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc"
Jul 08 21:52:50.211600 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:50.211455    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl4ks\" (UniqueName: \"kubernetes.io/projected/b42c6654-6a60-4db6-8132-981f4a3f0530-kube-api-access-tl4ks\") pod \"maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc\" (UID: \"b42c6654-6a60-4db6-8132-981f4a3f0530\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc"
Jul 08 21:52:50.311980 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:50.311946    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b42c6654-6a60-4db6-8132-981f4a3f0530-maas-api-tls\") pod \"maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc\" (UID: \"b42c6654-6a60-4db6-8132-981f4a3f0530\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc"
Jul 08 21:52:50.312178 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:50.312011    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b42c6654-6a60-4db6-8132-981f4a3f0530-openshift-service-ca\") pod \"maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc\" (UID: \"b42c6654-6a60-4db6-8132-981f4a3f0530\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc"
Jul 08 21:52:50.312178 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:50.312045    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl4ks\" (UniqueName: \"kubernetes.io/projected/b42c6654-6a60-4db6-8132-981f4a3f0530-kube-api-access-tl4ks\") pod \"maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc\" (UID: \"b42c6654-6a60-4db6-8132-981f4a3f0530\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc"
Jul 08 21:52:50.312178 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:52:50.312078    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-dc8a59-serving-cert: secret "maas-api-e2e-shared-b-dc8a59-serving-cert" not found
Jul 08 21:52:50.312178 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:52:50.312152    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b42c6654-6a60-4db6-8132-981f4a3f0530-maas-api-tls podName:b42c6654-6a60-4db6-8132-981f4a3f0530 nodeName:}" failed. No retries permitted until 2026-07-08 21:52:50.812136598 +0000 UTC m=+2231.467039296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b42c6654-6a60-4db6-8132-981f4a3f0530-maas-api-tls") pod "maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc" (UID: "b42c6654-6a60-4db6-8132-981f4a3f0530") : secret "maas-api-e2e-shared-b-dc8a59-serving-cert" not found
Jul 08 21:52:50.312693 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:50.312671    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b42c6654-6a60-4db6-8132-981f4a3f0530-openshift-service-ca\") pod \"maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc\" (UID: \"b42c6654-6a60-4db6-8132-981f4a3f0530\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc"
Jul 08 21:52:50.324553 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:50.324526    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl4ks\" (UniqueName: \"kubernetes.io/projected/b42c6654-6a60-4db6-8132-981f4a3f0530-kube-api-access-tl4ks\") pod \"maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc\" (UID: \"b42c6654-6a60-4db6-8132-981f4a3f0530\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc"
Jul 08 21:52:50.816908 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:50.816871    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b42c6654-6a60-4db6-8132-981f4a3f0530-maas-api-tls\") pod \"maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc\" (UID: \"b42c6654-6a60-4db6-8132-981f4a3f0530\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc"
Jul 08 21:52:50.819411 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:50.819391    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b42c6654-6a60-4db6-8132-981f4a3f0530-maas-api-tls\") pod \"maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc\" (UID: \"b42c6654-6a60-4db6-8132-981f4a3f0530\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc"
Jul 08 21:52:51.028418 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:51.028387    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc"
Jul 08 21:52:51.176292 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:51.176268    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc"]
Jul 08 21:52:51.178727 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:52:51.178701    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb42c6654_6a60_4db6_8132_981f4a3f0530.slice/crio-9f53b973c12e9f769178675c1c4ee0f34ccde2f0945e31a5bba65a15f2eadcd4 WatchSource:0}: Error finding container 9f53b973c12e9f769178675c1c4ee0f34ccde2f0945e31a5bba65a15f2eadcd4: Status 404 returned error can't find the container with id 9f53b973c12e9f769178675c1c4ee0f34ccde2f0945e31a5bba65a15f2eadcd4
Jul 08 21:52:51.509376 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:51.509337    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc" event={"ID":"b42c6654-6a60-4db6-8132-981f4a3f0530","Type":"ContainerStarted","Data":"9f53b973c12e9f769178675c1c4ee0f34ccde2f0945e31a5bba65a15f2eadcd4"}
Jul 08 21:52:52.515131 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:52.515087    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc" event={"ID":"b42c6654-6a60-4db6-8132-981f4a3f0530","Type":"ContainerStarted","Data":"1d851e64ba860027693eba980a1b4a2aca8bde4cda3d0794ab9e2548e6ac336c"}
Jul 08 21:52:52.515511 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:52.515240    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc"
Jul 08 21:52:52.533868 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:52.533819    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc" podStartSLOduration=2.076441702 podStartE2EDuration="2.533805029s" totalImagesPullingTime="457.363327ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:52:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:52:52.531208455 +0000 UTC m=+2233.186111175" watchObservedRunningTime="2026-07-08 21:52:52.533805029 +0000 UTC m=+2233.188707747"
Jul 08 21:52:55.453918 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:55.453880    2571 patch_prober.go:28] interesting pod/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 08 21:52:55.454348 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:55.453938    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2" podUID="77c14260-4e78-48cd-b2f0-918ae3485ae7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 08 21:52:55.529431 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:55.529394    2571 generic.go:356] "Generic (PLEG): container finished" podID="77c14260-4e78-48cd-b2f0-918ae3485ae7" containerID="e6b842a7dec54684676ddf81f3c118a0e6d7955a97d38c80519a476ac2c42ab6" exitCode=0
Jul 08 21:52:55.529622 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:55.529436    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2" event={"ID":"77c14260-4e78-48cd-b2f0-918ae3485ae7","Type":"ContainerDied","Data":"e6b842a7dec54684676ddf81f3c118a0e6d7955a97d38c80519a476ac2c42ab6"}
Jul 08 21:52:55.529911 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:55.529894    2571 scope.go:117] "RemoveContainer" containerID="e6b842a7dec54684676ddf81f3c118a0e6d7955a97d38c80519a476ac2c42ab6"
Jul 08 21:52:55.530980 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:55.530948    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 21:52:55.531054 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:55.531037    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 21:52:55.531096 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:55.531082    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 21:52:56.541676 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:56.541636    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2" event={"ID":"77c14260-4e78-48cd-b2f0-918ae3485ae7","Type":"ContainerStarted","Data":"e8594735374f4a63ea4ebcc45af179c6effddc29fc0c93b90b49b5178571595a"}
Jul 08 21:52:56.779311 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:56.779275    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:52:56.779475 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:56.779457    2571 patch_prober.go:28] interesting pod/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 08 21:52:56.779523 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:56.779501    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2" podUID="77c14260-4e78-48cd-b2f0-918ae3485ae7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 08 21:52:57.779014 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:57.778974    2571 patch_prober.go:28] interesting pod/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 08 21:52:57.779388 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:57.779043    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2" podUID="77c14260-4e78-48cd-b2f0-918ae3485ae7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 08 21:52:58.524776 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:58.524727    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc"
Jul 08 21:52:58.779340 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:58.779258    2571 patch_prober.go:28] interesting pod/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 08 21:52:58.779340 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:58.779309    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2" podUID="77c14260-4e78-48cd-b2f0-918ae3485ae7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 08 21:52:59.778924 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:59.778835    2571 patch_prober.go:28] interesting pod/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 08 21:52:59.778924 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:52:59.778895    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2" podUID="77c14260-4e78-48cd-b2f0-918ae3485ae7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 08 21:53:00.783199 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:53:00.783169    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:53:00.783588 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:53:00.783437    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:53:00.784052 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:53:00.784037    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:56:00.355431 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:00.355353    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv"]
Jul 08 21:56:00.355961 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:00.355542    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv" podUID="d5e5e760-4597-4789-9d5a-37cb23d8a573" containerName="maas-api" containerID="cri-o://090c4506a7e44337d39825dd41e67f015d2ca87ac0ea73a3b230d0813041355d" gracePeriod=30
Jul 08 21:56:00.604392 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:00.604369    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv"
Jul 08 21:56:00.722289 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:00.722260    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5e5e760-4597-4789-9d5a-37cb23d8a573-openshift-service-ca\") pod \"d5e5e760-4597-4789-9d5a-37cb23d8a573\" (UID: \"d5e5e760-4597-4789-9d5a-37cb23d8a573\") "
Jul 08 21:56:00.722454 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:00.722296    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6f4f\" (UniqueName: \"kubernetes.io/projected/d5e5e760-4597-4789-9d5a-37cb23d8a573-kube-api-access-h6f4f\") pod \"d5e5e760-4597-4789-9d5a-37cb23d8a573\" (UID: \"d5e5e760-4597-4789-9d5a-37cb23d8a573\") "
Jul 08 21:56:00.722454 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:00.722343    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5e5e760-4597-4789-9d5a-37cb23d8a573-maas-api-tls\") pod \"d5e5e760-4597-4789-9d5a-37cb23d8a573\" (UID: \"d5e5e760-4597-4789-9d5a-37cb23d8a573\") "
Jul 08 21:56:00.722665 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:00.722627    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5e5e760-4597-4789-9d5a-37cb23d8a573-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d5e5e760-4597-4789-9d5a-37cb23d8a573" (UID: "d5e5e760-4597-4789-9d5a-37cb23d8a573"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:56:00.724528 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:00.724504    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5e5e760-4597-4789-9d5a-37cb23d8a573-kube-api-access-h6f4f" (OuterVolumeSpecName: "kube-api-access-h6f4f") pod "d5e5e760-4597-4789-9d5a-37cb23d8a573" (UID: "d5e5e760-4597-4789-9d5a-37cb23d8a573"). InnerVolumeSpecName "kube-api-access-h6f4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:56:00.724613 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:00.724595    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5e5e760-4597-4789-9d5a-37cb23d8a573-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d5e5e760-4597-4789-9d5a-37cb23d8a573" (UID: "d5e5e760-4597-4789-9d5a-37cb23d8a573"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:56:00.823112 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:00.823086    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5e5e760-4597-4789-9d5a-37cb23d8a573-openshift-service-ca\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:56:00.823254 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:00.823110    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6f4f\" (UniqueName: \"kubernetes.io/projected/d5e5e760-4597-4789-9d5a-37cb23d8a573-kube-api-access-h6f4f\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:56:00.823254 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:00.823133    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5e5e760-4597-4789-9d5a-37cb23d8a573-maas-api-tls\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:56:01.301314 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:01.301277    2571 generic.go:356] "Generic (PLEG): container finished" podID="d5e5e760-4597-4789-9d5a-37cb23d8a573" containerID="090c4506a7e44337d39825dd41e67f015d2ca87ac0ea73a3b230d0813041355d" exitCode=0
Jul 08 21:56:01.301480 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:01.301326    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv"
Jul 08 21:56:01.301480 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:01.301360    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv" event={"ID":"d5e5e760-4597-4789-9d5a-37cb23d8a573","Type":"ContainerDied","Data":"090c4506a7e44337d39825dd41e67f015d2ca87ac0ea73a3b230d0813041355d"}
Jul 08 21:56:01.301480 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:01.301416    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv" event={"ID":"d5e5e760-4597-4789-9d5a-37cb23d8a573","Type":"ContainerDied","Data":"a4f0a9942f3527ea22071da9f938ba5299149c2d41c7f0b8072c30fcddd372bf"}
Jul 08 21:56:01.301480 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:01.301438    2571 scope.go:117] "RemoveContainer" containerID="090c4506a7e44337d39825dd41e67f015d2ca87ac0ea73a3b230d0813041355d"
Jul 08 21:56:01.310088 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:01.310070    2571 scope.go:117] "RemoveContainer" containerID="090c4506a7e44337d39825dd41e67f015d2ca87ac0ea73a3b230d0813041355d"
Jul 08 21:56:01.310336 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:56:01.310314    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"090c4506a7e44337d39825dd41e67f015d2ca87ac0ea73a3b230d0813041355d\": container with ID starting with 090c4506a7e44337d39825dd41e67f015d2ca87ac0ea73a3b230d0813041355d not found: ID does not exist" containerID="090c4506a7e44337d39825dd41e67f015d2ca87ac0ea73a3b230d0813041355d"
Jul 08 21:56:01.310394 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:01.310346    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"090c4506a7e44337d39825dd41e67f015d2ca87ac0ea73a3b230d0813041355d"} err="failed to get container status \"090c4506a7e44337d39825dd41e67f015d2ca87ac0ea73a3b230d0813041355d\": rpc error: code = NotFound desc = could not find container \"090c4506a7e44337d39825dd41e67f015d2ca87ac0ea73a3b230d0813041355d\": container with ID starting with 090c4506a7e44337d39825dd41e67f015d2ca87ac0ea73a3b230d0813041355d not found: ID does not exist"
Jul 08 21:56:01.326927 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:01.326906    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv"]
Jul 08 21:56:01.338433 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:01.338408    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e45deb-69c79c7797-w2tnv"]
Jul 08 21:56:01.867470 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:01.867437    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5e5e760-4597-4789-9d5a-37cb23d8a573" path="/var/lib/kubelet/pods/d5e5e760-4597-4789-9d5a-37cb23d8a573/volumes"
Jul 08 21:56:05.793971 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:05.793940    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"]
Jul 08 21:56:05.794443 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:05.794164    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2" podUID="77c14260-4e78-48cd-b2f0-918ae3485ae7" containerName="istio-proxy" containerID="cri-o://e8594735374f4a63ea4ebcc45af179c6effddc29fc0c93b90b49b5178571595a" gracePeriod=30
Jul 08 21:56:06.877835 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:06.877804    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc"]
Jul 08 21:56:06.878293 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:06.878032    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc" podUID="b42c6654-6a60-4db6-8132-981f4a3f0530" containerName="maas-api" containerID="cri-o://1d851e64ba860027693eba980a1b4a2aca8bde4cda3d0794ab9e2548e6ac336c" gracePeriod=30
Jul 08 21:56:07.124937 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:07.124913    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc"
Jul 08 21:56:07.169644 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:07.169619    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tl4ks\" (UniqueName: \"kubernetes.io/projected/b42c6654-6a60-4db6-8132-981f4a3f0530-kube-api-access-tl4ks\") pod \"b42c6654-6a60-4db6-8132-981f4a3f0530\" (UID: \"b42c6654-6a60-4db6-8132-981f4a3f0530\") "
Jul 08 21:56:07.169802 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:07.169678    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b42c6654-6a60-4db6-8132-981f4a3f0530-openshift-service-ca\") pod \"b42c6654-6a60-4db6-8132-981f4a3f0530\" (UID: \"b42c6654-6a60-4db6-8132-981f4a3f0530\") "
Jul 08 21:56:07.169802 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:07.169706    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b42c6654-6a60-4db6-8132-981f4a3f0530-maas-api-tls\") pod \"b42c6654-6a60-4db6-8132-981f4a3f0530\" (UID: \"b42c6654-6a60-4db6-8132-981f4a3f0530\") "
Jul 08 21:56:07.170042 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:07.170014    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b42c6654-6a60-4db6-8132-981f4a3f0530-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b42c6654-6a60-4db6-8132-981f4a3f0530" (UID: "b42c6654-6a60-4db6-8132-981f4a3f0530"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:56:07.171812 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:07.171782    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b42c6654-6a60-4db6-8132-981f4a3f0530-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b42c6654-6a60-4db6-8132-981f4a3f0530" (UID: "b42c6654-6a60-4db6-8132-981f4a3f0530"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:56:07.171892 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:07.171808    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b42c6654-6a60-4db6-8132-981f4a3f0530-kube-api-access-tl4ks" (OuterVolumeSpecName: "kube-api-access-tl4ks") pod "b42c6654-6a60-4db6-8132-981f4a3f0530" (UID: "b42c6654-6a60-4db6-8132-981f4a3f0530"). InnerVolumeSpecName "kube-api-access-tl4ks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:56:07.271159 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:07.271134    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tl4ks\" (UniqueName: \"kubernetes.io/projected/b42c6654-6a60-4db6-8132-981f4a3f0530-kube-api-access-tl4ks\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:56:07.271159 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:07.271156    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b42c6654-6a60-4db6-8132-981f4a3f0530-openshift-service-ca\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:56:07.271288 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:07.271167    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b42c6654-6a60-4db6-8132-981f4a3f0530-maas-api-tls\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:56:07.327742 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:07.327717    2571 generic.go:356] "Generic (PLEG): container finished" podID="b42c6654-6a60-4db6-8132-981f4a3f0530" containerID="1d851e64ba860027693eba980a1b4a2aca8bde4cda3d0794ab9e2548e6ac336c" exitCode=0
Jul 08 21:56:07.327851 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:07.327776    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc"
Jul 08 21:56:07.327851 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:07.327783    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc" event={"ID":"b42c6654-6a60-4db6-8132-981f4a3f0530","Type":"ContainerDied","Data":"1d851e64ba860027693eba980a1b4a2aca8bde4cda3d0794ab9e2548e6ac336c"}
Jul 08 21:56:07.327851 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:07.327825    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc" event={"ID":"b42c6654-6a60-4db6-8132-981f4a3f0530","Type":"ContainerDied","Data":"9f53b973c12e9f769178675c1c4ee0f34ccde2f0945e31a5bba65a15f2eadcd4"}
Jul 08 21:56:07.327851 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:07.327848    2571 scope.go:117] "RemoveContainer" containerID="1d851e64ba860027693eba980a1b4a2aca8bde4cda3d0794ab9e2548e6ac336c"
Jul 08 21:56:07.336063 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:07.336043    2571 scope.go:117] "RemoveContainer" containerID="1d851e64ba860027693eba980a1b4a2aca8bde4cda3d0794ab9e2548e6ac336c"
Jul 08 21:56:07.336424 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:56:07.336404    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d851e64ba860027693eba980a1b4a2aca8bde4cda3d0794ab9e2548e6ac336c\": container with ID starting with 1d851e64ba860027693eba980a1b4a2aca8bde4cda3d0794ab9e2548e6ac336c not found: ID does not exist" containerID="1d851e64ba860027693eba980a1b4a2aca8bde4cda3d0794ab9e2548e6ac336c"
Jul 08 21:56:07.336479 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:07.336432    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d851e64ba860027693eba980a1b4a2aca8bde4cda3d0794ab9e2548e6ac336c"} err="failed to get container status \"1d851e64ba860027693eba980a1b4a2aca8bde4cda3d0794ab9e2548e6ac336c\": rpc error: code = NotFound desc = could not find container \"1d851e64ba860027693eba980a1b4a2aca8bde4cda3d0794ab9e2548e6ac336c\": container with ID starting with 1d851e64ba860027693eba980a1b4a2aca8bde4cda3d0794ab9e2548e6ac336c not found: ID does not exist"
Jul 08 21:56:07.354033 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:07.353997    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc"]
Jul 08 21:56:07.355567 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:07.355545    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-dc8a59-5cc4c9d8c7-r6vtc"]
Jul 08 21:56:07.866523 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:07.866495    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b42c6654-6a60-4db6-8132-981f4a3f0530" path="/var/lib/kubelet/pods/b42c6654-6a60-4db6-8132-981f4a3f0530/volumes"
Jul 08 21:56:11.044591 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.044567    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:56:11.100256 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.100182    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77c14260-4e78-48cd-b2f0-918ae3485ae7-istiod-ca-cert\") pod \"77c14260-4e78-48cd-b2f0-918ae3485ae7\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") "
Jul 08 21:56:11.100256 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.100252    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkgxk\" (UniqueName: \"kubernetes.io/projected/77c14260-4e78-48cd-b2f0-918ae3485ae7-kube-api-access-hkgxk\") pod \"77c14260-4e78-48cd-b2f0-918ae3485ae7\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") "
Jul 08 21:56:11.100464 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.100277    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77c14260-4e78-48cd-b2f0-918ae3485ae7-istio-data\") pod \"77c14260-4e78-48cd-b2f0-918ae3485ae7\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") "
Jul 08 21:56:11.100464 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.100304    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77c14260-4e78-48cd-b2f0-918ae3485ae7-istio-podinfo\") pod \"77c14260-4e78-48cd-b2f0-918ae3485ae7\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") "
Jul 08 21:56:11.100464 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.100338    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77c14260-4e78-48cd-b2f0-918ae3485ae7-istio-token\") pod \"77c14260-4e78-48cd-b2f0-918ae3485ae7\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") "
Jul 08 21:56:11.100464 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.100353    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77c14260-4e78-48cd-b2f0-918ae3485ae7-credential-socket\") pod \"77c14260-4e78-48cd-b2f0-918ae3485ae7\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") "
Jul 08 21:56:11.100464 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.100370    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77c14260-4e78-48cd-b2f0-918ae3485ae7-istio-envoy\") pod \"77c14260-4e78-48cd-b2f0-918ae3485ae7\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") "
Jul 08 21:56:11.100464 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.100412    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77c14260-4e78-48cd-b2f0-918ae3485ae7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "77c14260-4e78-48cd-b2f0-918ae3485ae7" (UID: "77c14260-4e78-48cd-b2f0-918ae3485ae7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:56:11.100464 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.100447    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77c14260-4e78-48cd-b2f0-918ae3485ae7-workload-socket\") pod \"77c14260-4e78-48cd-b2f0-918ae3485ae7\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") "
Jul 08 21:56:11.100869 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.100468    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77c14260-4e78-48cd-b2f0-918ae3485ae7-workload-certs\") pod \"77c14260-4e78-48cd-b2f0-918ae3485ae7\" (UID: \"77c14260-4e78-48cd-b2f0-918ae3485ae7\") "
Jul 08 21:56:11.100869 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.100669    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77c14260-4e78-48cd-b2f0-918ae3485ae7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "77c14260-4e78-48cd-b2f0-918ae3485ae7" (UID: "77c14260-4e78-48cd-b2f0-918ae3485ae7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:56:11.100869 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.100725    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77c14260-4e78-48cd-b2f0-918ae3485ae7-istiod-ca-cert\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:56:11.101206 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.100874    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77c14260-4e78-48cd-b2f0-918ae3485ae7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "77c14260-4e78-48cd-b2f0-918ae3485ae7" (UID: "77c14260-4e78-48cd-b2f0-918ae3485ae7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:56:11.101206 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.100912    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77c14260-4e78-48cd-b2f0-918ae3485ae7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "77c14260-4e78-48cd-b2f0-918ae3485ae7" (UID: "77c14260-4e78-48cd-b2f0-918ae3485ae7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:56:11.101383 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.101355    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77c14260-4e78-48cd-b2f0-918ae3485ae7-istio-data" (OuterVolumeSpecName: "istio-data") pod "77c14260-4e78-48cd-b2f0-918ae3485ae7" (UID: "77c14260-4e78-48cd-b2f0-918ae3485ae7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:56:11.102617 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.102593    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77c14260-4e78-48cd-b2f0-918ae3485ae7-kube-api-access-hkgxk" (OuterVolumeSpecName: "kube-api-access-hkgxk") pod "77c14260-4e78-48cd-b2f0-918ae3485ae7" (UID: "77c14260-4e78-48cd-b2f0-918ae3485ae7"). InnerVolumeSpecName "kube-api-access-hkgxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:56:11.102617 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.102605    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/77c14260-4e78-48cd-b2f0-918ae3485ae7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "77c14260-4e78-48cd-b2f0-918ae3485ae7" (UID: "77c14260-4e78-48cd-b2f0-918ae3485ae7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 21:56:11.103029 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.103011    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77c14260-4e78-48cd-b2f0-918ae3485ae7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "77c14260-4e78-48cd-b2f0-918ae3485ae7" (UID: "77c14260-4e78-48cd-b2f0-918ae3485ae7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:56:11.103178 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.103158    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77c14260-4e78-48cd-b2f0-918ae3485ae7-istio-token" (OuterVolumeSpecName: "istio-token") pod "77c14260-4e78-48cd-b2f0-918ae3485ae7" (UID: "77c14260-4e78-48cd-b2f0-918ae3485ae7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:56:11.201729 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.201699    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkgxk\" (UniqueName: \"kubernetes.io/projected/77c14260-4e78-48cd-b2f0-918ae3485ae7-kube-api-access-hkgxk\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:56:11.201729 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.201723    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77c14260-4e78-48cd-b2f0-918ae3485ae7-istio-data\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:56:11.201729 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.201733    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77c14260-4e78-48cd-b2f0-918ae3485ae7-istio-podinfo\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:56:11.201947 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.201740    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77c14260-4e78-48cd-b2f0-918ae3485ae7-istio-token\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:56:11.201947 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.201768    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77c14260-4e78-48cd-b2f0-918ae3485ae7-credential-socket\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:56:11.201947 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.201777    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77c14260-4e78-48cd-b2f0-918ae3485ae7-istio-envoy\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:56:11.201947 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.201786    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77c14260-4e78-48cd-b2f0-918ae3485ae7-workload-socket\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:56:11.201947 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.201794    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77c14260-4e78-48cd-b2f0-918ae3485ae7-workload-certs\") on node \"ip-10-0-143-138.ec2.internal\" DevicePath \"\""
Jul 08 21:56:11.345652 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.345618    2571 generic.go:356] "Generic (PLEG): container finished" podID="77c14260-4e78-48cd-b2f0-918ae3485ae7" containerID="e8594735374f4a63ea4ebcc45af179c6effddc29fc0c93b90b49b5178571595a" exitCode=0
Jul 08 21:56:11.345828 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.345665    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"
Jul 08 21:56:11.345828 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.345707    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2" event={"ID":"77c14260-4e78-48cd-b2f0-918ae3485ae7","Type":"ContainerDied","Data":"e8594735374f4a63ea4ebcc45af179c6effddc29fc0c93b90b49b5178571595a"}
Jul 08 21:56:11.345828 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.345780    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2" event={"ID":"77c14260-4e78-48cd-b2f0-918ae3485ae7","Type":"ContainerDied","Data":"3a55d0182a18f21d5787b861224c63f9b5b417829d88e86a019318fbe1f5f113"}
Jul 08 21:56:11.345828 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.345805    2571 scope.go:117] "RemoveContainer" containerID="e8594735374f4a63ea4ebcc45af179c6effddc29fc0c93b90b49b5178571595a"
Jul 08 21:56:11.354259 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.354242    2571 scope.go:117] "RemoveContainer" containerID="e6b842a7dec54684676ddf81f3c118a0e6d7955a97d38c80519a476ac2c42ab6"
Jul 08 21:56:11.361827 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.361811    2571 scope.go:117] "RemoveContainer" containerID="e8594735374f4a63ea4ebcc45af179c6effddc29fc0c93b90b49b5178571595a"
Jul 08 21:56:11.362108 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:56:11.362088    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8594735374f4a63ea4ebcc45af179c6effddc29fc0c93b90b49b5178571595a\": container with ID starting with e8594735374f4a63ea4ebcc45af179c6effddc29fc0c93b90b49b5178571595a not found: ID does not exist" containerID="e8594735374f4a63ea4ebcc45af179c6effddc29fc0c93b90b49b5178571595a"
Jul 08 21:56:11.362175 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.362116    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8594735374f4a63ea4ebcc45af179c6effddc29fc0c93b90b49b5178571595a"} err="failed to get container status \"e8594735374f4a63ea4ebcc45af179c6effddc29fc0c93b90b49b5178571595a\": rpc error: code = NotFound desc = could not find container \"e8594735374f4a63ea4ebcc45af179c6effddc29fc0c93b90b49b5178571595a\": container with ID starting with e8594735374f4a63ea4ebcc45af179c6effddc29fc0c93b90b49b5178571595a not found: ID does not exist"
Jul 08 21:56:11.362175 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.362131    2571 scope.go:117] "RemoveContainer" containerID="e6b842a7dec54684676ddf81f3c118a0e6d7955a97d38c80519a476ac2c42ab6"
Jul 08 21:56:11.362375 ip-10-0-143-138 kubenswrapper[2571]: E0708 21:56:11.362357    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6b842a7dec54684676ddf81f3c118a0e6d7955a97d38c80519a476ac2c42ab6\": container with ID starting with e6b842a7dec54684676ddf81f3c118a0e6d7955a97d38c80519a476ac2c42ab6 not found: ID does not exist" containerID="e6b842a7dec54684676ddf81f3c118a0e6d7955a97d38c80519a476ac2c42ab6"
Jul 08 21:56:11.362432 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.362382    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6b842a7dec54684676ddf81f3c118a0e6d7955a97d38c80519a476ac2c42ab6"} err="failed to get container status \"e6b842a7dec54684676ddf81f3c118a0e6d7955a97d38c80519a476ac2c42ab6\": rpc error: code = NotFound desc = could not find container \"e6b842a7dec54684676ddf81f3c118a0e6d7955a97d38c80519a476ac2c42ab6\": container with ID starting with e6b842a7dec54684676ddf81f3c118a0e6d7955a97d38c80519a476ac2c42ab6 not found: ID does not exist"
Jul 08 21:56:11.366382 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.366363    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"]
Jul 08 21:56:11.372080 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.372061    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-e45deb-openshift-default-7959cd6fc9-gljn2"]
Jul 08 21:56:11.867114 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:11.867082    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77c14260-4e78-48cd-b2f0-918ae3485ae7" path="/var/lib/kubelet/pods/77c14260-4e78-48cd-b2f0-918ae3485ae7/volumes"
Jul 08 21:56:18.589586 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:18.589556    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c9df76854-glzbx_1f1b72ca-8176-434f-a907-ebf26051b348/copy-manifests/0.log"
Jul 08 21:56:18.596434 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:18.596413    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c9df76854-glzbx_1f1b72ca-8176-434f-a907-ebf26051b348/manager/0.log"
Jul 08 21:56:21.375452 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:21.375418    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678w6jfj_a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a/istio-proxy/0.log"
Jul 08 21:56:21.500102 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:21.500062    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-vv62j_10fcf54e-2728-4ef6-8770-5eee8b0c521e/discovery/0.log"
Jul 08 21:56:21.980373 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:21.980336    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-z6vwr_3e8fb17d-87f4-4915-8f6f-4dd686d63740/payload-pre-processing/0.log"
Jul 08 21:56:22.568140 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:22.568114    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-vt97b_884bdfaa-7763-46e5-9066-c131c6bac079/main/0.log"
Jul 08 21:56:22.681344 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:22.681296    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-96rbk_ac779ec6-8e35-4426-9c9e-e24e0a0e5378/main/0.log"
Jul 08 21:56:22.912372 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:22.912344    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcs4mh_d8e00acf-fbef-44d5-b265-b7b1d592a932/main/0.log"
Jul 08 21:56:30.309108 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:30.309082    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hk4nc_fed9c17c-f689-4d9f-b52e-7ba52d04948f/global-pull-secret-syncer/0.log"
Jul 08 21:56:30.463710 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:30.463679    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lwvml_b260a6a3-7539-4175-b668-a648e3b3a123/konnectivity-agent/0.log"
Jul 08 21:56:30.532900 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:30.532867    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-138.ec2.internal_e15bd876fdc5c28fde6928dbc5f32a53/haproxy/0.log"
Jul 08 21:56:38.493061 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:38.493033    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nthml_a1537a24-4ec5-4832-b85e-d9a579b2b885/node-exporter/0.log"
Jul 08 21:56:38.526696 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:38.526671    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nthml_a1537a24-4ec5-4832-b85e-d9a579b2b885/kube-rbac-proxy/0.log"
Jul 08 21:56:38.557440 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:38.557418    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nthml_a1537a24-4ec5-4832-b85e-d9a579b2b885/init-textfile/0.log"
Jul 08 21:56:40.326073 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.325983    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ccpfm/perf-node-gather-daemonset-rvt4s"]
Jul 08 21:56:40.326500 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.326377    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b42c6654-6a60-4db6-8132-981f4a3f0530" containerName="maas-api"
Jul 08 21:56:40.326500 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.326393    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b42c6654-6a60-4db6-8132-981f4a3f0530" containerName="maas-api"
Jul 08 21:56:40.326500 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.326418    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5e5e760-4597-4789-9d5a-37cb23d8a573" containerName="maas-api"
Jul 08 21:56:40.326500 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.326426    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5e5e760-4597-4789-9d5a-37cb23d8a573" containerName="maas-api"
Jul 08 21:56:40.326500 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.326435    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77c14260-4e78-48cd-b2f0-918ae3485ae7" containerName="istio-proxy"
Jul 08 21:56:40.326500 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.326442    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="77c14260-4e78-48cd-b2f0-918ae3485ae7" containerName="istio-proxy"
Jul 08 21:56:40.326500 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.326456    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77c14260-4e78-48cd-b2f0-918ae3485ae7" containerName="istio-proxy"
Jul 08 21:56:40.326500 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.326463    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="77c14260-4e78-48cd-b2f0-918ae3485ae7" containerName="istio-proxy"
Jul 08 21:56:40.326937 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.326524    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="77c14260-4e78-48cd-b2f0-918ae3485ae7" containerName="istio-proxy"
Jul 08 21:56:40.326937 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.326534    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b42c6654-6a60-4db6-8132-981f4a3f0530" containerName="maas-api"
Jul 08 21:56:40.326937 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.326543    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="77c14260-4e78-48cd-b2f0-918ae3485ae7" containerName="istio-proxy"
Jul 08 21:56:40.326937 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.326554    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5e5e760-4597-4789-9d5a-37cb23d8a573" containerName="maas-api"
Jul 08 21:56:40.331000 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.330977    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ccpfm/perf-node-gather-daemonset-rvt4s"
Jul 08 21:56:40.333329 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.333309    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ccpfm\"/\"kube-root-ca.crt\""
Jul 08 21:56:40.334331 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.334314    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ccpfm\"/\"default-dockercfg-v6cws\""
Jul 08 21:56:40.334437 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.334331    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ccpfm\"/\"openshift-service-ca.crt\""
Jul 08 21:56:40.340430 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.340412    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ccpfm/perf-node-gather-daemonset-rvt4s"]
Jul 08 21:56:40.434721 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.434684    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce-lib-modules\") pod \"perf-node-gather-daemonset-rvt4s\" (UID: \"6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce\") " pod="openshift-must-gather-ccpfm/perf-node-gather-daemonset-rvt4s"
Jul 08 21:56:40.434914 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.434729    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce-podres\") pod \"perf-node-gather-daemonset-rvt4s\" (UID: \"6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce\") " pod="openshift-must-gather-ccpfm/perf-node-gather-daemonset-rvt4s"
Jul 08 21:56:40.434914 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.434786    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce-proc\") pod \"perf-node-gather-daemonset-rvt4s\" (UID: \"6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce\") " pod="openshift-must-gather-ccpfm/perf-node-gather-daemonset-rvt4s"
Jul 08 21:56:40.434914 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.434811    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce-sys\") pod \"perf-node-gather-daemonset-rvt4s\" (UID: \"6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce\") " pod="openshift-must-gather-ccpfm/perf-node-gather-daemonset-rvt4s"
Jul 08 21:56:40.434914 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.434894    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgg5r\" (UniqueName: \"kubernetes.io/projected/6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce-kube-api-access-sgg5r\") pod \"perf-node-gather-daemonset-rvt4s\" (UID: \"6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce\") " pod="openshift-must-gather-ccpfm/perf-node-gather-daemonset-rvt4s"
Jul 08 21:56:40.535432 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.535400    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgg5r\" (UniqueName: \"kubernetes.io/projected/6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce-kube-api-access-sgg5r\") pod \"perf-node-gather-daemonset-rvt4s\" (UID: \"6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce\") " pod="openshift-must-gather-ccpfm/perf-node-gather-daemonset-rvt4s"
Jul 08 21:56:40.535628 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.535458    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce-lib-modules\") pod \"perf-node-gather-daemonset-rvt4s\" (UID: \"6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce\") " pod="openshift-must-gather-ccpfm/perf-node-gather-daemonset-rvt4s"
Jul 08 21:56:40.535628 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.535482    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce-podres\") pod \"perf-node-gather-daemonset-rvt4s\" (UID: \"6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce\") " pod="openshift-must-gather-ccpfm/perf-node-gather-daemonset-rvt4s"
Jul 08 21:56:40.535628 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.535503    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce-proc\") pod \"perf-node-gather-daemonset-rvt4s\" (UID: \"6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce\") " pod="openshift-must-gather-ccpfm/perf-node-gather-daemonset-rvt4s"
Jul 08 21:56:40.535628 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.535520    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce-sys\") pod \"perf-node-gather-daemonset-rvt4s\" (UID: \"6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce\") " pod="openshift-must-gather-ccpfm/perf-node-gather-daemonset-rvt4s"
Jul 08 21:56:40.535628 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.535604    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce-sys\") pod \"perf-node-gather-daemonset-rvt4s\" (UID: \"6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce\") " pod="openshift-must-gather-ccpfm/perf-node-gather-daemonset-rvt4s"
Jul 08 21:56:40.535849 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.535626    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce-proc\") pod \"perf-node-gather-daemonset-rvt4s\" (UID: \"6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce\") " pod="openshift-must-gather-ccpfm/perf-node-gather-daemonset-rvt4s"
Jul 08 21:56:40.535849 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.535647    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce-podres\") pod \"perf-node-gather-daemonset-rvt4s\" (UID: \"6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce\") " pod="openshift-must-gather-ccpfm/perf-node-gather-daemonset-rvt4s"
Jul 08 21:56:40.535849 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.535676    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce-lib-modules\") pod \"perf-node-gather-daemonset-rvt4s\" (UID: \"6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce\") " pod="openshift-must-gather-ccpfm/perf-node-gather-daemonset-rvt4s"
Jul 08 21:56:40.543379 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.543351    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgg5r\" (UniqueName: \"kubernetes.io/projected/6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce-kube-api-access-sgg5r\") pod \"perf-node-gather-daemonset-rvt4s\" (UID: \"6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce\") " pod="openshift-must-gather-ccpfm/perf-node-gather-daemonset-rvt4s"
Jul 08 21:56:40.640879 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.640806    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ccpfm/perf-node-gather-daemonset-rvt4s"
Jul 08 21:56:40.767262 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:40.767141    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ccpfm/perf-node-gather-daemonset-rvt4s"]
Jul 08 21:56:40.770114 ip-10-0-143-138 kubenswrapper[2571]: W0708 21:56:40.770085    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6c8f372e_c7b1_4431_b4dc_8c8caf9b50ce.slice/crio-6430023a83abc13c7f51fd2b752e87b15c11cfc0ba5fdef6e73890e0ce78a7ff WatchSource:0}: Error finding container 6430023a83abc13c7f51fd2b752e87b15c11cfc0ba5fdef6e73890e0ce78a7ff: Status 404 returned error can't find the container with id 6430023a83abc13c7f51fd2b752e87b15c11cfc0ba5fdef6e73890e0ce78a7ff
Jul 08 21:56:41.304640 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:41.304613    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5b869b8c56-l98h9_961c8721-db96-4a0e-b1d1-62601f66cbd6/console/0.log"
Jul 08 21:56:41.469610 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:41.469576    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ccpfm/perf-node-gather-daemonset-rvt4s" event={"ID":"6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce","Type":"ContainerStarted","Data":"059e2bf642cb8aeaf08d7f7994a0f3ebe9189bf55b2ae0ff6c5ecfe73abefd5a"}
Jul 08 21:56:41.470031 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:41.469624    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ccpfm/perf-node-gather-daemonset-rvt4s" event={"ID":"6c8f372e-c7b1-4431-b4dc-8c8caf9b50ce","Type":"ContainerStarted","Data":"6430023a83abc13c7f51fd2b752e87b15c11cfc0ba5fdef6e73890e0ce78a7ff"}
Jul 08 21:56:41.470031 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:41.469701    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ccpfm/perf-node-gather-daemonset-rvt4s"
Jul 08 21:56:41.485440 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:41.485394    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ccpfm/perf-node-gather-daemonset-rvt4s" podStartSLOduration=1.485381167 podStartE2EDuration="1.485381167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:56:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:56:41.484213931 +0000 UTC m=+2462.139116662" watchObservedRunningTime="2026-07-08 21:56:41.485381167 +0000 UTC m=+2462.140283886"
Jul 08 21:56:42.933197 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:42.933160    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-27wfb_f9d47a6b-4d3c-42ba-8965-67b29cfaad5e/dns/0.log"
Jul 08 21:56:42.957981 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:42.957949    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-27wfb_f9d47a6b-4d3c-42ba-8965-67b29cfaad5e/kube-rbac-proxy/0.log"
Jul 08 21:56:43.111421 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:43.111387    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kwg77_db7d97d7-b4b1-4c44-a4e8-be1d3590a217/dns-node-resolver/0.log"
Jul 08 21:56:43.646850 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:43.646815    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5ccddc7869-2w579_d7f513e3-b4c6-4ece-bbcb-bef29e97319c/registry/0.log"
Jul 08 21:56:43.664343 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:43.664295    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5ccddc7869-2w579_d7f513e3-b4c6-4ece-bbcb-bef29e97319c/registry/1.log"
Jul 08 21:56:43.692191 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:43.692166    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q6v7s_13f8f143-b56b-41cc-b6d4-58330207e6d9/node-ca/0.log"
Jul 08 21:56:44.699344 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:44.699316    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678w6jfj_a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a/istio-proxy/0.log"
Jul 08 21:56:44.867096 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:44.867067    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-vv62j_10fcf54e-2728-4ef6-8770-5eee8b0c521e/discovery/0.log"
Jul 08 21:56:45.035159 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:45.035082    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-z6vwr_3e8fb17d-87f4-4915-8f6f-4dd686d63740/payload-pre-processing/0.log"
Jul 08 21:56:45.758004 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:45.757978    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8v56v_05b59558-56ed-4741-ac0f-2911399956a1/serve-healthcheck-canary/0.log"
Jul 08 21:56:46.312371 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:46.312340    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-67x2p_36bda6e3-fb2a-45b7-86f1-008dea6ef292/kube-rbac-proxy/0.log"
Jul 08 21:56:46.335423 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:46.335395    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-67x2p_36bda6e3-fb2a-45b7-86f1-008dea6ef292/exporter/0.log"
Jul 08 21:56:46.358796 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:46.358769    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-67x2p_36bda6e3-fb2a-45b7-86f1-008dea6ef292/extractor/0.log"
Jul 08 21:56:47.483455 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:47.483430    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ccpfm/perf-node-gather-daemonset-rvt4s"
Jul 08 21:56:49.078091 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:49.078065    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c9df76854-glzbx_1f1b72ca-8176-434f-a907-ebf26051b348/manager/0.log"
Jul 08 21:56:49.098882 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:49.098856    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c9df76854-glzbx_1f1b72ca-8176-434f-a907-ebf26051b348/copy-manifests/0.log"
Jul 08 21:56:50.461310 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:50.461280    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678w6jfj_a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a/istio-proxy/0.log"
Jul 08 21:56:50.562355 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:50.562326    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5cdf98c45c-jvqn7_58e9ed4e-ec3b-4619-b38d-9f47ddd37da8/manager/0.log"
Jul 08 21:56:50.622147 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:50.622118    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-vv62j_10fcf54e-2728-4ef6-8770-5eee8b0c521e/discovery/0.log"
Jul 08 21:56:50.751103 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:50.751075    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-z6vwr_3e8fb17d-87f4-4915-8f6f-4dd686d63740/payload-pre-processing/0.log"
Jul 08 21:56:52.083557 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:52.083532    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678w6jfj_a781ecff-a5bb-49bf-a5fb-899e6ecbaf6a/istio-proxy/0.log"
Jul 08 21:56:52.248078 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:52.248053    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-vv62j_10fcf54e-2728-4ef6-8770-5eee8b0c521e/discovery/0.log"
Jul 08 21:56:52.368001 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:52.367906    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-z6vwr_3e8fb17d-87f4-4915-8f6f-4dd686d63740/payload-pre-processing/0.log"
Jul 08 21:56:57.107658 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:57.107626    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2dxpp_1180d3c1-505c-468f-81bf-81224aac85b1/kube-multus/0.log"
Jul 08 21:56:57.333849 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:57.333815    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nq92z_e4b6b532-b51d-4685-b7d2-ddc06df5c56c/kube-multus-additional-cni-plugins/0.log"
Jul 08 21:56:57.359402 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:57.359282    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nq92z_e4b6b532-b51d-4685-b7d2-ddc06df5c56c/egress-router-binary-copy/0.log"
Jul 08 21:56:57.380817 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:57.380791    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nq92z_e4b6b532-b51d-4685-b7d2-ddc06df5c56c/cni-plugins/0.log"
Jul 08 21:56:57.402563 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:57.402530    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nq92z_e4b6b532-b51d-4685-b7d2-ddc06df5c56c/bond-cni-plugin/0.log"
Jul 08 21:56:57.426440 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:57.426410    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nq92z_e4b6b532-b51d-4685-b7d2-ddc06df5c56c/routeoverride-cni/0.log"
Jul 08 21:56:57.450647 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:57.450622    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nq92z_e4b6b532-b51d-4685-b7d2-ddc06df5c56c/whereabouts-cni-bincopy/0.log"
Jul 08 21:56:57.474886 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:57.474861    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nq92z_e4b6b532-b51d-4685-b7d2-ddc06df5c56c/whereabouts-cni/0.log"
Jul 08 21:56:57.786261 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:57.786234    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w5tkg_bcf041d9-9dcf-4edd-b480-dc0051905946/network-metrics-daemon/0.log"
Jul 08 21:56:57.804584 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:57.804562    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w5tkg_bcf041d9-9dcf-4edd-b480-dc0051905946/kube-rbac-proxy/0.log"
Jul 08 21:56:58.605855 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:58.605818    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fjtm_6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf/ovn-controller/0.log"
Jul 08 21:56:58.621209 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:58.621179    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fjtm_6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf/ovn-acl-logging/0.log"
Jul 08 21:56:58.650514 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:58.650481    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fjtm_6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf/kube-rbac-proxy-node/0.log"
Jul 08 21:56:58.675633 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:58.675611    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fjtm_6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf/kube-rbac-proxy-ovn-metrics/0.log"
Jul 08 21:56:58.692316 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:58.692291    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fjtm_6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf/northd/0.log"
Jul 08 21:56:58.711461 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:58.711445    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fjtm_6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf/nbdb/0.log"
Jul 08 21:56:58.731294 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:58.731274    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fjtm_6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf/sbdb/0.log"
Jul 08 21:56:58.803472 ip-10-0-143-138 kubenswrapper[2571]: I0708 21:56:58.803434    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fjtm_6f7a7b62-cbc8-4907-9a55-9bc0b8a89fbf/ovnkube-controller/0.log"