Jul 20 09:57:06.171164 ip-10-0-138-143 systemd[1]: Starting Kubernetes Kubelet...
Jul 20 09:57:06.576951 ip-10-0-138-143 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 09:57:06.576951 ip-10-0-138-143 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 20 09:57:06.576951 ip-10-0-138-143 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 09:57:06.576951 ip-10-0-138-143 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 20 09:57:06.576951 ip-10-0-138-143 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 09:57:06.576951 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.521263    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 20 09:57:06.576951 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527052    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 09:57:06.576951 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527067    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 09:57:06.576951 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527071    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 09:57:06.576951 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527075    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 09:57:06.576951 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527082    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 09:57:06.576951 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527086    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 09:57:06.576951 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527089    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 09:57:06.576951 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527092    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 09:57:06.578900 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527096    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 09:57:06.578900 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527099    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 09:57:06.578900 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527102    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 09:57:06.578900 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527105    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 09:57:06.578900 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527109    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 09:57:06.578900 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527111    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 09:57:06.578900 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527114    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 09:57:06.578900 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527117    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 09:57:06.578900 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527121    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 09:57:06.578900 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527123    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 09:57:06.578900 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527126    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 09:57:06.578900 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527129    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 09:57:06.578900 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527131    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 09:57:06.578900 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527134    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 09:57:06.578900 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527136    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 09:57:06.578900 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527147    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 09:57:06.578900 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527150    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 09:57:06.578900 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527152    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 09:57:06.578900 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527155    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 09:57:06.581018 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527158    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 09:57:06.581018 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527160    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 09:57:06.581018 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527162    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 09:57:06.581018 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527165    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 09:57:06.581018 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527169    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 09:57:06.581018 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527174    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 09:57:06.581018 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527177    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 09:57:06.581018 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527180    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 09:57:06.581018 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527182    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 09:57:06.581018 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527185    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 09:57:06.581018 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527187    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 09:57:06.581018 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527190    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 09:57:06.581018 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527193    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 09:57:06.581018 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527196    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 09:57:06.581018 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527200    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 09:57:06.581018 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527202    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 09:57:06.581018 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527205    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 09:57:06.581018 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527207    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 09:57:06.581018 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527210    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 09:57:06.582668 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527212    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 09:57:06.582668 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527214    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 09:57:06.582668 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527217    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 09:57:06.582668 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527219    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 09:57:06.582668 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527222    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 09:57:06.582668 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527224    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 09:57:06.582668 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527227    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 09:57:06.582668 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527230    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 09:57:06.582668 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527233    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 09:57:06.582668 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527235    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 09:57:06.582668 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527239    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 09:57:06.582668 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527241    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 09:57:06.582668 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527244    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 09:57:06.582668 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527246    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 09:57:06.582668 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527249    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 09:57:06.582668 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527251    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 09:57:06.582668 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527254    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 09:57:06.582668 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527257    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 09:57:06.582668 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527259    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 09:57:06.582668 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527263    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 09:57:06.584719 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527266    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 09:57:06.584719 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527269    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 09:57:06.584719 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527271    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 09:57:06.584719 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527273    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 09:57:06.584719 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527276    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 09:57:06.584719 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527279    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 09:57:06.584719 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527281    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 09:57:06.584719 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527284    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 09:57:06.584719 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527286    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 09:57:06.584719 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527289    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 09:57:06.584719 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527291    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 09:57:06.584719 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527294    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 09:57:06.584719 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527296    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 09:57:06.584719 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527299    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 09:57:06.584719 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527301    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 09:57:06.584719 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527304    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 09:57:06.584719 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527306    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 09:57:06.584719 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527309    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 09:57:06.584719 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527311    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 09:57:06.584719 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527314    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 09:57:06.586403 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527317    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 09:57:06.586403 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527319    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 09:57:06.586403 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527322    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 09:57:06.586403 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527325    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 09:57:06.586403 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527327    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 09:57:06.586403 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527330    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 09:57:06.586403 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527332    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 09:57:06.586403 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527335    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 09:57:06.586403 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527337    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 09:57:06.586403 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527341    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 09:57:06.586403 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527343    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 09:57:06.586403 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527346    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 09:57:06.586403 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.527348    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 09:57:06.586403 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.528118    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 09:57:06.586403 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.528126    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 09:57:06.586403 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.528130    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 09:57:06.586403 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.528133    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 09:57:06.586403 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.528136    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 09:57:06.586403 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.528139    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 09:57:06.586403 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.528142    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 09:57:06.588853 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.528145    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 09:57:06.588853 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.528148    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 09:57:06.588853 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.528151    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 09:57:06.588853 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.528154    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 09:57:06.588853 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.528157    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 09:57:06.588853 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.528159    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 09:57:06.588853 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.528162    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 09:57:06.588853 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.528164    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 09:57:06.588853 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.528167    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 09:57:06.588853 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.528169    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 09:57:06.588853 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.528172    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 09:57:06.588853 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.528175    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 09:57:06.588853 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.528177    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 09:57:06.588853 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.528180    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 09:57:06.588853 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.528182    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 09:57:06.588853 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.528185    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 09:57:06.588853 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.528226    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 09:57:06.588853 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.528270    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 09:57:06.588853 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.528275    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 09:57:06.588853 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.528280    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 09:57:06.590795 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.528286    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 09:57:06.590795 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529634    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 09:57:06.590795 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529776    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 09:57:06.590795 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529782    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 09:57:06.590795 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529786    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 09:57:06.590795 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529790    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 09:57:06.590795 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529793    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 09:57:06.590795 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529798    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 09:57:06.590795 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529802    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 09:57:06.590795 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529805    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 09:57:06.590795 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529809    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 09:57:06.590795 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529812    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 09:57:06.590795 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529815    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 09:57:06.590795 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529818    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 09:57:06.590795 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529820    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 09:57:06.590795 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529823    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 09:57:06.590795 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529826    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 09:57:06.590795 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529829    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 09:57:06.590795 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529832    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 09:57:06.590795 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529835    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 09:57:06.593191 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529838    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 09:57:06.593191 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529841    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 09:57:06.593191 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529844    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 09:57:06.593191 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529846    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 09:57:06.593191 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529849    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 09:57:06.593191 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529852    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 09:57:06.593191 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529855    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 09:57:06.593191 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529857    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 09:57:06.593191 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529865    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 09:57:06.593191 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529868    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 09:57:06.593191 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529871    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 09:57:06.593191 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529874    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 09:57:06.593191 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529893    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 09:57:06.593191 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529898    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 09:57:06.593191 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529901    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 09:57:06.593191 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529904    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 09:57:06.593191 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529907    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 09:57:06.593191 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529909    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 09:57:06.593191 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529913    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 09:57:06.594927 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529919    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 09:57:06.594927 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529921    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 09:57:06.594927 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529924    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 09:57:06.594927 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529927    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 09:57:06.594927 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529930    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 09:57:06.594927 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529935    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 09:57:06.594927 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529939    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 09:57:06.594927 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529942    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 09:57:06.594927 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529945    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 09:57:06.594927 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529948    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 09:57:06.594927 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529951    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 09:57:06.594927 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529953    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 09:57:06.594927 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529956    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 09:57:06.594927 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529959    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 09:57:06.594927 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529962    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 09:57:06.594927 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529964    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 09:57:06.594927 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529967    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 09:57:06.594927 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529970    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 09:57:06.594927 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529973    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 09:57:06.594927 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529975    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 09:57:06.597566 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529980    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 09:57:06.597566 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529983    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 09:57:06.597566 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529986    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 09:57:06.597566 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529989    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 09:57:06.597566 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529991    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 09:57:06.597566 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529993    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 09:57:06.597566 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529996    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 09:57:06.597566 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.529999    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 09:57:06.597566 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530001    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 09:57:06.597566 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530005    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 09:57:06.597566 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530008    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 09:57:06.597566 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530012    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 09:57:06.597566 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530016    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 09:57:06.597566 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530473    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 09:57:06.597566 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530479    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 09:57:06.597566 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530482    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 09:57:06.597566 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530486    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 09:57:06.597566 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530489    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 09:57:06.599369 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530492    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 09:57:06.599369 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530496    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 09:57:06.599369 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530499    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 09:57:06.599369 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530502    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 09:57:06.599369 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530505    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 09:57:06.599369 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530507    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 09:57:06.599369 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530510    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 09:57:06.599369 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530513    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 09:57:06.599369 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530516    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 09:57:06.599369 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530520    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 09:57:06.599369 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530523    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 09:57:06.599369 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530526    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 09:57:06.599369 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530529    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 09:57:06.599369 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530531    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 09:57:06.599369 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530534    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 09:57:06.599369 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530537    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 09:57:06.599369 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530539    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 09:57:06.599369 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530542    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 09:57:06.599369 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530545    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 09:57:06.599369 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530547    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 09:57:06.600716 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530550    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 09:57:06.600716 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530552    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 09:57:06.600716 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530555    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 09:57:06.600716 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530558    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 09:57:06.600716 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530560    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 09:57:06.600716 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530563    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 09:57:06.600716 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530565    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 09:57:06.600716 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530568    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 09:57:06.600716 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530570    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 09:57:06.600716 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530573    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 09:57:06.600716 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530575    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 09:57:06.600716 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530579    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 09:57:06.600716 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530582    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 09:57:06.600716 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530584    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 09:57:06.600716 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530587    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 09:57:06.600716 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530589    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 09:57:06.600716 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530592    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 09:57:06.600716 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530594    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 09:57:06.600716 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530597    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 09:57:06.600716 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530601    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 09:57:06.600465 ip-10-0-138-143 systemd[1]: Started Kubernetes Kubelet.
Jul 20 09:57:06.603968 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530604    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 09:57:06.603968 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530608    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 09:57:06.603968 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530611    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 09:57:06.603968 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530614    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 09:57:06.603968 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530617    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 09:57:06.603968 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530619    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 09:57:06.603968 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530622    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 09:57:06.603968 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530625    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 09:57:06.603968 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530627    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 09:57:06.603968 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530629    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 09:57:06.603968 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530632    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 09:57:06.603968 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530635    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 09:57:06.603968 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530638    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 09:57:06.603968 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530642    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 09:57:06.603968 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530645    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 09:57:06.603968 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530648    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 09:57:06.603968 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530651    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 09:57:06.603968 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530654    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 09:57:06.603968 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530656    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 09:57:06.617285 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530659    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 09:57:06.617285 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530662    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 09:57:06.617285 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530665    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 09:57:06.617285 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530668    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 09:57:06.617285 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530671    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 09:57:06.617285 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530673    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 09:57:06.617285 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530676    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 09:57:06.617285 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530678    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 09:57:06.617285 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530682    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 09:57:06.617285 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530684    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 09:57:06.617285 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530687    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 09:57:06.617285 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530689    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 09:57:06.617285 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530692    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 09:57:06.617285 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530694    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 09:57:06.617285 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530700    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 09:57:06.617285 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530703    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 09:57:06.617285 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530706    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 09:57:06.617285 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530718    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 09:57:06.617285 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530722    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 09:57:06.633643 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530724    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 09:57:06.633643 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530727    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 09:57:06.633643 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530732    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 09:57:06.633643 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530734    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 09:57:06.633643 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530738    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 09:57:06.633643 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530740    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 09:57:06.633643 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530743    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 09:57:06.633643 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530746    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 09:57:06.633643 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530748    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 09:57:06.633643 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530751    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 09:57:06.633643 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530753    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 09:57:06.633643 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530756    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 09:57:06.633643 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530758    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 09:57:06.633643 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530761    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 09:57:06.633643 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530764    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 09:57:06.633643 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.530766    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 09:57:06.633643 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530838    2561 flags.go:64] FLAG: --address="0.0.0.0"
Jul 20 09:57:06.633643 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530845    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 20 09:57:06.633643 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530851    2561 flags.go:64] FLAG: --anonymous-auth="true"
Jul 20 09:57:06.633643 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530856    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 20 09:57:06.633643 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530860    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 20 09:57:06.636343 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530863    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 20 09:57:06.636343 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530868    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 20 09:57:06.636343 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530873    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 20 09:57:06.636343 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530891    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 20 09:57:06.636343 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530895    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 20 09:57:06.636343 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530898    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 20 09:57:06.636343 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530903    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 20 09:57:06.636343 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530907    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 20 09:57:06.636343 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530909    2561 flags.go:64] FLAG: --cgroup-root=""
Jul 20 09:57:06.636343 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530912    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 20 09:57:06.636343 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530915    2561 flags.go:64] FLAG: --client-ca-file=""
Jul 20 09:57:06.636343 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530918    2561 flags.go:64] FLAG: --cloud-provider="external"
Jul 20 09:57:06.636343 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530921    2561 flags.go:64] FLAG: --cluster-dns="[]"
Jul 20 09:57:06.636343 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530928    2561 flags.go:64] FLAG: --cluster-domain=""
Jul 20 09:57:06.636343 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530931    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 20 09:57:06.636343 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530934    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 20 09:57:06.636343 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530937    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 20 09:57:06.636343 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530940    2561 flags.go:64] FLAG: --container-log-max-files="5"
Jul 20 09:57:06.636343 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530944    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 20 09:57:06.636343 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530947    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 20 09:57:06.636343 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530950    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 20 09:57:06.636343 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530953    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 20 09:57:06.636343 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530956    2561 flags.go:64] FLAG: --contention-profiling="false"
Jul 20 09:57:06.636343 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530959    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 20 09:57:06.639093 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530962    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 20 09:57:06.639093 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530966    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 20 09:57:06.639093 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530969    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 20 09:57:06.639093 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530973    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 20 09:57:06.639093 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530976    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 20 09:57:06.639093 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530978    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 20 09:57:06.639093 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530982    2561 flags.go:64] FLAG: --enable-load-reader="false"
Jul 20 09:57:06.639093 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530985    2561 flags.go:64] FLAG: --enable-server="true"
Jul 20 09:57:06.639093 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530988    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 20 09:57:06.639093 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530992    2561 flags.go:64] FLAG: --event-burst="100"
Jul 20 09:57:06.639093 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530995    2561 flags.go:64] FLAG: --event-qps="50"
Jul 20 09:57:06.639093 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.530998    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 20 09:57:06.639093 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531001    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 20 09:57:06.639093 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531004    2561 flags.go:64] FLAG: --eviction-hard=""
Jul 20 09:57:06.639093 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531014    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 20 09:57:06.639093 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531017    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 20 09:57:06.639093 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531020    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 20 09:57:06.639093 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531023    2561 flags.go:64] FLAG: --eviction-soft=""
Jul 20 09:57:06.639093 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531026    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 20 09:57:06.639093 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531029    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 20 09:57:06.639093 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531032    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 20 09:57:06.639093 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531036    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 20 09:57:06.639093 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531039    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 20 09:57:06.639093 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531042    2561 flags.go:64] FLAG: --fail-swap-on="true"
Jul 20 09:57:06.639093 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531045    2561 flags.go:64] FLAG: --feature-gates=""
Jul 20 09:57:06.643196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531049    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 20 09:57:06.643196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531052    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 20 09:57:06.643196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531055    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 20 09:57:06.643196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531058    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 20 09:57:06.643196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531062    2561 flags.go:64] FLAG: --healthz-port="10248"
Jul 20 09:57:06.643196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531064    2561 flags.go:64] FLAG: --help="false"
Jul 20 09:57:06.643196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531067    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-138-143.ec2.internal"
Jul 20 09:57:06.643196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531070    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 20 09:57:06.643196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531073    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 20 09:57:06.643196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531076    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 20 09:57:06.643196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531079    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 20 09:57:06.643196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531083    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 20 09:57:06.643196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531086    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 20 09:57:06.643196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531089    2561 flags.go:64] FLAG: --image-service-endpoint=""
Jul 20 09:57:06.643196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531091    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 20 09:57:06.643196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531094    2561 flags.go:64] FLAG: --kube-api-burst="100"
Jul 20 09:57:06.643196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531097    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 20 09:57:06.643196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531100    2561 flags.go:64] FLAG: --kube-api-qps="50"
Jul 20 09:57:06.643196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531104    2561 flags.go:64] FLAG: --kube-reserved=""
Jul 20 09:57:06.643196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531106    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 20 09:57:06.643196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531109    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 20 09:57:06.643196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531113    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 20 09:57:06.643196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531116    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 20 09:57:06.643196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531119    2561 flags.go:64] FLAG: --lock-file=""
Jul 20 09:57:06.826936 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531122    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 20 09:57:06.826936 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531125    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 20 09:57:06.826936 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531128    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 20 09:57:06.826936 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531133    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 20 09:57:06.826936 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531137    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 20 09:57:06.826936 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531140    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 20 09:57:06.826936 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531143    2561 flags.go:64] FLAG: --logging-format="text"
Jul 20 09:57:06.826936 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531146    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 20 09:57:06.826936 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531149    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 20 09:57:06.826936 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531152    2561 flags.go:64] FLAG: --manifest-url=""
Jul 20 09:57:06.826936 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531154    2561 flags.go:64] FLAG: --manifest-url-header=""
Jul 20 09:57:06.826936 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531159    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 20 09:57:06.826936 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531161    2561 flags.go:64] FLAG: --max-open-files="1000000"
Jul 20 09:57:06.826936 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531165    2561 flags.go:64] FLAG: --max-pods="110"
Jul 20 09:57:06.826936 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531168    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 20 09:57:06.826936 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531171    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 20 09:57:06.826936 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531174    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 20 09:57:06.826936 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531177    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 20 09:57:06.826936 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531180    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 20 09:57:06.826936 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531183    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 20 09:57:06.826936 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531186    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 20 09:57:06.826936 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531193    2561 flags.go:64] FLAG: --node-status-max-images="50"
Jul 20 09:57:06.826936 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531196    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 20 09:57:06.826936 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531199    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 20 09:57:06.826936 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531202    2561 flags.go:64] FLAG: --pod-cidr=""
Jul 20 09:57:06.828389 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531205    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 20 09:57:06.828389 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531211    2561 flags.go:64] FLAG: --pod-manifest-path=""
Jul 20 09:57:06.828389 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531214    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 20 09:57:06.828389 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531217    2561 flags.go:64] FLAG: --pods-per-core="0"
Jul 20 09:57:06.828389 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531220    2561 flags.go:64] FLAG: --port="10250"
Jul 20 09:57:06.828389 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531225    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 20 09:57:06.828389 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531228    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09eb47c8ff5112b1b"
Jul 20 09:57:06.828389 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531232    2561 flags.go:64] FLAG: --qos-reserved=""
Jul 20 09:57:06.828389 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531235    2561 flags.go:64] FLAG: --read-only-port="10255"
Jul 20 09:57:06.828389 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531237    2561 flags.go:64] FLAG: --register-node="true"
Jul 20 09:57:06.828389 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531241    2561 flags.go:64] FLAG: --register-with-taints=""
Jul 20 09:57:06.828389 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531246    2561 flags.go:64] FLAG: --registry-burst="10"
Jul 20 09:57:06.828389 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531249    2561 flags.go:64] FLAG: --registry-qps="5"
Jul 20 09:57:06.828389 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531252    2561 flags.go:64] FLAG: --reserved-cpus=""
Jul 20 09:57:06.828389 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531254    2561 flags.go:64] FLAG: --reserved-memory=""
Jul 20 09:57:06.828389 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531258    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 20 09:57:06.828389 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531261    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 20 09:57:06.828389 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531264    2561 flags.go:64] FLAG: --rotate-certificates="false"
Jul 20 09:57:06.828389 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531267    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 20 09:57:06.828389 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531269    2561 flags.go:64] FLAG: --runonce="false"
Jul 20 09:57:06.828389 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531272    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 20 09:57:06.828389 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531275    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 20 09:57:06.828389 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531278    2561 flags.go:64] FLAG: --seccomp-default="false"
Jul 20 09:57:06.828389 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531281    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 20 09:57:06.828389 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531283    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 20 09:57:06.831467 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531286    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 20 09:57:06.831467 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531290    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 20 09:57:06.831467 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531293    2561 flags.go:64] FLAG: --storage-driver-password="root"
Jul 20 09:57:06.831467 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531295    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 20 09:57:06.831467 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531298    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 20 09:57:06.831467 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531301    2561 flags.go:64] FLAG: --storage-driver-user="root"
Jul 20 09:57:06.831467 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531304    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 20 09:57:06.831467 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531307    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 20 09:57:06.831467 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531309    2561 flags.go:64] FLAG: --system-cgroups=""
Jul 20 09:57:06.831467 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531312    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 20 09:57:06.831467 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531318    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 20 09:57:06.831467 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531321    2561 flags.go:64] FLAG: --tls-cert-file=""
Jul 20 09:57:06.831467 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531325    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 20 09:57:06.831467 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531333    2561 flags.go:64] FLAG: --tls-min-version=""
Jul 20 09:57:06.831467 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531335    2561 flags.go:64] FLAG: --tls-private-key-file=""
Jul 20 09:57:06.831467 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531338    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 20 09:57:06.831467 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531341    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 20 09:57:06.831467 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531344    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 20 09:57:06.831467 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531349    2561 flags.go:64] FLAG: --v="2"
Jul 20 09:57:06.831467 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531353    2561 flags.go:64] FLAG: --version="false"
Jul 20 09:57:06.831467 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531357    2561 flags.go:64] FLAG: --vmodule=""
Jul 20 09:57:06.831467 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531361    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 20 09:57:06.831467 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.531364    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 20 09:57:06.831467 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531505    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 09:57:06.832240 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531511    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 09:57:06.832240 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531514    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 09:57:06.832240 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531517    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 09:57:06.832240 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531520    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 09:57:06.832240 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531523    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 09:57:06.832240 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531526    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 09:57:06.832240 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531528    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 09:57:06.832240 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531531    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 09:57:06.832240 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531533    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 09:57:06.832240 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531536    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 09:57:06.832240 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531539    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 09:57:06.832240 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531541    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 09:57:06.832240 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531544    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 09:57:06.832240 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531546    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 09:57:06.832240 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531549    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 09:57:06.832240 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531552    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 09:57:06.832240 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531554    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 09:57:06.832240 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531557    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 09:57:06.832240 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531559    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 09:57:06.832240 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531562    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 09:57:06.832836 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531566    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 09:57:06.832836 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531569    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 09:57:06.832836 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531572    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 09:57:06.832836 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531574    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 09:57:06.832836 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531577    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 09:57:06.832836 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531580    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 09:57:06.832836 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531584    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 09:57:06.832836 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531586    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 09:57:06.832836 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531589    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 09:57:06.832836 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531593    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 09:57:06.832836 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531597    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 09:57:06.832836 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531599    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 09:57:06.832836 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531602    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 09:57:06.832836 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531605    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 09:57:06.832836 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531608    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 09:57:06.832836 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531610    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 09:57:06.832836 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531623    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 09:57:06.832836 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531626    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 09:57:06.832836 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531629    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 09:57:06.832836 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531632    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 09:57:06.833467 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531634    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 09:57:06.833467 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531637    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 09:57:06.833467 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531639    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 09:57:06.833467 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531642    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 09:57:06.833467 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531644    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 09:57:06.833467 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531647    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 09:57:06.833467 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531649    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 09:57:06.833467 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531652    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 09:57:06.833467 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531654    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 09:57:06.833467 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531657    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 09:57:06.833467 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531660    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 09:57:06.833467 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531662    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 09:57:06.833467 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531667    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 09:57:06.833467 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531670    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 09:57:06.833467 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531673    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 09:57:06.833467 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531675    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 09:57:06.833467 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531678    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 09:57:06.833467 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531681    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 09:57:06.833467 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531684    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 09:57:06.834044 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531687    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 09:57:06.834044 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531690    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 09:57:06.834044 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531693    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 09:57:06.834044 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531695    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 09:57:06.834044 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531697    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 09:57:06.834044 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531700    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 09:57:06.834044 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531703    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 09:57:06.834044 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531705    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 09:57:06.834044 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531709    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 09:57:06.834044 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531712    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 09:57:06.834044 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531715    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 09:57:06.834044 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531718    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 09:57:06.834044 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531720    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 09:57:06.834044 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531735    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 09:57:06.834044 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531739    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 09:57:06.834044 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531742    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 09:57:06.834044 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531744    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 09:57:06.834044 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531747    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 09:57:06.834044 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531750    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 09:57:06.834044 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531753    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 09:57:06.834624 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531756    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 09:57:06.834624 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531758    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 09:57:06.834624 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531761    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 09:57:06.834624 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531764    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 09:57:06.834624 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531767    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 09:57:06.834624 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531771    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 09:57:06.834624 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531774    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 09:57:06.834624 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531777    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 09:57:06.834624 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531779    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 09:57:06.834624 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531782    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 09:57:06.834624 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531784    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 09:57:06.834624 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531788    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 09:57:06.834624 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531791    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 09:57:06.834624 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531794    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 09:57:06.834624 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531796    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 09:57:06.834624 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531799    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 09:57:06.834624 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531802    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 09:57:06.834624 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531805    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 09:57:06.834624 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.531807    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 09:57:06.835161 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.532410    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 09:57:06.835161 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.539205    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 20 09:57:06.835161 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.539230    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 20 09:57:06.835161 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.539248    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 20 09:57:06.835161 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.539254    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 20 09:57:06.835161 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539311    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 09:57:06.835161 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539317    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 09:57:06.835161 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539320    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 09:57:06.835161 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539324    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 09:57:06.835161 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539326    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 09:57:06.835161 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539329    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 09:57:06.835161 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539332    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 09:57:06.835161 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539335    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 09:57:06.835161 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539337    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 09:57:06.835161 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539344    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 09:57:06.835634 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539347    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 09:57:06.835634 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539350    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 09:57:06.835634 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539352    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 09:57:06.835634 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539355    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 09:57:06.835634 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539358    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 09:57:06.835634 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539361    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 09:57:06.835634 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539364    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 09:57:06.835634 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539366    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 09:57:06.835634 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539369    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 09:57:06.835634 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539372    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 09:57:06.835634 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539376    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 09:57:06.835634 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539380    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 09:57:06.835634 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539383    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 09:57:06.835634 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539386    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 09:57:06.835634 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539388    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 09:57:06.835634 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539391    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 09:57:06.835634 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539393    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 09:57:06.835634 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539396    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 09:57:06.835634 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539399    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 09:57:06.836170 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539404    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 09:57:06.836170 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539407    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 09:57:06.836170 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539409    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 09:57:06.836170 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539412    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 09:57:06.836170 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539415    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 09:57:06.836170 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539417    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 09:57:06.836170 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539420    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 09:57:06.836170 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539422    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 09:57:06.836170 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539425    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 09:57:06.836170 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539428    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 09:57:06.836170 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539430    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 09:57:06.836170 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539434    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 09:57:06.836170 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539437    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 09:57:06.836170 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539440    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 09:57:06.836170 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539443    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 09:57:06.836170 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539445    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 09:57:06.836170 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539448    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 09:57:06.836170 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539451    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 09:57:06.836170 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539453    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 09:57:06.836170 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539456    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 09:57:06.836742 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539458    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 09:57:06.836742 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539461    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 09:57:06.836742 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539463    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 09:57:06.836742 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539466    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 09:57:06.836742 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539469    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 09:57:06.836742 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539473    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 09:57:06.836742 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539477    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 09:57:06.836742 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539480    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 09:57:06.836742 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539483    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 09:57:06.836742 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539486    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 09:57:06.836742 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539489    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 09:57:06.836742 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539491    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 09:57:06.836742 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539495    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 09:57:06.836742 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539498    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 09:57:06.836742 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539501    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 09:57:06.836742 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539503    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 09:57:06.836742 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539506    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 09:57:06.836742 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539508    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 09:57:06.836742 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539511    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 09:57:06.837276 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539514    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 09:57:06.837276 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539516    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 09:57:06.837276 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539519    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 09:57:06.837276 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539521    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 09:57:06.837276 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539524    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 09:57:06.837276 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539527    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 09:57:06.837276 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539530    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 09:57:06.837276 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539533    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 09:57:06.837276 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539535    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 09:57:06.837276 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539538    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 09:57:06.837276 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539541    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 09:57:06.837276 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539544    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 09:57:06.837276 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539546    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 09:57:06.837276 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539549    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 09:57:06.837276 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539553    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 09:57:06.837276 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539556    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 09:57:06.837276 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539559    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 09:57:06.837276 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539562    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 09:57:06.837276 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539564    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 09:57:06.837827 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539566    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 09:57:06.837827 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539569    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 09:57:06.837827 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539572    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 09:57:06.837827 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539574    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 09:57:06.837827 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539577    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 09:57:06.837827 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539579    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 09:57:06.837827 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539583    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 09:57:06.837827 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539586    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 09:57:06.837827 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539589    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 09:57:06.837827 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539592    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 09:57:06.837827 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539594    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 09:57:06.837827 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539597    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 09:57:06.837827 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.539603    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 09:57:06.837827 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539747    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 09:57:06.837827 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539752    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 09:57:06.838341 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539756    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 09:57:06.838341 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539759    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 09:57:06.838341 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539761    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 09:57:06.838341 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539764    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 09:57:06.838341 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539768    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 09:57:06.838341 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539771    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 09:57:06.838341 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539774    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 09:57:06.838341 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539776    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 09:57:06.838341 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539779    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 09:57:06.838341 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539781    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 09:57:06.838341 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539784    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 09:57:06.838341 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539787    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 09:57:06.838341 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539789    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 09:57:06.838341 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539793    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 09:57:06.838341 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539796    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 09:57:06.838341 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539799    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 09:57:06.838341 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539802    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 09:57:06.838341 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539804    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 09:57:06.838341 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539807    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 09:57:06.839007 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539809    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 09:57:06.839007 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539812    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 09:57:06.839007 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539814    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 09:57:06.839007 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539817    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 09:57:06.839007 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539821    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 09:57:06.839007 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539823    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 09:57:06.839007 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539826    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 09:57:06.839007 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539829    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 09:57:06.839007 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539832    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 09:57:06.839007 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539834    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 09:57:06.839007 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539837    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 09:57:06.839007 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539840    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 09:57:06.839007 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539842    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 09:57:06.839007 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539845    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 09:57:06.839007 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539848    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 09:57:06.839007 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539850    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 09:57:06.839007 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539853    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 09:57:06.839007 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539856    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 09:57:06.839007 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539859    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 09:57:06.839007 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539861    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 09:57:07.046245 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539864    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 09:57:07.046245 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539867    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 09:57:07.046245 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539869    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 09:57:07.046245 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539872    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 09:57:07.046245 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539890    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 09:57:07.046245 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539893    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 09:57:07.046245 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539895    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 09:57:07.046245 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539898    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 09:57:07.046245 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539900    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 09:57:07.046245 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539903    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 09:57:07.046245 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539908    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 09:57:07.046245 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539911    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 09:57:07.046245 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539914    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 09:57:07.046245 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539917    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 09:57:07.046245 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539920    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 09:57:07.046245 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539923    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 09:57:07.046245 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539927    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 09:57:07.046245 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539930    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 09:57:07.046245 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539933    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 09:57:07.047142 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539935    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 09:57:07.047142 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539938    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 09:57:07.047142 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539941    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 09:57:07.047142 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539944    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 09:57:07.047142 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539946    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 09:57:07.047142 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539949    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 09:57:07.047142 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539951    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 09:57:07.047142 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539954    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 09:57:07.047142 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539956    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 09:57:07.047142 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539959    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 09:57:07.047142 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539963    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 09:57:07.047142 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539965    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 09:57:07.047142 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539968    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 09:57:07.047142 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539972    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 09:57:07.047142 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539975    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 09:57:07.047142 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539978    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 09:57:07.047142 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539981    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 09:57:07.047142 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539983    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 09:57:07.047142 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539986    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 09:57:07.047142 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539988    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 09:57:07.047798 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539991    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 09:57:07.047798 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539994    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 09:57:07.047798 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539997    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 09:57:07.047798 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.539999    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 09:57:07.047798 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.540002    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 09:57:07.047798 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.540004    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 09:57:07.047798 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.540007    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 09:57:07.047798 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.540009    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 09:57:07.047798 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.540012    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 09:57:07.047798 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.540016    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 09:57:07.047798 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.540018    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 09:57:07.047798 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.540021    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 09:57:07.047798 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.540024    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 09:57:07.047798 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.540026    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 09:57:07.047798 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.540029    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 09:57:07.047798 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.540032    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 09:57:07.047798 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.540034    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 09:57:07.047798 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.540037    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 09:57:07.047798 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:06.540039    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 09:57:07.048361 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.540044    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 09:57:07.048361 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.540157    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 20 09:57:07.048361 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.542816    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 20 09:57:07.048361 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.544143    2561 server.go:1019] "Starting client certificate rotation"
Jul 20 09:57:07.048361 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.544247    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 09:57:07.048361 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.544280    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 09:57:07.048361 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.546329    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 09:57:07.048361 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.547512    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 09:57:07.048361 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.562628    2561 log.go:25] "Validated CRI v1 runtime API"
Jul 20 09:57:07.048361 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.564842    2561 log.go:25] "Validated CRI v1 image API"
Jul 20 09:57:07.048361 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.565600    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 20 09:57:07.048361 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.567777    2561 fs.go:135] Filesystem UUIDs: map[5b7e9f7f-04ae-4ebd-96e7-8372f3532dd0:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9aacc12b-661c-43e8-ba88-391ea42fba07:/dev/nvme0n1p3]
Jul 20 09:57:07.048716 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.567791    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 20 09:57:07.048716 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.572761    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 09:57:07.049354 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.573960    2561 manager.go:216] Machine: {Timestamp:2026-07-20 09:57:06.572714833 +0000 UTC m=+0.289630114 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3120591 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec283165bc367e8f4b57aaf989af2079 SystemUUID:ec283165-bc36-7e8f-4b57-aaf989af2079 BootID:b51b34b6-438e-4956-bafb-e942c1caf340 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:42:aa:86:54:c5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:42:aa:86:54:c5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:d0:ef:0b:4c:0c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 20 09:57:07.049354 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.574064    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 20 09:57:07.049354 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.574136    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 20 09:57:07.049354 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.577583    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 20 09:57:07.049354 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.577606    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-143.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 20 09:57:07.049354 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.578353    2561 topology_manager.go:138] "Creating topology manager with none policy"
Jul 20 09:57:07.049354 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.578363    2561 container_manager_linux.go:309] "Creating device plugin manager"
Jul 20 09:57:07.049354 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.578372    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 09:57:07.049354 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.578975    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 09:57:07.049354 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.580992    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 20 09:57:07.049354 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.585963    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 09:57:07.049354 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.586218    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 20 09:57:07.049354 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.586241    2561 kubelet.go:486] "Attempting to sync node with API server"
Jul 20 09:57:07.049354 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.586251    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 20 09:57:07.049354 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.586263    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 20 09:57:07.049354 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.586272    2561 kubelet.go:398] "Adding apiserver pod source"
Jul 20 09:57:07.049354 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.586280    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 20 09:57:07.049354 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.586577    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.586592    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.591642    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.593300    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.593328    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.594042    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.594058    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.594066    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.594072    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.594080    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.594086    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.594164    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.594170    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.594177    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.594182    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.594191    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.594198    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.595622    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.595634    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.597707    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g5qhs"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.597951    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-143.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:06.597978    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:06.598013    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-143.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.599609    2561 server.go:1268] "Started kubelet"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.599687    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.599691    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.599761    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.601404    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.602009    2561 server.go:310] "Adding debug handlers to kubelet server"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:06.605377    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.605835    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g5qhs"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.611703    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.611713    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:06.611845    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-143.ec2.internal\" not found"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.612630    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.612635    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.612781    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.612806    2561 factory.go:55] Registering systemd factory
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.612844    2561 factory.go:223] Registration of the systemd container factory successfully
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.612930    2561 reconstruct.go:97] "Volume reconstruction finished"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.612941    2561 reconciler.go:29] "Reconciler: start to sync state"
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.613234    2561 factory.go:153] Registering CRI-O factory
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.613261    2561 factory.go:223] Registration of the crio container factory successfully
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.613312    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.613334    2561 factory.go:103] Registering Raw factory
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.613356    2561 manager.go:1196] Started watching for new ooms in manager
Jul 20 09:57:07.049934 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.613978    2561 manager.go:349] Starting recovery of all containers
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:06.613753    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-143.ec2.internal.18c3f6f8fb6fe032  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-143.ec2.internal,UID:ip-10-0-138-143.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-143.ec2.internal,},FirstTimestamp:2026-07-20 09:57:06.599583794 +0000 UTC m=+0.316499054,LastTimestamp:2026-07-20 09:57:06.599583794 +0000 UTC m=+0.316499054,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-143.ec2.internal,}"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.625746    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.627201    2561 manager.go:354] Recovery completed
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:06.628732    2561 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-143.ec2.internal\" not found" node="ip-10-0-138-143.ec2.internal"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.632058    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.634070    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.634102    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.634117    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientPID"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.634706    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.634718    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.634735    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.634752    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.635752    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.635773    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.635786    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientPID"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.636928    2561 policy_none.go:49] "None policy: Start"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.636943    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.636953    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.638917    2561 policy_none.go:47] "Start"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.669415    2561 manager.go:337] "Starting Device Plugin manager"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:06.669445    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.669454    2561 server.go:87] "Starting device plugin registration server"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.669753    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.669763    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.669860    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.669950    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.669959    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:06.670475    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:06.670528    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-143.ec2.internal\" not found"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.736401    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.737617    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.737657    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.737680    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:06.737717    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.740585    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.770143    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.771061    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.771090    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.771104    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientPID"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.771134    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-143.ec2.internal"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.782909    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-143.ec2.internal"
Jul 20 09:57:07.263335 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:06.782929    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-143.ec2.internal\": node \"ip-10-0-138-143.ec2.internal\" not found"
Jul 20 09:57:07.265196 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:06.798456    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-143.ec2.internal\" not found"
Jul 20 09:57:07.265196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.838747    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal"]
Jul 20 09:57:07.265196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.838823    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 09:57:07.265196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.840867    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 09:57:07.265196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.840910    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 09:57:07.265196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.840923    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientPID"
Jul 20 09:57:07.265196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.842952    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 09:57:07.265196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.843069    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal"
Jul 20 09:57:07.265196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.843097    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 09:57:07.265196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.843735    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 09:57:07.265196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.843756    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 09:57:07.265196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.843773    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientPID"
Jul 20 09:57:07.265196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.844164    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 09:57:07.265196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.844182    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 09:57:07.265196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.844190    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientPID"
Jul 20 09:57:07.265196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.846239    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal"
Jul 20 09:57:07.265196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.846260    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 09:57:07.265196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.846873    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 09:57:07.265196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.846911    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 09:57:07.265196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.846923    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientPID"
Jul 20 09:57:07.265196 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:06.875491    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-143.ec2.internal\" not found" node="ip-10-0-138-143.ec2.internal"
Jul 20 09:57:07.265196 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:06.879806    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-143.ec2.internal\" not found" node="ip-10-0-138-143.ec2.internal"
Jul 20 09:57:07.265196 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:06.899259    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-143.ec2.internal\" not found"
Jul 20 09:57:07.265196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.915035    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1887ae439b2a3b9cf7ae9dd23a2eb4c4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal\" (UID: \"1887ae439b2a3b9cf7ae9dd23a2eb4c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal"
Jul 20 09:57:07.265196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.915056    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1887ae439b2a3b9cf7ae9dd23a2eb4c4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal\" (UID: \"1887ae439b2a3b9cf7ae9dd23a2eb4c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal"
Jul 20 09:57:07.265196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:06.915074    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b627e4843adfbd64039515f41cb64e53-config\") pod \"kube-apiserver-proxy-ip-10-0-138-143.ec2.internal\" (UID: \"b627e4843adfbd64039515f41cb64e53\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal"
Jul 20 09:57:07.265196 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:06.999775    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-143.ec2.internal\" not found"
Jul 20 09:57:07.265196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:07.016114    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1887ae439b2a3b9cf7ae9dd23a2eb4c4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal\" (UID: \"1887ae439b2a3b9cf7ae9dd23a2eb4c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal"
Jul 20 09:57:07.265196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:07.016140    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1887ae439b2a3b9cf7ae9dd23a2eb4c4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal\" (UID: \"1887ae439b2a3b9cf7ae9dd23a2eb4c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal"
Jul 20 09:57:07.266037 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:07.016159    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b627e4843adfbd64039515f41cb64e53-config\") pod \"kube-apiserver-proxy-ip-10-0-138-143.ec2.internal\" (UID: \"b627e4843adfbd64039515f41cb64e53\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal"
Jul 20 09:57:07.266037 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:07.016220    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1887ae439b2a3b9cf7ae9dd23a2eb4c4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal\" (UID: \"1887ae439b2a3b9cf7ae9dd23a2eb4c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal"
Jul 20 09:57:07.266037 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:07.016282    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b627e4843adfbd64039515f41cb64e53-config\") pod \"kube-apiserver-proxy-ip-10-0-138-143.ec2.internal\" (UID: \"b627e4843adfbd64039515f41cb64e53\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal"
Jul 20 09:57:07.266037 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:07.016319    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1887ae439b2a3b9cf7ae9dd23a2eb4c4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal\" (UID: \"1887ae439b2a3b9cf7ae9dd23a2eb4c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal"
Jul 20 09:57:07.266037 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:07.100515    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-143.ec2.internal\" not found"
Jul 20 09:57:07.266037 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:07.178002    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal"
Jul 20 09:57:07.266037 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:07.185104    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal"
Jul 20 09:57:07.266037 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:07.200749    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-143.ec2.internal\" not found"
Jul 20 09:57:07.383826 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:07.301301    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-143.ec2.internal\" not found"
Jul 20 09:57:07.480822 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:07.401830    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-143.ec2.internal\" not found"
Jul 20 09:57:07.578651 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:07.502410    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-143.ec2.internal\" not found"
Jul 20 09:57:07.578651 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:07.543932    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 20 09:57:07.578651 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:07.544068    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 09:57:07.578651 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:07.544104    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 09:57:07.681754 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:07.603245    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-143.ec2.internal\" not found"
Jul 20 09:57:07.681754 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:07.614196    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 09:52:07 +0000 UTC" deadline="2028-04-06 07:18:34.524651124 +0000 UTC"
Jul 20 09:57:07.681754 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:07.614225    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15021h21m26.91042937s"
Jul 20 09:57:07.791683 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:07.703629    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-143.ec2.internal\" not found"
Jul 20 09:57:07.805255 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:07.804751    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-143.ec2.internal\" not found"
Jul 20 09:57:07.906477 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:07.905361    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-143.ec2.internal\" not found"
Jul 20 09:57:08.025378 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:07.971680    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 09:57:08.025378 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.011991    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal"
Jul 20 09:57:08.025378 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.022712    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 09:57:08.025378 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.024429    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal"
Jul 20 09:57:08.036408 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.035596    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 09:57:08.145709 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.071577    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.587507    2561 apiserver.go:52] "Watching apiserver"
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.593125    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.594336    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhm69","openshift-cluster-node-tuning-operator/tuned-hbqt8","openshift-dns/node-resolver-hp5fq","openshift-image-registry/node-ca-gxfkw","openshift-multus/multus-9msk6","openshift-network-operator/iptables-alerter-xbpjz","openshift-ovn-kubernetes/ovnkube-node-d48r5","kube-system/global-pull-secret-syncer-29gzc","kube-system/konnectivity-agent-6bh7x","kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal","openshift-multus/multus-additional-cni-plugins-gx8fw","openshift-multus/network-metrics-daemon-w778v","openshift-network-diagnostics/network-check-target-gr6fz"]
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.597113    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.599537    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.599830    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wjjfp\""
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.599839    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.600282    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.600314    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:08.600347    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w778v" podUID="10552df3-551a-4023-ad75-003c6559ce60"
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.600661    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.600982    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.601139    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.602874    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hp5fq"
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.605109    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jc2l2\""
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.605357    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.605440    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.606687    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gxfkw"
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.609011    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.611238    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xbpjz"
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.612224    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.613479    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6bh7x"
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.615951    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhm69"
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.616082    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.616152    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.616391    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.616398    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.616494    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.616592    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.616604    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.616619    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.616631    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-99d92\""
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.616500    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z7hcn\""
Jul 20 09:57:08.623144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.616914    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 20 09:57:08.625322 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.616999    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xd8hj\""
Jul 20 09:57:08.625322 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.617028    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rzlrp\""
Jul 20 09:57:08.625322 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.617035    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 20 09:57:08.625322 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.617428    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 20 09:57:08.625322 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.617789    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 20 09:57:08.625322 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.617911    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 20 09:57:08.625322 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.618142    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-h84g7\""
Jul 20 09:57:08.625322 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.618400    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 20 09:57:08.625322 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.618608    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.625322 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.619202    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 20 09:57:08.625322 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.620787    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 20 09:57:08.625322 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.620826    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 20 09:57:08.625322 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.621000    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ls47k\""
Jul 20 09:57:08.625322 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.621222    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:57:08.625322 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:08.621268    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gr6fz" podUID="d8343adb-7f45-419c-b894-e9b307ecb5fd"
Jul 20 09:57:08.625322 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624013    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:08.625322 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:08.624066    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gzc" podUID="559d8262-0cc6-4900-a6d2-52167877eb3c"
Jul 20 09:57:08.625322 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624161    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10552df3-551a-4023-ad75-003c6559ce60-metrics-certs\") pod \"network-metrics-daemon-w778v\" (UID: \"10552df3-551a-4023-ad75-003c6559ce60\") " pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:57:08.625322 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624181    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-host-var-lib-kubelet\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.625322 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624205    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-etc-openvswitch\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.625322 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624227    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-run-openvswitch\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.625322 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624254    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-ovn-node-metrics-cert\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.625322 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624272    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/74a3c5ba-e636-47df-b3cd-1ad53902bc5a-hosts-file\") pod \"node-resolver-hp5fq\" (UID: \"74a3c5ba-e636-47df-b3cd-1ad53902bc5a\") " pod="openshift-dns/node-resolver-hp5fq"
Jul 20 09:57:08.625322 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624293    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b63f200f-1a84-43ec-95f8-d33f0f50cc20-konnectivity-ca\") pod \"konnectivity-agent-6bh7x\" (UID: \"b63f200f-1a84-43ec-95f8-d33f0f50cc20\") " pod="kube-system/konnectivity-agent-6bh7x"
Jul 20 09:57:08.627735 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624337    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82acb4fa-dae4-4dfd-b56b-b4df34feddd4-host-slash\") pod \"iptables-alerter-xbpjz\" (UID: \"82acb4fa-dae4-4dfd-b56b-b4df34feddd4\") " pod="openshift-network-operator/iptables-alerter-xbpjz"
Jul 20 09:57:08.627735 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624367    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42664\" (UniqueName: \"kubernetes.io/projected/82acb4fa-dae4-4dfd-b56b-b4df34feddd4-kube-api-access-42664\") pod \"iptables-alerter-xbpjz\" (UID: \"82acb4fa-dae4-4dfd-b56b-b4df34feddd4\") " pod="openshift-network-operator/iptables-alerter-xbpjz"
Jul 20 09:57:08.627735 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624389    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-run-ovn\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.627735 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624416    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.627735 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624443    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm9db\" (UniqueName: \"kubernetes.io/projected/74a3c5ba-e636-47df-b3cd-1ad53902bc5a-kube-api-access-jm9db\") pod \"node-resolver-hp5fq\" (UID: \"74a3c5ba-e636-47df-b3cd-1ad53902bc5a\") " pod="openshift-dns/node-resolver-hp5fq"
Jul 20 09:57:08.627735 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624472    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-hostroot\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.627735 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624488    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/82acb4fa-dae4-4dfd-b56b-b4df34feddd4-iptables-alerter-script\") pod \"iptables-alerter-xbpjz\" (UID: \"82acb4fa-dae4-4dfd-b56b-b4df34feddd4\") " pod="openshift-network-operator/iptables-alerter-xbpjz"
Jul 20 09:57:08.627735 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624512    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-systemd-units\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.627735 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624535    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-host-slash\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.627735 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624556    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-host-run-netns\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.627735 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624595    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-run-systemd\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.627735 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624631    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-host-run-ovn-kubernetes\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.627735 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624659    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7e59906-508b-40d8-a8e4-4244d7c1cbbd-host\") pod \"node-ca-gxfkw\" (UID: \"c7e59906-508b-40d8-a8e4-4244d7c1cbbd\") " pod="openshift-image-registry/node-ca-gxfkw"
Jul 20 09:57:08.627735 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624685    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-os-release\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.627735 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624707    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-multus-socket-dir-parent\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.627735 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624729    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlf4c\" (UniqueName: \"kubernetes.io/projected/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-kube-api-access-qlf4c\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.628569 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624752    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-host-cni-bin\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.628569 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624775    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-ovnkube-script-lib\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.628569 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624799    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c7e59906-508b-40d8-a8e4-4244d7c1cbbd-serviceca\") pod \"node-ca-gxfkw\" (UID: \"c7e59906-508b-40d8-a8e4-4244d7c1cbbd\") " pod="openshift-image-registry/node-ca-gxfkw"
Jul 20 09:57:08.628569 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624821    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mwk6\" (UniqueName: \"kubernetes.io/projected/c7e59906-508b-40d8-a8e4-4244d7c1cbbd-kube-api-access-2mwk6\") pod \"node-ca-gxfkw\" (UID: \"c7e59906-508b-40d8-a8e4-4244d7c1cbbd\") " pod="openshift-image-registry/node-ca-gxfkw"
Jul 20 09:57:08.628569 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624844    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-host-run-k8s-cni-cncf-io\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.628569 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624866    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-host-run-netns\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.628569 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624917    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-host-var-lib-cni-bin\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.628569 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624918    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 09:57:08.628569 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624942    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-host-run-multus-certs\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.628569 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.624981    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-node-log\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.628569 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.625007    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-multus-cni-dir\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.628569 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.625031    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-host-var-lib-cni-multus\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.628569 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.625056    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-etc-kubernetes\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.628569 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.625078    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-log-socket\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.628569 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.625100    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-host-cni-netd\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.628569 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.625123    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-ovnkube-config\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.628569 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.625150    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvh8p\" (UniqueName: \"kubernetes.io/projected/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-kube-api-access-jvh8p\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.629780 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.625176    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxr67\" (UniqueName: \"kubernetes.io/projected/10552df3-551a-4023-ad75-003c6559ce60-kube-api-access-zxr67\") pod \"network-metrics-daemon-w778v\" (UID: \"10552df3-551a-4023-ad75-003c6559ce60\") " pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:57:08.629780 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.625207    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-system-cni-dir\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.629780 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.625231    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-cni-binary-copy\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.629780 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.625255    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-multus-conf-dir\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.629780 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.625278    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-host-kubelet\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.629780 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.625317    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-var-lib-openvswitch\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.629780 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.625343    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b63f200f-1a84-43ec-95f8-d33f0f50cc20-agent-certs\") pod \"konnectivity-agent-6bh7x\" (UID: \"b63f200f-1a84-43ec-95f8-d33f0f50cc20\") " pod="kube-system/konnectivity-agent-6bh7x"
Jul 20 09:57:08.629780 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.625363    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-cnibin\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.629780 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.625384    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-multus-daemon-config\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.629780 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.625404    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-env-overrides\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.629780 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.625423    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74a3c5ba-e636-47df-b3cd-1ad53902bc5a-tmp-dir\") pod \"node-resolver-hp5fq\" (UID: \"74a3c5ba-e636-47df-b3cd-1ad53902bc5a\") " pod="openshift-dns/node-resolver-hp5fq"
Jul 20 09:57:08.629780 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.626724    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gx8fw"
Jul 20 09:57:08.629780 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.628695    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 20 09:57:08.629780 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.628726    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6xb22\""
Jul 20 09:57:08.629780 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.628832    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 20 09:57:08.653800 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.653770    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hx8lf"
Jul 20 09:57:08.664944 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.664924    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hx8lf"
Jul 20 09:57:08.713684 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.713651    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 20 09:57:08.726475 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.726443    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxgks\" (UniqueName: \"kubernetes.io/projected/ad8a980a-797b-413a-9a49-c8d2fd36e4f5-kube-api-access-fxgks\") pod \"multus-additional-cni-plugins-gx8fw\" (UID: \"ad8a980a-797b-413a-9a49-c8d2fd36e4f5\") " pod="openshift-multus/multus-additional-cni-plugins-gx8fw"
Jul 20 09:57:08.726475 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.726489    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10552df3-551a-4023-ad75-003c6559ce60-metrics-certs\") pod \"network-metrics-daemon-w778v\" (UID: \"10552df3-551a-4023-ad75-003c6559ce60\") " pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:57:08.726763 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.726517    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-host-var-lib-kubelet\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.726763 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.726542    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-run-openvswitch\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.726763 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.726567    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-ovn-node-metrics-cert\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.726763 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.726569    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-host-var-lib-kubelet\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.726763 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.726592    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/74a3c5ba-e636-47df-b3cd-1ad53902bc5a-hosts-file\") pod \"node-resolver-hp5fq\" (UID: \"74a3c5ba-e636-47df-b3cd-1ad53902bc5a\") " pod="openshift-dns/node-resolver-hp5fq"
Jul 20 09:57:08.726763 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.726617    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-run\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.726763 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:08.726630    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 09:57:08.726763 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.726636    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-run-openvswitch\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.726763 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.726640    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad8a980a-797b-413a-9a49-c8d2fd36e4f5-cnibin\") pod \"multus-additional-cni-plugins-gx8fw\" (UID: \"ad8a980a-797b-413a-9a49-c8d2fd36e4f5\") " pod="openshift-multus/multus-additional-cni-plugins-gx8fw"
Jul 20 09:57:08.726763 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.726663    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/74a3c5ba-e636-47df-b3cd-1ad53902bc5a-hosts-file\") pod \"node-resolver-hp5fq\" (UID: \"74a3c5ba-e636-47df-b3cd-1ad53902bc5a\") " pod="openshift-dns/node-resolver-hp5fq"
Jul 20 09:57:08.726763 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.726695    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ad8a980a-797b-413a-9a49-c8d2fd36e4f5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gx8fw\" (UID: \"ad8a980a-797b-413a-9a49-c8d2fd36e4f5\") " pod="openshift-multus/multus-additional-cni-plugins-gx8fw"
Jul 20 09:57:08.726763 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:08.726710    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10552df3-551a-4023-ad75-003c6559ce60-metrics-certs podName:10552df3-551a-4023-ad75-003c6559ce60 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:09.226688952 +0000 UTC m=+2.943604218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10552df3-551a-4023-ad75-003c6559ce60-metrics-certs") pod "network-metrics-daemon-w778v" (UID: "10552df3-551a-4023-ad75-003c6559ce60") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 09:57:08.726763 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.726746    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82acb4fa-dae4-4dfd-b56b-b4df34feddd4-host-slash\") pod \"iptables-alerter-xbpjz\" (UID: \"82acb4fa-dae4-4dfd-b56b-b4df34feddd4\") " pod="openshift-network-operator/iptables-alerter-xbpjz"
Jul 20 09:57:08.726763 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.726771    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42664\" (UniqueName: \"kubernetes.io/projected/82acb4fa-dae4-4dfd-b56b-b4df34feddd4-kube-api-access-42664\") pod \"iptables-alerter-xbpjz\" (UID: \"82acb4fa-dae4-4dfd-b56b-b4df34feddd4\") " pod="openshift-network-operator/iptables-alerter-xbpjz"
Jul 20 09:57:08.727752 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.726794    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-run-ovn\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.727752 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.726817    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ad8a980a-797b-413a-9a49-c8d2fd36e4f5-os-release\") pod \"multus-additional-cni-plugins-gx8fw\" (UID: \"ad8a980a-797b-413a-9a49-c8d2fd36e4f5\") " pod="openshift-multus/multus-additional-cni-plugins-gx8fw"
Jul 20 09:57:08.727752 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.726832    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82acb4fa-dae4-4dfd-b56b-b4df34feddd4-host-slash\") pod \"iptables-alerter-xbpjz\" (UID: \"82acb4fa-dae4-4dfd-b56b-b4df34feddd4\") " pod="openshift-network-operator/iptables-alerter-xbpjz"
Jul 20 09:57:08.727752 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.726842    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-systemd-units\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.727752 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.726885    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-run-ovn\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.727752 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.726883    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-systemd-units\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.727752 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.726877    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-host-slash\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.727752 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.726930    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-host-slash\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.727752 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.726940    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-host-run-ovn-kubernetes\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.727752 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.726965    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-host-cni-bin\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.727752 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.726993    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-host-run-ovn-kubernetes\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.727752 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.726993    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-var-lib-kubelet\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.727752 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727031    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-host-cni-bin\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.727752 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727035    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-os-release\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.727752 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727063    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlf4c\" (UniqueName: \"kubernetes.io/projected/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-kube-api-access-qlf4c\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.727752 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727094    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-os-release\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.727752 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727090    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c7e59906-508b-40d8-a8e4-4244d7c1cbbd-serviceca\") pod \"node-ca-gxfkw\" (UID: \"c7e59906-508b-40d8-a8e4-4244d7c1cbbd\") " pod="openshift-image-registry/node-ca-gxfkw"
Jul 20 09:57:08.727752 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727201    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mwk6\" (UniqueName: \"kubernetes.io/projected/c7e59906-508b-40d8-a8e4-4244d7c1cbbd-kube-api-access-2mwk6\") pod \"node-ca-gxfkw\" (UID: \"c7e59906-508b-40d8-a8e4-4244d7c1cbbd\") " pod="openshift-image-registry/node-ca-gxfkw"
Jul 20 09:57:08.728619 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727219    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-host-run-k8s-cni-cncf-io\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.728619 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727235    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-host-run-netns\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.728619 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727252    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-host-var-lib-cni-bin\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.728619 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727266    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-host-run-multus-certs\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.728619 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727290    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-node-log\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.728619 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727299    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-host-run-k8s-cni-cncf-io\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.728619 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727330    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-host-run-netns\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.728619 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727338    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-host-var-lib-cni-bin\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.728619 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727358    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-multus-cni-dir\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.728619 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727384    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-log-socket\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.728619 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727409    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-ovnkube-config\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.728619 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727340    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-host-run-multus-certs\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.728619 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727434    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9886560c-baa6-48cf-a2a9-cb7047d2771e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fhm69\" (UID: \"9886560c-baa6-48cf-a2a9-cb7047d2771e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhm69"
Jul 20 09:57:08.728619 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727434    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-multus-cni-dir\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.728619 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727459    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-log-socket\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.728619 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727339    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-node-log\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.728619 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727481    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-etc-modprobe-d\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.728619 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727505    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-etc-sysctl-d\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.729393 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727520    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-host\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.729393 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727537    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/762b4f6c-bad2-4382-a8c3-6944d0177fd3-etc-tuned\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.729393 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727568    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxr67\" (UniqueName: \"kubernetes.io/projected/10552df3-551a-4023-ad75-003c6559ce60-kube-api-access-zxr67\") pod \"network-metrics-daemon-w778v\" (UID: \"10552df3-551a-4023-ad75-003c6559ce60\") " pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:57:08.729393 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727611    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-host-kubelet\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.729393 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727704    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-host-kubelet\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.729393 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727710    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-var-lib-openvswitch\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.729393 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727744    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b63f200f-1a84-43ec-95f8-d33f0f50cc20-agent-certs\") pod \"konnectivity-agent-6bh7x\" (UID: \"b63f200f-1a84-43ec-95f8-d33f0f50cc20\") " pod="kube-system/konnectivity-agent-6bh7x"
Jul 20 09:57:08.729393 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727781    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-var-lib-openvswitch\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.729393 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727780    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9886560c-baa6-48cf-a2a9-cb7047d2771e-registration-dir\") pod \"aws-ebs-csi-driver-node-fhm69\" (UID: \"9886560c-baa6-48cf-a2a9-cb7047d2771e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhm69"
Jul 20 09:57:08.729393 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727833    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgchf\" (UniqueName: \"kubernetes.io/projected/9886560c-baa6-48cf-a2a9-cb7047d2771e-kube-api-access-sgchf\") pod \"aws-ebs-csi-driver-node-fhm69\" (UID: \"9886560c-baa6-48cf-a2a9-cb7047d2771e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhm69"
Jul 20 09:57:08.729393 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727853    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/559d8262-0cc6-4900-a6d2-52167877eb3c-kubelet-config\") pod \"global-pull-secret-syncer-29gzc\" (UID: \"559d8262-0cc6-4900-a6d2-52167877eb3c\") " pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:08.729393 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727870    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-env-overrides\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.729393 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727886    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9886560c-baa6-48cf-a2a9-cb7047d2771e-device-dir\") pod \"aws-ebs-csi-driver-node-fhm69\" (UID: \"9886560c-baa6-48cf-a2a9-cb7047d2771e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhm69"
Jul 20 09:57:08.729393 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727949    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-sys\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.729393 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.727980    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/559d8262-0cc6-4900-a6d2-52167877eb3c-dbus\") pod \"global-pull-secret-syncer-29gzc\" (UID: \"559d8262-0cc6-4900-a6d2-52167877eb3c\") " pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:08.729393 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728003    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-etc-openvswitch\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.729393 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728047    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b63f200f-1a84-43ec-95f8-d33f0f50cc20-konnectivity-ca\") pod \"konnectivity-agent-6bh7x\" (UID: \"b63f200f-1a84-43ec-95f8-d33f0f50cc20\") " pod="kube-system/konnectivity-agent-6bh7x"
Jul 20 09:57:08.730086 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728071    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-etc-openvswitch\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.730086 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728088    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9886560c-baa6-48cf-a2a9-cb7047d2771e-etc-selinux\") pod \"aws-ebs-csi-driver-node-fhm69\" (UID: \"9886560c-baa6-48cf-a2a9-cb7047d2771e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhm69"
Jul 20 09:57:08.730086 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728114    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.730086 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728134    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm9db\" (UniqueName: \"kubernetes.io/projected/74a3c5ba-e636-47df-b3cd-1ad53902bc5a-kube-api-access-jm9db\") pod \"node-resolver-hp5fq\" (UID: \"74a3c5ba-e636-47df-b3cd-1ad53902bc5a\") " pod="openshift-dns/node-resolver-hp5fq"
Jul 20 09:57:08.730086 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728151    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-hostroot\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.730086 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728195    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.730086 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728200    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-hostroot\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.730086 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728238    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/82acb4fa-dae4-4dfd-b56b-b4df34feddd4-iptables-alerter-script\") pod \"iptables-alerter-xbpjz\" (UID: \"82acb4fa-dae4-4dfd-b56b-b4df34feddd4\") " pod="openshift-network-operator/iptables-alerter-xbpjz"
Jul 20 09:57:08.730086 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728264    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-host-run-netns\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.730086 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728288    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-run-systemd\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.730086 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728312    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-ovnkube-script-lib\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.730086 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728343    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9886560c-baa6-48cf-a2a9-cb7047d2771e-socket-dir\") pod \"aws-ebs-csi-driver-node-fhm69\" (UID: \"9886560c-baa6-48cf-a2a9-cb7047d2771e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhm69"
Jul 20 09:57:08.730086 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728370    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v72kl\" (UniqueName: \"kubernetes.io/projected/762b4f6c-bad2-4382-a8c3-6944d0177fd3-kube-api-access-v72kl\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.730086 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728372    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-host-run-netns\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.730086 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728395    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7e59906-508b-40d8-a8e4-4244d7c1cbbd-host\") pod \"node-ca-gxfkw\" (UID: \"c7e59906-508b-40d8-a8e4-4244d7c1cbbd\") " pod="openshift-image-registry/node-ca-gxfkw"
Jul 20 09:57:08.730086 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728431    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7e59906-508b-40d8-a8e4-4244d7c1cbbd-host\") pod \"node-ca-gxfkw\" (UID: \"c7e59906-508b-40d8-a8e4-4244d7c1cbbd\") " pod="openshift-image-registry/node-ca-gxfkw"
Jul 20 09:57:08.730086 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728469    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-run-systemd\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.730632 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728430    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-multus-socket-dir-parent\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.730632 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728521    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-multus-socket-dir-parent\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.730632 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728564    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9886560c-baa6-48cf-a2a9-cb7047d2771e-sys-fs\") pod \"aws-ebs-csi-driver-node-fhm69\" (UID: \"9886560c-baa6-48cf-a2a9-cb7047d2771e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhm69"
Jul 20 09:57:08.730632 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728626    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad8a980a-797b-413a-9a49-c8d2fd36e4f5-system-cni-dir\") pod \"multus-additional-cni-plugins-gx8fw\" (UID: \"ad8a980a-797b-413a-9a49-c8d2fd36e4f5\") " pod="openshift-multus/multus-additional-cni-plugins-gx8fw"
Jul 20 09:57:08.730632 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728655    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad8a980a-797b-413a-9a49-c8d2fd36e4f5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gx8fw\" (UID: \"ad8a980a-797b-413a-9a49-c8d2fd36e4f5\") " pod="openshift-multus/multus-additional-cni-plugins-gx8fw"
Jul 20 09:57:08.730632 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728678    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ad8a980a-797b-413a-9a49-c8d2fd36e4f5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gx8fw\" (UID: \"ad8a980a-797b-413a-9a49-c8d2fd36e4f5\") " pod="openshift-multus/multus-additional-cni-plugins-gx8fw"
Jul 20 09:57:08.730632 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728707    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvh8p\" (UniqueName: \"kubernetes.io/projected/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-kube-api-access-jvh8p\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.730632 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728733    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/559d8262-0cc6-4900-a6d2-52167877eb3c-original-pull-secret\") pod \"global-pull-secret-syncer-29gzc\" (UID: \"559d8262-0cc6-4900-a6d2-52167877eb3c\") " pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:08.730632 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728773    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-host-var-lib-cni-multus\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.730632 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728810    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-etc-kubernetes\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.730632 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728868    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-etc-kubernetes\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.730632 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728872    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-host-var-lib-cni-multus\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.730632 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728900    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-host-cni-netd\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.730632 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728964    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-host-cni-netd\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.730632 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.728999    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-etc-sysconfig\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.730632 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.729021    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-etc-kubernetes\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.730632 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.729038    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-lib-modules\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.731240 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.729052    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/762b4f6c-bad2-4382-a8c3-6944d0177fd3-tmp\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.731240 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.729070    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gznmk\" (UniqueName: \"kubernetes.io/projected/d8343adb-7f45-419c-b894-e9b307ecb5fd-kube-api-access-gznmk\") pod \"network-check-target-gr6fz\" (UID: \"d8343adb-7f45-419c-b894-e9b307ecb5fd\") " pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:57:08.731240 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.729088    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-system-cni-dir\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.731240 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.729114    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-cni-binary-copy\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.731240 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.729182    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-multus-conf-dir\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.731240 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.729218    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-etc-sysctl-conf\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.731240 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.729234    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-etc-systemd\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.731240 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.729237    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-system-cni-dir\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.731240 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.729282    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-cnibin\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.731240 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.729286    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-multus-conf-dir\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.731240 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.729301    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-multus-daemon-config\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.731240 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.729319    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74a3c5ba-e636-47df-b3cd-1ad53902bc5a-tmp-dir\") pod \"node-resolver-hp5fq\" (UID: \"74a3c5ba-e636-47df-b3cd-1ad53902bc5a\") " pod="openshift-dns/node-resolver-hp5fq"
Jul 20 09:57:08.731240 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.729335    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad8a980a-797b-413a-9a49-c8d2fd36e4f5-cni-binary-copy\") pod \"multus-additional-cni-plugins-gx8fw\" (UID: \"ad8a980a-797b-413a-9a49-c8d2fd36e4f5\") " pod="openshift-multus/multus-additional-cni-plugins-gx8fw"
Jul 20 09:57:08.731240 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.729340    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-cnibin\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.732498 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.732328    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74a3c5ba-e636-47df-b3cd-1ad53902bc5a-tmp-dir\") pod \"node-resolver-hp5fq\" (UID: \"74a3c5ba-e636-47df-b3cd-1ad53902bc5a\") " pod="openshift-dns/node-resolver-hp5fq"
Jul 20 09:57:08.732498 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.732355    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-env-overrides\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.732498 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.732418    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-ovnkube-script-lib\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.732498 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.732447    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b63f200f-1a84-43ec-95f8-d33f0f50cc20-konnectivity-ca\") pod \"konnectivity-agent-6bh7x\" (UID: \"b63f200f-1a84-43ec-95f8-d33f0f50cc20\") " pod="kube-system/konnectivity-agent-6bh7x"
Jul 20 09:57:08.732498 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.732473    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/82acb4fa-dae4-4dfd-b56b-b4df34feddd4-iptables-alerter-script\") pod \"iptables-alerter-xbpjz\" (UID: \"82acb4fa-dae4-4dfd-b56b-b4df34feddd4\") " pod="openshift-network-operator/iptables-alerter-xbpjz"
Jul 20 09:57:08.732749 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.732536    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 20 09:57:08.732749 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.732600    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-multus-daemon-config\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.732749 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.732613    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-cni-binary-copy\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.732749 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.732568    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c7e59906-508b-40d8-a8e4-4244d7c1cbbd-serviceca\") pod \"node-ca-gxfkw\" (UID: \"c7e59906-508b-40d8-a8e4-4244d7c1cbbd\") " pod="openshift-image-registry/node-ca-gxfkw"
Jul 20 09:57:08.732749 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.732720    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-ovnkube-config\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.736372 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.736252    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-ovn-node-metrics-cert\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.736456 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.736355    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b63f200f-1a84-43ec-95f8-d33f0f50cc20-agent-certs\") pod \"konnectivity-agent-6bh7x\" (UID: \"b63f200f-1a84-43ec-95f8-d33f0f50cc20\") " pod="kube-system/konnectivity-agent-6bh7x"
Jul 20 09:57:08.736636 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.736621    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 09:57:08.742381 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.742355    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm9db\" (UniqueName: \"kubernetes.io/projected/74a3c5ba-e636-47df-b3cd-1ad53902bc5a-kube-api-access-jm9db\") pod \"node-resolver-hp5fq\" (UID: \"74a3c5ba-e636-47df-b3cd-1ad53902bc5a\") " pod="openshift-dns/node-resolver-hp5fq"
Jul 20 09:57:08.742523 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.742448    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42664\" (UniqueName: \"kubernetes.io/projected/82acb4fa-dae4-4dfd-b56b-b4df34feddd4-kube-api-access-42664\") pod \"iptables-alerter-xbpjz\" (UID: \"82acb4fa-dae4-4dfd-b56b-b4df34feddd4\") " pod="openshift-network-operator/iptables-alerter-xbpjz"
Jul 20 09:57:08.743110 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.743090    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlf4c\" (UniqueName: \"kubernetes.io/projected/d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2-kube-api-access-qlf4c\") pod \"multus-9msk6\" (UID: \"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2\") " pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.743197 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.743143    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mwk6\" (UniqueName: \"kubernetes.io/projected/c7e59906-508b-40d8-a8e4-4244d7c1cbbd-kube-api-access-2mwk6\") pod \"node-ca-gxfkw\" (UID: \"c7e59906-508b-40d8-a8e4-4244d7c1cbbd\") " pod="openshift-image-registry/node-ca-gxfkw"
Jul 20 09:57:08.743252 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.743202    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxr67\" (UniqueName: \"kubernetes.io/projected/10552df3-551a-4023-ad75-003c6559ce60-kube-api-access-zxr67\") pod \"network-metrics-daemon-w778v\" (UID: \"10552df3-551a-4023-ad75-003c6559ce60\") " pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:57:08.743370 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.743350    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvh8p\" (UniqueName: \"kubernetes.io/projected/4d1f349c-9b09-4f4c-9e38-403589ac8d3f-kube-api-access-jvh8p\") pod \"ovnkube-node-d48r5\" (UID: \"4d1f349c-9b09-4f4c-9e38-403589ac8d3f\") " pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.772110 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.772050    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:08.778428 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.778410    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hp5fq"
Jul 20 09:57:08.792777 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.792751    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gxfkw"
Jul 20 09:57:08.798743 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.798724    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9msk6"
Jul 20 09:57:08.812590 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.812570    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xbpjz"
Jul 20 09:57:08.827268 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.827245    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6bh7x"
Jul 20 09:57:08.829538 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.829514    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad8a980a-797b-413a-9a49-c8d2fd36e4f5-cnibin\") pod \"multus-additional-cni-plugins-gx8fw\" (UID: \"ad8a980a-797b-413a-9a49-c8d2fd36e4f5\") " pod="openshift-multus/multus-additional-cni-plugins-gx8fw"
Jul 20 09:57:08.829662 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.829547    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ad8a980a-797b-413a-9a49-c8d2fd36e4f5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gx8fw\" (UID: \"ad8a980a-797b-413a-9a49-c8d2fd36e4f5\") " pod="openshift-multus/multus-additional-cni-plugins-gx8fw"
Jul 20 09:57:08.829662 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.829592    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ad8a980a-797b-413a-9a49-c8d2fd36e4f5-os-release\") pod \"multus-additional-cni-plugins-gx8fw\" (UID: \"ad8a980a-797b-413a-9a49-c8d2fd36e4f5\") " pod="openshift-multus/multus-additional-cni-plugins-gx8fw"
Jul 20 09:57:08.829662 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.829623    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-var-lib-kubelet\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.829839 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.829659    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad8a980a-797b-413a-9a49-c8d2fd36e4f5-cnibin\") pod \"multus-additional-cni-plugins-gx8fw\" (UID: \"ad8a980a-797b-413a-9a49-c8d2fd36e4f5\") " pod="openshift-multus/multus-additional-cni-plugins-gx8fw"
Jul 20 09:57:08.829839 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.829718    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ad8a980a-797b-413a-9a49-c8d2fd36e4f5-os-release\") pod \"multus-additional-cni-plugins-gx8fw\" (UID: \"ad8a980a-797b-413a-9a49-c8d2fd36e4f5\") " pod="openshift-multus/multus-additional-cni-plugins-gx8fw"
Jul 20 09:57:08.829839 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.829777    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-var-lib-kubelet\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.829839 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.829811    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9886560c-baa6-48cf-a2a9-cb7047d2771e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fhm69\" (UID: \"9886560c-baa6-48cf-a2a9-cb7047d2771e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhm69"
Jul 20 09:57:08.830149 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.829844    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-etc-modprobe-d\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.830149 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.829870    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-etc-sysctl-d\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.830149 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.829894    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-host\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.830149 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.829918    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/762b4f6c-bad2-4382-a8c3-6944d0177fd3-etc-tuned\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.830149 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.829994    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9886560c-baa6-48cf-a2a9-cb7047d2771e-registration-dir\") pod \"aws-ebs-csi-driver-node-fhm69\" (UID: \"9886560c-baa6-48cf-a2a9-cb7047d2771e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhm69"
Jul 20 09:57:08.830149 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.830025    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-etc-modprobe-d\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.830149 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.830047    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-host\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.830149 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.830024    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgchf\" (UniqueName: \"kubernetes.io/projected/9886560c-baa6-48cf-a2a9-cb7047d2771e-kube-api-access-sgchf\") pod \"aws-ebs-csi-driver-node-fhm69\" (UID: \"9886560c-baa6-48cf-a2a9-cb7047d2771e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhm69"
Jul 20 09:57:08.830149 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.830061    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9886560c-baa6-48cf-a2a9-cb7047d2771e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fhm69\" (UID: \"9886560c-baa6-48cf-a2a9-cb7047d2771e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhm69"
Jul 20 09:57:08.830149 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.830104    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/559d8262-0cc6-4900-a6d2-52167877eb3c-kubelet-config\") pod \"global-pull-secret-syncer-29gzc\" (UID: \"559d8262-0cc6-4900-a6d2-52167877eb3c\") " pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:08.830149 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.830129    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9886560c-baa6-48cf-a2a9-cb7047d2771e-registration-dir\") pod \"aws-ebs-csi-driver-node-fhm69\" (UID: \"9886560c-baa6-48cf-a2a9-cb7047d2771e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhm69"
Jul 20 09:57:08.830706 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.830164    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9886560c-baa6-48cf-a2a9-cb7047d2771e-device-dir\") pod \"aws-ebs-csi-driver-node-fhm69\" (UID: \"9886560c-baa6-48cf-a2a9-cb7047d2771e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhm69"
Jul 20 09:57:08.830706 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.830192    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-sys\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.830706 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.830192    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/559d8262-0cc6-4900-a6d2-52167877eb3c-kubelet-config\") pod \"global-pull-secret-syncer-29gzc\" (UID: \"559d8262-0cc6-4900-a6d2-52167877eb3c\") " pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:08.830706 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.830166    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-etc-sysctl-d\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.830706 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.830242    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9886560c-baa6-48cf-a2a9-cb7047d2771e-device-dir\") pod \"aws-ebs-csi-driver-node-fhm69\" (UID: \"9886560c-baa6-48cf-a2a9-cb7047d2771e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhm69"
Jul 20 09:57:08.830706 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.830265    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-sys\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.830706 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.830273    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/559d8262-0cc6-4900-a6d2-52167877eb3c-dbus\") pod \"global-pull-secret-syncer-29gzc\" (UID: \"559d8262-0cc6-4900-a6d2-52167877eb3c\") " pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:08.830706 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.830332    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9886560c-baa6-48cf-a2a9-cb7047d2771e-etc-selinux\") pod \"aws-ebs-csi-driver-node-fhm69\" (UID: \"9886560c-baa6-48cf-a2a9-cb7047d2771e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhm69"
Jul 20 09:57:08.830706 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.830344    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ad8a980a-797b-413a-9a49-c8d2fd36e4f5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gx8fw\" (UID: \"ad8a980a-797b-413a-9a49-c8d2fd36e4f5\") " pod="openshift-multus/multus-additional-cni-plugins-gx8fw"
Jul 20 09:57:08.830706 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.830411    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/559d8262-0cc6-4900-a6d2-52167877eb3c-dbus\") pod \"global-pull-secret-syncer-29gzc\" (UID: \"559d8262-0cc6-4900-a6d2-52167877eb3c\") " pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:08.830706 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.830416    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9886560c-baa6-48cf-a2a9-cb7047d2771e-socket-dir\") pod \"aws-ebs-csi-driver-node-fhm69\" (UID: \"9886560c-baa6-48cf-a2a9-cb7047d2771e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhm69"
Jul 20 09:57:08.830706 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.830458    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v72kl\" (UniqueName: \"kubernetes.io/projected/762b4f6c-bad2-4382-a8c3-6944d0177fd3-kube-api-access-v72kl\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.830706 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.830626    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9886560c-baa6-48cf-a2a9-cb7047d2771e-sys-fs\") pod \"aws-ebs-csi-driver-node-fhm69\" (UID: \"9886560c-baa6-48cf-a2a9-cb7047d2771e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhm69"
Jul 20 09:57:08.830706 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.830657    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad8a980a-797b-413a-9a49-c8d2fd36e4f5-system-cni-dir\") pod \"multus-additional-cni-plugins-gx8fw\" (UID: \"ad8a980a-797b-413a-9a49-c8d2fd36e4f5\") " pod="openshift-multus/multus-additional-cni-plugins-gx8fw"
Jul 20 09:57:08.830706 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.830666    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9886560c-baa6-48cf-a2a9-cb7047d2771e-etc-selinux\") pod \"aws-ebs-csi-driver-node-fhm69\" (UID: \"9886560c-baa6-48cf-a2a9-cb7047d2771e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhm69"
Jul 20 09:57:08.830706 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.830686    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad8a980a-797b-413a-9a49-c8d2fd36e4f5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gx8fw\" (UID: \"ad8a980a-797b-413a-9a49-c8d2fd36e4f5\") " pod="openshift-multus/multus-additional-cni-plugins-gx8fw"
Jul 20 09:57:08.830706 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.830714    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9886560c-baa6-48cf-a2a9-cb7047d2771e-sys-fs\") pod \"aws-ebs-csi-driver-node-fhm69\" (UID: \"9886560c-baa6-48cf-a2a9-cb7047d2771e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhm69"
Jul 20 09:57:08.831757 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.830714    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ad8a980a-797b-413a-9a49-c8d2fd36e4f5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gx8fw\" (UID: \"ad8a980a-797b-413a-9a49-c8d2fd36e4f5\") " pod="openshift-multus/multus-additional-cni-plugins-gx8fw"
Jul 20 09:57:08.831757 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.830723    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad8a980a-797b-413a-9a49-c8d2fd36e4f5-system-cni-dir\") pod \"multus-additional-cni-plugins-gx8fw\" (UID: \"ad8a980a-797b-413a-9a49-c8d2fd36e4f5\") " pod="openshift-multus/multus-additional-cni-plugins-gx8fw"
Jul 20 09:57:08.831757 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.830782    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/559d8262-0cc6-4900-a6d2-52167877eb3c-original-pull-secret\") pod \"global-pull-secret-syncer-29gzc\" (UID: \"559d8262-0cc6-4900-a6d2-52167877eb3c\") " pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:08.831757 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.830783    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9886560c-baa6-48cf-a2a9-cb7047d2771e-socket-dir\") pod \"aws-ebs-csi-driver-node-fhm69\" (UID: \"9886560c-baa6-48cf-a2a9-cb7047d2771e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhm69"
Jul 20 09:57:08.831757 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.830839    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-etc-sysconfig\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.831757 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.830992    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-etc-sysconfig\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.831757 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.831031    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-etc-kubernetes\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.831757 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.831053    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad8a980a-797b-413a-9a49-c8d2fd36e4f5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gx8fw\" (UID: \"ad8a980a-797b-413a-9a49-c8d2fd36e4f5\") " pod="openshift-multus/multus-additional-cni-plugins-gx8fw"
Jul 20 09:57:08.831757 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.831057    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-lib-modules\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.831757 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.831110    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/762b4f6c-bad2-4382-a8c3-6944d0177fd3-tmp\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.831757 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.831123    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-etc-kubernetes\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.831757 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.831133    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-lib-modules\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.831757 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.831169    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gznmk\" (UniqueName: \"kubernetes.io/projected/d8343adb-7f45-419c-b894-e9b307ecb5fd-kube-api-access-gznmk\") pod \"network-check-target-gr6fz\" (UID: \"d8343adb-7f45-419c-b894-e9b307ecb5fd\") " pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:57:08.831757 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:08.831192    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 09:57:08.831757 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.831239    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-etc-sysctl-conf\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.831757 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.831266    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-etc-systemd\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.831757 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:08.831315    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/559d8262-0cc6-4900-a6d2-52167877eb3c-original-pull-secret podName:559d8262-0cc6-4900-a6d2-52167877eb3c nodeName:}" failed. No retries permitted until 2026-07-20 09:57:09.331279882 +0000 UTC m=+3.048195141 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/559d8262-0cc6-4900-a6d2-52167877eb3c-original-pull-secret") pod "global-pull-secret-syncer-29gzc" (UID: "559d8262-0cc6-4900-a6d2-52167877eb3c") : object "kube-system"/"original-pull-secret" not registered
Jul 20 09:57:08.832702 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.831331    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-etc-systemd\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.832702 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.831365    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad8a980a-797b-413a-9a49-c8d2fd36e4f5-cni-binary-copy\") pod \"multus-additional-cni-plugins-gx8fw\" (UID: \"ad8a980a-797b-413a-9a49-c8d2fd36e4f5\") " pod="openshift-multus/multus-additional-cni-plugins-gx8fw"
Jul 20 09:57:08.832702 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.831398    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxgks\" (UniqueName: \"kubernetes.io/projected/ad8a980a-797b-413a-9a49-c8d2fd36e4f5-kube-api-access-fxgks\") pod \"multus-additional-cni-plugins-gx8fw\" (UID: \"ad8a980a-797b-413a-9a49-c8d2fd36e4f5\") " pod="openshift-multus/multus-additional-cni-plugins-gx8fw"
Jul 20 09:57:08.832702 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.831462    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-etc-sysctl-conf\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.832702 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.831464    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-run\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.832702 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.831524    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/762b4f6c-bad2-4382-a8c3-6944d0177fd3-run\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.832702 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.831535    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ad8a980a-797b-413a-9a49-c8d2fd36e4f5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gx8fw\" (UID: \"ad8a980a-797b-413a-9a49-c8d2fd36e4f5\") " pod="openshift-multus/multus-additional-cni-plugins-gx8fw"
Jul 20 09:57:08.832702 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.832047    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad8a980a-797b-413a-9a49-c8d2fd36e4f5-cni-binary-copy\") pod \"multus-additional-cni-plugins-gx8fw\" (UID: \"ad8a980a-797b-413a-9a49-c8d2fd36e4f5\") " pod="openshift-multus/multus-additional-cni-plugins-gx8fw"
Jul 20 09:57:08.833305 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.833282    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/762b4f6c-bad2-4382-a8c3-6944d0177fd3-etc-tuned\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.833850 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.833829    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/762b4f6c-bad2-4382-a8c3-6944d0177fd3-tmp\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.838045 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:08.838021    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 09:57:08.838150 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:08.838049    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 09:57:08.838150 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:08.838064    2561 projected.go:196] Error preparing data for projected volume kube-api-access-gznmk for pod openshift-network-diagnostics/network-check-target-gr6fz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 09:57:08.838150 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:08.838134    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8343adb-7f45-419c-b894-e9b307ecb5fd-kube-api-access-gznmk podName:d8343adb-7f45-419c-b894-e9b307ecb5fd nodeName:}" failed. No retries permitted until 2026-07-20 09:57:09.338113846 +0000 UTC m=+3.055029120 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gznmk" (UniqueName: "kubernetes.io/projected/d8343adb-7f45-419c-b894-e9b307ecb5fd-kube-api-access-gznmk") pod "network-check-target-gr6fz" (UID: "d8343adb-7f45-419c-b894-e9b307ecb5fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 09:57:08.838655 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.838630    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgchf\" (UniqueName: \"kubernetes.io/projected/9886560c-baa6-48cf-a2a9-cb7047d2771e-kube-api-access-sgchf\") pod \"aws-ebs-csi-driver-node-fhm69\" (UID: \"9886560c-baa6-48cf-a2a9-cb7047d2771e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhm69"
Jul 20 09:57:08.838828 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.838801    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v72kl\" (UniqueName: \"kubernetes.io/projected/762b4f6c-bad2-4382-a8c3-6944d0177fd3-kube-api-access-v72kl\") pod \"tuned-hbqt8\" (UID: \"762b4f6c-bad2-4382-a8c3-6944d0177fd3\") " pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.840445 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.840426    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxgks\" (UniqueName: \"kubernetes.io/projected/ad8a980a-797b-413a-9a49-c8d2fd36e4f5-kube-api-access-fxgks\") pod \"multus-additional-cni-plugins-gx8fw\" (UID: \"ad8a980a-797b-413a-9a49-c8d2fd36e4f5\") " pod="openshift-multus/multus-additional-cni-plugins-gx8fw"
Jul 20 09:57:08.849968 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.849948    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhm69"
Jul 20 09:57:08.866783 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.866756    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hbqt8"
Jul 20 09:57:08.872221 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.872201    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gx8fw"
Jul 20 09:57:08.947845 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:08.947808    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb627e4843adfbd64039515f41cb64e53.slice/crio-27a62904da6aac6262ae913b037ec7770434bed44c7c97f6132daf83273bee18 WatchSource:0}: Error finding container 27a62904da6aac6262ae913b037ec7770434bed44c7c97f6132daf83273bee18: Status 404 returned error can't find the container with id 27a62904da6aac6262ae913b037ec7770434bed44c7c97f6132daf83273bee18
Jul 20 09:57:08.948246 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:08.948222    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1887ae439b2a3b9cf7ae9dd23a2eb4c4.slice/crio-e621743fc838751165fe6f309a55af2ef3198178e14a2d982fe4e3089e5a0f63 WatchSource:0}: Error finding container e621743fc838751165fe6f309a55af2ef3198178e14a2d982fe4e3089e5a0f63: Status 404 returned error can't find the container with id e621743fc838751165fe6f309a55af2ef3198178e14a2d982fe4e3089e5a0f63
Jul 20 09:57:08.952715 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.952694    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 09:57:08.953663 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:08.953648    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 09:57:09.057344 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:09.057312    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d1f349c_9b09_4f4c_9e38_403589ac8d3f.slice/crio-2422a8319d2d1b77564e33eb8f8c5f42af3fe40b73d4dfd1e40a06882ee0f9d6 WatchSource:0}: Error finding container 2422a8319d2d1b77564e33eb8f8c5f42af3fe40b73d4dfd1e40a06882ee0f9d6: Status 404 returned error can't find the container with id 2422a8319d2d1b77564e33eb8f8c5f42af3fe40b73d4dfd1e40a06882ee0f9d6
Jul 20 09:57:09.231749 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:09.231717    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad8a980a_797b_413a_9a49_c8d2fd36e4f5.slice/crio-a5aa69578aec534af437ec9e7f555dcd46e623d68462da9ddd304d7922c54fa4 WatchSource:0}: Error finding container a5aa69578aec534af437ec9e7f555dcd46e623d68462da9ddd304d7922c54fa4: Status 404 returned error can't find the container with id a5aa69578aec534af437ec9e7f555dcd46e623d68462da9ddd304d7922c54fa4
Jul 20 09:57:09.236187 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:09.236163    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10552df3-551a-4023-ad75-003c6559ce60-metrics-certs\") pod \"network-metrics-daemon-w778v\" (UID: \"10552df3-551a-4023-ad75-003c6559ce60\") " pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:57:09.236320 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:09.236298    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 09:57:09.236388 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:09.236367    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10552df3-551a-4023-ad75-003c6559ce60-metrics-certs podName:10552df3-551a-4023-ad75-003c6559ce60 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:10.236345873 +0000 UTC m=+3.953261122 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10552df3-551a-4023-ad75-003c6559ce60-metrics-certs") pod "network-metrics-daemon-w778v" (UID: "10552df3-551a-4023-ad75-003c6559ce60") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 09:57:09.257168 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:09.257138    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82acb4fa_dae4_4dfd_b56b_b4df34feddd4.slice/crio-7c799df0c7e2b691a527add4c5e3b7e578e84549c90003b737477d0ccafaf521 WatchSource:0}: Error finding container 7c799df0c7e2b691a527add4c5e3b7e578e84549c90003b737477d0ccafaf521: Status 404 returned error can't find the container with id 7c799df0c7e2b691a527add4c5e3b7e578e84549c90003b737477d0ccafaf521
Jul 20 09:57:09.290397 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:09.290372    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4ca0bdc_644a_4cc7_8e2c_3231dd869ec2.slice/crio-91fb3ff1d5795c8d70a6374388c747405a503e48070eb9beca64dca9be36d3e4 WatchSource:0}: Error finding container 91fb3ff1d5795c8d70a6374388c747405a503e48070eb9beca64dca9be36d3e4: Status 404 returned error can't find the container with id 91fb3ff1d5795c8d70a6374388c747405a503e48070eb9beca64dca9be36d3e4
Jul 20 09:57:09.335985 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:09.335954    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9886560c_baa6_48cf_a2a9_cb7047d2771e.slice/crio-42a11fcea5ca0f5fefa3dc5ceb53cf25d6771c272baedc1b1b0d38422c7e25b6 WatchSource:0}: Error finding container 42a11fcea5ca0f5fefa3dc5ceb53cf25d6771c272baedc1b1b0d38422c7e25b6: Status 404 returned error can't find the container with id 42a11fcea5ca0f5fefa3dc5ceb53cf25d6771c272baedc1b1b0d38422c7e25b6
Jul 20 09:57:09.336672 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:09.336649    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/559d8262-0cc6-4900-a6d2-52167877eb3c-original-pull-secret\") pod \"global-pull-secret-syncer-29gzc\" (UID: \"559d8262-0cc6-4900-a6d2-52167877eb3c\") " pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:09.336800 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:09.336784    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 09:57:09.336856 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:09.336847    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/559d8262-0cc6-4900-a6d2-52167877eb3c-original-pull-secret podName:559d8262-0cc6-4900-a6d2-52167877eb3c nodeName:}" failed. No retries permitted until 2026-07-20 09:57:10.336831078 +0000 UTC m=+4.053746327 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/559d8262-0cc6-4900-a6d2-52167877eb3c-original-pull-secret") pod "global-pull-secret-syncer-29gzc" (UID: "559d8262-0cc6-4900-a6d2-52167877eb3c") : object "kube-system"/"original-pull-secret" not registered
Jul 20 09:57:09.398552 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:09.398522    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7e59906_508b_40d8_a8e4_4244d7c1cbbd.slice/crio-1520d5fa391d35d774bef23b94ad1cc6a82b2aa458dcc624958fa148754b3358 WatchSource:0}: Error finding container 1520d5fa391d35d774bef23b94ad1cc6a82b2aa458dcc624958fa148754b3358: Status 404 returned error can't find the container with id 1520d5fa391d35d774bef23b94ad1cc6a82b2aa458dcc624958fa148754b3358
Jul 20 09:57:09.437747 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:09.437705    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gznmk\" (UniqueName: \"kubernetes.io/projected/d8343adb-7f45-419c-b894-e9b307ecb5fd-kube-api-access-gznmk\") pod \"network-check-target-gr6fz\" (UID: \"d8343adb-7f45-419c-b894-e9b307ecb5fd\") " pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:57:09.437950 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:09.437924    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 09:57:09.437950 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:09.437956    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 09:57:09.437950 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:09.437971    2561 projected.go:196] Error preparing data for projected volume kube-api-access-gznmk for pod openshift-network-diagnostics/network-check-target-gr6fz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 09:57:09.438256 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:09.438034    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8343adb-7f45-419c-b894-e9b307ecb5fd-kube-api-access-gznmk podName:d8343adb-7f45-419c-b894-e9b307ecb5fd nodeName:}" failed. No retries permitted until 2026-07-20 09:57:10.438014922 +0000 UTC m=+4.154930187 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gznmk" (UniqueName: "kubernetes.io/projected/d8343adb-7f45-419c-b894-e9b307ecb5fd-kube-api-access-gznmk") pod "network-check-target-gr6fz" (UID: "d8343adb-7f45-419c-b894-e9b307ecb5fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 09:57:09.452779 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:09.452747    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74a3c5ba_e636_47df_b3cd_1ad53902bc5a.slice/crio-ae7b9f5ef57f732c9b2278ca2ed25115fb3c91519d0706086dcbab444b265ea8 WatchSource:0}: Error finding container ae7b9f5ef57f732c9b2278ca2ed25115fb3c91519d0706086dcbab444b265ea8: Status 404 returned error can't find the container with id ae7b9f5ef57f732c9b2278ca2ed25115fb3c91519d0706086dcbab444b265ea8
Jul 20 09:57:09.586761 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:09.586672    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb63f200f_1a84_43ec_95f8_d33f0f50cc20.slice/crio-dc188e192ebefdafc3bce340ffe7b989afca92025e5d58037955d40529ee3454 WatchSource:0}: Error finding container dc188e192ebefdafc3bce340ffe7b989afca92025e5d58037955d40529ee3454: Status 404 returned error can't find the container with id dc188e192ebefdafc3bce340ffe7b989afca92025e5d58037955d40529ee3454
Jul 20 09:57:09.667848 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:09.667760    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 09:52:09 +0000 UTC" deadline="2027-12-30 01:57:10.767707194 +0000 UTC"
Jul 20 09:57:09.667848 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:09.667839    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12664h0m1.099872945s"
Jul 20 09:57:09.737978 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:09.737947    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:57:09.738164 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:09.738082    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gr6fz" podUID="d8343adb-7f45-419c-b894-e9b307ecb5fd"
Jul 20 09:57:09.738643 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:09.738493    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:09.738643 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:09.738599    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gzc" podUID="559d8262-0cc6-4900-a6d2-52167877eb3c"
Jul 20 09:57:09.748856 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:09.748796    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhm69" event={"ID":"9886560c-baa6-48cf-a2a9-cb7047d2771e","Type":"ContainerStarted","Data":"42a11fcea5ca0f5fefa3dc5ceb53cf25d6771c272baedc1b1b0d38422c7e25b6"}
Jul 20 09:57:09.750737 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:09.750713    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9msk6" event={"ID":"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2","Type":"ContainerStarted","Data":"91fb3ff1d5795c8d70a6374388c747405a503e48070eb9beca64dca9be36d3e4"}
Jul 20 09:57:09.756332 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:09.756275    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal" event={"ID":"b627e4843adfbd64039515f41cb64e53","Type":"ContainerStarted","Data":"27a62904da6aac6262ae913b037ec7770434bed44c7c97f6132daf83273bee18"}
Jul 20 09:57:09.758284 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:09.758257    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod762b4f6c_bad2_4382_a8c3_6944d0177fd3.slice/crio-e51c1b88eddbf7514db1257bf222779d8efba776bf3a2cbae439e6c25bd0aca5 WatchSource:0}: Error finding container e51c1b88eddbf7514db1257bf222779d8efba776bf3a2cbae439e6c25bd0aca5: Status 404 returned error can't find the container with id e51c1b88eddbf7514db1257bf222779d8efba776bf3a2cbae439e6c25bd0aca5
Jul 20 09:57:09.759330 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:09.759266    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal" event={"ID":"1887ae439b2a3b9cf7ae9dd23a2eb4c4","Type":"ContainerStarted","Data":"e621743fc838751165fe6f309a55af2ef3198178e14a2d982fe4e3089e5a0f63"}
Jul 20 09:57:09.761160 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:09.761082    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gxfkw" event={"ID":"c7e59906-508b-40d8-a8e4-4244d7c1cbbd","Type":"ContainerStarted","Data":"1520d5fa391d35d774bef23b94ad1cc6a82b2aa458dcc624958fa148754b3358"}
Jul 20 09:57:09.765478 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:09.765422    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xbpjz" event={"ID":"82acb4fa-dae4-4dfd-b56b-b4df34feddd4","Type":"ContainerStarted","Data":"7c799df0c7e2b691a527add4c5e3b7e578e84549c90003b737477d0ccafaf521"}
Jul 20 09:57:09.782714 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:09.782354    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gx8fw" event={"ID":"ad8a980a-797b-413a-9a49-c8d2fd36e4f5","Type":"ContainerStarted","Data":"a5aa69578aec534af437ec9e7f555dcd46e623d68462da9ddd304d7922c54fa4"}
Jul 20 09:57:09.786636 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:09.786520    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d48r5" event={"ID":"4d1f349c-9b09-4f4c-9e38-403589ac8d3f","Type":"ContainerStarted","Data":"2422a8319d2d1b77564e33eb8f8c5f42af3fe40b73d4dfd1e40a06882ee0f9d6"}
Jul 20 09:57:09.789113 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:09.789089    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6bh7x" event={"ID":"b63f200f-1a84-43ec-95f8-d33f0f50cc20","Type":"ContainerStarted","Data":"dc188e192ebefdafc3bce340ffe7b989afca92025e5d58037955d40529ee3454"}
Jul 20 09:57:09.798462 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:09.798419    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hp5fq" event={"ID":"74a3c5ba-e636-47df-b3cd-1ad53902bc5a","Type":"ContainerStarted","Data":"ae7b9f5ef57f732c9b2278ca2ed25115fb3c91519d0706086dcbab444b265ea8"}
Jul 20 09:57:10.244084 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:10.243879    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10552df3-551a-4023-ad75-003c6559ce60-metrics-certs\") pod \"network-metrics-daemon-w778v\" (UID: \"10552df3-551a-4023-ad75-003c6559ce60\") " pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:57:10.244084 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:10.244059    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 09:57:10.244340 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:10.244143    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10552df3-551a-4023-ad75-003c6559ce60-metrics-certs podName:10552df3-551a-4023-ad75-003c6559ce60 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:12.244121926 +0000 UTC m=+5.961037178 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10552df3-551a-4023-ad75-003c6559ce60-metrics-certs") pod "network-metrics-daemon-w778v" (UID: "10552df3-551a-4023-ad75-003c6559ce60") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 09:57:10.345678 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:10.345011    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/559d8262-0cc6-4900-a6d2-52167877eb3c-original-pull-secret\") pod \"global-pull-secret-syncer-29gzc\" (UID: \"559d8262-0cc6-4900-a6d2-52167877eb3c\") " pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:10.345678 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:10.345177    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 09:57:10.345678 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:10.345247    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/559d8262-0cc6-4900-a6d2-52167877eb3c-original-pull-secret podName:559d8262-0cc6-4900-a6d2-52167877eb3c nodeName:}" failed. No retries permitted until 2026-07-20 09:57:12.345227766 +0000 UTC m=+6.062143040 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/559d8262-0cc6-4900-a6d2-52167877eb3c-original-pull-secret") pod "global-pull-secret-syncer-29gzc" (UID: "559d8262-0cc6-4900-a6d2-52167877eb3c") : object "kube-system"/"original-pull-secret" not registered
Jul 20 09:57:10.446677 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:10.445969    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gznmk\" (UniqueName: \"kubernetes.io/projected/d8343adb-7f45-419c-b894-e9b307ecb5fd-kube-api-access-gznmk\") pod \"network-check-target-gr6fz\" (UID: \"d8343adb-7f45-419c-b894-e9b307ecb5fd\") " pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:57:10.446677 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:10.446193    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 09:57:10.446677 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:10.446218    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 09:57:10.446677 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:10.446232    2561 projected.go:196] Error preparing data for projected volume kube-api-access-gznmk for pod openshift-network-diagnostics/network-check-target-gr6fz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 09:57:10.446677 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:10.446300    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8343adb-7f45-419c-b894-e9b307ecb5fd-kube-api-access-gznmk podName:d8343adb-7f45-419c-b894-e9b307ecb5fd nodeName:}" failed. No retries permitted until 2026-07-20 09:57:12.446278977 +0000 UTC m=+6.163194245 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gznmk" (UniqueName: "kubernetes.io/projected/d8343adb-7f45-419c-b894-e9b307ecb5fd-kube-api-access-gznmk") pod "network-check-target-gr6fz" (UID: "d8343adb-7f45-419c-b894-e9b307ecb5fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 09:57:10.668381 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:10.668250    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 09:52:09 +0000 UTC" deadline="2028-01-20 23:35:48.534835225 +0000 UTC"
Jul 20 09:57:10.668381 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:10.668343    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13189h38m37.866496592s"
Jul 20 09:57:10.739109 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:10.739065    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:57:10.739296 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:10.739224    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w778v" podUID="10552df3-551a-4023-ad75-003c6559ce60"
Jul 20 09:57:10.823038 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:10.822996    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hbqt8" event={"ID":"762b4f6c-bad2-4382-a8c3-6944d0177fd3","Type":"ContainerStarted","Data":"e51c1b88eddbf7514db1257bf222779d8efba776bf3a2cbae439e6c25bd0aca5"}
Jul 20 09:57:11.738463 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:11.738427    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:57:11.739202 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:11.738572    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gr6fz" podUID="d8343adb-7f45-419c-b894-e9b307ecb5fd"
Jul 20 09:57:11.739202 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:11.739009    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:11.739202 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:11.739117    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gzc" podUID="559d8262-0cc6-4900-a6d2-52167877eb3c"
Jul 20 09:57:12.264780 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:12.264097    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10552df3-551a-4023-ad75-003c6559ce60-metrics-certs\") pod \"network-metrics-daemon-w778v\" (UID: \"10552df3-551a-4023-ad75-003c6559ce60\") " pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:57:12.264780 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:12.264306    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 09:57:12.264780 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:12.264371    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10552df3-551a-4023-ad75-003c6559ce60-metrics-certs podName:10552df3-551a-4023-ad75-003c6559ce60 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:16.26435098 +0000 UTC m=+9.981266245 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10552df3-551a-4023-ad75-003c6559ce60-metrics-certs") pod "network-metrics-daemon-w778v" (UID: "10552df3-551a-4023-ad75-003c6559ce60") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 09:57:12.365473 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:12.364868    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/559d8262-0cc6-4900-a6d2-52167877eb3c-original-pull-secret\") pod \"global-pull-secret-syncer-29gzc\" (UID: \"559d8262-0cc6-4900-a6d2-52167877eb3c\") " pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:12.365473 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:12.365043    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 09:57:12.365473 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:12.365120    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/559d8262-0cc6-4900-a6d2-52167877eb3c-original-pull-secret podName:559d8262-0cc6-4900-a6d2-52167877eb3c nodeName:}" failed. No retries permitted until 2026-07-20 09:57:16.365101039 +0000 UTC m=+10.082016306 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/559d8262-0cc6-4900-a6d2-52167877eb3c-original-pull-secret") pod "global-pull-secret-syncer-29gzc" (UID: "559d8262-0cc6-4900-a6d2-52167877eb3c") : object "kube-system"/"original-pull-secret" not registered
Jul 20 09:57:12.465844 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:12.465807    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gznmk\" (UniqueName: \"kubernetes.io/projected/d8343adb-7f45-419c-b894-e9b307ecb5fd-kube-api-access-gznmk\") pod \"network-check-target-gr6fz\" (UID: \"d8343adb-7f45-419c-b894-e9b307ecb5fd\") " pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:57:12.466080 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:12.466058    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 09:57:12.466189 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:12.466087    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 09:57:12.466189 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:12.466101    2561 projected.go:196] Error preparing data for projected volume kube-api-access-gznmk for pod openshift-network-diagnostics/network-check-target-gr6fz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 09:57:12.466189 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:12.466173    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8343adb-7f45-419c-b894-e9b307ecb5fd-kube-api-access-gznmk podName:d8343adb-7f45-419c-b894-e9b307ecb5fd nodeName:}" failed. No retries permitted until 2026-07-20 09:57:16.466150912 +0000 UTC m=+10.183066164 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gznmk" (UniqueName: "kubernetes.io/projected/d8343adb-7f45-419c-b894-e9b307ecb5fd-kube-api-access-gznmk") pod "network-check-target-gr6fz" (UID: "d8343adb-7f45-419c-b894-e9b307ecb5fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 09:57:12.738696 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:12.738138    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:57:12.738696 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:12.738300    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w778v" podUID="10552df3-551a-4023-ad75-003c6559ce60"
Jul 20 09:57:13.738733 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:13.738231    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:57:13.738733 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:13.738372    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gr6fz" podUID="d8343adb-7f45-419c-b894-e9b307ecb5fd"
Jul 20 09:57:13.738733 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:13.738402    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:13.738733 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:13.738519    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gzc" podUID="559d8262-0cc6-4900-a6d2-52167877eb3c"
Jul 20 09:57:14.739115 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:14.739076    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:57:14.744908 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:14.739233    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w778v" podUID="10552df3-551a-4023-ad75-003c6559ce60"
Jul 20 09:57:15.738230 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:15.738140    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:57:15.738396 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:15.738149    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:15.738396 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:15.738275    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gr6fz" podUID="d8343adb-7f45-419c-b894-e9b307ecb5fd"
Jul 20 09:57:15.738396 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:15.738364    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gzc" podUID="559d8262-0cc6-4900-a6d2-52167877eb3c"
Jul 20 09:57:16.299164 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:16.299126    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10552df3-551a-4023-ad75-003c6559ce60-metrics-certs\") pod \"network-metrics-daemon-w778v\" (UID: \"10552df3-551a-4023-ad75-003c6559ce60\") " pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:57:16.299654 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:16.299270    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 09:57:16.299654 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:16.299333    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10552df3-551a-4023-ad75-003c6559ce60-metrics-certs podName:10552df3-551a-4023-ad75-003c6559ce60 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:24.299314761 +0000 UTC m=+18.016230012 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10552df3-551a-4023-ad75-003c6559ce60-metrics-certs") pod "network-metrics-daemon-w778v" (UID: "10552df3-551a-4023-ad75-003c6559ce60") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 09:57:16.399558 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:16.399441    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/559d8262-0cc6-4900-a6d2-52167877eb3c-original-pull-secret\") pod \"global-pull-secret-syncer-29gzc\" (UID: \"559d8262-0cc6-4900-a6d2-52167877eb3c\") " pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:16.399742 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:16.399612    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 09:57:16.399742 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:16.399685    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/559d8262-0cc6-4900-a6d2-52167877eb3c-original-pull-secret podName:559d8262-0cc6-4900-a6d2-52167877eb3c nodeName:}" failed. No retries permitted until 2026-07-20 09:57:24.39966746 +0000 UTC m=+18.116582724 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/559d8262-0cc6-4900-a6d2-52167877eb3c-original-pull-secret") pod "global-pull-secret-syncer-29gzc" (UID: "559d8262-0cc6-4900-a6d2-52167877eb3c") : object "kube-system"/"original-pull-secret" not registered
Jul 20 09:57:16.500514 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:16.500474    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gznmk\" (UniqueName: \"kubernetes.io/projected/d8343adb-7f45-419c-b894-e9b307ecb5fd-kube-api-access-gznmk\") pod \"network-check-target-gr6fz\" (UID: \"d8343adb-7f45-419c-b894-e9b307ecb5fd\") " pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:57:16.500695 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:16.500657    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 09:57:16.500695 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:16.500683    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 09:57:16.500695 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:16.500697    2561 projected.go:196] Error preparing data for projected volume kube-api-access-gznmk for pod openshift-network-diagnostics/network-check-target-gr6fz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 09:57:16.500861 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:16.500764    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8343adb-7f45-419c-b894-e9b307ecb5fd-kube-api-access-gznmk podName:d8343adb-7f45-419c-b894-e9b307ecb5fd nodeName:}" failed. No retries permitted until 2026-07-20 09:57:24.50074514 +0000 UTC m=+18.217660402 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gznmk" (UniqueName: "kubernetes.io/projected/d8343adb-7f45-419c-b894-e9b307ecb5fd-kube-api-access-gznmk") pod "network-check-target-gr6fz" (UID: "d8343adb-7f45-419c-b894-e9b307ecb5fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 09:57:16.739496 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:16.738989    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:57:16.739496 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:16.739119    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w778v" podUID="10552df3-551a-4023-ad75-003c6559ce60"
Jul 20 09:57:17.738373 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:17.738341    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:17.738373 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:17.738360    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:57:17.738853 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:17.738474    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gzc" podUID="559d8262-0cc6-4900-a6d2-52167877eb3c"
Jul 20 09:57:17.738853 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:17.738603    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gr6fz" podUID="d8343adb-7f45-419c-b894-e9b307ecb5fd"
Jul 20 09:57:18.739012 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:18.738978    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:57:18.739592 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:18.739126    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w778v" podUID="10552df3-551a-4023-ad75-003c6559ce60"
Jul 20 09:57:19.738125 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:19.738087    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:57:19.738307 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:19.738095    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:19.738307 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:19.738201    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gr6fz" podUID="d8343adb-7f45-419c-b894-e9b307ecb5fd"
Jul 20 09:57:19.738422 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:19.738295    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gzc" podUID="559d8262-0cc6-4900-a6d2-52167877eb3c"
Jul 20 09:57:20.738210 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:20.738176    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:57:20.738590 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:20.738328    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w778v" podUID="10552df3-551a-4023-ad75-003c6559ce60"
Jul 20 09:57:21.738007 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:21.737968    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:57:21.738007 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:21.737988    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:21.738228 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:21.738089    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gr6fz" podUID="d8343adb-7f45-419c-b894-e9b307ecb5fd"
Jul 20 09:57:21.738547 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:21.738238    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gzc" podUID="559d8262-0cc6-4900-a6d2-52167877eb3c"
Jul 20 09:57:22.738530 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:22.738496    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:57:22.738987 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:22.738614    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w778v" podUID="10552df3-551a-4023-ad75-003c6559ce60"
Jul 20 09:57:23.738288 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:23.738252    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:57:23.738452 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:23.738256    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:23.738452 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:23.738366    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gr6fz" podUID="d8343adb-7f45-419c-b894-e9b307ecb5fd"
Jul 20 09:57:23.738543 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:23.738451    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gzc" podUID="559d8262-0cc6-4900-a6d2-52167877eb3c"
Jul 20 09:57:24.360782 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:24.360743    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10552df3-551a-4023-ad75-003c6559ce60-metrics-certs\") pod \"network-metrics-daemon-w778v\" (UID: \"10552df3-551a-4023-ad75-003c6559ce60\") " pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:57:24.361199 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:24.360909    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 09:57:24.361199 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:24.360981    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10552df3-551a-4023-ad75-003c6559ce60-metrics-certs podName:10552df3-551a-4023-ad75-003c6559ce60 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:40.360961534 +0000 UTC m=+34.077876801 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10552df3-551a-4023-ad75-003c6559ce60-metrics-certs") pod "network-metrics-daemon-w778v" (UID: "10552df3-551a-4023-ad75-003c6559ce60") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 09:57:24.462106 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:24.462068    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/559d8262-0cc6-4900-a6d2-52167877eb3c-original-pull-secret\") pod \"global-pull-secret-syncer-29gzc\" (UID: \"559d8262-0cc6-4900-a6d2-52167877eb3c\") " pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:24.462287 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:24.462187    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 09:57:24.462287 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:24.462248    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/559d8262-0cc6-4900-a6d2-52167877eb3c-original-pull-secret podName:559d8262-0cc6-4900-a6d2-52167877eb3c nodeName:}" failed. No retries permitted until 2026-07-20 09:57:40.462231303 +0000 UTC m=+34.179146563 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/559d8262-0cc6-4900-a6d2-52167877eb3c-original-pull-secret") pod "global-pull-secret-syncer-29gzc" (UID: "559d8262-0cc6-4900-a6d2-52167877eb3c") : object "kube-system"/"original-pull-secret" not registered
Jul 20 09:57:24.563413 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:24.563378    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gznmk\" (UniqueName: \"kubernetes.io/projected/d8343adb-7f45-419c-b894-e9b307ecb5fd-kube-api-access-gznmk\") pod \"network-check-target-gr6fz\" (UID: \"d8343adb-7f45-419c-b894-e9b307ecb5fd\") " pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:57:24.563580 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:24.563512    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 09:57:24.563580 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:24.563527    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 09:57:24.563580 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:24.563540    2561 projected.go:196] Error preparing data for projected volume kube-api-access-gznmk for pod openshift-network-diagnostics/network-check-target-gr6fz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 09:57:24.563721 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:24.563598    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8343adb-7f45-419c-b894-e9b307ecb5fd-kube-api-access-gznmk podName:d8343adb-7f45-419c-b894-e9b307ecb5fd nodeName:}" failed. No retries permitted until 2026-07-20 09:57:40.563579312 +0000 UTC m=+34.280494560 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gznmk" (UniqueName: "kubernetes.io/projected/d8343adb-7f45-419c-b894-e9b307ecb5fd-kube-api-access-gznmk") pod "network-check-target-gr6fz" (UID: "d8343adb-7f45-419c-b894-e9b307ecb5fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 09:57:24.738862 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:24.738787    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:57:24.739036 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:24.738949    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w778v" podUID="10552df3-551a-4023-ad75-003c6559ce60"
Jul 20 09:57:25.737919 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:25.737868    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:57:25.738345 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:25.737868    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:25.738345 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:25.737999    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gr6fz" podUID="d8343adb-7f45-419c-b894-e9b307ecb5fd"
Jul 20 09:57:25.738345 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:25.738101    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gzc" podUID="559d8262-0cc6-4900-a6d2-52167877eb3c"
Jul 20 09:57:26.739585 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:26.739548    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:57:26.740054 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:26.739677    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w778v" podUID="10552df3-551a-4023-ad75-003c6559ce60"
Jul 20 09:57:27.738112 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:27.738070    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:27.738284 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:27.738079    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:57:27.738284 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:27.738183    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gzc" podUID="559d8262-0cc6-4900-a6d2-52167877eb3c"
Jul 20 09:57:27.738284 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:27.738271    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gr6fz" podUID="d8343adb-7f45-419c-b894-e9b307ecb5fd"
Jul 20 09:57:28.738758 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:28.738726    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:57:28.739200 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:28.738873    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w778v" podUID="10552df3-551a-4023-ad75-003c6559ce60"
Jul 20 09:57:29.739171 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:29.738847    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:57:29.739598 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:29.738913    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:29.739598 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:29.739206    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gr6fz" podUID="d8343adb-7f45-419c-b894-e9b307ecb5fd"
Jul 20 09:57:29.739598 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:29.739271    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gzc" podUID="559d8262-0cc6-4900-a6d2-52167877eb3c"
Jul 20 09:57:29.858630 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:29.858601    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gxfkw" event={"ID":"c7e59906-508b-40d8-a8e4-4244d7c1cbbd","Type":"ContainerStarted","Data":"20123ec1efa7c98c35d7b38f05757fa7df53299a3dbcba4c95e6a470c0ecd462"}
Jul 20 09:57:29.860016 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:29.859995    2561 generic.go:356] "Generic (PLEG): container finished" podID="ad8a980a-797b-413a-9a49-c8d2fd36e4f5" containerID="4c9c24340909bafc93adf8320a3d7f2c9e96eec1808ff72cf89d172339804db7" exitCode=0
Jul 20 09:57:29.860106 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:29.860058    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gx8fw" event={"ID":"ad8a980a-797b-413a-9a49-c8d2fd36e4f5","Type":"ContainerDied","Data":"4c9c24340909bafc93adf8320a3d7f2c9e96eec1808ff72cf89d172339804db7"}
Jul 20 09:57:29.862451 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:29.862431    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d48r5" event={"ID":"4d1f349c-9b09-4f4c-9e38-403589ac8d3f","Type":"ContainerStarted","Data":"7313bbb1378635035eadc2422bd8551298a4f7ec0d391cf144c0b2e255d75354"}
Jul 20 09:57:29.862546 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:29.862486    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d48r5" event={"ID":"4d1f349c-9b09-4f4c-9e38-403589ac8d3f","Type":"ContainerStarted","Data":"71dc0b14d8a6f55f57ad870e7daad0b99843c2b669ec75bd91ce2e6abeb07c18"}
Jul 20 09:57:29.862546 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:29.862523    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d48r5" event={"ID":"4d1f349c-9b09-4f4c-9e38-403589ac8d3f","Type":"ContainerStarted","Data":"194e18df404307e94bd5d2b6a36047ca40921b07cdcf7dcdc84dda4163530f6d"}
Jul 20 09:57:29.862643 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:29.862565    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d48r5" event={"ID":"4d1f349c-9b09-4f4c-9e38-403589ac8d3f","Type":"ContainerStarted","Data":"8fc8d4ebe900bd37115288055596bedf63d48dec9d19928e6f3bff0d123d5c3b"}
Jul 20 09:57:29.863807 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:29.863781    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6bh7x" event={"ID":"b63f200f-1a84-43ec-95f8-d33f0f50cc20","Type":"ContainerStarted","Data":"b488e4177df29a3027d8bdc355f63431f6a123f319dadf7d9e692ce48d7d83e8"}
Jul 20 09:57:29.865007 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:29.864984    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hp5fq" event={"ID":"74a3c5ba-e636-47df-b3cd-1ad53902bc5a","Type":"ContainerStarted","Data":"46414f77d5ac6107cdda036997fda44f8018b1be22b7bb36fa6521fb33681ad0"}
Jul 20 09:57:29.866602 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:29.866583    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhm69" event={"ID":"9886560c-baa6-48cf-a2a9-cb7047d2771e","Type":"ContainerStarted","Data":"1fd58c661ee0f2641e5dbaf8516e8681bf5a150d13b28a98e6e238ecfbbdaf37"}
Jul 20 09:57:29.867839 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:29.867817    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9msk6" event={"ID":"d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2","Type":"ContainerStarted","Data":"e46be247e5ea71130a106a780ef945ba77f389effa0585108241b481c91bf935"}
Jul 20 09:57:29.869017 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:29.868998    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal" event={"ID":"b627e4843adfbd64039515f41cb64e53","Type":"ContainerStarted","Data":"b7eaaed3a40ed3b9009c7f52b0a6854894774dc4b50923efc023a0afdfef4e46"}
Jul 20 09:57:29.870281 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:29.870259    2561 generic.go:356] "Generic (PLEG): container finished" podID="1887ae439b2a3b9cf7ae9dd23a2eb4c4" containerID="9b8ea7ac54762a57143762945fca27790a112807adca633db7589d86afd893d3" exitCode=0
Jul 20 09:57:29.870344 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:29.870330    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal" event={"ID":"1887ae439b2a3b9cf7ae9dd23a2eb4c4","Type":"ContainerDied","Data":"9b8ea7ac54762a57143762945fca27790a112807adca633db7589d86afd893d3"}
Jul 20 09:57:29.871581 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:29.871555    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hbqt8" event={"ID":"762b4f6c-bad2-4382-a8c3-6944d0177fd3","Type":"ContainerStarted","Data":"d9adde972150008c8977fdb87da709c034ad8257764f6928221e035c650ec8aa"}
Jul 20 09:57:29.876302 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:29.876255    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gxfkw" podStartSLOduration=7.440641942 podStartE2EDuration="22.876243704s" totalImagesPullingTime="15.435601762s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:29.875796646 +0000 UTC m=+23.592711914" watchObservedRunningTime="2026-07-20 09:57:29.876243704 +0000 UTC m=+23.593158973"
Jul 20 09:57:29.894848 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:29.894811    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9msk6" podStartSLOduration=2.9709223 podStartE2EDuration="22.894797929s" totalImagesPullingTime="19.923875629s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:29.894345104 +0000 UTC m=+23.611260397" watchObservedRunningTime="2026-07-20 09:57:29.894797929 +0000 UTC m=+23.611713197"
Jul 20 09:57:29.928510 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:29.928470    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hbqt8" podStartSLOduration=3.545026391 podStartE2EDuration="22.928455881s" totalImagesPullingTime="19.38342949s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:29.913029861 +0000 UTC m=+23.629945132" watchObservedRunningTime="2026-07-20 09:57:29.928455881 +0000 UTC m=+23.645371149"
Jul 20 09:57:29.928628 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:29.928561    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hp5fq" podStartSLOduration=3.218059442 podStartE2EDuration="22.928555625s" totalImagesPullingTime="19.710496183s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:29.928001968 +0000 UTC m=+23.644917260" watchObservedRunningTime="2026-07-20 09:57:29.928555625 +0000 UTC m=+23.645470894"
Jul 20 09:57:29.944860 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:29.944816    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6bh7x" podStartSLOduration=7.6978473659999995 podStartE2EDuration="22.944799977s" totalImagesPullingTime="15.246952611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:57:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:29.944657523 +0000 UTC m=+23.661572788" watchObservedRunningTime="2026-07-20 09:57:29.944799977 +0000 UTC m=+23.661715246"
Jul 20 09:57:30.738611 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:30.738575    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:57:30.738786 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:30.738718    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w778v" podUID="10552df3-551a-4023-ad75-003c6559ce60"
Jul 20 09:57:30.875914 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:30.875807    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal" event={"ID":"1887ae439b2a3b9cf7ae9dd23a2eb4c4","Type":"ContainerStarted","Data":"05439a330fbb8f332c6c97afc2659c2a4abe61efce2c9f510b88af97fb287211"}
Jul 20 09:57:30.878360 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:30.878327    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xbpjz" event={"ID":"82acb4fa-dae4-4dfd-b56b-b4df34feddd4","Type":"ContainerStarted","Data":"8a0039ae71cc603482d879f7a696f4b6dc50eccc47b662bfc3b23e799e64fd45"}
Jul 20 09:57:30.882263 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:30.882233    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d48r5" event={"ID":"4d1f349c-9b09-4f4c-9e38-403589ac8d3f","Type":"ContainerStarted","Data":"2ecf47d77e23fda55e2217c965f4a2a39020115d4fbfd6c556ced205bf863e32"}
Jul 20 09:57:30.882402 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:30.882298    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d48r5" event={"ID":"4d1f349c-9b09-4f4c-9e38-403589ac8d3f","Type":"ContainerStarted","Data":"6f285d117d6acc8c99adc8e77bf38f21be78a5c0bdc68dd76b3c2827deb4fee9"}
Jul 20 09:57:30.894386 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:30.894329    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal" podStartSLOduration=22.8943128 podStartE2EDuration="22.8943128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:30.004002997 +0000 UTC m=+23.720918266" watchObservedRunningTime="2026-07-20 09:57:30.8943128 +0000 UTC m=+24.611228069"
Jul 20 09:57:30.894538 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:30.894408    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal" podStartSLOduration=22.894404181 podStartE2EDuration="22.894404181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:30.894154829 +0000 UTC m=+24.611070146" watchObservedRunningTime="2026-07-20 09:57:30.894404181 +0000 UTC m=+24.611319450"
Jul 20 09:57:31.168556 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:31.168298    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 20 09:57:31.687179 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:31.687059    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T09:57:31.168471614Z","UUID":"4d99d109-55c7-4a02-af3c-04ee4681ef27","Handler":null,"Name":"","Endpoint":""}
Jul 20 09:57:31.688955 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:31.688929    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 20 09:57:31.689097 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:31.688980    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 20 09:57:31.738398 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:31.738367    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:31.738602 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:31.738402    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:57:31.738602 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:31.738501    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gzc" podUID="559d8262-0cc6-4900-a6d2-52167877eb3c"
Jul 20 09:57:31.738735 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:31.738625    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gr6fz" podUID="d8343adb-7f45-419c-b894-e9b307ecb5fd"
Jul 20 09:57:31.887338 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:31.887295    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhm69" event={"ID":"9886560c-baa6-48cf-a2a9-cb7047d2771e","Type":"ContainerStarted","Data":"a3b434764f94fa998e00b93bbc893fcfaf2d6b1e7060cc9679b85d006bf0cb21"}
Jul 20 09:57:32.738375 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:32.738343    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:57:32.738583 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:32.738488    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w778v" podUID="10552df3-551a-4023-ad75-003c6559ce60"
Jul 20 09:57:32.896770 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:32.896731    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d48r5" event={"ID":"4d1f349c-9b09-4f4c-9e38-403589ac8d3f","Type":"ContainerStarted","Data":"73c2034f280ef2eda3839abb09f3088e80a2a6bcf583c81481907b5d78b2461d"}
Jul 20 09:57:33.738466 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:33.738432    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:33.738646 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:33.738436    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:57:33.738646 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:33.738554    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gzc" podUID="559d8262-0cc6-4900-a6d2-52167877eb3c"
Jul 20 09:57:33.738768 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:33.738659    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gr6fz" podUID="d8343adb-7f45-419c-b894-e9b307ecb5fd"
Jul 20 09:57:34.239866 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:34.239844    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6bh7x"
Jul 20 09:57:34.240477 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:34.240461    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6bh7x"
Jul 20 09:57:34.243344 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:34.243290    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6bh7x"
Jul 20 09:57:34.243788 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:34.243772    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6bh7x"
Jul 20 09:57:34.257063 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:34.257013    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xbpjz" podStartSLOduration=7.350791636 podStartE2EDuration="27.256995217s" totalImagesPullingTime="19.906203581s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:30.910504695 +0000 UTC m=+24.627419965" watchObservedRunningTime="2026-07-20 09:57:34.256995217 +0000 UTC m=+27.973910487"
Jul 20 09:57:34.738738 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:34.738580    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:57:34.738949 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:34.738816    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w778v" podUID="10552df3-551a-4023-ad75-003c6559ce60"
Jul 20 09:57:34.913108 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:34.913077    2561 generic.go:356] "Generic (PLEG): container finished" podID="ad8a980a-797b-413a-9a49-c8d2fd36e4f5" containerID="41141f3fbf218316d4c576ab8db1b56ad91f499cf6a2087a77d3aabdad1e6565" exitCode=0
Jul 20 09:57:34.913270 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:34.913137    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gx8fw" event={"ID":"ad8a980a-797b-413a-9a49-c8d2fd36e4f5","Type":"ContainerDied","Data":"41141f3fbf218316d4c576ab8db1b56ad91f499cf6a2087a77d3aabdad1e6565"}
Jul 20 09:57:34.917166 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:34.917140    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d48r5" event={"ID":"4d1f349c-9b09-4f4c-9e38-403589ac8d3f","Type":"ContainerStarted","Data":"4f8280158e63511b6d302fdbaa8277c9f49816745341a76eb51a21c4c6ffaa51"}
Jul 20 09:57:34.917436 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:34.917414    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:34.919449 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:34.919419    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhm69" event={"ID":"9886560c-baa6-48cf-a2a9-cb7047d2771e","Type":"ContainerStarted","Data":"63827a3de6e0d1f3ea0f8cc9ba521a3c9b72e7ed4de3f5dab9be88dc484e7d35"}
Jul 20 09:57:34.933845 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:34.933828    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:34.979402 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:34.979351    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-d48r5" podStartSLOduration=7.806072947 podStartE2EDuration="27.979334714s" totalImagesPullingTime="20.173261767s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:34.9772849 +0000 UTC m=+28.694200169" watchObservedRunningTime="2026-07-20 09:57:34.979334714 +0000 UTC m=+28.696249976"
Jul 20 09:57:34.979757 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:34.979732    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fhm69" podStartSLOduration=3.95855101 podStartE2EDuration="27.979726496s" totalImagesPullingTime="24.021175486s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:34.949626343 +0000 UTC m=+28.666541611" watchObservedRunningTime="2026-07-20 09:57:34.979726496 +0000 UTC m=+28.696641764"
Jul 20 09:57:35.738266 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:35.738198    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:57:35.738739 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:35.738208    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:35.738739 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:35.738300    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gr6fz" podUID="d8343adb-7f45-419c-b894-e9b307ecb5fd"
Jul 20 09:57:35.738739 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:35.738373    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gzc" podUID="559d8262-0cc6-4900-a6d2-52167877eb3c"
Jul 20 09:57:35.921695 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:35.921664    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:35.922286 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:35.922266    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:35.935727 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:35.935705    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:57:36.257625 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:36.257380    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gr6fz"]
Jul 20 09:57:36.257777 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:36.257629    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:57:36.257777 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:36.257730    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gr6fz" podUID="d8343adb-7f45-419c-b894-e9b307ecb5fd"
Jul 20 09:57:36.260600 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:36.260564    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-29gzc"]
Jul 20 09:57:36.260723 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:36.260664    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:36.260774 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:36.260754    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gzc" podUID="559d8262-0cc6-4900-a6d2-52167877eb3c"
Jul 20 09:57:36.261205 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:36.261188    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w778v"]
Jul 20 09:57:36.261291 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:36.261282    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:57:36.261392 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:36.261376    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w778v" podUID="10552df3-551a-4023-ad75-003c6559ce60"
Jul 20 09:57:36.925360 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:36.925319    2561 generic.go:356] "Generic (PLEG): container finished" podID="ad8a980a-797b-413a-9a49-c8d2fd36e4f5" containerID="676858fbf3c0381e6df90a2a447668ac466005bf33b4dfecfdbbf92de28122ff" exitCode=0
Jul 20 09:57:36.926035 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:36.925406    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gx8fw" event={"ID":"ad8a980a-797b-413a-9a49-c8d2fd36e4f5","Type":"ContainerDied","Data":"676858fbf3c0381e6df90a2a447668ac466005bf33b4dfecfdbbf92de28122ff"}
Jul 20 09:57:37.738678 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:37.738638    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:57:37.738903 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:37.738757    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:37.738903 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:37.738773    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gr6fz" podUID="d8343adb-7f45-419c-b894-e9b307ecb5fd"
Jul 20 09:57:37.738903 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:37.738788    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:57:37.738903 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:37.738849    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gzc" podUID="559d8262-0cc6-4900-a6d2-52167877eb3c"
Jul 20 09:57:37.739053 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:37.738930    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w778v" podUID="10552df3-551a-4023-ad75-003c6559ce60"
Jul 20 09:57:38.932459 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:38.932423    2561 generic.go:356] "Generic (PLEG): container finished" podID="ad8a980a-797b-413a-9a49-c8d2fd36e4f5" containerID="4c75f62b671ae6261fbfa7a7216d883432c9d5d916fc02bcb46d3d01268fb23a" exitCode=0
Jul 20 09:57:38.932974 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:38.932503    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gx8fw" event={"ID":"ad8a980a-797b-413a-9a49-c8d2fd36e4f5","Type":"ContainerDied","Data":"4c75f62b671ae6261fbfa7a7216d883432c9d5d916fc02bcb46d3d01268fb23a"}
Jul 20 09:57:39.738802 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:39.738766    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:57:39.739012 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:39.738809    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:57:39.739012 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:39.738809    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:39.739012 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:39.738911    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gr6fz" podUID="d8343adb-7f45-419c-b894-e9b307ecb5fd"
Jul 20 09:57:39.739012 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:39.738976    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gzc" podUID="559d8262-0cc6-4900-a6d2-52167877eb3c"
Jul 20 09:57:39.739224 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:39.739056    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w778v" podUID="10552df3-551a-4023-ad75-003c6559ce60"
Jul 20 09:57:40.385437 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:40.385390    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10552df3-551a-4023-ad75-003c6559ce60-metrics-certs\") pod \"network-metrics-daemon-w778v\" (UID: \"10552df3-551a-4023-ad75-003c6559ce60\") " pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:57:40.385919 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:40.385553    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 09:57:40.385919 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:40.385630    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10552df3-551a-4023-ad75-003c6559ce60-metrics-certs podName:10552df3-551a-4023-ad75-003c6559ce60 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:12.385606041 +0000 UTC m=+66.102521292 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10552df3-551a-4023-ad75-003c6559ce60-metrics-certs") pod "network-metrics-daemon-w778v" (UID: "10552df3-551a-4023-ad75-003c6559ce60") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 09:57:40.486713 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:40.486676    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/559d8262-0cc6-4900-a6d2-52167877eb3c-original-pull-secret\") pod \"global-pull-secret-syncer-29gzc\" (UID: \"559d8262-0cc6-4900-a6d2-52167877eb3c\") " pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:40.486909 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:40.486822    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 09:57:40.486909 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:40.486901    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/559d8262-0cc6-4900-a6d2-52167877eb3c-original-pull-secret podName:559d8262-0cc6-4900-a6d2-52167877eb3c nodeName:}" failed. No retries permitted until 2026-07-20 09:58:12.486867818 +0000 UTC m=+66.203783064 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/559d8262-0cc6-4900-a6d2-52167877eb3c-original-pull-secret") pod "global-pull-secret-syncer-29gzc" (UID: "559d8262-0cc6-4900-a6d2-52167877eb3c") : object "kube-system"/"original-pull-secret" not registered
Jul 20 09:57:40.588047 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:40.588006    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gznmk\" (UniqueName: \"kubernetes.io/projected/d8343adb-7f45-419c-b894-e9b307ecb5fd-kube-api-access-gznmk\") pod \"network-check-target-gr6fz\" (UID: \"d8343adb-7f45-419c-b894-e9b307ecb5fd\") " pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:57:40.588207 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:40.588169    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 09:57:40.588207 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:40.588192    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 09:57:40.588207 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:40.588202    2561 projected.go:196] Error preparing data for projected volume kube-api-access-gznmk for pod openshift-network-diagnostics/network-check-target-gr6fz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 09:57:40.588383 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:40.588255    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8343adb-7f45-419c-b894-e9b307ecb5fd-kube-api-access-gznmk podName:d8343adb-7f45-419c-b894-e9b307ecb5fd nodeName:}" failed. No retries permitted until 2026-07-20 09:58:12.58823994 +0000 UTC m=+66.305155191 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gznmk" (UniqueName: "kubernetes.io/projected/d8343adb-7f45-419c-b894-e9b307ecb5fd-kube-api-access-gznmk") pod "network-check-target-gr6fz" (UID: "d8343adb-7f45-419c-b894-e9b307ecb5fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 09:57:41.738484 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:41.738443    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:57:41.738968 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:41.738457    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:41.738968 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:41.738564    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:57:41.738968 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:41.738556    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gr6fz" podUID="d8343adb-7f45-419c-b894-e9b307ecb5fd"
Jul 20 09:57:41.738968 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:41.738657    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gzc" podUID="559d8262-0cc6-4900-a6d2-52167877eb3c"
Jul 20 09:57:41.738968 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:41.738747    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w778v" podUID="10552df3-551a-4023-ad75-003c6559ce60"
Jul 20 09:57:43.128896 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.128849    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeReady"
Jul 20 09:57:43.129259 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.128982    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 20 09:57:43.178096 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.178064    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nqn9s"]
Jul 20 09:57:43.188941 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.188907    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8w7nk"]
Jul 20 09:57:43.189092 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.188985    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nqn9s"
Jul 20 09:57:43.191080 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.191052    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 20 09:57:43.191080 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.191086    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 20 09:57:43.191244 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.191124    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-txv2k\""
Jul 20 09:57:43.203035 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.203015    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nqn9s"]
Jul 20 09:57:43.203133 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.203054    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8w7nk"]
Jul 20 09:57:43.203133 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.203124    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8w7nk"
Jul 20 09:57:43.205203 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.205185    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bk72q\""
Jul 20 09:57:43.205327 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.205311    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 20 09:57:43.205437 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.205422    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 20 09:57:43.205484 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.205445    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 20 09:57:43.309487 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.309458    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c734c345-3620-4c06-9f56-5178fd4ac3a8-cert\") pod \"ingress-canary-8w7nk\" (UID: \"c734c345-3620-4c06-9f56-5178fd4ac3a8\") " pod="openshift-ingress-canary/ingress-canary-8w7nk"
Jul 20 09:57:43.309608 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.309498    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcb4c\" (UniqueName: \"kubernetes.io/projected/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-kube-api-access-xcb4c\") pod \"dns-default-nqn9s\" (UID: \"906abe6c-f9a3-4ef8-80de-43d9ba0f79b2\") " pod="openshift-dns/dns-default-nqn9s"
Jul 20 09:57:43.309608 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.309550    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-metrics-tls\") pod \"dns-default-nqn9s\" (UID: \"906abe6c-f9a3-4ef8-80de-43d9ba0f79b2\") " pod="openshift-dns/dns-default-nqn9s"
Jul 20 09:57:43.309608 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.309583    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-config-volume\") pod \"dns-default-nqn9s\" (UID: \"906abe6c-f9a3-4ef8-80de-43d9ba0f79b2\") " pod="openshift-dns/dns-default-nqn9s"
Jul 20 09:57:43.309608 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.309606    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-tmp-dir\") pod \"dns-default-nqn9s\" (UID: \"906abe6c-f9a3-4ef8-80de-43d9ba0f79b2\") " pod="openshift-dns/dns-default-nqn9s"
Jul 20 09:57:43.309781 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.309678    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwt59\" (UniqueName: \"kubernetes.io/projected/c734c345-3620-4c06-9f56-5178fd4ac3a8-kube-api-access-fwt59\") pod \"ingress-canary-8w7nk\" (UID: \"c734c345-3620-4c06-9f56-5178fd4ac3a8\") " pod="openshift-ingress-canary/ingress-canary-8w7nk"
Jul 20 09:57:43.410437 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.410369    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-config-volume\") pod \"dns-default-nqn9s\" (UID: \"906abe6c-f9a3-4ef8-80de-43d9ba0f79b2\") " pod="openshift-dns/dns-default-nqn9s"
Jul 20 09:57:43.410437 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.410404    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-tmp-dir\") pod \"dns-default-nqn9s\" (UID: \"906abe6c-f9a3-4ef8-80de-43d9ba0f79b2\") " pod="openshift-dns/dns-default-nqn9s"
Jul 20 09:57:43.410437 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.410434    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwt59\" (UniqueName: \"kubernetes.io/projected/c734c345-3620-4c06-9f56-5178fd4ac3a8-kube-api-access-fwt59\") pod \"ingress-canary-8w7nk\" (UID: \"c734c345-3620-4c06-9f56-5178fd4ac3a8\") " pod="openshift-ingress-canary/ingress-canary-8w7nk"
Jul 20 09:57:43.410644 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.410479    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c734c345-3620-4c06-9f56-5178fd4ac3a8-cert\") pod \"ingress-canary-8w7nk\" (UID: \"c734c345-3620-4c06-9f56-5178fd4ac3a8\") " pod="openshift-ingress-canary/ingress-canary-8w7nk"
Jul 20 09:57:43.410644 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.410508    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcb4c\" (UniqueName: \"kubernetes.io/projected/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-kube-api-access-xcb4c\") pod \"dns-default-nqn9s\" (UID: \"906abe6c-f9a3-4ef8-80de-43d9ba0f79b2\") " pod="openshift-dns/dns-default-nqn9s"
Jul 20 09:57:43.410734 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.410693    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-metrics-tls\") pod \"dns-default-nqn9s\" (UID: \"906abe6c-f9a3-4ef8-80de-43d9ba0f79b2\") " pod="openshift-dns/dns-default-nqn9s"
Jul 20 09:57:43.410835 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.410809    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-tmp-dir\") pod \"dns-default-nqn9s\" (UID: \"906abe6c-f9a3-4ef8-80de-43d9ba0f79b2\") " pod="openshift-dns/dns-default-nqn9s"
Jul 20 09:57:43.410913 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:43.410835    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 09:57:43.410969 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:43.410943    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-metrics-tls podName:906abe6c-f9a3-4ef8-80de-43d9ba0f79b2 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:43.910922219 +0000 UTC m=+37.627837470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-metrics-tls") pod "dns-default-nqn9s" (UID: "906abe6c-f9a3-4ef8-80de-43d9ba0f79b2") : secret "dns-default-metrics-tls" not found
Jul 20 09:57:43.411032 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.411013    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-config-volume\") pod \"dns-default-nqn9s\" (UID: \"906abe6c-f9a3-4ef8-80de-43d9ba0f79b2\") " pod="openshift-dns/dns-default-nqn9s"
Jul 20 09:57:43.415466 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.415321    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c734c345-3620-4c06-9f56-5178fd4ac3a8-cert\") pod \"ingress-canary-8w7nk\" (UID: \"c734c345-3620-4c06-9f56-5178fd4ac3a8\") " pod="openshift-ingress-canary/ingress-canary-8w7nk"
Jul 20 09:57:43.418637 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.418615    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcb4c\" (UniqueName: \"kubernetes.io/projected/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-kube-api-access-xcb4c\") pod \"dns-default-nqn9s\" (UID: \"906abe6c-f9a3-4ef8-80de-43d9ba0f79b2\") " pod="openshift-dns/dns-default-nqn9s"
Jul 20 09:57:43.419019 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.418996    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwt59\" (UniqueName: \"kubernetes.io/projected/c734c345-3620-4c06-9f56-5178fd4ac3a8-kube-api-access-fwt59\") pod \"ingress-canary-8w7nk\" (UID: \"c734c345-3620-4c06-9f56-5178fd4ac3a8\") " pod="openshift-ingress-canary/ingress-canary-8w7nk"
Jul 20 09:57:43.510960 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.510928    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8w7nk"
Jul 20 09:57:43.660238 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.660206    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8w7nk"]
Jul 20 09:57:43.665476 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:57:43.665449    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc734c345_3620_4c06_9f56_5178fd4ac3a8.slice/crio-13f2cf18d27aa2536dfffafa46d93ac77223976a7fb4af626a79fde6b1bf031f WatchSource:0}: Error finding container 13f2cf18d27aa2536dfffafa46d93ac77223976a7fb4af626a79fde6b1bf031f: Status 404 returned error can't find the container with id 13f2cf18d27aa2536dfffafa46d93ac77223976a7fb4af626a79fde6b1bf031f
Jul 20 09:57:43.738320 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.738293    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:57:43.738470 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.738296    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:57:43.738530 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.738296    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:57:43.740721 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.740666    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 09:57:43.740721 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.740678    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 09:57:43.740721 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.740685    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 09:57:43.740965 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.740731    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f4r9z\""
Jul 20 09:57:43.741147 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.741134    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 09:57:43.741196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.741154    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b7v24\""
Jul 20 09:57:43.914254 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.914170    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-metrics-tls\") pod \"dns-default-nqn9s\" (UID: \"906abe6c-f9a3-4ef8-80de-43d9ba0f79b2\") " pod="openshift-dns/dns-default-nqn9s"
Jul 20 09:57:43.914400 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:43.914278    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 09:57:43.914400 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:43.914329    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-metrics-tls podName:906abe6c-f9a3-4ef8-80de-43d9ba0f79b2 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:44.914314886 +0000 UTC m=+38.631230133 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-metrics-tls") pod "dns-default-nqn9s" (UID: "906abe6c-f9a3-4ef8-80de-43d9ba0f79b2") : secret "dns-default-metrics-tls" not found
Jul 20 09:57:43.945383 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.945349    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8w7nk" event={"ID":"c734c345-3620-4c06-9f56-5178fd4ac3a8","Type":"ContainerStarted","Data":"13f2cf18d27aa2536dfffafa46d93ac77223976a7fb4af626a79fde6b1bf031f"}
Jul 20 09:57:43.947996 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.947975    2561 generic.go:356] "Generic (PLEG): container finished" podID="ad8a980a-797b-413a-9a49-c8d2fd36e4f5" containerID="bdfae1850e686b5dbb2b543b22b58a770648fb3a28592ae415d25daa8362117f" exitCode=0
Jul 20 09:57:43.948097 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:43.948012    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gx8fw" event={"ID":"ad8a980a-797b-413a-9a49-c8d2fd36e4f5","Type":"ContainerDied","Data":"bdfae1850e686b5dbb2b543b22b58a770648fb3a28592ae415d25daa8362117f"}
Jul 20 09:57:44.921719 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:44.921683    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-metrics-tls\") pod \"dns-default-nqn9s\" (UID: \"906abe6c-f9a3-4ef8-80de-43d9ba0f79b2\") " pod="openshift-dns/dns-default-nqn9s"
Jul 20 09:57:44.922565 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:44.921850    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 09:57:44.922565 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:44.921934    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-metrics-tls podName:906abe6c-f9a3-4ef8-80de-43d9ba0f79b2 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:46.921913317 +0000 UTC m=+40.638828576 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-metrics-tls") pod "dns-default-nqn9s" (UID: "906abe6c-f9a3-4ef8-80de-43d9ba0f79b2") : secret "dns-default-metrics-tls" not found
Jul 20 09:57:44.954185 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:44.954150    2561 generic.go:356] "Generic (PLEG): container finished" podID="ad8a980a-797b-413a-9a49-c8d2fd36e4f5" containerID="fce043c43a09d4b33e8ceda7fe60dc746d6d6872b426233cee67163e1b02d632" exitCode=0
Jul 20 09:57:44.954360 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:44.954207    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gx8fw" event={"ID":"ad8a980a-797b-413a-9a49-c8d2fd36e4f5","Type":"ContainerDied","Data":"fce043c43a09d4b33e8ceda7fe60dc746d6d6872b426233cee67163e1b02d632"}
Jul 20 09:57:45.958081 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:45.957870    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8w7nk" event={"ID":"c734c345-3620-4c06-9f56-5178fd4ac3a8","Type":"ContainerStarted","Data":"cc55db70f6d463baf9ede43e808d1c3eea837fbae6fb5cc9a93f9ef74b66b437"}
Jul 20 09:57:45.961553 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:45.961525    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gx8fw" event={"ID":"ad8a980a-797b-413a-9a49-c8d2fd36e4f5","Type":"ContainerStarted","Data":"fe7850349929e3953884b78f9f94d2ae7499ce6cc63314388a07294b52c470a6"}
Jul 20 09:57:45.975480 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:45.975426    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8w7nk" podStartSLOduration=0.828910127 podStartE2EDuration="2.975409192s" totalImagesPullingTime="2.146499065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:57:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:45.974969523 +0000 UTC m=+39.691884804" watchObservedRunningTime="2026-07-20 09:57:45.975409192 +0000 UTC m=+39.692324461"
Jul 20 09:57:45.998792 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:45.998721    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gx8fw" podStartSLOduration=8.41364554 podStartE2EDuration="38.998704456s" totalImagesPullingTime="30.585058916s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:45.997600395 +0000 UTC m=+39.714515665" watchObservedRunningTime="2026-07-20 09:57:45.998704456 +0000 UTC m=+39.715619724"
Jul 20 09:57:46.938392 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:46.938352    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-metrics-tls\") pod \"dns-default-nqn9s\" (UID: \"906abe6c-f9a3-4ef8-80de-43d9ba0f79b2\") " pod="openshift-dns/dns-default-nqn9s"
Jul 20 09:57:46.938531 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:46.938493    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 09:57:46.938585 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:46.938552    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-metrics-tls podName:906abe6c-f9a3-4ef8-80de-43d9ba0f79b2 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:50.938536879 +0000 UTC m=+44.655452126 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-metrics-tls") pod "dns-default-nqn9s" (UID: "906abe6c-f9a3-4ef8-80de-43d9ba0f79b2") : secret "dns-default-metrics-tls" not found
Jul 20 09:57:50.964567 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:50.964521    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-metrics-tls\") pod \"dns-default-nqn9s\" (UID: \"906abe6c-f9a3-4ef8-80de-43d9ba0f79b2\") " pod="openshift-dns/dns-default-nqn9s"
Jul 20 09:57:50.964991 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:50.964681    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 09:57:50.964991 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:50.964752    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-metrics-tls podName:906abe6c-f9a3-4ef8-80de-43d9ba0f79b2 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:58.964733944 +0000 UTC m=+52.681649211 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-metrics-tls") pod "dns-default-nqn9s" (UID: "906abe6c-f9a3-4ef8-80de-43d9ba0f79b2") : secret "dns-default-metrics-tls" not found
Jul 20 09:57:59.022541 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:57:59.022506    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-metrics-tls\") pod \"dns-default-nqn9s\" (UID: \"906abe6c-f9a3-4ef8-80de-43d9ba0f79b2\") " pod="openshift-dns/dns-default-nqn9s"
Jul 20 09:57:59.023024 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:59.022627    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 09:57:59.023024 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:57:59.022686    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-metrics-tls podName:906abe6c-f9a3-4ef8-80de-43d9ba0f79b2 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:15.022671968 +0000 UTC m=+68.739587216 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-metrics-tls") pod "dns-default-nqn9s" (UID: "906abe6c-f9a3-4ef8-80de-43d9ba0f79b2") : secret "dns-default-metrics-tls" not found
Jul 20 09:58:07.938069 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:07.938036    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d48r5"
Jul 20 09:58:12.411724 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:12.411670    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10552df3-551a-4023-ad75-003c6559ce60-metrics-certs\") pod \"network-metrics-daemon-w778v\" (UID: \"10552df3-551a-4023-ad75-003c6559ce60\") " pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:58:12.414086 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:12.414066    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 09:58:12.422751 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:12.422730    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 20 09:58:12.422862 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:12.422850    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10552df3-551a-4023-ad75-003c6559ce60-metrics-certs podName:10552df3-551a-4023-ad75-003c6559ce60 nodeName:}" failed. No retries permitted until 2026-07-20 09:59:16.422829327 +0000 UTC m=+130.139744588 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10552df3-551a-4023-ad75-003c6559ce60-metrics-certs") pod "network-metrics-daemon-w778v" (UID: "10552df3-551a-4023-ad75-003c6559ce60") : secret "metrics-daemon-secret" not found
Jul 20 09:58:12.512370 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:12.512328    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/559d8262-0cc6-4900-a6d2-52167877eb3c-original-pull-secret\") pod \"global-pull-secret-syncer-29gzc\" (UID: \"559d8262-0cc6-4900-a6d2-52167877eb3c\") " pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:58:12.514378 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:12.514362    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 09:58:12.525931 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:12.525912    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/559d8262-0cc6-4900-a6d2-52167877eb3c-original-pull-secret\") pod \"global-pull-secret-syncer-29gzc\" (UID: \"559d8262-0cc6-4900-a6d2-52167877eb3c\") " pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:58:12.558333 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:12.558313    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gzc"
Jul 20 09:58:12.613475 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:12.613447    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gznmk\" (UniqueName: \"kubernetes.io/projected/d8343adb-7f45-419c-b894-e9b307ecb5fd-kube-api-access-gznmk\") pod \"network-check-target-gr6fz\" (UID: \"d8343adb-7f45-419c-b894-e9b307ecb5fd\") " pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:58:12.616060 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:12.616004    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 09:58:12.626101 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:12.626081    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 09:58:12.637299 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:12.637253    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gznmk\" (UniqueName: \"kubernetes.io/projected/d8343adb-7f45-419c-b894-e9b307ecb5fd-kube-api-access-gznmk\") pod \"network-check-target-gr6fz\" (UID: \"d8343adb-7f45-419c-b894-e9b307ecb5fd\") " pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:58:12.677458 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:12.677388    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-29gzc"]
Jul 20 09:58:12.680633 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:58:12.680610    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod559d8262_0cc6_4900_a6d2_52167877eb3c.slice/crio-86e61a25b0d306a8b74636c247560596220e1b335b1be8640fd4ea86e592a5f1 WatchSource:0}: Error finding container 86e61a25b0d306a8b74636c247560596220e1b335b1be8640fd4ea86e592a5f1: Status 404 returned error can't find the container with id 86e61a25b0d306a8b74636c247560596220e1b335b1be8640fd4ea86e592a5f1
Jul 20 09:58:12.850929 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:12.850433    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f4r9z\""
Jul 20 09:58:12.858226 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:12.858199    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:58:12.977555 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:12.977515    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gr6fz"]
Jul 20 09:58:12.981150 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:58:12.981126    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8343adb_7f45_419c_b894_e9b307ecb5fd.slice/crio-d11cfa1d7208f7a6332a04a3c5524467d624ea66b1f84b7f9b3ac39214586f0f WatchSource:0}: Error finding container d11cfa1d7208f7a6332a04a3c5524467d624ea66b1f84b7f9b3ac39214586f0f: Status 404 returned error can't find the container with id d11cfa1d7208f7a6332a04a3c5524467d624ea66b1f84b7f9b3ac39214586f0f
Jul 20 09:58:13.023125 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:13.023087    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gr6fz" event={"ID":"d8343adb-7f45-419c-b894-e9b307ecb5fd","Type":"ContainerStarted","Data":"d11cfa1d7208f7a6332a04a3c5524467d624ea66b1f84b7f9b3ac39214586f0f"}
Jul 20 09:58:13.024472 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:13.024443    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-29gzc" event={"ID":"559d8262-0cc6-4900-a6d2-52167877eb3c","Type":"ContainerStarted","Data":"86e61a25b0d306a8b74636c247560596220e1b335b1be8640fd4ea86e592a5f1"}
Jul 20 09:58:15.033937 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:15.033908    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-metrics-tls\") pod \"dns-default-nqn9s\" (UID: \"906abe6c-f9a3-4ef8-80de-43d9ba0f79b2\") " pod="openshift-dns/dns-default-nqn9s"
Jul 20 09:58:15.034321 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:15.034046    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 09:58:15.034321 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:15.034111    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-metrics-tls podName:906abe6c-f9a3-4ef8-80de-43d9ba0f79b2 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:47.034091361 +0000 UTC m=+100.751006608 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-metrics-tls") pod "dns-default-nqn9s" (UID: "906abe6c-f9a3-4ef8-80de-43d9ba0f79b2") : secret "dns-default-metrics-tls" not found
Jul 20 09:58:18.038340 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:18.038304    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gr6fz" event={"ID":"d8343adb-7f45-419c-b894-e9b307ecb5fd","Type":"ContainerStarted","Data":"9e1b6582959acb585844d859f5f54bc2446d67208ec06582ef43038267c42911"}
Jul 20 09:58:18.038737 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:18.038398    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:58:18.039736 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:18.039717    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-29gzc" event={"ID":"559d8262-0cc6-4900-a6d2-52167877eb3c","Type":"ContainerStarted","Data":"409e4abedef6b44e09fa606c3bdf3cf1b495ff40ea68873d7e547dd06dd46511"}
Jul 20 09:58:18.065760 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:18.065713    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gr6fz" podStartSLOduration=66.482033138 podStartE2EDuration="1m11.065699944s" totalImagesPullingTime="4.583666806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:57:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:58:18.06442121 +0000 UTC m=+71.781336479" watchObservedRunningTime="2026-07-20 09:58:18.065699944 +0000 UTC m=+71.782615191"
Jul 20 09:58:18.089425 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:18.089387    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-29gzc" podStartSLOduration=66.193331804 podStartE2EDuration="1m11.089373106s" totalImagesPullingTime="4.896041302s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:58:18.088855845 +0000 UTC m=+71.805771110" watchObservedRunningTime="2026-07-20 09:58:18.089373106 +0000 UTC m=+71.806288374"
Jul 20 09:58:23.212455 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:23.212425    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-58c5b89866-b7ptf"]
Jul 20 09:58:23.214513 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:23.214494    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:23.216350 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:23.216323    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 20 09:58:23.216647 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:23.216628    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 20 09:58:23.216788 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:23.216771    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 20 09:58:23.216857 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:23.216784    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 20 09:58:23.216961 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:23.216743    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 20 09:58:23.217083 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:23.217067    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mscwp\""
Jul 20 09:58:23.218914 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:23.217230    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 20 09:58:23.228369 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:23.228348    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-58c5b89866-b7ptf"]
Jul 20 09:58:23.290656 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:23.290626    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad001118-5c0b-498b-a99c-d04c846350bd-service-ca-bundle\") pod \"router-default-58c5b89866-b7ptf\" (UID: \"ad001118-5c0b-498b-a99c-d04c846350bd\") " pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:23.290656 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:23.290659    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ad001118-5c0b-498b-a99c-d04c846350bd-stats-auth\") pod \"router-default-58c5b89866-b7ptf\" (UID: \"ad001118-5c0b-498b-a99c-d04c846350bd\") " pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:23.290825 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:23.290677    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad001118-5c0b-498b-a99c-d04c846350bd-metrics-certs\") pod \"router-default-58c5b89866-b7ptf\" (UID: \"ad001118-5c0b-498b-a99c-d04c846350bd\") " pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:23.290825 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:23.290723    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ad001118-5c0b-498b-a99c-d04c846350bd-default-certificate\") pod \"router-default-58c5b89866-b7ptf\" (UID: \"ad001118-5c0b-498b-a99c-d04c846350bd\") " pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:23.290825 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:23.290805    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhqcv\" (UniqueName: \"kubernetes.io/projected/ad001118-5c0b-498b-a99c-d04c846350bd-kube-api-access-xhqcv\") pod \"router-default-58c5b89866-b7ptf\" (UID: \"ad001118-5c0b-498b-a99c-d04c846350bd\") " pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:23.391536 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:23.391497    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad001118-5c0b-498b-a99c-d04c846350bd-service-ca-bundle\") pod \"router-default-58c5b89866-b7ptf\" (UID: \"ad001118-5c0b-498b-a99c-d04c846350bd\") " pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:23.391701 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:23.391540    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ad001118-5c0b-498b-a99c-d04c846350bd-stats-auth\") pod \"router-default-58c5b89866-b7ptf\" (UID: \"ad001118-5c0b-498b-a99c-d04c846350bd\") " pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:23.391701 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:23.391562    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad001118-5c0b-498b-a99c-d04c846350bd-metrics-certs\") pod \"router-default-58c5b89866-b7ptf\" (UID: \"ad001118-5c0b-498b-a99c-d04c846350bd\") " pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:23.391701 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:23.391589    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ad001118-5c0b-498b-a99c-d04c846350bd-default-certificate\") pod \"router-default-58c5b89866-b7ptf\" (UID: \"ad001118-5c0b-498b-a99c-d04c846350bd\") " pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:23.391701 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:23.391665    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad001118-5c0b-498b-a99c-d04c846350bd-service-ca-bundle podName:ad001118-5c0b-498b-a99c-d04c846350bd nodeName:}" failed. No retries permitted until 2026-07-20 09:58:23.891646944 +0000 UTC m=+77.608562209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ad001118-5c0b-498b-a99c-d04c846350bd-service-ca-bundle") pod "router-default-58c5b89866-b7ptf" (UID: "ad001118-5c0b-498b-a99c-d04c846350bd") : configmap references non-existent config key: service-ca.crt
Jul 20 09:58:23.391701 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:23.391690    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhqcv\" (UniqueName: \"kubernetes.io/projected/ad001118-5c0b-498b-a99c-d04c846350bd-kube-api-access-xhqcv\") pod \"router-default-58c5b89866-b7ptf\" (UID: \"ad001118-5c0b-498b-a99c-d04c846350bd\") " pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:23.392010 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:23.391710    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 09:58:23.392010 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:23.391764    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad001118-5c0b-498b-a99c-d04c846350bd-metrics-certs podName:ad001118-5c0b-498b-a99c-d04c846350bd nodeName:}" failed. No retries permitted until 2026-07-20 09:58:23.891748776 +0000 UTC m=+77.608664023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad001118-5c0b-498b-a99c-d04c846350bd-metrics-certs") pod "router-default-58c5b89866-b7ptf" (UID: "ad001118-5c0b-498b-a99c-d04c846350bd") : secret "router-metrics-certs-default" not found
Jul 20 09:58:23.393994 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:23.393967    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ad001118-5c0b-498b-a99c-d04c846350bd-stats-auth\") pod \"router-default-58c5b89866-b7ptf\" (UID: \"ad001118-5c0b-498b-a99c-d04c846350bd\") " pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:23.394115 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:23.394093    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ad001118-5c0b-498b-a99c-d04c846350bd-default-certificate\") pod \"router-default-58c5b89866-b7ptf\" (UID: \"ad001118-5c0b-498b-a99c-d04c846350bd\") " pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:23.400566 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:23.400545    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhqcv\" (UniqueName: \"kubernetes.io/projected/ad001118-5c0b-498b-a99c-d04c846350bd-kube-api-access-xhqcv\") pod \"router-default-58c5b89866-b7ptf\" (UID: \"ad001118-5c0b-498b-a99c-d04c846350bd\") " pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:23.894460 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:23.894409    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad001118-5c0b-498b-a99c-d04c846350bd-service-ca-bundle\") pod \"router-default-58c5b89866-b7ptf\" (UID: \"ad001118-5c0b-498b-a99c-d04c846350bd\") " pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:23.894460 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:23.894463    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad001118-5c0b-498b-a99c-d04c846350bd-metrics-certs\") pod \"router-default-58c5b89866-b7ptf\" (UID: \"ad001118-5c0b-498b-a99c-d04c846350bd\") " pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:23.894690 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:23.894614    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad001118-5c0b-498b-a99c-d04c846350bd-service-ca-bundle podName:ad001118-5c0b-498b-a99c-d04c846350bd nodeName:}" failed. No retries permitted until 2026-07-20 09:58:24.894593754 +0000 UTC m=+78.611509003 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ad001118-5c0b-498b-a99c-d04c846350bd-service-ca-bundle") pod "router-default-58c5b89866-b7ptf" (UID: "ad001118-5c0b-498b-a99c-d04c846350bd") : configmap references non-existent config key: service-ca.crt
Jul 20 09:58:23.894690 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:23.894614    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 09:58:23.894690 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:23.894660    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad001118-5c0b-498b-a99c-d04c846350bd-metrics-certs podName:ad001118-5c0b-498b-a99c-d04c846350bd nodeName:}" failed. No retries permitted until 2026-07-20 09:58:24.894648967 +0000 UTC m=+78.611564216 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad001118-5c0b-498b-a99c-d04c846350bd-metrics-certs") pod "router-default-58c5b89866-b7ptf" (UID: "ad001118-5c0b-498b-a99c-d04c846350bd") : secret "router-metrics-certs-default" not found
Jul 20 09:58:24.901154 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:24.901101    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad001118-5c0b-498b-a99c-d04c846350bd-service-ca-bundle\") pod \"router-default-58c5b89866-b7ptf\" (UID: \"ad001118-5c0b-498b-a99c-d04c846350bd\") " pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:24.901154 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:24.901160    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad001118-5c0b-498b-a99c-d04c846350bd-metrics-certs\") pod \"router-default-58c5b89866-b7ptf\" (UID: \"ad001118-5c0b-498b-a99c-d04c846350bd\") " pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:24.901677 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:24.901279    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad001118-5c0b-498b-a99c-d04c846350bd-service-ca-bundle podName:ad001118-5c0b-498b-a99c-d04c846350bd nodeName:}" failed. No retries permitted until 2026-07-20 09:58:26.901261945 +0000 UTC m=+80.618177196 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ad001118-5c0b-498b-a99c-d04c846350bd-service-ca-bundle") pod "router-default-58c5b89866-b7ptf" (UID: "ad001118-5c0b-498b-a99c-d04c846350bd") : configmap references non-existent config key: service-ca.crt
Jul 20 09:58:24.901677 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:24.901280    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 09:58:24.901677 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:24.901319    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad001118-5c0b-498b-a99c-d04c846350bd-metrics-certs podName:ad001118-5c0b-498b-a99c-d04c846350bd nodeName:}" failed. No retries permitted until 2026-07-20 09:58:26.90131187 +0000 UTC m=+80.618227117 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad001118-5c0b-498b-a99c-d04c846350bd-metrics-certs") pod "router-default-58c5b89866-b7ptf" (UID: "ad001118-5c0b-498b-a99c-d04c846350bd") : secret "router-metrics-certs-default" not found
Jul 20 09:58:26.588037 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:26.588006    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pnzs5"]
Jul 20 09:58:26.589776 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:26.589761    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pnzs5"
Jul 20 09:58:26.596363 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:26.596333    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 20 09:58:26.596462 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:26.596338    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 20 09:58:26.596462 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:26.596401    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 20 09:58:26.596865 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:26.596848    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 20 09:58:26.596928 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:26.596911    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wds68\""
Jul 20 09:58:26.606853 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:26.606833    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pnzs5"]
Jul 20 09:58:26.714675 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:26.714648    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b58cbaa-28eb-4c6f-af79-543c2c843f35-data-volume\") pod \"insights-runtime-extractor-pnzs5\" (UID: \"2b58cbaa-28eb-4c6f-af79-543c2c843f35\") " pod="openshift-insights/insights-runtime-extractor-pnzs5"
Jul 20 09:58:26.714869 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:26.714693    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b58cbaa-28eb-4c6f-af79-543c2c843f35-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pnzs5\" (UID: \"2b58cbaa-28eb-4c6f-af79-543c2c843f35\") " pod="openshift-insights/insights-runtime-extractor-pnzs5"
Jul 20 09:58:26.714869 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:26.714728    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zwmx\" (UniqueName: \"kubernetes.io/projected/2b58cbaa-28eb-4c6f-af79-543c2c843f35-kube-api-access-6zwmx\") pod \"insights-runtime-extractor-pnzs5\" (UID: \"2b58cbaa-28eb-4c6f-af79-543c2c843f35\") " pod="openshift-insights/insights-runtime-extractor-pnzs5"
Jul 20 09:58:26.714869 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:26.714812    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2b58cbaa-28eb-4c6f-af79-543c2c843f35-crio-socket\") pod \"insights-runtime-extractor-pnzs5\" (UID: \"2b58cbaa-28eb-4c6f-af79-543c2c843f35\") " pod="openshift-insights/insights-runtime-extractor-pnzs5"
Jul 20 09:58:26.714869 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:26.714861    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b58cbaa-28eb-4c6f-af79-543c2c843f35-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pnzs5\" (UID: \"2b58cbaa-28eb-4c6f-af79-543c2c843f35\") " pod="openshift-insights/insights-runtime-extractor-pnzs5"
Jul 20 09:58:26.815323 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:26.815292    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b58cbaa-28eb-4c6f-af79-543c2c843f35-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pnzs5\" (UID: \"2b58cbaa-28eb-4c6f-af79-543c2c843f35\") " pod="openshift-insights/insights-runtime-extractor-pnzs5"
Jul 20 09:58:26.815496 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:26.815343    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b58cbaa-28eb-4c6f-af79-543c2c843f35-data-volume\") pod \"insights-runtime-extractor-pnzs5\" (UID: \"2b58cbaa-28eb-4c6f-af79-543c2c843f35\") " pod="openshift-insights/insights-runtime-extractor-pnzs5"
Jul 20 09:58:26.815566 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:26.815492    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 09:58:26.815566 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:26.815553    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b58cbaa-28eb-4c6f-af79-543c2c843f35-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pnzs5\" (UID: \"2b58cbaa-28eb-4c6f-af79-543c2c843f35\") " pod="openshift-insights/insights-runtime-extractor-pnzs5"
Jul 20 09:58:26.815671 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:26.815569    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b58cbaa-28eb-4c6f-af79-543c2c843f35-kube-rbac-proxy-cm podName:2b58cbaa-28eb-4c6f-af79-543c2c843f35 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:27.315547705 +0000 UTC m=+81.032462955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2b58cbaa-28eb-4c6f-af79-543c2c843f35-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pnzs5" (UID: "2b58cbaa-28eb-4c6f-af79-543c2c843f35") : configmap "kube-rbac-proxy" not found
Jul 20 09:58:26.815671 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:26.815629    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b58cbaa-28eb-4c6f-af79-543c2c843f35-data-volume\") pod \"insights-runtime-extractor-pnzs5\" (UID: \"2b58cbaa-28eb-4c6f-af79-543c2c843f35\") " pod="openshift-insights/insights-runtime-extractor-pnzs5"
Jul 20 09:58:26.815671 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:26.815639    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 09:58:26.815671 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:26.815642    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zwmx\" (UniqueName: \"kubernetes.io/projected/2b58cbaa-28eb-4c6f-af79-543c2c843f35-kube-api-access-6zwmx\") pod \"insights-runtime-extractor-pnzs5\" (UID: \"2b58cbaa-28eb-4c6f-af79-543c2c843f35\") " pod="openshift-insights/insights-runtime-extractor-pnzs5"
Jul 20 09:58:26.815846 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:26.815693    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b58cbaa-28eb-4c6f-af79-543c2c843f35-insights-runtime-extractor-tls podName:2b58cbaa-28eb-4c6f-af79-543c2c843f35 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:27.31567954 +0000 UTC m=+81.032594793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b58cbaa-28eb-4c6f-af79-543c2c843f35-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pnzs5" (UID: "2b58cbaa-28eb-4c6f-af79-543c2c843f35") : secret "insights-runtime-extractor-tls" not found
Jul 20 09:58:26.815846 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:26.815777    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2b58cbaa-28eb-4c6f-af79-543c2c843f35-crio-socket\") pod \"insights-runtime-extractor-pnzs5\" (UID: \"2b58cbaa-28eb-4c6f-af79-543c2c843f35\") " pod="openshift-insights/insights-runtime-extractor-pnzs5"
Jul 20 09:58:26.815948 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:26.815861    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2b58cbaa-28eb-4c6f-af79-543c2c843f35-crio-socket\") pod \"insights-runtime-extractor-pnzs5\" (UID: \"2b58cbaa-28eb-4c6f-af79-543c2c843f35\") " pod="openshift-insights/insights-runtime-extractor-pnzs5"
Jul 20 09:58:26.826068 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:26.826040    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zwmx\" (UniqueName: \"kubernetes.io/projected/2b58cbaa-28eb-4c6f-af79-543c2c843f35-kube-api-access-6zwmx\") pod \"insights-runtime-extractor-pnzs5\" (UID: \"2b58cbaa-28eb-4c6f-af79-543c2c843f35\") " pod="openshift-insights/insights-runtime-extractor-pnzs5"
Jul 20 09:58:26.916986 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:26.916891    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad001118-5c0b-498b-a99c-d04c846350bd-service-ca-bundle\") pod \"router-default-58c5b89866-b7ptf\" (UID: \"ad001118-5c0b-498b-a99c-d04c846350bd\") " pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:26.916986 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:26.916931    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad001118-5c0b-498b-a99c-d04c846350bd-metrics-certs\") pod \"router-default-58c5b89866-b7ptf\" (UID: \"ad001118-5c0b-498b-a99c-d04c846350bd\") " pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:26.917172 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:26.917065    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad001118-5c0b-498b-a99c-d04c846350bd-service-ca-bundle podName:ad001118-5c0b-498b-a99c-d04c846350bd nodeName:}" failed. No retries permitted until 2026-07-20 09:58:30.917043867 +0000 UTC m=+84.633959113 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ad001118-5c0b-498b-a99c-d04c846350bd-service-ca-bundle") pod "router-default-58c5b89866-b7ptf" (UID: "ad001118-5c0b-498b-a99c-d04c846350bd") : configmap references non-existent config key: service-ca.crt
Jul 20 09:58:26.917172 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:26.917082    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 09:58:26.917172 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:26.917154    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad001118-5c0b-498b-a99c-d04c846350bd-metrics-certs podName:ad001118-5c0b-498b-a99c-d04c846350bd nodeName:}" failed. No retries permitted until 2026-07-20 09:58:30.917136765 +0000 UTC m=+84.634052029 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad001118-5c0b-498b-a99c-d04c846350bd-metrics-certs") pod "router-default-58c5b89866-b7ptf" (UID: "ad001118-5c0b-498b-a99c-d04c846350bd") : secret "router-metrics-certs-default" not found
Jul 20 09:58:27.320340 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:27.320301    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b58cbaa-28eb-4c6f-af79-543c2c843f35-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pnzs5\" (UID: \"2b58cbaa-28eb-4c6f-af79-543c2c843f35\") " pod="openshift-insights/insights-runtime-extractor-pnzs5"
Jul 20 09:58:27.320502 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:27.320403    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b58cbaa-28eb-4c6f-af79-543c2c843f35-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pnzs5\" (UID: \"2b58cbaa-28eb-4c6f-af79-543c2c843f35\") " pod="openshift-insights/insights-runtime-extractor-pnzs5"
Jul 20 09:58:27.320502 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:27.320465    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 09:58:27.320587 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:27.320509    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 09:58:27.320587 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:27.320530    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b58cbaa-28eb-4c6f-af79-543c2c843f35-insights-runtime-extractor-tls podName:2b58cbaa-28eb-4c6f-af79-543c2c843f35 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:28.320516149 +0000 UTC m=+82.037431411 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b58cbaa-28eb-4c6f-af79-543c2c843f35-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pnzs5" (UID: "2b58cbaa-28eb-4c6f-af79-543c2c843f35") : secret "insights-runtime-extractor-tls" not found
Jul 20 09:58:27.320587 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:27.320560    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b58cbaa-28eb-4c6f-af79-543c2c843f35-kube-rbac-proxy-cm podName:2b58cbaa-28eb-4c6f-af79-543c2c843f35 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:28.320549108 +0000 UTC m=+82.037464355 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2b58cbaa-28eb-4c6f-af79-543c2c843f35-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pnzs5" (UID: "2b58cbaa-28eb-4c6f-af79-543c2c843f35") : configmap "kube-rbac-proxy" not found
Jul 20 09:58:28.326639 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:28.326584    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b58cbaa-28eb-4c6f-af79-543c2c843f35-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pnzs5\" (UID: \"2b58cbaa-28eb-4c6f-af79-543c2c843f35\") " pod="openshift-insights/insights-runtime-extractor-pnzs5"
Jul 20 09:58:28.327033 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:28.326666    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b58cbaa-28eb-4c6f-af79-543c2c843f35-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pnzs5\" (UID: \"2b58cbaa-28eb-4c6f-af79-543c2c843f35\") " pod="openshift-insights/insights-runtime-extractor-pnzs5"
Jul 20 09:58:28.327033 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:28.326738    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 09:58:28.327033 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:28.326741    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 09:58:28.327033 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:28.326791    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b58cbaa-28eb-4c6f-af79-543c2c843f35-kube-rbac-proxy-cm podName:2b58cbaa-28eb-4c6f-af79-543c2c843f35 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:30.326777951 +0000 UTC m=+84.043693197 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2b58cbaa-28eb-4c6f-af79-543c2c843f35-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pnzs5" (UID: "2b58cbaa-28eb-4c6f-af79-543c2c843f35") : configmap "kube-rbac-proxy" not found
Jul 20 09:58:28.327033 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:28.326804    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b58cbaa-28eb-4c6f-af79-543c2c843f35-insights-runtime-extractor-tls podName:2b58cbaa-28eb-4c6f-af79-543c2c843f35 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:30.326797698 +0000 UTC m=+84.043712944 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b58cbaa-28eb-4c6f-af79-543c2c843f35-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pnzs5" (UID: "2b58cbaa-28eb-4c6f-af79-543c2c843f35") : secret "insights-runtime-extractor-tls" not found
Jul 20 09:58:28.560442 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:28.560414    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hp5fq_74a3c5ba-e636-47df-b3cd-1ad53902bc5a/dns-node-resolver/0.log"
Jul 20 09:58:29.560060 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:29.559969    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gxfkw_c7e59906-508b-40d8-a8e4-4244d7c1cbbd/node-ca/0.log"
Jul 20 09:58:29.961289 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:29.961224    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8w7nk_c734c345-3620-4c06-9f56-5178fd4ac3a8/serve-healthcheck-canary/0.log"
Jul 20 09:58:30.341932 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:30.341868    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b58cbaa-28eb-4c6f-af79-543c2c843f35-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pnzs5\" (UID: \"2b58cbaa-28eb-4c6f-af79-543c2c843f35\") " pod="openshift-insights/insights-runtime-extractor-pnzs5"
Jul 20 09:58:30.342123 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:30.341981    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b58cbaa-28eb-4c6f-af79-543c2c843f35-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pnzs5\" (UID: \"2b58cbaa-28eb-4c6f-af79-543c2c843f35\") " pod="openshift-insights/insights-runtime-extractor-pnzs5"
Jul 20 09:58:30.342123 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:30.342030    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 09:58:30.342123 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:30.342098    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b58cbaa-28eb-4c6f-af79-543c2c843f35-insights-runtime-extractor-tls podName:2b58cbaa-28eb-4c6f-af79-543c2c843f35 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:34.342081754 +0000 UTC m=+88.058997017 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b58cbaa-28eb-4c6f-af79-543c2c843f35-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pnzs5" (UID: "2b58cbaa-28eb-4c6f-af79-543c2c843f35") : secret "insights-runtime-extractor-tls" not found
Jul 20 09:58:30.342123 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:30.342087    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 09:58:30.342287 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:30.342154    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b58cbaa-28eb-4c6f-af79-543c2c843f35-kube-rbac-proxy-cm podName:2b58cbaa-28eb-4c6f-af79-543c2c843f35 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:34.342138793 +0000 UTC m=+88.059054043 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2b58cbaa-28eb-4c6f-af79-543c2c843f35-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pnzs5" (UID: "2b58cbaa-28eb-4c6f-af79-543c2c843f35") : configmap "kube-rbac-proxy" not found
Jul 20 09:58:30.945855 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:30.945828    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad001118-5c0b-498b-a99c-d04c846350bd-metrics-certs\") pod \"router-default-58c5b89866-b7ptf\" (UID: \"ad001118-5c0b-498b-a99c-d04c846350bd\") " pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:30.946288 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:30.945931    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad001118-5c0b-498b-a99c-d04c846350bd-service-ca-bundle\") pod \"router-default-58c5b89866-b7ptf\" (UID: \"ad001118-5c0b-498b-a99c-d04c846350bd\") " pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:30.946288 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:30.945975    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 09:58:30.946288 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:30.946038    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad001118-5c0b-498b-a99c-d04c846350bd-service-ca-bundle podName:ad001118-5c0b-498b-a99c-d04c846350bd nodeName:}" failed. No retries permitted until 2026-07-20 09:58:38.946018312 +0000 UTC m=+92.662933559 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ad001118-5c0b-498b-a99c-d04c846350bd-service-ca-bundle") pod "router-default-58c5b89866-b7ptf" (UID: "ad001118-5c0b-498b-a99c-d04c846350bd") : configmap references non-existent config key: service-ca.crt
Jul 20 09:58:30.946288 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:30.946054    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad001118-5c0b-498b-a99c-d04c846350bd-metrics-certs podName:ad001118-5c0b-498b-a99c-d04c846350bd nodeName:}" failed. No retries permitted until 2026-07-20 09:58:38.946047763 +0000 UTC m=+92.662963009 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad001118-5c0b-498b-a99c-d04c846350bd-metrics-certs") pod "router-default-58c5b89866-b7ptf" (UID: "ad001118-5c0b-498b-a99c-d04c846350bd") : secret "router-metrics-certs-default" not found
Jul 20 09:58:32.959119 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:32.959083    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8gn2c"]
Jul 20 09:58:32.963218 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:32.963197    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8gn2c"
Jul 20 09:58:32.965820 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:32.965793    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 20 09:58:32.966740 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:32.966724    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 20 09:58:32.968970 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:32.968948    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 20 09:58:32.969070 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:32.969048    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-tgtkf\""
Jul 20 09:58:32.969327 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:32.969313    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 20 09:58:32.999252 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:32.999227    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8gn2c"]
Jul 20 09:58:33.063449 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:33.063419    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9b9a399a-33c9-4c5f-a918-521c8b328583-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-8gn2c\" (UID: \"9b9a399a-33c9-4c5f-a918-521c8b328583\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8gn2c"
Jul 20 09:58:33.063601 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:33.063461    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9b9a399a-33c9-4c5f-a918-521c8b328583-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-8gn2c\" (UID: \"9b9a399a-33c9-4c5f-a918-521c8b328583\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8gn2c"
Jul 20 09:58:33.063601 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:33.063488    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqh9m\" (UniqueName: \"kubernetes.io/projected/9b9a399a-33c9-4c5f-a918-521c8b328583-kube-api-access-zqh9m\") pod \"kube-storage-version-migrator-operator-7658d9b749-8gn2c\" (UID: \"9b9a399a-33c9-4c5f-a918-521c8b328583\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8gn2c"
Jul 20 09:58:33.163838 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:33.163809    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9b9a399a-33c9-4c5f-a918-521c8b328583-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-8gn2c\" (UID: \"9b9a399a-33c9-4c5f-a918-521c8b328583\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8gn2c"
Jul 20 09:58:33.163979 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:33.163851    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9b9a399a-33c9-4c5f-a918-521c8b328583-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-8gn2c\" (UID: \"9b9a399a-33c9-4c5f-a918-521c8b328583\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8gn2c"
Jul 20 09:58:33.163979 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:33.163896    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqh9m\" (UniqueName: \"kubernetes.io/projected/9b9a399a-33c9-4c5f-a918-521c8b328583-kube-api-access-zqh9m\") pod \"kube-storage-version-migrator-operator-7658d9b749-8gn2c\" (UID: \"9b9a399a-33c9-4c5f-a918-521c8b328583\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8gn2c"
Jul 20 09:58:33.164387 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:33.164359    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9b9a399a-33c9-4c5f-a918-521c8b328583-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-8gn2c\" (UID: \"9b9a399a-33c9-4c5f-a918-521c8b328583\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8gn2c"
Jul 20 09:58:33.166118 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:33.166098    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9b9a399a-33c9-4c5f-a918-521c8b328583-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-8gn2c\" (UID: \"9b9a399a-33c9-4c5f-a918-521c8b328583\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8gn2c"
Jul 20 09:58:33.172419 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:33.172395    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqh9m\" (UniqueName: \"kubernetes.io/projected/9b9a399a-33c9-4c5f-a918-521c8b328583-kube-api-access-zqh9m\") pod \"kube-storage-version-migrator-operator-7658d9b749-8gn2c\" (UID: \"9b9a399a-33c9-4c5f-a918-521c8b328583\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8gn2c"
Jul 20 09:58:33.272353 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:33.272327    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8gn2c"
Jul 20 09:58:33.403132 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:33.403102    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8gn2c"]
Jul 20 09:58:33.406691 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:58:33.406664    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b9a399a_33c9_4c5f_a918_521c8b328583.slice/crio-29a76db03ff417222bc321db8586ccccda33cfb991cb0fbc9db9da5f05e3070f WatchSource:0}: Error finding container 29a76db03ff417222bc321db8586ccccda33cfb991cb0fbc9db9da5f05e3070f: Status 404 returned error can't find the container with id 29a76db03ff417222bc321db8586ccccda33cfb991cb0fbc9db9da5f05e3070f
Jul 20 09:58:34.078867 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:34.078829    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8gn2c" event={"ID":"9b9a399a-33c9-4c5f-a918-521c8b328583","Type":"ContainerStarted","Data":"29a76db03ff417222bc321db8586ccccda33cfb991cb0fbc9db9da5f05e3070f"}
Jul 20 09:58:34.373655 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:34.373570    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b58cbaa-28eb-4c6f-af79-543c2c843f35-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pnzs5\" (UID: \"2b58cbaa-28eb-4c6f-af79-543c2c843f35\") " pod="openshift-insights/insights-runtime-extractor-pnzs5"
Jul 20 09:58:34.373655 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:34.373634    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b58cbaa-28eb-4c6f-af79-543c2c843f35-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pnzs5\" (UID: \"2b58cbaa-28eb-4c6f-af79-543c2c843f35\") " pod="openshift-insights/insights-runtime-extractor-pnzs5"
Jul 20 09:58:34.373896 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:34.373709    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 09:58:34.373896 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:34.373740    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 09:58:34.373896 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:34.373788    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b58cbaa-28eb-4c6f-af79-543c2c843f35-kube-rbac-proxy-cm podName:2b58cbaa-28eb-4c6f-af79-543c2c843f35 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:42.37376749 +0000 UTC m=+96.090682737 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2b58cbaa-28eb-4c6f-af79-543c2c843f35-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pnzs5" (UID: "2b58cbaa-28eb-4c6f-af79-543c2c843f35") : configmap "kube-rbac-proxy" not found
Jul 20 09:58:34.373896 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:34.373806    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b58cbaa-28eb-4c6f-af79-543c2c843f35-insights-runtime-extractor-tls podName:2b58cbaa-28eb-4c6f-af79-543c2c843f35 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:42.373797624 +0000 UTC m=+96.090712874 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b58cbaa-28eb-4c6f-af79-543c2c843f35-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pnzs5" (UID: "2b58cbaa-28eb-4c6f-af79-543c2c843f35") : secret "insights-runtime-extractor-tls" not found
Jul 20 09:58:35.083523 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:35.083492    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8gn2c" event={"ID":"9b9a399a-33c9-4c5f-a918-521c8b328583","Type":"ContainerStarted","Data":"477a38ea46066b5db19c325d1578d7bcd3c24bce1bca332475e01c92145ceed2"}
Jul 20 09:58:35.102318 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:35.102160    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8gn2c" podStartSLOduration=1.518585453 podStartE2EDuration="3.102142992s" totalImagesPullingTime="1.583557539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:58:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:58:35.101761131 +0000 UTC m=+88.818676401" watchObservedRunningTime="2026-07-20 09:58:35.102142992 +0000 UTC m=+88.819058263"
Jul 20 09:58:39.008759 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:39.008721    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad001118-5c0b-498b-a99c-d04c846350bd-service-ca-bundle\") pod \"router-default-58c5b89866-b7ptf\" (UID: \"ad001118-5c0b-498b-a99c-d04c846350bd\") " pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:39.008759 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:39.008762    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad001118-5c0b-498b-a99c-d04c846350bd-metrics-certs\") pod \"router-default-58c5b89866-b7ptf\" (UID: \"ad001118-5c0b-498b-a99c-d04c846350bd\") " pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:39.009216 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:39.008863    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 09:58:39.009216 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:39.008930    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad001118-5c0b-498b-a99c-d04c846350bd-service-ca-bundle podName:ad001118-5c0b-498b-a99c-d04c846350bd nodeName:}" failed. No retries permitted until 2026-07-20 09:58:55.008908782 +0000 UTC m=+108.725824052 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ad001118-5c0b-498b-a99c-d04c846350bd-service-ca-bundle") pod "router-default-58c5b89866-b7ptf" (UID: "ad001118-5c0b-498b-a99c-d04c846350bd") : configmap references non-existent config key: service-ca.crt
Jul 20 09:58:39.009216 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:39.008953    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad001118-5c0b-498b-a99c-d04c846350bd-metrics-certs podName:ad001118-5c0b-498b-a99c-d04c846350bd nodeName:}" failed. No retries permitted until 2026-07-20 09:58:55.008946955 +0000 UTC m=+108.725862201 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad001118-5c0b-498b-a99c-d04c846350bd-metrics-certs") pod "router-default-58c5b89866-b7ptf" (UID: "ad001118-5c0b-498b-a99c-d04c846350bd") : secret "router-metrics-certs-default" not found
Jul 20 09:58:39.173612 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:39.173586    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-fxc8x"]
Jul 20 09:58:39.176540 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:39.176525    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-fxc8x"
Jul 20 09:58:39.183613 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:39.183592    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 20 09:58:39.188219 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:39.188203    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-d2vfj\""
Jul 20 09:58:39.190443 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:39.190428    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 20 09:58:39.191253 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:39.191240    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 20 09:58:39.193548 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:39.193535    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 20 09:58:39.250260 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:39.250236    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-fxc8x"]
Jul 20 09:58:39.311061 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:39.311038    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/de60bb63-060a-4b2b-9107-bd44cf402b98-signing-cabundle\") pod \"service-ca-58598695f7-fxc8x\" (UID: \"de60bb63-060a-4b2b-9107-bd44cf402b98\") " pod="openshift-service-ca/service-ca-58598695f7-fxc8x"
Jul 20 09:58:39.311179 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:39.311077    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/de60bb63-060a-4b2b-9107-bd44cf402b98-signing-key\") pod \"service-ca-58598695f7-fxc8x\" (UID: \"de60bb63-060a-4b2b-9107-bd44cf402b98\") " pod="openshift-service-ca/service-ca-58598695f7-fxc8x"
Jul 20 09:58:39.311179 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:39.311137    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8cv4\" (UniqueName: \"kubernetes.io/projected/de60bb63-060a-4b2b-9107-bd44cf402b98-kube-api-access-c8cv4\") pod \"service-ca-58598695f7-fxc8x\" (UID: \"de60bb63-060a-4b2b-9107-bd44cf402b98\") " pod="openshift-service-ca/service-ca-58598695f7-fxc8x"
Jul 20 09:58:39.412366 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:39.412340    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8cv4\" (UniqueName: \"kubernetes.io/projected/de60bb63-060a-4b2b-9107-bd44cf402b98-kube-api-access-c8cv4\") pod \"service-ca-58598695f7-fxc8x\" (UID: \"de60bb63-060a-4b2b-9107-bd44cf402b98\") " pod="openshift-service-ca/service-ca-58598695f7-fxc8x"
Jul 20 09:58:39.412465 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:39.412407    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/de60bb63-060a-4b2b-9107-bd44cf402b98-signing-cabundle\") pod \"service-ca-58598695f7-fxc8x\" (UID: \"de60bb63-060a-4b2b-9107-bd44cf402b98\") " pod="openshift-service-ca/service-ca-58598695f7-fxc8x"
Jul 20 09:58:39.412465 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:39.412435    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/de60bb63-060a-4b2b-9107-bd44cf402b98-signing-key\") pod \"service-ca-58598695f7-fxc8x\" (UID: \"de60bb63-060a-4b2b-9107-bd44cf402b98\") " pod="openshift-service-ca/service-ca-58598695f7-fxc8x"
Jul 20 09:58:39.413139 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:39.413120    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/de60bb63-060a-4b2b-9107-bd44cf402b98-signing-cabundle\") pod \"service-ca-58598695f7-fxc8x\" (UID: \"de60bb63-060a-4b2b-9107-bd44cf402b98\") " pod="openshift-service-ca/service-ca-58598695f7-fxc8x"
Jul 20 09:58:39.414868 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:39.414847    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/de60bb63-060a-4b2b-9107-bd44cf402b98-signing-key\") pod \"service-ca-58598695f7-fxc8x\" (UID: \"de60bb63-060a-4b2b-9107-bd44cf402b98\") " pod="openshift-service-ca/service-ca-58598695f7-fxc8x"
Jul 20 09:58:39.422700 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:39.422677    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8cv4\" (UniqueName: \"kubernetes.io/projected/de60bb63-060a-4b2b-9107-bd44cf402b98-kube-api-access-c8cv4\") pod \"service-ca-58598695f7-fxc8x\" (UID: \"de60bb63-060a-4b2b-9107-bd44cf402b98\") " pod="openshift-service-ca/service-ca-58598695f7-fxc8x"
Jul 20 09:58:39.484816 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:39.484786    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-fxc8x"
Jul 20 09:58:39.612459 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:39.612385    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-fxc8x"]
Jul 20 09:58:39.616555 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:58:39.616526    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde60bb63_060a_4b2b_9107_bd44cf402b98.slice/crio-f67288122f6ad50d4278172f3b33f8086f99f5c081730dbe7291c548cf8889a4 WatchSource:0}: Error finding container f67288122f6ad50d4278172f3b33f8086f99f5c081730dbe7291c548cf8889a4: Status 404 returned error can't find the container with id f67288122f6ad50d4278172f3b33f8086f99f5c081730dbe7291c548cf8889a4
Jul 20 09:58:40.098946 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:40.098906    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-fxc8x" event={"ID":"de60bb63-060a-4b2b-9107-bd44cf402b98","Type":"ContainerStarted","Data":"f67288122f6ad50d4278172f3b33f8086f99f5c081730dbe7291c548cf8889a4"}
Jul 20 09:58:42.105688 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:42.105650    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-fxc8x" event={"ID":"de60bb63-060a-4b2b-9107-bd44cf402b98","Type":"ContainerStarted","Data":"5d85b6da1e87039b6b3f5f237c10eb90d774a1b754fc1bdb2eb7416efc6fe728"}
Jul 20 09:58:42.138687 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:42.138628    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-fxc8x" podStartSLOduration=1.519926667 podStartE2EDuration="3.138608156s" totalImagesPullingTime="1.618681489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:58:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:58:42.137866244 +0000 UTC m=+95.854781514" watchObservedRunningTime="2026-07-20 09:58:42.138608156 +0000 UTC m=+95.855523426"
Jul 20 09:58:42.435820 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:42.435743    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b58cbaa-28eb-4c6f-af79-543c2c843f35-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pnzs5\" (UID: \"2b58cbaa-28eb-4c6f-af79-543c2c843f35\") " pod="openshift-insights/insights-runtime-extractor-pnzs5"
Jul 20 09:58:42.435820 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:42.435806    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b58cbaa-28eb-4c6f-af79-543c2c843f35-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pnzs5\" (UID: \"2b58cbaa-28eb-4c6f-af79-543c2c843f35\") " pod="openshift-insights/insights-runtime-extractor-pnzs5"
Jul 20 09:58:42.436045 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:42.435931    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 09:58:42.436045 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:58:42.436022    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b58cbaa-28eb-4c6f-af79-543c2c843f35-insights-runtime-extractor-tls podName:2b58cbaa-28eb-4c6f-af79-543c2c843f35 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:58.436000109 +0000 UTC m=+112.152915373 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b58cbaa-28eb-4c6f-af79-543c2c843f35-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pnzs5" (UID: "2b58cbaa-28eb-4c6f-af79-543c2c843f35") : secret "insights-runtime-extractor-tls" not found
Jul 20 09:58:42.436260 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:42.436244    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b58cbaa-28eb-4c6f-af79-543c2c843f35-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pnzs5\" (UID: \"2b58cbaa-28eb-4c6f-af79-543c2c843f35\") " pod="openshift-insights/insights-runtime-extractor-pnzs5"
Jul 20 09:58:47.073285 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:47.073249    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-metrics-tls\") pod \"dns-default-nqn9s\" (UID: \"906abe6c-f9a3-4ef8-80de-43d9ba0f79b2\") " pod="openshift-dns/dns-default-nqn9s"
Jul 20 09:58:47.075492 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:47.075472    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/906abe6c-f9a3-4ef8-80de-43d9ba0f79b2-metrics-tls\") pod \"dns-default-nqn9s\" (UID: \"906abe6c-f9a3-4ef8-80de-43d9ba0f79b2\") " pod="openshift-dns/dns-default-nqn9s"
Jul 20 09:58:47.102843 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:47.102816    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-txv2k\""
Jul 20 09:58:47.108872 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:47.108857    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nqn9s"
Jul 20 09:58:47.271984 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:47.271898    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nqn9s"]
Jul 20 09:58:47.277421 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:58:47.277394    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod906abe6c_f9a3_4ef8_80de_43d9ba0f79b2.slice/crio-1665047b9f746bbeff37b6584644d7e1e9d3870b0acb8c8071eb7912b292d35a WatchSource:0}: Error finding container 1665047b9f746bbeff37b6584644d7e1e9d3870b0acb8c8071eb7912b292d35a: Status 404 returned error can't find the container with id 1665047b9f746bbeff37b6584644d7e1e9d3870b0acb8c8071eb7912b292d35a
Jul 20 09:58:48.122139 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:48.122100    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nqn9s" event={"ID":"906abe6c-f9a3-4ef8-80de-43d9ba0f79b2","Type":"ContainerStarted","Data":"1665047b9f746bbeff37b6584644d7e1e9d3870b0acb8c8071eb7912b292d35a"}
Jul 20 09:58:49.044087 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:49.044065    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gr6fz"
Jul 20 09:58:49.127477 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:49.127448    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nqn9s" event={"ID":"906abe6c-f9a3-4ef8-80de-43d9ba0f79b2","Type":"ContainerStarted","Data":"bb50e180fa98ea8382ef2a53d83232439c54e1b553e08e7d6921a2d7edcd0a02"}
Jul 20 09:58:50.132028 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:50.131991    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nqn9s" event={"ID":"906abe6c-f9a3-4ef8-80de-43d9ba0f79b2","Type":"ContainerStarted","Data":"38747e0c201d34db64fa6c2e26ae93592b04fecf101c937cdd1929568e686d88"}
Jul 20 09:58:50.132398 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:50.132113    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nqn9s"
Jul 20 09:58:50.151772 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:50.151725    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nqn9s" podStartSLOduration=65.436644625 podStartE2EDuration="1m7.151709437s" totalImagesPullingTime="1.715064812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:57:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:58:50.150748388 +0000 UTC m=+103.867663709" watchObservedRunningTime="2026-07-20 09:58:50.151709437 +0000 UTC m=+103.868624705"
Jul 20 09:58:55.038440 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:55.038390    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad001118-5c0b-498b-a99c-d04c846350bd-service-ca-bundle\") pod \"router-default-58c5b89866-b7ptf\" (UID: \"ad001118-5c0b-498b-a99c-d04c846350bd\") " pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:55.038440 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:55.038443    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad001118-5c0b-498b-a99c-d04c846350bd-metrics-certs\") pod \"router-default-58c5b89866-b7ptf\" (UID: \"ad001118-5c0b-498b-a99c-d04c846350bd\") " pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:55.039038 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:55.039016    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad001118-5c0b-498b-a99c-d04c846350bd-service-ca-bundle\") pod \"router-default-58c5b89866-b7ptf\" (UID: \"ad001118-5c0b-498b-a99c-d04c846350bd\") " pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:55.040777 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:55.040755    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad001118-5c0b-498b-a99c-d04c846350bd-metrics-certs\") pod \"router-default-58c5b89866-b7ptf\" (UID: \"ad001118-5c0b-498b-a99c-d04c846350bd\") " pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:55.324786 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:55.324680    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:55.464100 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:55.464066    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-58c5b89866-b7ptf"]
Jul 20 09:58:55.466655 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:58:55.466629    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad001118_5c0b_498b_a99c_d04c846350bd.slice/crio-fc34f6addfe6b750df6a9b7f260eca5910e04fcc0532b256430952c225a02658 WatchSource:0}: Error finding container fc34f6addfe6b750df6a9b7f260eca5910e04fcc0532b256430952c225a02658: Status 404 returned error can't find the container with id fc34f6addfe6b750df6a9b7f260eca5910e04fcc0532b256430952c225a02658
Jul 20 09:58:56.153558 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:56.153517    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-58c5b89866-b7ptf" event={"ID":"ad001118-5c0b-498b-a99c-d04c846350bd","Type":"ContainerStarted","Data":"555b235e726aafa54ab25fcb63136819868b5d9765dd3dd7a7616be2a01b38a4"}
Jul 20 09:58:56.154021 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:56.153586    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-58c5b89866-b7ptf" event={"ID":"ad001118-5c0b-498b-a99c-d04c846350bd","Type":"ContainerStarted","Data":"fc34f6addfe6b750df6a9b7f260eca5910e04fcc0532b256430952c225a02658"}
Jul 20 09:58:56.177300 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:56.177254    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-58c5b89866-b7ptf" podStartSLOduration=33.177240811 podStartE2EDuration="33.177240811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:58:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:58:56.174900736 +0000 UTC m=+109.891816023" watchObservedRunningTime="2026-07-20 09:58:56.177240811 +0000 UTC m=+109.894156080"
Jul 20 09:58:56.325698 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:56.325654    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:56.328200 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:56.328176    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:57.156170 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:57.156138    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:57.157376 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:57.157351    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-58c5b89866-b7ptf"
Jul 20 09:58:58.463618 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:58.463580    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b58cbaa-28eb-4c6f-af79-543c2c843f35-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pnzs5\" (UID: \"2b58cbaa-28eb-4c6f-af79-543c2c843f35\") " pod="openshift-insights/insights-runtime-extractor-pnzs5"
Jul 20 09:58:58.466011 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:58.465989    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b58cbaa-28eb-4c6f-af79-543c2c843f35-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pnzs5\" (UID: \"2b58cbaa-28eb-4c6f-af79-543c2c843f35\") " pod="openshift-insights/insights-runtime-extractor-pnzs5"
Jul 20 09:58:58.698410 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:58.698363    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pnzs5"
Jul 20 09:58:58.849605 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:58.849576    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pnzs5"]
Jul 20 09:58:58.853228 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:58:58.853197    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b58cbaa_28eb_4c6f_af79_543c2c843f35.slice/crio-84fd64ae7e8cd686deffed65e3c3288d05cebf3ce644093564580d8dce548568 WatchSource:0}: Error finding container 84fd64ae7e8cd686deffed65e3c3288d05cebf3ce644093564580d8dce548568: Status 404 returned error can't find the container with id 84fd64ae7e8cd686deffed65e3c3288d05cebf3ce644093564580d8dce548568
Jul 20 09:58:59.162072 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:58:59.162040    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pnzs5" event={"ID":"2b58cbaa-28eb-4c6f-af79-543c2c843f35","Type":"ContainerStarted","Data":"84fd64ae7e8cd686deffed65e3c3288d05cebf3ce644093564580d8dce548568"}
Jul 20 09:59:00.137456 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:00.137428    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nqn9s"
Jul 20 09:59:02.867903 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:02.867856    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-65ff74448-qd7l6"]
Jul 20 09:59:02.877020 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:02.876996    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65ff74448-qd7l6"
Jul 20 09:59:02.879096 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:02.879072    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 20 09:59:02.879799 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:02.879764    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 20 09:59:02.879799 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:02.879788    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 20 09:59:02.879996 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:02.879860    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 20 09:59:02.887221 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:02.887194    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-65ff74448-qd7l6"]
Jul 20 09:59:02.900224 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:02.900201    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-d66598b74-8fxp2"]
Jul 20 09:59:02.903330 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:02.903308    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d66598b74-8fxp2"
Jul 20 09:59:02.907935 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:02.907915    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 20 09:59:02.908066 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:02.908025    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 20 09:59:02.908269 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:02.908253    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 20 09:59:02.908803 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:02.908646    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9q88t\""
Jul 20 09:59:02.915698 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:02.915675    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 20 09:59:02.923360 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:02.923338    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d66598b74-8fxp2"]
Jul 20 09:59:02.997508 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:02.997473    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82a51935-5e62-4145-b5bb-a0553481b469-registry-tls\") pod \"image-registry-d66598b74-8fxp2\" (UID: \"82a51935-5e62-4145-b5bb-a0553481b469\") " pod="openshift-image-registry/image-registry-d66598b74-8fxp2"
Jul 20 09:59:02.997701 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:02.997522    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82a51935-5e62-4145-b5bb-a0553481b469-ca-trust-extracted\") pod \"image-registry-d66598b74-8fxp2\" (UID: \"82a51935-5e62-4145-b5bb-a0553481b469\") " pod="openshift-image-registry/image-registry-d66598b74-8fxp2"
Jul 20 09:59:02.997701 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:02.997563    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82a51935-5e62-4145-b5bb-a0553481b469-trusted-ca\") pod \"image-registry-d66598b74-8fxp2\" (UID: \"82a51935-5e62-4145-b5bb-a0553481b469\") " pod="openshift-image-registry/image-registry-d66598b74-8fxp2"
Jul 20 09:59:02.997701 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:02.997587    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb7vh\" (UniqueName: \"kubernetes.io/projected/82a51935-5e62-4145-b5bb-a0553481b469-kube-api-access-lb7vh\") pod \"image-registry-d66598b74-8fxp2\" (UID: \"82a51935-5e62-4145-b5bb-a0553481b469\") " pod="openshift-image-registry/image-registry-d66598b74-8fxp2"
Jul 20 09:59:02.997701 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:02.997656    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f4b722a6-00c5-4517-b4ed-17e684476286-klusterlet-config\") pod \"klusterlet-addon-workmgr-65ff74448-qd7l6\" (UID: \"f4b722a6-00c5-4517-b4ed-17e684476286\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65ff74448-qd7l6"
Jul 20 09:59:02.997701 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:02.997689    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4ct5\" (UniqueName: \"kubernetes.io/projected/f4b722a6-00c5-4517-b4ed-17e684476286-kube-api-access-b4ct5\") pod \"klusterlet-addon-workmgr-65ff74448-qd7l6\" (UID: \"f4b722a6-00c5-4517-b4ed-17e684476286\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65ff74448-qd7l6"
Jul 20 09:59:02.997981 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:02.997736    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82a51935-5e62-4145-b5bb-a0553481b469-image-registry-private-configuration\") pod \"image-registry-d66598b74-8fxp2\" (UID: \"82a51935-5e62-4145-b5bb-a0553481b469\") " pod="openshift-image-registry/image-registry-d66598b74-8fxp2"
Jul 20 09:59:02.997981 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:02.997793    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82a51935-5e62-4145-b5bb-a0553481b469-bound-sa-token\") pod \"image-registry-d66598b74-8fxp2\" (UID: \"82a51935-5e62-4145-b5bb-a0553481b469\") " pod="openshift-image-registry/image-registry-d66598b74-8fxp2"
Jul 20 09:59:02.997981 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:02.997821    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82a51935-5e62-4145-b5bb-a0553481b469-registry-certificates\") pod \"image-registry-d66598b74-8fxp2\" (UID: \"82a51935-5e62-4145-b5bb-a0553481b469\") " pod="openshift-image-registry/image-registry-d66598b74-8fxp2"
Jul 20 09:59:02.997981 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:02.997891    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4b722a6-00c5-4517-b4ed-17e684476286-tmp\") pod \"klusterlet-addon-workmgr-65ff74448-qd7l6\" (UID: \"f4b722a6-00c5-4517-b4ed-17e684476286\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65ff74448-qd7l6"
Jul 20 09:59:02.997981 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:02.997928    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82a51935-5e62-4145-b5bb-a0553481b469-installation-pull-secrets\") pod \"image-registry-d66598b74-8fxp2\" (UID: \"82a51935-5e62-4145-b5bb-a0553481b469\") " pod="openshift-image-registry/image-registry-d66598b74-8fxp2"
Jul 20 09:59:03.098989 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:03.098905    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82a51935-5e62-4145-b5bb-a0553481b469-image-registry-private-configuration\") pod \"image-registry-d66598b74-8fxp2\" (UID: \"82a51935-5e62-4145-b5bb-a0553481b469\") " pod="openshift-image-registry/image-registry-d66598b74-8fxp2"
Jul 20 09:59:03.098989 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:03.098962    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82a51935-5e62-4145-b5bb-a0553481b469-bound-sa-token\") pod \"image-registry-d66598b74-8fxp2\" (UID: \"82a51935-5e62-4145-b5bb-a0553481b469\") " pod="openshift-image-registry/image-registry-d66598b74-8fxp2"
Jul 20 09:59:03.098989 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:03.098991    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82a51935-5e62-4145-b5bb-a0553481b469-registry-certificates\") pod \"image-registry-d66598b74-8fxp2\" (UID: \"82a51935-5e62-4145-b5bb-a0553481b469\") " pod="openshift-image-registry/image-registry-d66598b74-8fxp2"
Jul 20 09:59:03.099267 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:03.099020    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4b722a6-00c5-4517-b4ed-17e684476286-tmp\") pod \"klusterlet-addon-workmgr-65ff74448-qd7l6\" (UID: \"f4b722a6-00c5-4517-b4ed-17e684476286\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65ff74448-qd7l6"
Jul 20 09:59:03.099267 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:03.099045    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82a51935-5e62-4145-b5bb-a0553481b469-installation-pull-secrets\") pod \"image-registry-d66598b74-8fxp2\" (UID: \"82a51935-5e62-4145-b5bb-a0553481b469\") " pod="openshift-image-registry/image-registry-d66598b74-8fxp2"
Jul 20 09:59:03.099267 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:03.099080    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82a51935-5e62-4145-b5bb-a0553481b469-registry-tls\") pod \"image-registry-d66598b74-8fxp2\" (UID: \"82a51935-5e62-4145-b5bb-a0553481b469\") " pod="openshift-image-registry/image-registry-d66598b74-8fxp2"
Jul 20 09:59:03.099267 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:03.099114    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82a51935-5e62-4145-b5bb-a0553481b469-ca-trust-extracted\") pod \"image-registry-d66598b74-8fxp2\" (UID: \"82a51935-5e62-4145-b5bb-a0553481b469\") " pod="openshift-image-registry/image-registry-d66598b74-8fxp2"
Jul 20 09:59:03.099267 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:03.099150    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82a51935-5e62-4145-b5bb-a0553481b469-trusted-ca\") pod \"image-registry-d66598b74-8fxp2\" (UID: \"82a51935-5e62-4145-b5bb-a0553481b469\") " pod="openshift-image-registry/image-registry-d66598b74-8fxp2"
Jul 20 09:59:03.099267 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:03.099172    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb7vh\" (UniqueName: \"kubernetes.io/projected/82a51935-5e62-4145-b5bb-a0553481b469-kube-api-access-lb7vh\") pod \"image-registry-d66598b74-8fxp2\" (UID: \"82a51935-5e62-4145-b5bb-a0553481b469\") " pod="openshift-image-registry/image-registry-d66598b74-8fxp2"
Jul 20 09:59:03.099267 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:03.099199    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f4b722a6-00c5-4517-b4ed-17e684476286-klusterlet-config\") pod \"klusterlet-addon-workmgr-65ff74448-qd7l6\" (UID: \"f4b722a6-00c5-4517-b4ed-17e684476286\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65ff74448-qd7l6"
Jul 20 09:59:03.099267 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:03.099227    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4ct5\" (UniqueName: \"kubernetes.io/projected/f4b722a6-00c5-4517-b4ed-17e684476286-kube-api-access-b4ct5\") pod \"klusterlet-addon-workmgr-65ff74448-qd7l6\" (UID: \"f4b722a6-00c5-4517-b4ed-17e684476286\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65ff74448-qd7l6"
Jul 20 09:59:03.099650 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:03.099410    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4b722a6-00c5-4517-b4ed-17e684476286-tmp\") pod \"klusterlet-addon-workmgr-65ff74448-qd7l6\" (UID: \"f4b722a6-00c5-4517-b4ed-17e684476286\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65ff74448-qd7l6"
Jul 20 09:59:03.100151 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:03.100106    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82a51935-5e62-4145-b5bb-a0553481b469-registry-certificates\") pod \"image-registry-d66598b74-8fxp2\" (UID: \"82a51935-5e62-4145-b5bb-a0553481b469\") " pod="openshift-image-registry/image-registry-d66598b74-8fxp2"
Jul 20 09:59:03.100955 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:03.100932    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82a51935-5e62-4145-b5bb-a0553481b469-trusted-ca\") pod \"image-registry-d66598b74-8fxp2\" (UID: \"82a51935-5e62-4145-b5bb-a0553481b469\") " pod="openshift-image-registry/image-registry-d66598b74-8fxp2"
Jul 20 09:59:03.101144 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:03.101126    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82a51935-5e62-4145-b5bb-a0553481b469-ca-trust-extracted\") pod \"image-registry-d66598b74-8fxp2\" (UID: \"82a51935-5e62-4145-b5bb-a0553481b469\") " pod="openshift-image-registry/image-registry-d66598b74-8fxp2"
Jul 20 09:59:03.102126 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:03.102081    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82a51935-5e62-4145-b5bb-a0553481b469-image-registry-private-configuration\") pod \"image-registry-d66598b74-8fxp2\" (UID: \"82a51935-5e62-4145-b5bb-a0553481b469\") " pod="openshift-image-registry/image-registry-d66598b74-8fxp2"
Jul 20 09:59:03.102233 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:03.102130    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82a51935-5e62-4145-b5bb-a0553481b469-installation-pull-secrets\") pod \"image-registry-d66598b74-8fxp2\" (UID: \"82a51935-5e62-4145-b5bb-a0553481b469\") " pod="openshift-image-registry/image-registry-d66598b74-8fxp2"
Jul 20 09:59:03.102410 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:03.102365    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82a51935-5e62-4145-b5bb-a0553481b469-registry-tls\") pod \"image-registry-d66598b74-8fxp2\" (UID: \"82a51935-5e62-4145-b5bb-a0553481b469\") " pod="openshift-image-registry/image-registry-d66598b74-8fxp2"
Jul 20 09:59:03.102491 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:03.102466    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f4b722a6-00c5-4517-b4ed-17e684476286-klusterlet-config\") pod \"klusterlet-addon-workmgr-65ff74448-qd7l6\" (UID: \"f4b722a6-00c5-4517-b4ed-17e684476286\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65ff74448-qd7l6"
Jul 20 09:59:03.122789 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:03.122758    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4ct5\" (UniqueName: \"kubernetes.io/projected/f4b722a6-00c5-4517-b4ed-17e684476286-kube-api-access-b4ct5\") pod \"klusterlet-addon-workmgr-65ff74448-qd7l6\" (UID: \"f4b722a6-00c5-4517-b4ed-17e684476286\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65ff74448-qd7l6"
Jul 20 09:59:03.122945 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:03.122849    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb7vh\" (UniqueName: \"kubernetes.io/projected/82a51935-5e62-4145-b5bb-a0553481b469-kube-api-access-lb7vh\") pod \"image-registry-d66598b74-8fxp2\" (UID: \"82a51935-5e62-4145-b5bb-a0553481b469\") " pod="openshift-image-registry/image-registry-d66598b74-8fxp2"
Jul 20 09:59:03.122945 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:03.122902    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82a51935-5e62-4145-b5bb-a0553481b469-bound-sa-token\") pod \"image-registry-d66598b74-8fxp2\" (UID: \"82a51935-5e62-4145-b5bb-a0553481b469\") " pod="openshift-image-registry/image-registry-d66598b74-8fxp2"
Jul 20 09:59:03.187212 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:03.187172    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65ff74448-qd7l6"
Jul 20 09:59:03.213309 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:03.213278    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d66598b74-8fxp2"
Jul 20 09:59:03.719979 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:03.719956    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d66598b74-8fxp2"]
Jul 20 09:59:03.721931 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:59:03.721906    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82a51935_5e62_4145_b5bb_a0553481b469.slice/crio-ef6e988a7c6a3ab6373cf7560e4324cf29be569be15af182a174baf6fd4fbfed WatchSource:0}: Error finding container ef6e988a7c6a3ab6373cf7560e4324cf29be569be15af182a174baf6fd4fbfed: Status 404 returned error can't find the container with id ef6e988a7c6a3ab6373cf7560e4324cf29be569be15af182a174baf6fd4fbfed
Jul 20 09:59:03.733571 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:03.733441    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-65ff74448-qd7l6"]
Jul 20 09:59:03.737153 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:59:03.737129    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4b722a6_00c5_4517_b4ed_17e684476286.slice/crio-3d49a26dffbf9973c6498c18d0e4b7eb6888f94427fd515acca3cf2306b0e286 WatchSource:0}: Error finding container 3d49a26dffbf9973c6498c18d0e4b7eb6888f94427fd515acca3cf2306b0e286: Status 404 returned error can't find the container with id 3d49a26dffbf9973c6498c18d0e4b7eb6888f94427fd515acca3cf2306b0e286
Jul 20 09:59:04.182387 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:04.182336    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65ff74448-qd7l6" event={"ID":"f4b722a6-00c5-4517-b4ed-17e684476286","Type":"ContainerStarted","Data":"3d49a26dffbf9973c6498c18d0e4b7eb6888f94427fd515acca3cf2306b0e286"}
Jul 20 09:59:04.185068 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:04.184963    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pnzs5" event={"ID":"2b58cbaa-28eb-4c6f-af79-543c2c843f35","Type":"ContainerStarted","Data":"78692f655a66b0123e1fe83b659cd743ccd6663d4bac83cedbbeeec10d47fd87"}
Jul 20 09:59:04.188311 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:04.187440    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d66598b74-8fxp2" event={"ID":"82a51935-5e62-4145-b5bb-a0553481b469","Type":"ContainerStarted","Data":"940500b37a72110598830fc63a2b22a29c89c77ce532c3f74b93cb04911db4b5"}
Jul 20 09:59:04.188311 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:04.187486    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d66598b74-8fxp2" event={"ID":"82a51935-5e62-4145-b5bb-a0553481b469","Type":"ContainerStarted","Data":"ef6e988a7c6a3ab6373cf7560e4324cf29be569be15af182a174baf6fd4fbfed"}
Jul 20 09:59:04.188311 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:04.188231    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-d66598b74-8fxp2"
Jul 20 09:59:04.852199 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:04.850494    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-d66598b74-8fxp2" podStartSLOduration=2.850472827 podStartE2EDuration="2.850472827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:59:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:04.213109772 +0000 UTC m=+117.930025068" watchObservedRunningTime="2026-07-20 09:59:04.850472827 +0000 UTC m=+118.567388098"
Jul 20 09:59:04.852199 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:04.851154    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77dc58c9d5-jz9zh"]
Jul 20 09:59:04.854419 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:04.854390    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77dc58c9d5-jz9zh"
Jul 20 09:59:04.859075 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:04.858297    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 20 09:59:04.859075 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:04.858668    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 20 09:59:04.859075 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:04.858864    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 20 09:59:04.859075 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:04.858935    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 20 09:59:04.859344 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:04.859185    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 20 09:59:04.859664 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:04.859486    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7mwdt\""
Jul 20 09:59:04.859664 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:04.859609    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 20 09:59:04.869307 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:04.869234    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77dc58c9d5-jz9zh"]
Jul 20 09:59:04.871374 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:04.871352    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 20 09:59:05.018964 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:05.018930    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e669a9e4-6eb9-4219-b97a-5c669c1cf227-console-oauth-config\") pod \"console-77dc58c9d5-jz9zh\" (UID: \"e669a9e4-6eb9-4219-b97a-5c669c1cf227\") " pod="openshift-console/console-77dc58c9d5-jz9zh"
Jul 20 09:59:05.019130 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:05.018974    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e669a9e4-6eb9-4219-b97a-5c669c1cf227-oauth-serving-cert\") pod \"console-77dc58c9d5-jz9zh\" (UID: \"e669a9e4-6eb9-4219-b97a-5c669c1cf227\") " pod="openshift-console/console-77dc58c9d5-jz9zh"
Jul 20 09:59:05.019130 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:05.019009    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e669a9e4-6eb9-4219-b97a-5c669c1cf227-service-ca\") pod \"console-77dc58c9d5-jz9zh\" (UID: \"e669a9e4-6eb9-4219-b97a-5c669c1cf227\") " pod="openshift-console/console-77dc58c9d5-jz9zh"
Jul 20 09:59:05.019130 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:05.019029    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e669a9e4-6eb9-4219-b97a-5c669c1cf227-console-config\") pod \"console-77dc58c9d5-jz9zh\" (UID: \"e669a9e4-6eb9-4219-b97a-5c669c1cf227\") " pod="openshift-console/console-77dc58c9d5-jz9zh"
Jul 20 09:59:05.019130 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:05.019055    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qszsn\" (UniqueName: \"kubernetes.io/projected/e669a9e4-6eb9-4219-b97a-5c669c1cf227-kube-api-access-qszsn\") pod \"console-77dc58c9d5-jz9zh\" (UID: \"e669a9e4-6eb9-4219-b97a-5c669c1cf227\") " pod="openshift-console/console-77dc58c9d5-jz9zh"
Jul 20 09:59:05.019130 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:05.019123    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e669a9e4-6eb9-4219-b97a-5c669c1cf227-console-serving-cert\") pod \"console-77dc58c9d5-jz9zh\" (UID: \"e669a9e4-6eb9-4219-b97a-5c669c1cf227\") " pod="openshift-console/console-77dc58c9d5-jz9zh"
Jul 20 09:59:05.119967 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:05.119864    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e669a9e4-6eb9-4219-b97a-5c669c1cf227-console-oauth-config\") pod \"console-77dc58c9d5-jz9zh\" (UID: \"e669a9e4-6eb9-4219-b97a-5c669c1cf227\") " pod="openshift-console/console-77dc58c9d5-jz9zh"
Jul 20 09:59:05.119967 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:05.119940    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e669a9e4-6eb9-4219-b97a-5c669c1cf227-oauth-serving-cert\") pod \"console-77dc58c9d5-jz9zh\" (UID: \"e669a9e4-6eb9-4219-b97a-5c669c1cf227\") " pod="openshift-console/console-77dc58c9d5-jz9zh"
Jul 20 09:59:05.120176 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:05.119980    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e669a9e4-6eb9-4219-b97a-5c669c1cf227-service-ca\") pod \"console-77dc58c9d5-jz9zh\" (UID: \"e669a9e4-6eb9-4219-b97a-5c669c1cf227\") " pod="openshift-console/console-77dc58c9d5-jz9zh"
Jul 20 09:59:05.120176 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:05.120005    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e669a9e4-6eb9-4219-b97a-5c669c1cf227-console-config\") pod \"console-77dc58c9d5-jz9zh\" (UID: \"e669a9e4-6eb9-4219-b97a-5c669c1cf227\") " pod="openshift-console/console-77dc58c9d5-jz9zh"
Jul 20 09:59:05.120176 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:05.120039    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qszsn\" (UniqueName: \"kubernetes.io/projected/e669a9e4-6eb9-4219-b97a-5c669c1cf227-kube-api-access-qszsn\") pod \"console-77dc58c9d5-jz9zh\" (UID: \"e669a9e4-6eb9-4219-b97a-5c669c1cf227\") " pod="openshift-console/console-77dc58c9d5-jz9zh"
Jul 20 09:59:05.120176 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:05.120066    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e669a9e4-6eb9-4219-b97a-5c669c1cf227-console-serving-cert\") pod \"console-77dc58c9d5-jz9zh\" (UID: \"e669a9e4-6eb9-4219-b97a-5c669c1cf227\") " pod="openshift-console/console-77dc58c9d5-jz9zh"
Jul 20 09:59:05.120871 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:05.120842    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e669a9e4-6eb9-4219-b97a-5c669c1cf227-service-ca\") pod \"console-77dc58c9d5-jz9zh\" (UID: \"e669a9e4-6eb9-4219-b97a-5c669c1cf227\") " pod="openshift-console/console-77dc58c9d5-jz9zh"
Jul 20 09:59:05.121009 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:05.120908    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e669a9e4-6eb9-4219-b97a-5c669c1cf227-oauth-serving-cert\") pod \"console-77dc58c9d5-jz9zh\" (UID: \"e669a9e4-6eb9-4219-b97a-5c669c1cf227\") " pod="openshift-console/console-77dc58c9d5-jz9zh"
Jul 20 09:59:05.121245 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:05.121199    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e669a9e4-6eb9-4219-b97a-5c669c1cf227-console-config\") pod \"console-77dc58c9d5-jz9zh\" (UID: \"e669a9e4-6eb9-4219-b97a-5c669c1cf227\") " pod="openshift-console/console-77dc58c9d5-jz9zh"
Jul 20 09:59:05.123497 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:05.123456    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e669a9e4-6eb9-4219-b97a-5c669c1cf227-console-serving-cert\") pod \"console-77dc58c9d5-jz9zh\" (UID: \"e669a9e4-6eb9-4219-b97a-5c669c1cf227\") " pod="openshift-console/console-77dc58c9d5-jz9zh"
Jul 20 09:59:05.123590 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:05.123579    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e669a9e4-6eb9-4219-b97a-5c669c1cf227-console-oauth-config\") pod \"console-77dc58c9d5-jz9zh\" (UID: \"e669a9e4-6eb9-4219-b97a-5c669c1cf227\") " pod="openshift-console/console-77dc58c9d5-jz9zh"
Jul 20 09:59:05.129544 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:05.129460    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qszsn\" (UniqueName: \"kubernetes.io/projected/e669a9e4-6eb9-4219-b97a-5c669c1cf227-kube-api-access-qszsn\") pod \"console-77dc58c9d5-jz9zh\" (UID: \"e669a9e4-6eb9-4219-b97a-5c669c1cf227\") " pod="openshift-console/console-77dc58c9d5-jz9zh"
Jul 20 09:59:05.173148 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:05.173110    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77dc58c9d5-jz9zh"
Jul 20 09:59:09.131853 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:09.131827    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77dc58c9d5-jz9zh"]
Jul 20 09:59:09.136271 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:59:09.136245    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode669a9e4_6eb9_4219_b97a_5c669c1cf227.slice/crio-926b8880b26bd72f2eca0cf15a272abdce25cddb82b60a69c9782f41ccfddadb WatchSource:0}: Error finding container 926b8880b26bd72f2eca0cf15a272abdce25cddb82b60a69c9782f41ccfddadb: Status 404 returned error can't find the container with id 926b8880b26bd72f2eca0cf15a272abdce25cddb82b60a69c9782f41ccfddadb
Jul 20 09:59:09.206641 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:09.206605    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pnzs5" event={"ID":"2b58cbaa-28eb-4c6f-af79-543c2c843f35","Type":"ContainerStarted","Data":"ecccce58986d5bd1db0c1baddaae07807e923bc5b88a36f38cd32adc3d28269d"}
Jul 20 09:59:09.207634 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:09.207610    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77dc58c9d5-jz9zh" event={"ID":"e669a9e4-6eb9-4219-b97a-5c669c1cf227","Type":"ContainerStarted","Data":"926b8880b26bd72f2eca0cf15a272abdce25cddb82b60a69c9782f41ccfddadb"}
Jul 20 09:59:09.208800 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:09.208781    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65ff74448-qd7l6" event={"ID":"f4b722a6-00c5-4517-b4ed-17e684476286","Type":"ContainerStarted","Data":"525a08da89ca7859072ec2f8b5bb0e3ac9969e40a5be2bacc5813ce2d74208f2"}
Jul 20 09:59:09.209035 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:09.209017    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65ff74448-qd7l6"
Jul 20 09:59:09.210565 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:09.210545    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65ff74448-qd7l6"
Jul 20 09:59:09.224038 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:09.223988    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65ff74448-qd7l6" podStartSLOduration=1.9228643029999999 podStartE2EDuration="7.223972818s" totalImagesPullingTime="5.301108515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:59:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:09.223968196 +0000 UTC m=+122.940883464" watchObservedRunningTime="2026-07-20 09:59:09.223972818 +0000 UTC m=+122.940888087"
Jul 20 09:59:11.204092 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:11.204060    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-xh4xl"]
Jul 20 09:59:11.207277 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:11.207256    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-xh4xl"
Jul 20 09:59:11.209847 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:11.209822    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 20 09:59:11.209966 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:11.209917    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7954j\""
Jul 20 09:59:11.210457 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:11.210433    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 20 09:59:11.210557 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:11.210466    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 20 09:59:11.210557 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:11.210507    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 20 09:59:11.210557 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:11.210439    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 20 09:59:11.229073 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:11.229040    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-xh4xl"]
Jul 20 09:59:11.266017 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:11.265985    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d3122d4-7c16-42e0-916a-72c37e89a6e0-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-xh4xl\" (UID: \"6d3122d4-7c16-42e0-916a-72c37e89a6e0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-xh4xl"
Jul 20 09:59:11.266196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:11.266051    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d3122d4-7c16-42e0-916a-72c37e89a6e0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-xh4xl\" (UID: \"6d3122d4-7c16-42e0-916a-72c37e89a6e0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-xh4xl"
Jul 20 09:59:11.266196 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:11.266109    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl8kn\" (UniqueName: \"kubernetes.io/projected/6d3122d4-7c16-42e0-916a-72c37e89a6e0-kube-api-access-bl8kn\") pod \"prometheus-operator-5945b5cfd-xh4xl\" (UID: \"6d3122d4-7c16-42e0-916a-72c37e89a6e0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-xh4xl"
Jul 20 09:59:11.266307 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:11.266203    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d3122d4-7c16-42e0-916a-72c37e89a6e0-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-xh4xl\" (UID: \"6d3122d4-7c16-42e0-916a-72c37e89a6e0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-xh4xl"
Jul 20 09:59:11.367520 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:11.367488    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d3122d4-7c16-42e0-916a-72c37e89a6e0-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-xh4xl\" (UID: \"6d3122d4-7c16-42e0-916a-72c37e89a6e0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-xh4xl"
Jul 20 09:59:11.367711 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:11.367557    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d3122d4-7c16-42e0-916a-72c37e89a6e0-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-xh4xl\" (UID: \"6d3122d4-7c16-42e0-916a-72c37e89a6e0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-xh4xl"
Jul 20 09:59:11.367711 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:11.367668    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d3122d4-7c16-42e0-916a-72c37e89a6e0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-xh4xl\" (UID: \"6d3122d4-7c16-42e0-916a-72c37e89a6e0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-xh4xl"
Jul 20 09:59:11.367825 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:11.367729    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl8kn\" (UniqueName: \"kubernetes.io/projected/6d3122d4-7c16-42e0-916a-72c37e89a6e0-kube-api-access-bl8kn\") pod \"prometheus-operator-5945b5cfd-xh4xl\" (UID: \"6d3122d4-7c16-42e0-916a-72c37e89a6e0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-xh4xl"
Jul 20 09:59:11.368367 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:11.368347    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d3122d4-7c16-42e0-916a-72c37e89a6e0-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-xh4xl\" (UID: \"6d3122d4-7c16-42e0-916a-72c37e89a6e0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-xh4xl"
Jul 20 09:59:11.370294 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:11.370267    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d3122d4-7c16-42e0-916a-72c37e89a6e0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-xh4xl\" (UID: \"6d3122d4-7c16-42e0-916a-72c37e89a6e0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-xh4xl"
Jul 20 09:59:11.370408 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:11.370296    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d3122d4-7c16-42e0-916a-72c37e89a6e0-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-xh4xl\" (UID: \"6d3122d4-7c16-42e0-916a-72c37e89a6e0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-xh4xl"
Jul 20 09:59:11.377520 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:11.377501    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl8kn\" (UniqueName: \"kubernetes.io/projected/6d3122d4-7c16-42e0-916a-72c37e89a6e0-kube-api-access-bl8kn\") pod \"prometheus-operator-5945b5cfd-xh4xl\" (UID: \"6d3122d4-7c16-42e0-916a-72c37e89a6e0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-xh4xl"
Jul 20 09:59:11.518652 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:11.518558    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-xh4xl"
Jul 20 09:59:13.948159 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:13.948127    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-xh4xl"]
Jul 20 09:59:13.952853 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:59:13.952815    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d3122d4_7c16_42e0_916a_72c37e89a6e0.slice/crio-20674a71f399445906e2ee1456495a6bfe5a3d71f21b88c1b1281bd60d98e7dc WatchSource:0}: Error finding container 20674a71f399445906e2ee1456495a6bfe5a3d71f21b88c1b1281bd60d98e7dc: Status 404 returned error can't find the container with id 20674a71f399445906e2ee1456495a6bfe5a3d71f21b88c1b1281bd60d98e7dc
Jul 20 09:59:14.228870 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:14.228778    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pnzs5" event={"ID":"2b58cbaa-28eb-4c6f-af79-543c2c843f35","Type":"ContainerStarted","Data":"95927904e571b0ff4991cf180cfaec65c1e239b6093e60b792a70895698e8ae2"}
Jul 20 09:59:14.230402 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:14.230369    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77dc58c9d5-jz9zh" event={"ID":"e669a9e4-6eb9-4219-b97a-5c669c1cf227","Type":"ContainerStarted","Data":"d8f20a348fa0352538c21fcd58b75704b9d7d83cbb654f52579640142304e404"}
Jul 20 09:59:14.231475 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:14.231452    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-xh4xl" event={"ID":"6d3122d4-7c16-42e0-916a-72c37e89a6e0","Type":"ContainerStarted","Data":"20674a71f399445906e2ee1456495a6bfe5a3d71f21b88c1b1281bd60d98e7dc"}
Jul 20 09:59:14.250518 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:14.250453    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pnzs5" podStartSLOduration=33.426922974 podStartE2EDuration="48.250437254s" totalImagesPullingTime="14.82351428s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:58:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:14.250238208 +0000 UTC m=+127.967153490" watchObservedRunningTime="2026-07-20 09:59:14.250437254 +0000 UTC m=+127.967352524"
Jul 20 09:59:15.173753 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:15.173726    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77dc58c9d5-jz9zh"
Jul 20 09:59:15.174094 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:15.173781    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77dc58c9d5-jz9zh"
Jul 20 09:59:15.179712 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:15.179693    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77dc58c9d5-jz9zh"
Jul 20 09:59:15.202471 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:15.202419    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77dc58c9d5-jz9zh" podStartSLOduration=6.526618797 podStartE2EDuration="11.202398763s" totalImagesPullingTime="4.675779966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:14.270992501 +0000 UTC m=+127.987907788" watchObservedRunningTime="2026-07-20 09:59:15.202398763 +0000 UTC m=+128.919314033"
Jul 20 09:59:15.236415 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:15.236379    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-xh4xl" event={"ID":"6d3122d4-7c16-42e0-916a-72c37e89a6e0","Type":"ContainerStarted","Data":"7c55cdda3c68951ce98d79ed6f27340b41c1a851b83273e454583cf8911f084d"}
Jul 20 09:59:15.236574 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:15.236462    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-xh4xl" event={"ID":"6d3122d4-7c16-42e0-916a-72c37e89a6e0","Type":"ContainerStarted","Data":"93fcf7eb192bbe0b07f6fa0d0178ea027a3e4815e6cac02cb7311313e94373ea"}
Jul 20 09:59:15.240497 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:15.240476    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77dc58c9d5-jz9zh"
Jul 20 09:59:15.254032 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:15.253983    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-xh4xl" podStartSLOduration=3.147764789 podStartE2EDuration="4.25396932s" totalImagesPullingTime="1.106204531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:15.252630746 +0000 UTC m=+128.969546015" watchObservedRunningTime="2026-07-20 09:59:15.25396932 +0000 UTC m=+128.970884588"
Jul 20 09:59:16.508445 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:16.508411    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10552df3-551a-4023-ad75-003c6559ce60-metrics-certs\") pod \"network-metrics-daemon-w778v\" (UID: \"10552df3-551a-4023-ad75-003c6559ce60\") " pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:59:16.510619 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:16.510601    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10552df3-551a-4023-ad75-003c6559ce60-metrics-certs\") pod \"network-metrics-daemon-w778v\" (UID: \"10552df3-551a-4023-ad75-003c6559ce60\") " pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:59:16.756222 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:16.756192    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b7v24\""
Jul 20 09:59:16.764925 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:16.764858    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w778v"
Jul 20 09:59:16.897943 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:16.897916    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w778v"]
Jul 20 09:59:16.900892 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:59:16.900847    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10552df3_551a_4023_ad75_003c6559ce60.slice/crio-dcadd27bc07b1b7f517a1792652137acb901dc70933740cd763b124cfc4ec4ad WatchSource:0}: Error finding container dcadd27bc07b1b7f517a1792652137acb901dc70933740cd763b124cfc4ec4ad: Status 404 returned error can't find the container with id dcadd27bc07b1b7f517a1792652137acb901dc70933740cd763b124cfc4ec4ad
Jul 20 09:59:17.243221 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.243191    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w778v" event={"ID":"10552df3-551a-4023-ad75-003c6559ce60","Type":"ContainerStarted","Data":"dcadd27bc07b1b7f517a1792652137acb901dc70933740cd763b124cfc4ec4ad"}
Jul 20 09:59:17.715922 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.715638    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-djlzb"]
Jul 20 09:59:17.720253 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.720072    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djlzb"
Jul 20 09:59:17.726518 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.726495    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 20 09:59:17.726764 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.726744    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 20 09:59:17.727262 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.727241    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-svwt7\""
Jul 20 09:59:17.736954 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.736351    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-djlzb"]
Jul 20 09:59:17.819635 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.819595    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a075bbf-41cc-4538-aa11-365447990fa1-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-djlzb\" (UID: \"6a075bbf-41cc-4538-aa11-365447990fa1\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djlzb"
Jul 20 09:59:17.819778 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.819658    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a075bbf-41cc-4538-aa11-365447990fa1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-djlzb\" (UID: \"6a075bbf-41cc-4538-aa11-365447990fa1\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djlzb"
Jul 20 09:59:17.819778 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.819705    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plt5b\" (UniqueName: \"kubernetes.io/projected/6a075bbf-41cc-4538-aa11-365447990fa1-kube-api-access-plt5b\") pod \"openshift-state-metrics-79f6958cdf-djlzb\" (UID: \"6a075bbf-41cc-4538-aa11-365447990fa1\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djlzb"
Jul 20 09:59:17.819778 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.819765    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a075bbf-41cc-4538-aa11-365447990fa1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-djlzb\" (UID: \"6a075bbf-41cc-4538-aa11-365447990fa1\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djlzb"
Jul 20 09:59:17.822516 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.822490    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6tz26"]
Jul 20 09:59:17.825830 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.825812    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6tz26"
Jul 20 09:59:17.833136 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.833092    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sw4tj\""
Jul 20 09:59:17.833244 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.833145    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 20 09:59:17.833244 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.833147    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 20 09:59:17.833368 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.833105    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 20 09:59:17.921046 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.921008    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a075bbf-41cc-4538-aa11-365447990fa1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-djlzb\" (UID: \"6a075bbf-41cc-4538-aa11-365447990fa1\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djlzb"
Jul 20 09:59:17.921286 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.921067    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6-metrics-client-ca\") pod \"node-exporter-6tz26\" (UID: \"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6\") " pod="openshift-monitoring/node-exporter-6tz26"
Jul 20 09:59:17.921286 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.921100    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6tz26\" (UID: \"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6\") " pod="openshift-monitoring/node-exporter-6tz26"
Jul 20 09:59:17.921286 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.921129    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6-sys\") pod \"node-exporter-6tz26\" (UID: \"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6\") " pod="openshift-monitoring/node-exporter-6tz26"
Jul 20 09:59:17.921286 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.921178    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a075bbf-41cc-4538-aa11-365447990fa1-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-djlzb\" (UID: \"6a075bbf-41cc-4538-aa11-365447990fa1\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djlzb"
Jul 20 09:59:17.921286 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:59:17.921180    2561 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 20 09:59:17.921286 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.921194    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6-root\") pod \"node-exporter-6tz26\" (UID: \"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6\") " pod="openshift-monitoring/node-exporter-6tz26"
Jul 20 09:59:17.921286 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.921220    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6-node-exporter-tls\") pod \"node-exporter-6tz26\" (UID: \"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6\") " pod="openshift-monitoring/node-exporter-6tz26"
Jul 20 09:59:17.921286 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:59:17.921254    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a075bbf-41cc-4538-aa11-365447990fa1-openshift-state-metrics-tls podName:6a075bbf-41cc-4538-aa11-365447990fa1 nodeName:}" failed. No retries permitted until 2026-07-20 09:59:18.421233312 +0000 UTC m=+132.138148569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6a075bbf-41cc-4538-aa11-365447990fa1-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-djlzb" (UID: "6a075bbf-41cc-4538-aa11-365447990fa1") : secret "openshift-state-metrics-tls" not found
Jul 20 09:59:17.921974 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.921368    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a075bbf-41cc-4538-aa11-365447990fa1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-djlzb\" (UID: \"6a075bbf-41cc-4538-aa11-365447990fa1\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djlzb"
Jul 20 09:59:17.921974 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.921418    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6-node-exporter-accelerators-collector-config\") pod \"node-exporter-6tz26\" (UID: \"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6\") " pod="openshift-monitoring/node-exporter-6tz26"
Jul 20 09:59:17.921974 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.921446    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk982\" (UniqueName: \"kubernetes.io/projected/cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6-kube-api-access-xk982\") pod \"node-exporter-6tz26\" (UID: \"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6\") " pod="openshift-monitoring/node-exporter-6tz26"
Jul 20 09:59:17.921974 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.921470    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6-node-exporter-wtmp\") pod \"node-exporter-6tz26\" (UID: \"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6\") " pod="openshift-monitoring/node-exporter-6tz26"
Jul 20 09:59:17.921974 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.921505    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6-node-exporter-textfile\") pod \"node-exporter-6tz26\" (UID: \"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6\") " pod="openshift-monitoring/node-exporter-6tz26"
Jul 20 09:59:17.921974 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.921537    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plt5b\" (UniqueName: \"kubernetes.io/projected/6a075bbf-41cc-4538-aa11-365447990fa1-kube-api-access-plt5b\") pod \"openshift-state-metrics-79f6958cdf-djlzb\" (UID: \"6a075bbf-41cc-4538-aa11-365447990fa1\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djlzb"
Jul 20 09:59:17.921974 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.921961    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a075bbf-41cc-4538-aa11-365447990fa1-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-djlzb\" (UID: \"6a075bbf-41cc-4538-aa11-365447990fa1\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djlzb"
Jul 20 09:59:17.924066 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.924033    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a075bbf-41cc-4538-aa11-365447990fa1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-djlzb\" (UID: \"6a075bbf-41cc-4538-aa11-365447990fa1\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djlzb"
Jul 20 09:59:17.940462 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:17.940438    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plt5b\" (UniqueName: \"kubernetes.io/projected/6a075bbf-41cc-4538-aa11-365447990fa1-kube-api-access-plt5b\") pod \"openshift-state-metrics-79f6958cdf-djlzb\" (UID: \"6a075bbf-41cc-4538-aa11-365447990fa1\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djlzb"
Jul 20 09:59:18.023583 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:18.022823    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6-sys\") pod \"node-exporter-6tz26\" (UID: \"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6\") " pod="openshift-monitoring/node-exporter-6tz26"
Jul 20 09:59:18.023583 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:18.022874    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6-root\") pod \"node-exporter-6tz26\" (UID: \"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6\") " pod="openshift-monitoring/node-exporter-6tz26"
Jul 20 09:59:18.023583 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:18.022905    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6-node-exporter-tls\") pod \"node-exporter-6tz26\" (UID: \"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6\") " pod="openshift-monitoring/node-exporter-6tz26"
Jul 20 09:59:18.023583 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:18.022917    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6-sys\") pod \"node-exporter-6tz26\" (UID: \"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6\") " pod="openshift-monitoring/node-exporter-6tz26"
Jul 20 09:59:18.023583 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:18.022938    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6-node-exporter-accelerators-collector-config\") pod \"node-exporter-6tz26\" (UID: \"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6\") " pod="openshift-monitoring/node-exporter-6tz26"
Jul 20 09:59:18.023583 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:18.022979    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk982\" (UniqueName: \"kubernetes.io/projected/cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6-kube-api-access-xk982\") pod \"node-exporter-6tz26\" (UID: \"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6\") " pod="openshift-monitoring/node-exporter-6tz26"
Jul 20 09:59:18.023583 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:18.023005    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6-node-exporter-wtmp\") pod \"node-exporter-6tz26\" (UID: \"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6\") " pod="openshift-monitoring/node-exporter-6tz26"
Jul 20 09:59:18.023583 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:18.023041    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6-node-exporter-textfile\") pod \"node-exporter-6tz26\" (UID: \"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6\") " pod="openshift-monitoring/node-exporter-6tz26"
Jul 20 09:59:18.023583 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:18.023114    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6-metrics-client-ca\") pod \"node-exporter-6tz26\" (UID: \"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6\") " pod="openshift-monitoring/node-exporter-6tz26"
Jul 20 09:59:18.023583 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:18.023140    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6tz26\" (UID: \"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6\") " pod="openshift-monitoring/node-exporter-6tz26"
Jul 20 09:59:18.023583 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:18.023324    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6-node-exporter-accelerators-collector-config\") pod \"node-exporter-6tz26\" (UID: \"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6\") " pod="openshift-monitoring/node-exporter-6tz26"
Jul 20 09:59:18.023583 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:18.023365    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6-root\") pod \"node-exporter-6tz26\" (UID: \"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6\") " pod="openshift-monitoring/node-exporter-6tz26"
Jul 20 09:59:18.023583 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:59:18.023419    2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 20 09:59:18.023583 ip-10-0-138-143 kubenswrapper[2561]: E0720 09:59:18.023461    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6-node-exporter-tls podName:cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6 nodeName:}" failed. No retries permitted until 2026-07-20 09:59:18.523447282 +0000 UTC m=+132.240362529 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6-node-exporter-tls") pod "node-exporter-6tz26" (UID: "cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6") : secret "node-exporter-tls" not found
Jul 20 09:59:18.024442 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:18.023635    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6-node-exporter-wtmp\") pod \"node-exporter-6tz26\" (UID: \"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6\") " pod="openshift-monitoring/node-exporter-6tz26"
Jul 20 09:59:18.024442 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:18.023865    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6-node-exporter-textfile\") pod \"node-exporter-6tz26\" (UID: \"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6\") " pod="openshift-monitoring/node-exporter-6tz26"
Jul 20 09:59:18.024442 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:18.024132    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6-metrics-client-ca\") pod \"node-exporter-6tz26\" (UID: \"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6\") " pod="openshift-monitoring/node-exporter-6tz26"
Jul 20 09:59:18.025344 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:18.025325    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6tz26\" (UID: \"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6\") " pod="openshift-monitoring/node-exporter-6tz26"
Jul 20 09:59:18.038076 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:18.038055    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk982\" (UniqueName: \"kubernetes.io/projected/cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6-kube-api-access-xk982\") pod \"node-exporter-6tz26\" (UID: \"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6\") " pod="openshift-monitoring/node-exporter-6tz26"
Jul 20 09:59:18.248305 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:18.248210    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w778v" event={"ID":"10552df3-551a-4023-ad75-003c6559ce60","Type":"ContainerStarted","Data":"109a60f2914decd74c8a30a727a74f1c91db61aedecb7d304827a220f35d418d"}
Jul 20 09:59:18.248305 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:18.248285    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w778v" event={"ID":"10552df3-551a-4023-ad75-003c6559ce60","Type":"ContainerStarted","Data":"caf858a33ab9db7e9817f630e52cbd15bc94731f6d91c7a0e62f190e9f7c82f9"}
Jul 20 09:59:18.275794 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:18.275747    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-w778v" podStartSLOduration=130.334566247 podStartE2EDuration="2m11.275731343s" totalImagesPullingTime="941.165096ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:57:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:18.274674012 +0000 UTC m=+131.991589303" watchObservedRunningTime="2026-07-20 09:59:18.275731343 +0000 UTC m=+131.992646613"
Jul 20 09:59:18.426282 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:18.426242    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a075bbf-41cc-4538-aa11-365447990fa1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-djlzb\" (UID: \"6a075bbf-41cc-4538-aa11-365447990fa1\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djlzb"
Jul 20 09:59:18.428609 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:18.428575    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a075bbf-41cc-4538-aa11-365447990fa1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-djlzb\" (UID: \"6a075bbf-41cc-4538-aa11-365447990fa1\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djlzb"
Jul 20 09:59:18.527586 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:18.527560    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6-node-exporter-tls\") pod \"node-exporter-6tz26\" (UID: \"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6\") " pod="openshift-monitoring/node-exporter-6tz26"
Jul 20 09:59:18.529774 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:18.529746    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6-node-exporter-tls\") pod \"node-exporter-6tz26\" (UID: \"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6\") " pod="openshift-monitoring/node-exporter-6tz26"
Jul 20 09:59:18.634609 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:18.634582    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djlzb"
Jul 20 09:59:18.740096 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:18.740069    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6tz26"
Jul 20 09:59:18.751645 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:59:18.751618    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc3e1c08_a5e6_4ca8_9cd4_0dee6e0defe6.slice/crio-4d9fb8447a5012c2102e35bfaa5495c4a05e4043a41815cd55a96855d31b66de WatchSource:0}: Error finding container 4d9fb8447a5012c2102e35bfaa5495c4a05e4043a41815cd55a96855d31b66de: Status 404 returned error can't find the container with id 4d9fb8447a5012c2102e35bfaa5495c4a05e4043a41815cd55a96855d31b66de
Jul 20 09:59:18.768105 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:18.768078    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-djlzb"]
Jul 20 09:59:18.770461 ip-10-0-138-143 kubenswrapper[2561]: W0720 09:59:18.770437    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a075bbf_41cc_4538_aa11_365447990fa1.slice/crio-19c49123828b37c0eef70fb89d5a354700d4d3ed97929475e6fba78392d41837 WatchSource:0}: Error finding container 19c49123828b37c0eef70fb89d5a354700d4d3ed97929475e6fba78392d41837: Status 404 returned error can't find the container with id 19c49123828b37c0eef70fb89d5a354700d4d3ed97929475e6fba78392d41837
Jul 20 09:59:19.253404 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:19.253307    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6tz26" event={"ID":"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6","Type":"ContainerStarted","Data":"4d9fb8447a5012c2102e35bfaa5495c4a05e4043a41815cd55a96855d31b66de"}
Jul 20 09:59:19.255399 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:19.255366    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djlzb" event={"ID":"6a075bbf-41cc-4538-aa11-365447990fa1","Type":"ContainerStarted","Data":"56a804714b5ae07d59b58fa8099800f572190ac152f08ffdc0300b8b97c46379"}
Jul 20 09:59:19.255543 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:19.255437    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djlzb" event={"ID":"6a075bbf-41cc-4538-aa11-365447990fa1","Type":"ContainerStarted","Data":"e74ce3431cac487b0f0154372a8ae9fce956decac2cb7d8ac092cef78081cd21"}
Jul 20 09:59:19.255543 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:19.255470    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djlzb" event={"ID":"6a075bbf-41cc-4538-aa11-365447990fa1","Type":"ContainerStarted","Data":"19c49123828b37c0eef70fb89d5a354700d4d3ed97929475e6fba78392d41837"}
Jul 20 09:59:20.260807 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:20.260712    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djlzb" event={"ID":"6a075bbf-41cc-4538-aa11-365447990fa1","Type":"ContainerStarted","Data":"b8faaf2c32ad49a6b3ed1135aff538d8e59cbedb5012c143a3224c138161e296"}
Jul 20 09:59:20.262282 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:20.262260    2561 generic.go:356] "Generic (PLEG): container finished" podID="cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6" containerID="41a8049a80626597dd5038e95448ad029abbea5d103bd4fd7bfd40b6f94c4fab" exitCode=0
Jul 20 09:59:20.262399 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:20.262291    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6tz26" event={"ID":"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6","Type":"ContainerDied","Data":"41a8049a80626597dd5038e95448ad029abbea5d103bd4fd7bfd40b6f94c4fab"}
Jul 20 09:59:20.285786 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:20.285739    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djlzb" podStartSLOduration=2.321816924 podStartE2EDuration="3.285725505s" totalImagesPullingTime="963.908581ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:59:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:20.285444135 +0000 UTC m=+134.002359407" watchObservedRunningTime="2026-07-20 09:59:20.285725505 +0000 UTC m=+134.002640774"
Jul 20 09:59:21.267684 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:21.267650    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6tz26" event={"ID":"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6","Type":"ContainerStarted","Data":"9134324ab4b641874fe0748f04d36d304564d2dc318033a3b884d2d8f23059fe"}
Jul 20 09:59:21.268068 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:21.267720    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6tz26" event={"ID":"cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6","Type":"ContainerStarted","Data":"943ff98fdbfe7536cfb43b738faf7a44772f4b40c77b5d8fd5e9f2cc2eae96dd"}
Jul 20 09:59:21.296799 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:21.296749    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6tz26" podStartSLOduration=3.123135195 podStartE2EDuration="4.296733999s" totalImagesPullingTime="1.108702402s" totalInitContainerRuntime="64.896402ms" isStatefulPod=true podCreationTimestamp="2026-07-20 09:59:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:21.296548692 +0000 UTC m=+135.013464032" watchObservedRunningTime="2026-07-20 09:59:21.296733999 +0000 UTC m=+135.013649316"
Jul 20 09:59:26.200777 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:26.200749    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-d66598b74-8fxp2"
Jul 20 09:59:44.826536 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:44.826500    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77dc58c9d5-jz9zh"]
Jul 20 09:59:46.358735 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:46.358685    2561 generic.go:356] "Generic (PLEG): container finished" podID="9b9a399a-33c9-4c5f-a918-521c8b328583" containerID="477a38ea46066b5db19c325d1578d7bcd3c24bce1bca332475e01c92145ceed2" exitCode=0
Jul 20 09:59:46.359217 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:46.358762    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8gn2c" event={"ID":"9b9a399a-33c9-4c5f-a918-521c8b328583","Type":"ContainerDied","Data":"477a38ea46066b5db19c325d1578d7bcd3c24bce1bca332475e01c92145ceed2"}
Jul 20 09:59:46.359217 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:46.359185    2561 scope.go:117] "RemoveContainer" containerID="477a38ea46066b5db19c325d1578d7bcd3c24bce1bca332475e01c92145ceed2"
Jul 20 09:59:47.364675 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:47.364639    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-8gn2c" event={"ID":"9b9a399a-33c9-4c5f-a918-521c8b328583","Type":"ContainerStarted","Data":"d8a0a2e098e4ffdebc060458c3a6885f8bd592d70ba2d0e1ed1c9b3231ab9df2"}
Jul 20 09:59:52.834424 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:52.834397    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nqn9s_906abe6c-f9a3-4ef8-80de-43d9ba0f79b2/dns/0.log"
Jul 20 09:59:52.847745 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:52.847699    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nqn9s_906abe6c-f9a3-4ef8-80de-43d9ba0f79b2/kube-rbac-proxy/0.log"
Jul 20 09:59:53.119637 ip-10-0-138-143 kubenswrapper[2561]: I0720 09:59:53.119557    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hp5fq_74a3c5ba-e636-47df-b3cd-1ad53902bc5a/dns-node-resolver/0.log"
Jul 20 10:00:09.851600 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:09.851541    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-77dc58c9d5-jz9zh" podUID="e669a9e4-6eb9-4219-b97a-5c669c1cf227" containerName="console" containerID="cri-o://d8f20a348fa0352538c21fcd58b75704b9d7d83cbb654f52579640142304e404" gracePeriod=15
Jul 20 10:00:10.105495 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:10.105429    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77dc58c9d5-jz9zh"
Jul 20 10:00:10.151170 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:10.151129    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e669a9e4-6eb9-4219-b97a-5c669c1cf227-console-serving-cert\") pod \"e669a9e4-6eb9-4219-b97a-5c669c1cf227\" (UID: \"e669a9e4-6eb9-4219-b97a-5c669c1cf227\") "
Jul 20 10:00:10.151354 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:10.151184    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e669a9e4-6eb9-4219-b97a-5c669c1cf227-console-config\") pod \"e669a9e4-6eb9-4219-b97a-5c669c1cf227\" (UID: \"e669a9e4-6eb9-4219-b97a-5c669c1cf227\") "
Jul 20 10:00:10.151354 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:10.151228    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e669a9e4-6eb9-4219-b97a-5c669c1cf227-service-ca\") pod \"e669a9e4-6eb9-4219-b97a-5c669c1cf227\" (UID: \"e669a9e4-6eb9-4219-b97a-5c669c1cf227\") "
Jul 20 10:00:10.151354 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:10.151257    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e669a9e4-6eb9-4219-b97a-5c669c1cf227-console-oauth-config\") pod \"e669a9e4-6eb9-4219-b97a-5c669c1cf227\" (UID: \"e669a9e4-6eb9-4219-b97a-5c669c1cf227\") "
Jul 20 10:00:10.151354 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:10.151320    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e669a9e4-6eb9-4219-b97a-5c669c1cf227-oauth-serving-cert\") pod \"e669a9e4-6eb9-4219-b97a-5c669c1cf227\" (UID: \"e669a9e4-6eb9-4219-b97a-5c669c1cf227\") "
Jul 20 10:00:10.151354 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:10.151342    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qszsn\" (UniqueName: \"kubernetes.io/projected/e669a9e4-6eb9-4219-b97a-5c669c1cf227-kube-api-access-qszsn\") pod \"e669a9e4-6eb9-4219-b97a-5c669c1cf227\" (UID: \"e669a9e4-6eb9-4219-b97a-5c669c1cf227\") "
Jul 20 10:00:10.151703 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:10.151675    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e669a9e4-6eb9-4219-b97a-5c669c1cf227-service-ca" (OuterVolumeSpecName: "service-ca") pod "e669a9e4-6eb9-4219-b97a-5c669c1cf227" (UID: "e669a9e4-6eb9-4219-b97a-5c669c1cf227"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 10:00:10.151703 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:10.151690    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e669a9e4-6eb9-4219-b97a-5c669c1cf227-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e669a9e4-6eb9-4219-b97a-5c669c1cf227" (UID: "e669a9e4-6eb9-4219-b97a-5c669c1cf227"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 10:00:10.151848 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:10.151671    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e669a9e4-6eb9-4219-b97a-5c669c1cf227-console-config" (OuterVolumeSpecName: "console-config") pod "e669a9e4-6eb9-4219-b97a-5c669c1cf227" (UID: "e669a9e4-6eb9-4219-b97a-5c669c1cf227"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 10:00:10.153539 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:10.153508    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e669a9e4-6eb9-4219-b97a-5c669c1cf227-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e669a9e4-6eb9-4219-b97a-5c669c1cf227" (UID: "e669a9e4-6eb9-4219-b97a-5c669c1cf227"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:00:10.153539 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:10.153517    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e669a9e4-6eb9-4219-b97a-5c669c1cf227-kube-api-access-qszsn" (OuterVolumeSpecName: "kube-api-access-qszsn") pod "e669a9e4-6eb9-4219-b97a-5c669c1cf227" (UID: "e669a9e4-6eb9-4219-b97a-5c669c1cf227"). InnerVolumeSpecName "kube-api-access-qszsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 10:00:10.153665 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:10.153591    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e669a9e4-6eb9-4219-b97a-5c669c1cf227-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e669a9e4-6eb9-4219-b97a-5c669c1cf227" (UID: "e669a9e4-6eb9-4219-b97a-5c669c1cf227"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:00:10.252191 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:10.252151    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e669a9e4-6eb9-4219-b97a-5c669c1cf227-oauth-serving-cert\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:00:10.252191 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:10.252184    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qszsn\" (UniqueName: \"kubernetes.io/projected/e669a9e4-6eb9-4219-b97a-5c669c1cf227-kube-api-access-qszsn\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:00:10.252191 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:10.252194    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e669a9e4-6eb9-4219-b97a-5c669c1cf227-console-serving-cert\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:00:10.252414 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:10.252203    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e669a9e4-6eb9-4219-b97a-5c669c1cf227-console-config\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:00:10.252414 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:10.252213    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e669a9e4-6eb9-4219-b97a-5c669c1cf227-service-ca\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:00:10.252414 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:10.252220    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e669a9e4-6eb9-4219-b97a-5c669c1cf227-console-oauth-config\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:00:10.444358 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:10.444271    2561 generic.go:356] "Generic (PLEG): container finished" podID="e669a9e4-6eb9-4219-b97a-5c669c1cf227" containerID="d8f20a348fa0352538c21fcd58b75704b9d7d83cbb654f52579640142304e404" exitCode=0
Jul 20 10:00:10.444358 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:10.444316    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77dc58c9d5-jz9zh"
Jul 20 10:00:10.444544 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:10.444362    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77dc58c9d5-jz9zh" event={"ID":"e669a9e4-6eb9-4219-b97a-5c669c1cf227","Type":"ContainerDied","Data":"d8f20a348fa0352538c21fcd58b75704b9d7d83cbb654f52579640142304e404"}
Jul 20 10:00:10.444544 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:10.444418    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77dc58c9d5-jz9zh" event={"ID":"e669a9e4-6eb9-4219-b97a-5c669c1cf227","Type":"ContainerDied","Data":"926b8880b26bd72f2eca0cf15a272abdce25cddb82b60a69c9782f41ccfddadb"}
Jul 20 10:00:10.444544 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:10.444440    2561 scope.go:117] "RemoveContainer" containerID="d8f20a348fa0352538c21fcd58b75704b9d7d83cbb654f52579640142304e404"
Jul 20 10:00:10.457635 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:10.457605    2561 scope.go:117] "RemoveContainer" containerID="d8f20a348fa0352538c21fcd58b75704b9d7d83cbb654f52579640142304e404"
Jul 20 10:00:10.457950 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:00:10.457930    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8f20a348fa0352538c21fcd58b75704b9d7d83cbb654f52579640142304e404\": container with ID starting with d8f20a348fa0352538c21fcd58b75704b9d7d83cbb654f52579640142304e404 not found: ID does not exist" containerID="d8f20a348fa0352538c21fcd58b75704b9d7d83cbb654f52579640142304e404"
Jul 20 10:00:10.458004 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:10.457960    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8f20a348fa0352538c21fcd58b75704b9d7d83cbb654f52579640142304e404"} err="failed to get container status \"d8f20a348fa0352538c21fcd58b75704b9d7d83cbb654f52579640142304e404\": rpc error: code = NotFound desc = could not find container \"d8f20a348fa0352538c21fcd58b75704b9d7d83cbb654f52579640142304e404\": container with ID starting with d8f20a348fa0352538c21fcd58b75704b9d7d83cbb654f52579640142304e404 not found: ID does not exist"
Jul 20 10:00:10.467654 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:10.467626    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77dc58c9d5-jz9zh"]
Jul 20 10:00:10.472837 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:10.472814    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77dc58c9d5-jz9zh"]
Jul 20 10:00:10.743025 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:10.742939    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e669a9e4-6eb9-4219-b97a-5c669c1cf227" path="/var/lib/kubelet/pods/e669a9e4-6eb9-4219-b97a-5c669c1cf227/volumes"
Jul 20 10:00:41.595693 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.595663    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b9d5cc448-4pr88"]
Jul 20 10:00:41.596183 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.595942    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e669a9e4-6eb9-4219-b97a-5c669c1cf227" containerName="console"
Jul 20 10:00:41.596183 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.595955    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e669a9e4-6eb9-4219-b97a-5c669c1cf227" containerName="console"
Jul 20 10:00:41.596183 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.596007    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e669a9e4-6eb9-4219-b97a-5c669c1cf227" containerName="console"
Jul 20 10:00:41.598791 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.598771    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b9d5cc448-4pr88"
Jul 20 10:00:41.601034 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.600988    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 20 10:00:41.601196 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.601178    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 20 10:00:41.601196 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.601186    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 20 10:00:41.601344 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.601296    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 20 10:00:41.601344 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.601339    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 20 10:00:41.601708 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.601691    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7mwdt\""
Jul 20 10:00:41.601708 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.601699    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 20 10:00:41.601934 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.601802    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 20 10:00:41.608633 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.608615    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 20 10:00:41.613224 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.613202    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b9d5cc448-4pr88"]
Jul 20 10:00:41.674828 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.674795    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-console-config\") pod \"console-b9d5cc448-4pr88\" (UID: \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\") " pod="openshift-console/console-b9d5cc448-4pr88"
Jul 20 10:00:41.675001 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.674836    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-service-ca\") pod \"console-b9d5cc448-4pr88\" (UID: \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\") " pod="openshift-console/console-b9d5cc448-4pr88"
Jul 20 10:00:41.675001 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.674871    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-console-serving-cert\") pod \"console-b9d5cc448-4pr88\" (UID: \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\") " pod="openshift-console/console-b9d5cc448-4pr88"
Jul 20 10:00:41.675001 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.674912    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-trusted-ca-bundle\") pod \"console-b9d5cc448-4pr88\" (UID: \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\") " pod="openshift-console/console-b9d5cc448-4pr88"
Jul 20 10:00:41.675001 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.674936    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-oauth-serving-cert\") pod \"console-b9d5cc448-4pr88\" (UID: \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\") " pod="openshift-console/console-b9d5cc448-4pr88"
Jul 20 10:00:41.675001 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.674957    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w2dc\" (UniqueName: \"kubernetes.io/projected/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-kube-api-access-9w2dc\") pod \"console-b9d5cc448-4pr88\" (UID: \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\") " pod="openshift-console/console-b9d5cc448-4pr88"
Jul 20 10:00:41.675159 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.675008    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-console-oauth-config\") pod \"console-b9d5cc448-4pr88\" (UID: \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\") " pod="openshift-console/console-b9d5cc448-4pr88"
Jul 20 10:00:41.776017 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.775965    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-console-serving-cert\") pod \"console-b9d5cc448-4pr88\" (UID: \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\") " pod="openshift-console/console-b9d5cc448-4pr88"
Jul 20 10:00:41.776017 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.776016    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-trusted-ca-bundle\") pod \"console-b9d5cc448-4pr88\" (UID: \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\") " pod="openshift-console/console-b9d5cc448-4pr88"
Jul 20 10:00:41.776260 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.776046    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-oauth-serving-cert\") pod \"console-b9d5cc448-4pr88\" (UID: \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\") " pod="openshift-console/console-b9d5cc448-4pr88"
Jul 20 10:00:41.776260 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.776064    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w2dc\" (UniqueName: \"kubernetes.io/projected/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-kube-api-access-9w2dc\") pod \"console-b9d5cc448-4pr88\" (UID: \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\") " pod="openshift-console/console-b9d5cc448-4pr88"
Jul 20 10:00:41.776260 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.776096    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-console-oauth-config\") pod \"console-b9d5cc448-4pr88\" (UID: \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\") " pod="openshift-console/console-b9d5cc448-4pr88"
Jul 20 10:00:41.776260 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.776161    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-console-config\") pod \"console-b9d5cc448-4pr88\" (UID: \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\") " pod="openshift-console/console-b9d5cc448-4pr88"
Jul 20 10:00:41.776260 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.776213    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-service-ca\") pod \"console-b9d5cc448-4pr88\" (UID: \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\") " pod="openshift-console/console-b9d5cc448-4pr88"
Jul 20 10:00:41.777096 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.777069    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-service-ca\") pod \"console-b9d5cc448-4pr88\" (UID: \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\") " pod="openshift-console/console-b9d5cc448-4pr88"
Jul 20 10:00:41.777195 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.777105    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-trusted-ca-bundle\") pod \"console-b9d5cc448-4pr88\" (UID: \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\") " pod="openshift-console/console-b9d5cc448-4pr88"
Jul 20 10:00:41.777195 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.777070    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-console-config\") pod \"console-b9d5cc448-4pr88\" (UID: \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\") " pod="openshift-console/console-b9d5cc448-4pr88"
Jul 20 10:00:41.777268 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.777236    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-oauth-serving-cert\") pod \"console-b9d5cc448-4pr88\" (UID: \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\") " pod="openshift-console/console-b9d5cc448-4pr88"
Jul 20 10:00:41.778699 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.778676    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-console-oauth-config\") pod \"console-b9d5cc448-4pr88\" (UID: \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\") " pod="openshift-console/console-b9d5cc448-4pr88"
Jul 20 10:00:41.778699 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.778690    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-console-serving-cert\") pod \"console-b9d5cc448-4pr88\" (UID: \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\") " pod="openshift-console/console-b9d5cc448-4pr88"
Jul 20 10:00:41.784213 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.784191    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w2dc\" (UniqueName: \"kubernetes.io/projected/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-kube-api-access-9w2dc\") pod \"console-b9d5cc448-4pr88\" (UID: \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\") " pod="openshift-console/console-b9d5cc448-4pr88"
Jul 20 10:00:41.908067 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:41.907984    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b9d5cc448-4pr88"
Jul 20 10:00:42.044359 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:42.044328    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b9d5cc448-4pr88"]
Jul 20 10:00:42.047813 ip-10-0-138-143 kubenswrapper[2561]: W0720 10:00:42.047786    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fa64b05_a53d_4dfd_8774_5f7cbb4b1ee4.slice/crio-0d6fd0043f1fde920dea379f99c2ae75721dc3eebcaa7a70ba4437168a8de224 WatchSource:0}: Error finding container 0d6fd0043f1fde920dea379f99c2ae75721dc3eebcaa7a70ba4437168a8de224: Status 404 returned error can't find the container with id 0d6fd0043f1fde920dea379f99c2ae75721dc3eebcaa7a70ba4437168a8de224
Jul 20 10:00:42.551905 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:42.551840    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b9d5cc448-4pr88" event={"ID":"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4","Type":"ContainerStarted","Data":"a10ef3dc22d26a7679bf0b434f66f9bc29703a6bc25c8037f7780e7fd62f3e28"}
Jul 20 10:00:42.552080 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:42.551916    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b9d5cc448-4pr88" event={"ID":"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4","Type":"ContainerStarted","Data":"0d6fd0043f1fde920dea379f99c2ae75721dc3eebcaa7a70ba4437168a8de224"}
Jul 20 10:00:42.570231 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:42.569725    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b9d5cc448-4pr88" podStartSLOduration=1.569703335 podStartE2EDuration="1.569703335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:00:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:00:42.568789681 +0000 UTC m=+216.285704944" watchObservedRunningTime="2026-07-20 10:00:42.569703335 +0000 UTC m=+216.286618604"
Jul 20 10:00:51.908681 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:51.908643    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b9d5cc448-4pr88"
Jul 20 10:00:51.909154 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:51.908734    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b9d5cc448-4pr88"
Jul 20 10:00:51.913437 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:51.913410    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b9d5cc448-4pr88"
Jul 20 10:00:52.595598 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:00:52.595573    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b9d5cc448-4pr88"
Jul 20 10:02:06.630767 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:02:06.630742    2561 kubelet.go:1648] "Image garbage collection succeeded"
Jul 20 10:04:04.913182 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:04.913148    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5cm6cl"]
Jul 20 10:04:04.916256 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:04.916239    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5cm6cl"
Jul 20 10:04:04.918427 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:04.918406    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tppzh\""
Jul 20 10:04:04.918556 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:04.918447    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 20 10:04:04.919123 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:04.919100    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 20 10:04:04.936888 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:04.936851    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5cm6cl"]
Jul 20 10:04:05.012942 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:05.012913    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67384636-69ec-4400-b901-6ee081b3e726-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5cm6cl\" (UID: \"67384636-69ec-4400-b901-6ee081b3e726\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5cm6cl"
Jul 20 10:04:05.013099 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:05.012981    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67384636-69ec-4400-b901-6ee081b3e726-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5cm6cl\" (UID: \"67384636-69ec-4400-b901-6ee081b3e726\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5cm6cl"
Jul 20 10:04:05.013099 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:05.013016    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wj5v\" (UniqueName: \"kubernetes.io/projected/67384636-69ec-4400-b901-6ee081b3e726-kube-api-access-9wj5v\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5cm6cl\" (UID: \"67384636-69ec-4400-b901-6ee081b3e726\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5cm6cl"
Jul 20 10:04:05.114067 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:05.114037    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67384636-69ec-4400-b901-6ee081b3e726-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5cm6cl\" (UID: \"67384636-69ec-4400-b901-6ee081b3e726\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5cm6cl"
Jul 20 10:04:05.114183 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:05.114093    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67384636-69ec-4400-b901-6ee081b3e726-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5cm6cl\" (UID: \"67384636-69ec-4400-b901-6ee081b3e726\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5cm6cl"
Jul 20 10:04:05.114183 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:05.114114    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wj5v\" (UniqueName: \"kubernetes.io/projected/67384636-69ec-4400-b901-6ee081b3e726-kube-api-access-9wj5v\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5cm6cl\" (UID: \"67384636-69ec-4400-b901-6ee081b3e726\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5cm6cl"
Jul 20 10:04:05.114495 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:05.114474    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67384636-69ec-4400-b901-6ee081b3e726-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5cm6cl\" (UID: \"67384636-69ec-4400-b901-6ee081b3e726\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5cm6cl"
Jul 20 10:04:05.114533 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:05.114472    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67384636-69ec-4400-b901-6ee081b3e726-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5cm6cl\" (UID: \"67384636-69ec-4400-b901-6ee081b3e726\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5cm6cl"
Jul 20 10:04:05.123098 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:05.123071    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wj5v\" (UniqueName: \"kubernetes.io/projected/67384636-69ec-4400-b901-6ee081b3e726-kube-api-access-9wj5v\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5cm6cl\" (UID: \"67384636-69ec-4400-b901-6ee081b3e726\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5cm6cl"
Jul 20 10:04:05.226325 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:05.226247    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5cm6cl"
Jul 20 10:04:05.352705 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:05.352671    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5cm6cl"]
Jul 20 10:04:05.356260 ip-10-0-138-143 kubenswrapper[2561]: W0720 10:04:05.356233    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67384636_69ec_4400_b901_6ee081b3e726.slice/crio-a2b6cc2af78cb8edd5a3380fa13aad0382d02c3434e51662194e0cabd129c92e WatchSource:0}: Error finding container a2b6cc2af78cb8edd5a3380fa13aad0382d02c3434e51662194e0cabd129c92e: Status 404 returned error can't find the container with id a2b6cc2af78cb8edd5a3380fa13aad0382d02c3434e51662194e0cabd129c92e
Jul 20 10:04:05.358235 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:05.358221    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 10:04:06.249034 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:06.248994    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5cm6cl" event={"ID":"67384636-69ec-4400-b901-6ee081b3e726","Type":"ContainerStarted","Data":"a2b6cc2af78cb8edd5a3380fa13aad0382d02c3434e51662194e0cabd129c92e"}
Jul 20 10:04:11.270105 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:11.270075    2561 generic.go:356] "Generic (PLEG): container finished" podID="67384636-69ec-4400-b901-6ee081b3e726" containerID="ce7d0f1e0b612dfdb214f4b622e011fa4e5741db55844df94d71d1c551717416" exitCode=0
Jul 20 10:04:11.270450 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:11.270157    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5cm6cl" event={"ID":"67384636-69ec-4400-b901-6ee081b3e726","Type":"ContainerDied","Data":"ce7d0f1e0b612dfdb214f4b622e011fa4e5741db55844df94d71d1c551717416"}
Jul 20 10:04:13.279347 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:13.279309    2561 generic.go:356] "Generic (PLEG): container finished" podID="67384636-69ec-4400-b901-6ee081b3e726" containerID="2136b88f3538eff1ad4ec7934a0f41c9106947f6c95f003c543ea7c61f6662f4" exitCode=0
Jul 20 10:04:13.279767 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:13.279382    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5cm6cl" event={"ID":"67384636-69ec-4400-b901-6ee081b3e726","Type":"ContainerDied","Data":"2136b88f3538eff1ad4ec7934a0f41c9106947f6c95f003c543ea7c61f6662f4"}
Jul 20 10:04:20.308839 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:20.308802    2561 generic.go:356] "Generic (PLEG): container finished" podID="67384636-69ec-4400-b901-6ee081b3e726" containerID="4ab4148194f29f92a4a89993e7e52f08493d85fbf9734db3c8c723b733629cba" exitCode=0
Jul 20 10:04:20.309234 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:20.308909    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5cm6cl" event={"ID":"67384636-69ec-4400-b901-6ee081b3e726","Type":"ContainerDied","Data":"4ab4148194f29f92a4a89993e7e52f08493d85fbf9734db3c8c723b733629cba"}
Jul 20 10:04:21.438739 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:21.438714    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5cm6cl"
Jul 20 10:04:21.539673 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:21.539638    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67384636-69ec-4400-b901-6ee081b3e726-util\") pod \"67384636-69ec-4400-b901-6ee081b3e726\" (UID: \"67384636-69ec-4400-b901-6ee081b3e726\") "
Jul 20 10:04:21.539673 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:21.539678    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wj5v\" (UniqueName: \"kubernetes.io/projected/67384636-69ec-4400-b901-6ee081b3e726-kube-api-access-9wj5v\") pod \"67384636-69ec-4400-b901-6ee081b3e726\" (UID: \"67384636-69ec-4400-b901-6ee081b3e726\") "
Jul 20 10:04:21.539931 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:21.539728    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67384636-69ec-4400-b901-6ee081b3e726-bundle\") pod \"67384636-69ec-4400-b901-6ee081b3e726\" (UID: \"67384636-69ec-4400-b901-6ee081b3e726\") "
Jul 20 10:04:21.540417 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:21.540392    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67384636-69ec-4400-b901-6ee081b3e726-bundle" (OuterVolumeSpecName: "bundle") pod "67384636-69ec-4400-b901-6ee081b3e726" (UID: "67384636-69ec-4400-b901-6ee081b3e726"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 10:04:21.541856 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:21.541834    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67384636-69ec-4400-b901-6ee081b3e726-kube-api-access-9wj5v" (OuterVolumeSpecName: "kube-api-access-9wj5v") pod "67384636-69ec-4400-b901-6ee081b3e726" (UID: "67384636-69ec-4400-b901-6ee081b3e726"). InnerVolumeSpecName "kube-api-access-9wj5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 10:04:21.543854 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:21.543834    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67384636-69ec-4400-b901-6ee081b3e726-util" (OuterVolumeSpecName: "util") pod "67384636-69ec-4400-b901-6ee081b3e726" (UID: "67384636-69ec-4400-b901-6ee081b3e726"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 10:04:21.640632 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:21.640553    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67384636-69ec-4400-b901-6ee081b3e726-util\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:04:21.640632 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:21.640582    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wj5v\" (UniqueName: \"kubernetes.io/projected/67384636-69ec-4400-b901-6ee081b3e726-kube-api-access-9wj5v\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:04:21.640632 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:21.640591    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67384636-69ec-4400-b901-6ee081b3e726-bundle\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:04:22.317631 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:22.317594    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5cm6cl" event={"ID":"67384636-69ec-4400-b901-6ee081b3e726","Type":"ContainerDied","Data":"a2b6cc2af78cb8edd5a3380fa13aad0382d02c3434e51662194e0cabd129c92e"}
Jul 20 10:04:22.317794 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:22.317639    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5cm6cl"
Jul 20 10:04:22.317794 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:22.317645    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a2b6cc2af78cb8edd5a3380fa13aad0382d02c3434e51662194e0cabd129c92e"
Jul 20 10:04:33.950434 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:33.950356    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-77f648d694-vjt9s"]
Jul 20 10:04:33.950849 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:33.950616    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67384636-69ec-4400-b901-6ee081b3e726" containerName="util"
Jul 20 10:04:33.950849 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:33.950627    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="67384636-69ec-4400-b901-6ee081b3e726" containerName="util"
Jul 20 10:04:33.950849 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:33.950639    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67384636-69ec-4400-b901-6ee081b3e726" containerName="pull"
Jul 20 10:04:33.950849 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:33.950646    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="67384636-69ec-4400-b901-6ee081b3e726" containerName="pull"
Jul 20 10:04:33.950849 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:33.950651    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67384636-69ec-4400-b901-6ee081b3e726" containerName="extract"
Jul 20 10:04:33.950849 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:33.950656    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="67384636-69ec-4400-b901-6ee081b3e726" containerName="extract"
Jul 20 10:04:33.950849 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:33.950703    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="67384636-69ec-4400-b901-6ee081b3e726" containerName="extract"
Jul 20 10:04:33.965038 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:33.965017    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-vjt9s"
Jul 20 10:04:33.968019 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:33.967993    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Jul 20 10:04:33.968150 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:33.968130    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Jul 20 10:04:33.969602 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:33.969585    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Jul 20 10:04:33.969728 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:33.969690    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Jul 20 10:04:33.970147 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:33.970129    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-qqj6h\""
Jul 20 10:04:33.972066 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:33.972051    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
Jul 20 10:04:33.991171 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:33.991144    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-vjt9s"]
Jul 20 10:04:34.028162 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:34.028121    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kdx8\" (UniqueName: \"kubernetes.io/projected/4b324320-ada6-46ad-b2c9-ccd4dd1385d3-kube-api-access-4kdx8\") pod \"keda-operator-77f648d694-vjt9s\" (UID: \"4b324320-ada6-46ad-b2c9-ccd4dd1385d3\") " pod="openshift-keda/keda-operator-77f648d694-vjt9s"
Jul 20 10:04:34.028322 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:34.028177    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4b324320-ada6-46ad-b2c9-ccd4dd1385d3-certificates\") pod \"keda-operator-77f648d694-vjt9s\" (UID: \"4b324320-ada6-46ad-b2c9-ccd4dd1385d3\") " pod="openshift-keda/keda-operator-77f648d694-vjt9s"
Jul 20 10:04:34.028322 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:34.028264    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/4b324320-ada6-46ad-b2c9-ccd4dd1385d3-cabundle0\") pod \"keda-operator-77f648d694-vjt9s\" (UID: \"4b324320-ada6-46ad-b2c9-ccd4dd1385d3\") " pod="openshift-keda/keda-operator-77f648d694-vjt9s"
Jul 20 10:04:34.129477 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:34.129438    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/4b324320-ada6-46ad-b2c9-ccd4dd1385d3-cabundle0\") pod \"keda-operator-77f648d694-vjt9s\" (UID: \"4b324320-ada6-46ad-b2c9-ccd4dd1385d3\") " pod="openshift-keda/keda-operator-77f648d694-vjt9s"
Jul 20 10:04:34.129637 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:34.129485    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kdx8\" (UniqueName: \"kubernetes.io/projected/4b324320-ada6-46ad-b2c9-ccd4dd1385d3-kube-api-access-4kdx8\") pod \"keda-operator-77f648d694-vjt9s\" (UID: \"4b324320-ada6-46ad-b2c9-ccd4dd1385d3\") " pod="openshift-keda/keda-operator-77f648d694-vjt9s"
Jul 20 10:04:34.129637 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:34.129518    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4b324320-ada6-46ad-b2c9-ccd4dd1385d3-certificates\") pod \"keda-operator-77f648d694-vjt9s\" (UID: \"4b324320-ada6-46ad-b2c9-ccd4dd1385d3\") " pod="openshift-keda/keda-operator-77f648d694-vjt9s"
Jul 20 10:04:34.129637 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:04:34.129615    2561 secret.go:281] references non-existent secret key: ca.crt
Jul 20 10:04:34.129637 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:04:34.129626    2561 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Jul 20 10:04:34.129637 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:04:34.129634    2561 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-vjt9s: references non-existent secret key: ca.crt
Jul 20 10:04:34.129799 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:04:34.129693    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b324320-ada6-46ad-b2c9-ccd4dd1385d3-certificates podName:4b324320-ada6-46ad-b2c9-ccd4dd1385d3 nodeName:}" failed. No retries permitted until 2026-07-20 10:04:34.629678085 +0000 UTC m=+448.346593331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/4b324320-ada6-46ad-b2c9-ccd4dd1385d3-certificates") pod "keda-operator-77f648d694-vjt9s" (UID: "4b324320-ada6-46ad-b2c9-ccd4dd1385d3") : references non-existent secret key: ca.crt
Jul 20 10:04:34.130096 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:34.130078    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/4b324320-ada6-46ad-b2c9-ccd4dd1385d3-cabundle0\") pod \"keda-operator-77f648d694-vjt9s\" (UID: \"4b324320-ada6-46ad-b2c9-ccd4dd1385d3\") " pod="openshift-keda/keda-operator-77f648d694-vjt9s"
Jul 20 10:04:34.157565 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:34.157537    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kdx8\" (UniqueName: \"kubernetes.io/projected/4b324320-ada6-46ad-b2c9-ccd4dd1385d3-kube-api-access-4kdx8\") pod \"keda-operator-77f648d694-vjt9s\" (UID: \"4b324320-ada6-46ad-b2c9-ccd4dd1385d3\") " pod="openshift-keda/keda-operator-77f648d694-vjt9s"
Jul 20 10:04:34.634335 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:34.634294    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4b324320-ada6-46ad-b2c9-ccd4dd1385d3-certificates\") pod \"keda-operator-77f648d694-vjt9s\" (UID: \"4b324320-ada6-46ad-b2c9-ccd4dd1385d3\") " pod="openshift-keda/keda-operator-77f648d694-vjt9s"
Jul 20 10:04:34.634517 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:04:34.634436    2561 secret.go:281] references non-existent secret key: ca.crt
Jul 20 10:04:34.634517 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:04:34.634456    2561 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Jul 20 10:04:34.634517 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:04:34.634464    2561 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-vjt9s: references non-existent secret key: ca.crt
Jul 20 10:04:34.634517 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:04:34.634516    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b324320-ada6-46ad-b2c9-ccd4dd1385d3-certificates podName:4b324320-ada6-46ad-b2c9-ccd4dd1385d3 nodeName:}" failed. No retries permitted until 2026-07-20 10:04:35.634500863 +0000 UTC m=+449.351416109 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/4b324320-ada6-46ad-b2c9-ccd4dd1385d3-certificates") pod "keda-operator-77f648d694-vjt9s" (UID: "4b324320-ada6-46ad-b2c9-ccd4dd1385d3") : references non-existent secret key: ca.crt
Jul 20 10:04:34.929348 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:34.929269    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-wwbtt"]
Jul 20 10:04:34.931567 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:34.931545    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-wwbtt"
Jul 20 10:04:34.933572 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:34.933548    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
Jul 20 10:04:34.944621 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:34.944604    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-wwbtt"]
Jul 20 10:04:35.037705 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:35.037668    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/a59237e8-454a-45da-813f-fc7008a5fcc3-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-wwbtt\" (UID: \"a59237e8-454a-45da-813f-fc7008a5fcc3\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-wwbtt"
Jul 20 10:04:35.037705 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:35.037709    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/a59237e8-454a-45da-813f-fc7008a5fcc3-certificates\") pod \"keda-metrics-apiserver-55557df8c-wwbtt\" (UID: \"a59237e8-454a-45da-813f-fc7008a5fcc3\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-wwbtt"
Jul 20 10:04:35.038122 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:35.037730    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76jlz\" (UniqueName: \"kubernetes.io/projected/a59237e8-454a-45da-813f-fc7008a5fcc3-kube-api-access-76jlz\") pod \"keda-metrics-apiserver-55557df8c-wwbtt\" (UID: \"a59237e8-454a-45da-813f-fc7008a5fcc3\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-wwbtt"
Jul 20 10:04:35.138266 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:35.138236    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76jlz\" (UniqueName: \"kubernetes.io/projected/a59237e8-454a-45da-813f-fc7008a5fcc3-kube-api-access-76jlz\") pod \"keda-metrics-apiserver-55557df8c-wwbtt\" (UID: \"a59237e8-454a-45da-813f-fc7008a5fcc3\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-wwbtt"
Jul 20 10:04:35.138434 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:35.138317    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/a59237e8-454a-45da-813f-fc7008a5fcc3-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-wwbtt\" (UID: \"a59237e8-454a-45da-813f-fc7008a5fcc3\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-wwbtt"
Jul 20 10:04:35.138434 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:35.138338    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/a59237e8-454a-45da-813f-fc7008a5fcc3-certificates\") pod \"keda-metrics-apiserver-55557df8c-wwbtt\" (UID: \"a59237e8-454a-45da-813f-fc7008a5fcc3\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-wwbtt"
Jul 20 10:04:35.138772 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:35.138752    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/a59237e8-454a-45da-813f-fc7008a5fcc3-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-wwbtt\" (UID: \"a59237e8-454a-45da-813f-fc7008a5fcc3\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-wwbtt"
Jul 20 10:04:35.140789 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:35.140754    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/a59237e8-454a-45da-813f-fc7008a5fcc3-certificates\") pod \"keda-metrics-apiserver-55557df8c-wwbtt\" (UID: \"a59237e8-454a-45da-813f-fc7008a5fcc3\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-wwbtt"
Jul 20 10:04:35.148634 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:35.148606    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76jlz\" (UniqueName: \"kubernetes.io/projected/a59237e8-454a-45da-813f-fc7008a5fcc3-kube-api-access-76jlz\") pod \"keda-metrics-apiserver-55557df8c-wwbtt\" (UID: \"a59237e8-454a-45da-813f-fc7008a5fcc3\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-wwbtt"
Jul 20 10:04:35.153510 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:35.153480    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-8b6gc"]
Jul 20 10:04:35.155937 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:35.155920    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-8b6gc"
Jul 20 10:04:35.158473 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:35.158456    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
Jul 20 10:04:35.171409 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:35.171385    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-8b6gc"]
Jul 20 10:04:35.238746 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:35.238647    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6ww8\" (UniqueName: \"kubernetes.io/projected/bc6801b7-ed92-4a5f-9023-2918875ea71a-kube-api-access-g6ww8\") pod \"keda-admission-56f9798bb4-8b6gc\" (UID: \"bc6801b7-ed92-4a5f-9023-2918875ea71a\") " pod="openshift-keda/keda-admission-56f9798bb4-8b6gc"
Jul 20 10:04:35.238746 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:35.238703    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bc6801b7-ed92-4a5f-9023-2918875ea71a-certificates\") pod \"keda-admission-56f9798bb4-8b6gc\" (UID: \"bc6801b7-ed92-4a5f-9023-2918875ea71a\") " pod="openshift-keda/keda-admission-56f9798bb4-8b6gc"
Jul 20 10:04:35.241680 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:35.241651    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-wwbtt"
Jul 20 10:04:35.339962 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:35.339615    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6ww8\" (UniqueName: \"kubernetes.io/projected/bc6801b7-ed92-4a5f-9023-2918875ea71a-kube-api-access-g6ww8\") pod \"keda-admission-56f9798bb4-8b6gc\" (UID: \"bc6801b7-ed92-4a5f-9023-2918875ea71a\") " pod="openshift-keda/keda-admission-56f9798bb4-8b6gc"
Jul 20 10:04:35.339962 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:35.339703    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bc6801b7-ed92-4a5f-9023-2918875ea71a-certificates\") pod \"keda-admission-56f9798bb4-8b6gc\" (UID: \"bc6801b7-ed92-4a5f-9023-2918875ea71a\") " pod="openshift-keda/keda-admission-56f9798bb4-8b6gc"
Jul 20 10:04:35.339962 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:04:35.339846    2561 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found
Jul 20 10:04:35.339962 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:04:35.339872    2561 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-56f9798bb4-8b6gc: secret "keda-admission-webhooks-certs" not found
Jul 20 10:04:35.340260 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:04:35.340004    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc6801b7-ed92-4a5f-9023-2918875ea71a-certificates podName:bc6801b7-ed92-4a5f-9023-2918875ea71a nodeName:}" failed. No retries permitted until 2026-07-20 10:04:35.839972436 +0000 UTC m=+449.556887707 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/bc6801b7-ed92-4a5f-9023-2918875ea71a-certificates") pod "keda-admission-56f9798bb4-8b6gc" (UID: "bc6801b7-ed92-4a5f-9023-2918875ea71a") : secret "keda-admission-webhooks-certs" not found
Jul 20 10:04:35.355213 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:35.355188    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6ww8\" (UniqueName: \"kubernetes.io/projected/bc6801b7-ed92-4a5f-9023-2918875ea71a-kube-api-access-g6ww8\") pod \"keda-admission-56f9798bb4-8b6gc\" (UID: \"bc6801b7-ed92-4a5f-9023-2918875ea71a\") " pod="openshift-keda/keda-admission-56f9798bb4-8b6gc"
Jul 20 10:04:35.393571 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:35.393540    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-wwbtt"]
Jul 20 10:04:35.398494 ip-10-0-138-143 kubenswrapper[2561]: W0720 10:04:35.398466    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda59237e8_454a_45da_813f_fc7008a5fcc3.slice/crio-e9ab2b0425cf6511e6c2efa8ee33b8e35b8628d807fa1af7afd047a149b57f7e WatchSource:0}: Error finding container e9ab2b0425cf6511e6c2efa8ee33b8e35b8628d807fa1af7afd047a149b57f7e: Status 404 returned error can't find the container with id e9ab2b0425cf6511e6c2efa8ee33b8e35b8628d807fa1af7afd047a149b57f7e
Jul 20 10:04:35.643657 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:35.643619    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4b324320-ada6-46ad-b2c9-ccd4dd1385d3-certificates\") pod \"keda-operator-77f648d694-vjt9s\" (UID: \"4b324320-ada6-46ad-b2c9-ccd4dd1385d3\") " pod="openshift-keda/keda-operator-77f648d694-vjt9s"
Jul 20 10:04:35.646366 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:35.646339    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4b324320-ada6-46ad-b2c9-ccd4dd1385d3-certificates\") pod \"keda-operator-77f648d694-vjt9s\" (UID: \"4b324320-ada6-46ad-b2c9-ccd4dd1385d3\") " pod="openshift-keda/keda-operator-77f648d694-vjt9s"
Jul 20 10:04:35.775092 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:35.775053    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-vjt9s"
Jul 20 10:04:35.846615 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:35.846578    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bc6801b7-ed92-4a5f-9023-2918875ea71a-certificates\") pod \"keda-admission-56f9798bb4-8b6gc\" (UID: \"bc6801b7-ed92-4a5f-9023-2918875ea71a\") " pod="openshift-keda/keda-admission-56f9798bb4-8b6gc"
Jul 20 10:04:35.851536 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:35.849702    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bc6801b7-ed92-4a5f-9023-2918875ea71a-certificates\") pod \"keda-admission-56f9798bb4-8b6gc\" (UID: \"bc6801b7-ed92-4a5f-9023-2918875ea71a\") " pod="openshift-keda/keda-admission-56f9798bb4-8b6gc"
Jul 20 10:04:36.011332 ip-10-0-138-143 kubenswrapper[2561]: W0720 10:04:36.011269    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b324320_ada6_46ad_b2c9_ccd4dd1385d3.slice/crio-5366b6822bc6df51cff9719c1bf3cbc121fac7618555d15988c5c7000d74e5f7 WatchSource:0}: Error finding container 5366b6822bc6df51cff9719c1bf3cbc121fac7618555d15988c5c7000d74e5f7: Status 404 returned error can't find the container with id 5366b6822bc6df51cff9719c1bf3cbc121fac7618555d15988c5c7000d74e5f7
Jul 20 10:04:36.014456 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:36.014430    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-vjt9s"]
Jul 20 10:04:36.066368 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:36.066334    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-8b6gc"
Jul 20 10:04:36.215821 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:36.215790    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-8b6gc"]
Jul 20 10:04:36.219656 ip-10-0-138-143 kubenswrapper[2561]: W0720 10:04:36.219625    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc6801b7_ed92_4a5f_9023_2918875ea71a.slice/crio-074c2fabeedfc9143e10e0483107759167e684f3b1c3e113711ae1589f07c6ae WatchSource:0}: Error finding container 074c2fabeedfc9143e10e0483107759167e684f3b1c3e113711ae1589f07c6ae: Status 404 returned error can't find the container with id 074c2fabeedfc9143e10e0483107759167e684f3b1c3e113711ae1589f07c6ae
Jul 20 10:04:36.368929 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:36.368871    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-8b6gc" event={"ID":"bc6801b7-ed92-4a5f-9023-2918875ea71a","Type":"ContainerStarted","Data":"074c2fabeedfc9143e10e0483107759167e684f3b1c3e113711ae1589f07c6ae"}
Jul 20 10:04:36.370104 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:36.370071    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-wwbtt" event={"ID":"a59237e8-454a-45da-813f-fc7008a5fcc3","Type":"ContainerStarted","Data":"e9ab2b0425cf6511e6c2efa8ee33b8e35b8628d807fa1af7afd047a149b57f7e"}
Jul 20 10:04:36.371293 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:36.371271    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-vjt9s" event={"ID":"4b324320-ada6-46ad-b2c9-ccd4dd1385d3","Type":"ContainerStarted","Data":"5366b6822bc6df51cff9719c1bf3cbc121fac7618555d15988c5c7000d74e5f7"}
Jul 20 10:04:40.388107 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:40.388069    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-8b6gc" event={"ID":"bc6801b7-ed92-4a5f-9023-2918875ea71a","Type":"ContainerStarted","Data":"fe43993df2b086650f7712bce192073295d20dd5f6da9cd76163df814ff9ba70"}
Jul 20 10:04:40.388541 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:40.388188    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-56f9798bb4-8b6gc"
Jul 20 10:04:40.389609 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:40.389583    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-wwbtt" event={"ID":"a59237e8-454a-45da-813f-fc7008a5fcc3","Type":"ContainerStarted","Data":"f2c20b00cec12528f91bb22431dfead7edbea129963a2cc821be7492e232d64f"}
Jul 20 10:04:40.389723 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:40.389671    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-wwbtt"
Jul 20 10:04:40.390993 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:40.390973    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-vjt9s" event={"ID":"4b324320-ada6-46ad-b2c9-ccd4dd1385d3","Type":"ContainerStarted","Data":"0d1543265709912c601831c4bd159db2c7c48fede54d171686570d723532c9b3"}
Jul 20 10:04:40.391107 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:40.391095    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-77f648d694-vjt9s"
Jul 20 10:04:40.408453 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:40.408410    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-56f9798bb4-8b6gc" podStartSLOduration=2.194327988 podStartE2EDuration="5.408396323s" totalImagesPullingTime="3.214068335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:04:40.406101076 +0000 UTC m=+454.123016344" watchObservedRunningTime="2026-07-20 10:04:40.408396323 +0000 UTC m=+454.125311592"
Jul 20 10:04:40.426379 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:40.426334    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-wwbtt" podStartSLOduration=2.392180399 podStartE2EDuration="6.426318776s" totalImagesPullingTime="4.034138377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:04:40.424352944 +0000 UTC m=+454.141268213" watchObservedRunningTime="2026-07-20 10:04:40.426318776 +0000 UTC m=+454.143234044"
Jul 20 10:04:40.446013 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:40.445968    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-77f648d694-vjt9s" podStartSLOduration=4.016566746 podStartE2EDuration="7.445953697s" totalImagesPullingTime="3.429386951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:04:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:04:40.44505729 +0000 UTC m=+454.161972559" watchObservedRunningTime="2026-07-20 10:04:40.445953697 +0000 UTC m=+454.162868967"
Jul 20 10:04:51.404960 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:51.404928    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-wwbtt"
Jul 20 10:04:58.155951 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:04:58.155915    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b9d5cc448-4pr88"]
Jul 20 10:05:01.402647 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:01.402615    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-77f648d694-vjt9s"
Jul 20 10:05:01.403089 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:01.402938    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-56f9798bb4-8b6gc"
Jul 20 10:05:23.176557 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.176496    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b9d5cc448-4pr88" podUID="8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4" containerName="console" containerID="cri-o://a10ef3dc22d26a7679bf0b434f66f9bc29703a6bc25c8037f7780e7fd62f3e28" gracePeriod=15
Jul 20 10:05:23.408562 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.408540    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b9d5cc448-4pr88"
Jul 20 10:05:23.414626 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.414606    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9w2dc\" (UniqueName: \"kubernetes.io/projected/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-kube-api-access-9w2dc\") pod \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\" (UID: \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\") "
Jul 20 10:05:23.414729 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.414638    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-trusted-ca-bundle\") pod \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\" (UID: \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\") "
Jul 20 10:05:23.414729 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.414663    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-console-serving-cert\") pod \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\" (UID: \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\") "
Jul 20 10:05:23.414729 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.414699    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-console-config\") pod \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\" (UID: \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\") "
Jul 20 10:05:23.414729 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.414730    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-console-oauth-config\") pod \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\" (UID: \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\") "
Jul 20 10:05:23.414952 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.414751    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-oauth-serving-cert\") pod \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\" (UID: \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\") "
Jul 20 10:05:23.414952 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.414775    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-service-ca\") pod \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\" (UID: \"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4\") "
Jul 20 10:05:23.415088 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.415062    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4" (UID: "8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 10:05:23.415185 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.415157    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4" (UID: "8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 10:05:23.415248 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.415175    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-console-config" (OuterVolumeSpecName: "console-config") pod "8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4" (UID: "8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 10:05:23.415248 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.415217    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-service-ca" (OuterVolumeSpecName: "service-ca") pod "8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4" (UID: "8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 10:05:23.416776 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.416743    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-kube-api-access-9w2dc" (OuterVolumeSpecName: "kube-api-access-9w2dc") pod "8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4" (UID: "8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4"). InnerVolumeSpecName "kube-api-access-9w2dc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 10:05:23.416897 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.416823    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4" (UID: "8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:05:23.416897 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.416851    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4" (UID: "8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:05:23.515789 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.515702    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-console-oauth-config\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:05:23.515789 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.515734    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-oauth-serving-cert\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:05:23.515789 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.515744    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-service-ca\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:05:23.515789 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.515752    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9w2dc\" (UniqueName: \"kubernetes.io/projected/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-kube-api-access-9w2dc\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:05:23.515789 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.515761    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-trusted-ca-bundle\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:05:23.515789 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.515769    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-console-serving-cert\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:05:23.515789 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.515778    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4-console-config\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:05:23.555148 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.555110    2561 generic.go:356] "Generic (PLEG): container finished" podID="8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4" containerID="a10ef3dc22d26a7679bf0b434f66f9bc29703a6bc25c8037f7780e7fd62f3e28" exitCode=0
Jul 20 10:05:23.555297 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.555160    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b9d5cc448-4pr88"
Jul 20 10:05:23.555297 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.555200    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b9d5cc448-4pr88" event={"ID":"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4","Type":"ContainerDied","Data":"a10ef3dc22d26a7679bf0b434f66f9bc29703a6bc25c8037f7780e7fd62f3e28"}
Jul 20 10:05:23.555297 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.555254    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b9d5cc448-4pr88" event={"ID":"8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4","Type":"ContainerDied","Data":"0d6fd0043f1fde920dea379f99c2ae75721dc3eebcaa7a70ba4437168a8de224"}
Jul 20 10:05:23.555297 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.555275    2561 scope.go:117] "RemoveContainer" containerID="a10ef3dc22d26a7679bf0b434f66f9bc29703a6bc25c8037f7780e7fd62f3e28"
Jul 20 10:05:23.563862 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.563847    2561 scope.go:117] "RemoveContainer" containerID="a10ef3dc22d26a7679bf0b434f66f9bc29703a6bc25c8037f7780e7fd62f3e28"
Jul 20 10:05:23.564117 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:05:23.564097    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a10ef3dc22d26a7679bf0b434f66f9bc29703a6bc25c8037f7780e7fd62f3e28\": container with ID starting with a10ef3dc22d26a7679bf0b434f66f9bc29703a6bc25c8037f7780e7fd62f3e28 not found: ID does not exist" containerID="a10ef3dc22d26a7679bf0b434f66f9bc29703a6bc25c8037f7780e7fd62f3e28"
Jul 20 10:05:23.564165 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.564124    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a10ef3dc22d26a7679bf0b434f66f9bc29703a6bc25c8037f7780e7fd62f3e28"} err="failed to get container status \"a10ef3dc22d26a7679bf0b434f66f9bc29703a6bc25c8037f7780e7fd62f3e28\": rpc error: code = NotFound desc = could not find container \"a10ef3dc22d26a7679bf0b434f66f9bc29703a6bc25c8037f7780e7fd62f3e28\": container with ID starting with a10ef3dc22d26a7679bf0b434f66f9bc29703a6bc25c8037f7780e7fd62f3e28 not found: ID does not exist"
Jul 20 10:05:23.578582 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.578555    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b9d5cc448-4pr88"]
Jul 20 10:05:23.582244 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:23.582226    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b9d5cc448-4pr88"]
Jul 20 10:05:24.742633 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:24.742601    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4" path="/var/lib/kubelet/pods/8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4/volumes"
Jul 20 10:05:56.045477 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:56.045445    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-qw685"]
Jul 20 10:05:56.045970 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:56.045744    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4" containerName="console"
Jul 20 10:05:56.045970 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:56.045759    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4" containerName="console"
Jul 20 10:05:56.045970 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:56.045833    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fa64b05-a53d-4dfd-8774-5f7cbb4b1ee4" containerName="console"
Jul 20 10:05:56.047625 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:56.047607    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-qw685"
Jul 20 10:05:56.051319 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:56.051291    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 20 10:05:56.051319 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:56.051314    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-8m5t9\""
Jul 20 10:05:56.051480 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:56.051350    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Jul 20 10:05:56.052466 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:56.052451    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 20 10:05:56.065981 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:56.065959    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-qw685"]
Jul 20 10:05:56.166470 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:56.166437    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb2fc65e-0e52-466b-9454-d930e6c059fc-cert\") pod \"llmisvc-controller-manager-654c557856-qw685\" (UID: \"cb2fc65e-0e52-466b-9454-d930e6c059fc\") " pod="kserve/llmisvc-controller-manager-654c557856-qw685"
Jul 20 10:05:56.166650 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:56.166487    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mspgb\" (UniqueName: \"kubernetes.io/projected/cb2fc65e-0e52-466b-9454-d930e6c059fc-kube-api-access-mspgb\") pod \"llmisvc-controller-manager-654c557856-qw685\" (UID: \"cb2fc65e-0e52-466b-9454-d930e6c059fc\") " pod="kserve/llmisvc-controller-manager-654c557856-qw685"
Jul 20 10:05:56.267128 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:56.267084    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb2fc65e-0e52-466b-9454-d930e6c059fc-cert\") pod \"llmisvc-controller-manager-654c557856-qw685\" (UID: \"cb2fc65e-0e52-466b-9454-d930e6c059fc\") " pod="kserve/llmisvc-controller-manager-654c557856-qw685"
Jul 20 10:05:56.267128 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:56.267134    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mspgb\" (UniqueName: \"kubernetes.io/projected/cb2fc65e-0e52-466b-9454-d930e6c059fc-kube-api-access-mspgb\") pod \"llmisvc-controller-manager-654c557856-qw685\" (UID: \"cb2fc65e-0e52-466b-9454-d930e6c059fc\") " pod="kserve/llmisvc-controller-manager-654c557856-qw685"
Jul 20 10:05:56.269612 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:56.269585    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb2fc65e-0e52-466b-9454-d930e6c059fc-cert\") pod \"llmisvc-controller-manager-654c557856-qw685\" (UID: \"cb2fc65e-0e52-466b-9454-d930e6c059fc\") " pod="kserve/llmisvc-controller-manager-654c557856-qw685"
Jul 20 10:05:56.282398 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:56.282371    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mspgb\" (UniqueName: \"kubernetes.io/projected/cb2fc65e-0e52-466b-9454-d930e6c059fc-kube-api-access-mspgb\") pod \"llmisvc-controller-manager-654c557856-qw685\" (UID: \"cb2fc65e-0e52-466b-9454-d930e6c059fc\") " pod="kserve/llmisvc-controller-manager-654c557856-qw685"
Jul 20 10:05:56.357628 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:56.357534    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-qw685"
Jul 20 10:05:56.505689 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:56.505658    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-qw685"]
Jul 20 10:05:56.508967 ip-10-0-138-143 kubenswrapper[2561]: W0720 10:05:56.508933    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcb2fc65e_0e52_466b_9454_d930e6c059fc.slice/crio-555d79ff01e7bd885ce1999aec93ce14c4e35d7824efcfc30479dde0e88c93d5 WatchSource:0}: Error finding container 555d79ff01e7bd885ce1999aec93ce14c4e35d7824efcfc30479dde0e88c93d5: Status 404 returned error can't find the container with id 555d79ff01e7bd885ce1999aec93ce14c4e35d7824efcfc30479dde0e88c93d5
Jul 20 10:05:56.686389 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:56.686295    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-qw685" event={"ID":"cb2fc65e-0e52-466b-9454-d930e6c059fc","Type":"ContainerStarted","Data":"555d79ff01e7bd885ce1999aec93ce14c4e35d7824efcfc30479dde0e88c93d5"}
Jul 20 10:05:59.701125 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:59.701041    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-qw685" event={"ID":"cb2fc65e-0e52-466b-9454-d930e6c059fc","Type":"ContainerStarted","Data":"a5bf63895d2f8cb66acd155fcb123ff71ec4235c055be6b27f73ace80764836d"}
Jul 20 10:05:59.701125 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:59.701113    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-qw685"
Jul 20 10:05:59.722244 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:05:59.722193    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-654c557856-qw685" podStartSLOduration=1.340217379 podStartE2EDuration="3.722177439s" totalImagesPullingTime="2.38196006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:05:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:05:59.720631672 +0000 UTC m=+533.437546943" watchObservedRunningTime="2026-07-20 10:05:59.722177439 +0000 UTC m=+533.439092707"
Jul 20 10:06:30.707591 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:06:30.707559    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-654c557856-qw685"
Jul 20 10:07:13.674139 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:07:13.674104    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-fd65d7d6-94xhk"]
Jul 20 10:07:13.676504 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:07:13.676487    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-94xhk"
Jul 20 10:07:13.678487 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:07:13.678466    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\""
Jul 20 10:07:13.678610 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:07:13.678488    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-nrxlb\""
Jul 20 10:07:13.693619 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:07:13.693598    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-94xhk"]
Jul 20 10:07:13.759380 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:07:13.759349    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/588ff7f0-0116-4a77-b204-30ad932bbc64-tls-certs\") pod \"model-serving-api-fd65d7d6-94xhk\" (UID: \"588ff7f0-0116-4a77-b204-30ad932bbc64\") " pod="kserve/model-serving-api-fd65d7d6-94xhk"
Jul 20 10:07:13.759525 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:07:13.759388    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjrf9\" (UniqueName: \"kubernetes.io/projected/588ff7f0-0116-4a77-b204-30ad932bbc64-kube-api-access-fjrf9\") pod \"model-serving-api-fd65d7d6-94xhk\" (UID: \"588ff7f0-0116-4a77-b204-30ad932bbc64\") " pod="kserve/model-serving-api-fd65d7d6-94xhk"
Jul 20 10:07:13.860126 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:07:13.860089    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/588ff7f0-0116-4a77-b204-30ad932bbc64-tls-certs\") pod \"model-serving-api-fd65d7d6-94xhk\" (UID: \"588ff7f0-0116-4a77-b204-30ad932bbc64\") " pod="kserve/model-serving-api-fd65d7d6-94xhk"
Jul 20 10:07:13.860275 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:07:13.860138    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjrf9\" (UniqueName: \"kubernetes.io/projected/588ff7f0-0116-4a77-b204-30ad932bbc64-kube-api-access-fjrf9\") pod \"model-serving-api-fd65d7d6-94xhk\" (UID: \"588ff7f0-0116-4a77-b204-30ad932bbc64\") " pod="kserve/model-serving-api-fd65d7d6-94xhk"
Jul 20 10:07:13.862476 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:07:13.862447    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/588ff7f0-0116-4a77-b204-30ad932bbc64-tls-certs\") pod \"model-serving-api-fd65d7d6-94xhk\" (UID: \"588ff7f0-0116-4a77-b204-30ad932bbc64\") " pod="kserve/model-serving-api-fd65d7d6-94xhk"
Jul 20 10:07:13.868671 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:07:13.868650    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjrf9\" (UniqueName: \"kubernetes.io/projected/588ff7f0-0116-4a77-b204-30ad932bbc64-kube-api-access-fjrf9\") pod \"model-serving-api-fd65d7d6-94xhk\" (UID: \"588ff7f0-0116-4a77-b204-30ad932bbc64\") " pod="kserve/model-serving-api-fd65d7d6-94xhk"
Jul 20 10:07:13.988473 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:07:13.988390    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-94xhk"
Jul 20 10:07:14.117796 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:07:14.117754    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-94xhk"]
Jul 20 10:07:14.121762 ip-10-0-138-143 kubenswrapper[2561]: W0720 10:07:14.121734    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod588ff7f0_0116_4a77_b204_30ad932bbc64.slice/crio-01044a1e8c27cc933883c05c93166aff16d394f69e3104e730d708c7404fb47f WatchSource:0}: Error finding container 01044a1e8c27cc933883c05c93166aff16d394f69e3104e730d708c7404fb47f: Status 404 returned error can't find the container with id 01044a1e8c27cc933883c05c93166aff16d394f69e3104e730d708c7404fb47f
Jul 20 10:07:14.977198 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:07:14.977159    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-94xhk" event={"ID":"588ff7f0-0116-4a77-b204-30ad932bbc64","Type":"ContainerStarted","Data":"01044a1e8c27cc933883c05c93166aff16d394f69e3104e730d708c7404fb47f"}
Jul 20 10:07:16.985191 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:07:16.985150    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-94xhk" event={"ID":"588ff7f0-0116-4a77-b204-30ad932bbc64","Type":"ContainerStarted","Data":"8e57772fa07d29cf39b09d9f1fb4d3f94ae7aeb237ba1a128fd5714c2144d693"}
Jul 20 10:07:16.985570 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:07:16.985234    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-fd65d7d6-94xhk"
Jul 20 10:07:17.025150 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:07:17.025103    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-fd65d7d6-94xhk" podStartSLOduration=1.853050533 podStartE2EDuration="4.025090005s" totalImagesPullingTime="2.172039472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:07:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:07:17.025020516 +0000 UTC m=+610.741935782" watchObservedRunningTime="2026-07-20 10:07:17.025090005 +0000 UTC m=+610.742005273"
Jul 20 10:07:27.993819 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:07:27.993783    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-fd65d7d6-94xhk"
Jul 20 10:10:21.087403 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:10:21.087365    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq"]
Jul 20 10:10:21.090402 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:10:21.090386    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq"
Jul 20 10:10:21.092530 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:10:21.092488    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-ab339-serving-cert\""
Jul 20 10:10:21.092530 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:10:21.092505    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-ab339-kube-rbac-proxy-sar-config\""
Jul 20 10:10:21.092747 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:10:21.092569    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-npdx9\""
Jul 20 10:10:21.093164 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:10:21.093146    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 20 10:10:21.103048 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:10:21.103023    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq"]
Jul 20 10:10:21.122279 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:10:21.122253    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d9427823-77a6-4838-96d5-e14af568d7d7-proxy-tls\") pod \"switch-graph-ab339-7df5ddcb69-75wdq\" (UID: \"d9427823-77a6-4838-96d5-e14af568d7d7\") " pod="kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq"
Jul 20 10:10:21.122389 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:10:21.122328    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9427823-77a6-4838-96d5-e14af568d7d7-openshift-service-ca-bundle\") pod \"switch-graph-ab339-7df5ddcb69-75wdq\" (UID: \"d9427823-77a6-4838-96d5-e14af568d7d7\") " pod="kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq"
Jul 20 10:10:21.223123 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:10:21.223088    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9427823-77a6-4838-96d5-e14af568d7d7-openshift-service-ca-bundle\") pod \"switch-graph-ab339-7df5ddcb69-75wdq\" (UID: \"d9427823-77a6-4838-96d5-e14af568d7d7\") " pod="kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq"
Jul 20 10:10:21.223298 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:10:21.223159    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d9427823-77a6-4838-96d5-e14af568d7d7-proxy-tls\") pod \"switch-graph-ab339-7df5ddcb69-75wdq\" (UID: \"d9427823-77a6-4838-96d5-e14af568d7d7\") " pod="kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq"
Jul 20 10:10:21.223298 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:10:21.223261    2561 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-ab339-serving-cert: secret "switch-graph-ab339-serving-cert" not found
Jul 20 10:10:21.223390 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:10:21.223338    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9427823-77a6-4838-96d5-e14af568d7d7-proxy-tls podName:d9427823-77a6-4838-96d5-e14af568d7d7 nodeName:}" failed. No retries permitted until 2026-07-20 10:10:21.723320474 +0000 UTC m=+795.440235734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/d9427823-77a6-4838-96d5-e14af568d7d7-proxy-tls") pod "switch-graph-ab339-7df5ddcb69-75wdq" (UID: "d9427823-77a6-4838-96d5-e14af568d7d7") : secret "switch-graph-ab339-serving-cert" not found
Jul 20 10:10:21.223775 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:10:21.223752    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9427823-77a6-4838-96d5-e14af568d7d7-openshift-service-ca-bundle\") pod \"switch-graph-ab339-7df5ddcb69-75wdq\" (UID: \"d9427823-77a6-4838-96d5-e14af568d7d7\") " pod="kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq"
Jul 20 10:10:21.727264 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:10:21.727228    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d9427823-77a6-4838-96d5-e14af568d7d7-proxy-tls\") pod \"switch-graph-ab339-7df5ddcb69-75wdq\" (UID: \"d9427823-77a6-4838-96d5-e14af568d7d7\") " pod="kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq"
Jul 20 10:10:21.729621 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:10:21.729596    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d9427823-77a6-4838-96d5-e14af568d7d7-proxy-tls\") pod \"switch-graph-ab339-7df5ddcb69-75wdq\" (UID: \"d9427823-77a6-4838-96d5-e14af568d7d7\") " pod="kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq"
Jul 20 10:10:22.000610 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:10:22.000506    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq"
Jul 20 10:10:22.129798 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:10:22.129770    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq"]
Jul 20 10:10:22.132687 ip-10-0-138-143 kubenswrapper[2561]: W0720 10:10:22.132662    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9427823_77a6_4838_96d5_e14af568d7d7.slice/crio-b26eb3b52eac61e0649632dea0c7f4fd738e60796fe1aa24144818b403404a57 WatchSource:0}: Error finding container b26eb3b52eac61e0649632dea0c7f4fd738e60796fe1aa24144818b403404a57: Status 404 returned error can't find the container with id b26eb3b52eac61e0649632dea0c7f4fd738e60796fe1aa24144818b403404a57
Jul 20 10:10:22.134691 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:10:22.134675    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 10:10:22.657170 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:10:22.657138    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq" event={"ID":"d9427823-77a6-4838-96d5-e14af568d7d7","Type":"ContainerStarted","Data":"b26eb3b52eac61e0649632dea0c7f4fd738e60796fe1aa24144818b403404a57"}
Jul 20 10:10:24.666704 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:10:24.666665    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq" event={"ID":"d9427823-77a6-4838-96d5-e14af568d7d7","Type":"ContainerStarted","Data":"9e1fa0058a71f350f87129fc73e491b0b05e193139c7d613dd1128d968a10bbb"}
Jul 20 10:10:24.667108 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:10:24.666841    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq"
Jul 20 10:10:24.690915 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:10:24.690854    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq" podStartSLOduration=1.5720749010000001 podStartE2EDuration="3.690840163s" totalImagesPullingTime="2.118765262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:10:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:10:24.688029905 +0000 UTC m=+798.404945173" watchObservedRunningTime="2026-07-20 10:10:24.690840163 +0000 UTC m=+798.407755432"
Jul 20 10:10:30.676322 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:10:30.676232    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq"
Jul 20 10:10:31.209061 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:10:31.209028    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq"]
Jul 20 10:10:31.209261 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:10:31.209235    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq" podUID="d9427823-77a6-4838-96d5-e14af568d7d7" containerName="switch-graph-ab339" containerID="cri-o://9e1fa0058a71f350f87129fc73e491b0b05e193139c7d613dd1128d968a10bbb" gracePeriod=30
Jul 20 10:10:35.674653 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:10:35.674602    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq" podUID="d9427823-77a6-4838-96d5-e14af568d7d7" containerName="switch-graph-ab339" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:10:40.674931 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:10:40.674867    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq" podUID="d9427823-77a6-4838-96d5-e14af568d7d7" containerName="switch-graph-ab339" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:10:45.674518 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:10:45.674480    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq" podUID="d9427823-77a6-4838-96d5-e14af568d7d7" containerName="switch-graph-ab339" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:10:45.675009 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:10:45.674576    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq"
Jul 20 10:10:50.674849 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:10:50.674808    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq" podUID="d9427823-77a6-4838-96d5-e14af568d7d7" containerName="switch-graph-ab339" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:10:55.674991 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:10:55.674945    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq" podUID="d9427823-77a6-4838-96d5-e14af568d7d7" containerName="switch-graph-ab339" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:11:00.674082 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:00.674045    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq" podUID="d9427823-77a6-4838-96d5-e14af568d7d7" containerName="switch-graph-ab339" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:11:01.358447 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:01.358424    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq"
Jul 20 10:11:01.435624 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:01.435591    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d9427823-77a6-4838-96d5-e14af568d7d7-proxy-tls\") pod \"d9427823-77a6-4838-96d5-e14af568d7d7\" (UID: \"d9427823-77a6-4838-96d5-e14af568d7d7\") "
Jul 20 10:11:01.435766 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:01.435673    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9427823-77a6-4838-96d5-e14af568d7d7-openshift-service-ca-bundle\") pod \"d9427823-77a6-4838-96d5-e14af568d7d7\" (UID: \"d9427823-77a6-4838-96d5-e14af568d7d7\") "
Jul 20 10:11:01.436043 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:01.436019    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9427823-77a6-4838-96d5-e14af568d7d7-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "d9427823-77a6-4838-96d5-e14af568d7d7" (UID: "d9427823-77a6-4838-96d5-e14af568d7d7"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 10:11:01.437792 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:01.437767    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9427823-77a6-4838-96d5-e14af568d7d7-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "d9427823-77a6-4838-96d5-e14af568d7d7" (UID: "d9427823-77a6-4838-96d5-e14af568d7d7"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:11:01.536682 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:01.536655    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9427823-77a6-4838-96d5-e14af568d7d7-openshift-service-ca-bundle\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:11:01.536682 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:01.536681    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d9427823-77a6-4838-96d5-e14af568d7d7-proxy-tls\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:11:01.800986 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:01.800905    2561 generic.go:356] "Generic (PLEG): container finished" podID="d9427823-77a6-4838-96d5-e14af568d7d7" containerID="9e1fa0058a71f350f87129fc73e491b0b05e193139c7d613dd1128d968a10bbb" exitCode=0
Jul 20 10:11:01.800986 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:01.800945    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq"
Jul 20 10:11:01.801469 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:01.800946    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq" event={"ID":"d9427823-77a6-4838-96d5-e14af568d7d7","Type":"ContainerDied","Data":"9e1fa0058a71f350f87129fc73e491b0b05e193139c7d613dd1128d968a10bbb"}
Jul 20 10:11:01.801469 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:01.801075    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq" event={"ID":"d9427823-77a6-4838-96d5-e14af568d7d7","Type":"ContainerDied","Data":"b26eb3b52eac61e0649632dea0c7f4fd738e60796fe1aa24144818b403404a57"}
Jul 20 10:11:01.801469 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:01.801107    2561 scope.go:117] "RemoveContainer" containerID="9e1fa0058a71f350f87129fc73e491b0b05e193139c7d613dd1128d968a10bbb"
Jul 20 10:11:01.809415 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:01.809398    2561 scope.go:117] "RemoveContainer" containerID="9e1fa0058a71f350f87129fc73e491b0b05e193139c7d613dd1128d968a10bbb"
Jul 20 10:11:01.809648 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:11:01.809630    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e1fa0058a71f350f87129fc73e491b0b05e193139c7d613dd1128d968a10bbb\": container with ID starting with 9e1fa0058a71f350f87129fc73e491b0b05e193139c7d613dd1128d968a10bbb not found: ID does not exist" containerID="9e1fa0058a71f350f87129fc73e491b0b05e193139c7d613dd1128d968a10bbb"
Jul 20 10:11:01.809709 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:01.809656    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e1fa0058a71f350f87129fc73e491b0b05e193139c7d613dd1128d968a10bbb"} err="failed to get container status \"9e1fa0058a71f350f87129fc73e491b0b05e193139c7d613dd1128d968a10bbb\": rpc error: code = NotFound desc = could not find container \"9e1fa0058a71f350f87129fc73e491b0b05e193139c7d613dd1128d968a10bbb\": container with ID starting with 9e1fa0058a71f350f87129fc73e491b0b05e193139c7d613dd1128d968a10bbb not found: ID does not exist"
Jul 20 10:11:01.821314 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:01.821283    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq"]
Jul 20 10:11:01.823758 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:01.823735    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-ab339-7df5ddcb69-75wdq"]
Jul 20 10:11:02.743950 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:02.743922    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9427823-77a6-4838-96d5-e14af568d7d7" path="/var/lib/kubelet/pods/d9427823-77a6-4838-96d5-e14af568d7d7/volumes"
Jul 20 10:11:11.095734 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:11.095697    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c"]
Jul 20 10:11:11.096107 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:11.096016    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9427823-77a6-4838-96d5-e14af568d7d7" containerName="switch-graph-ab339"
Jul 20 10:11:11.096107 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:11.096028    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9427823-77a6-4838-96d5-e14af568d7d7" containerName="switch-graph-ab339"
Jul 20 10:11:11.096107 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:11.096078    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9427823-77a6-4838-96d5-e14af568d7d7" containerName="switch-graph-ab339"
Jul 20 10:11:11.100039 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:11.100016    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c"
Jul 20 10:11:11.102390 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:11.102363    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-serving-cert\""
Jul 20 10:11:11.102523 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:11.102407    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-kube-rbac-proxy-sar-config\""
Jul 20 10:11:11.102523 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:11.102419    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 20 10:11:11.102523 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:11.102420    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-npdx9\""
Jul 20 10:11:11.110676 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:11.110652    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c"]
Jul 20 10:11:11.215730 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:11.215692    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b306f8d8-3900-4432-bbab-b8be3191e22d-openshift-service-ca-bundle\") pod \"model-chainer-8df46b748-9ll4c\" (UID: \"b306f8d8-3900-4432-bbab-b8be3191e22d\") " pod="kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c"
Jul 20 10:11:11.215730 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:11.215735    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b306f8d8-3900-4432-bbab-b8be3191e22d-proxy-tls\") pod \"model-chainer-8df46b748-9ll4c\" (UID: \"b306f8d8-3900-4432-bbab-b8be3191e22d\") " pod="kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c"
Jul 20 10:11:11.316578 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:11.316485    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b306f8d8-3900-4432-bbab-b8be3191e22d-proxy-tls\") pod \"model-chainer-8df46b748-9ll4c\" (UID: \"b306f8d8-3900-4432-bbab-b8be3191e22d\") " pod="kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c"
Jul 20 10:11:11.316739 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:11.316586    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b306f8d8-3900-4432-bbab-b8be3191e22d-openshift-service-ca-bundle\") pod \"model-chainer-8df46b748-9ll4c\" (UID: \"b306f8d8-3900-4432-bbab-b8be3191e22d\") " pod="kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c"
Jul 20 10:11:11.316739 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:11:11.316637    2561 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-serving-cert: secret "model-chainer-serving-cert" not found
Jul 20 10:11:11.316739 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:11:11.316721    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b306f8d8-3900-4432-bbab-b8be3191e22d-proxy-tls podName:b306f8d8-3900-4432-bbab-b8be3191e22d nodeName:}" failed. No retries permitted until 2026-07-20 10:11:11.816703916 +0000 UTC m=+845.533619163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/b306f8d8-3900-4432-bbab-b8be3191e22d-proxy-tls") pod "model-chainer-8df46b748-9ll4c" (UID: "b306f8d8-3900-4432-bbab-b8be3191e22d") : secret "model-chainer-serving-cert" not found
Jul 20 10:11:11.317196 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:11.317179    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b306f8d8-3900-4432-bbab-b8be3191e22d-openshift-service-ca-bundle\") pod \"model-chainer-8df46b748-9ll4c\" (UID: \"b306f8d8-3900-4432-bbab-b8be3191e22d\") " pod="kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c"
Jul 20 10:11:11.820522 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:11.820487    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b306f8d8-3900-4432-bbab-b8be3191e22d-proxy-tls\") pod \"model-chainer-8df46b748-9ll4c\" (UID: \"b306f8d8-3900-4432-bbab-b8be3191e22d\") " pod="kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c"
Jul 20 10:11:11.820733 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:11:11.820649    2561 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-serving-cert: secret "model-chainer-serving-cert" not found
Jul 20 10:11:11.820733 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:11:11.820715    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b306f8d8-3900-4432-bbab-b8be3191e22d-proxy-tls podName:b306f8d8-3900-4432-bbab-b8be3191e22d nodeName:}" failed. No retries permitted until 2026-07-20 10:11:12.820698776 +0000 UTC m=+846.537614023 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/b306f8d8-3900-4432-bbab-b8be3191e22d-proxy-tls") pod "model-chainer-8df46b748-9ll4c" (UID: "b306f8d8-3900-4432-bbab-b8be3191e22d") : secret "model-chainer-serving-cert" not found
Jul 20 10:11:12.828974 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:12.828923    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b306f8d8-3900-4432-bbab-b8be3191e22d-proxy-tls\") pod \"model-chainer-8df46b748-9ll4c\" (UID: \"b306f8d8-3900-4432-bbab-b8be3191e22d\") " pod="kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c"
Jul 20 10:11:12.831381 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:12.831357    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b306f8d8-3900-4432-bbab-b8be3191e22d-proxy-tls\") pod \"model-chainer-8df46b748-9ll4c\" (UID: \"b306f8d8-3900-4432-bbab-b8be3191e22d\") " pod="kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c"
Jul 20 10:11:12.911113 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:12.911083    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c"
Jul 20 10:11:13.044236 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:13.044212    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c"]
Jul 20 10:11:13.046102 ip-10-0-138-143 kubenswrapper[2561]: W0720 10:11:13.046072    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb306f8d8_3900_4432_bbab_b8be3191e22d.slice/crio-12687fb50d7ef33d5581e0da65ffd8cba2dfdc7498a978d2863da75235bff66f WatchSource:0}: Error finding container 12687fb50d7ef33d5581e0da65ffd8cba2dfdc7498a978d2863da75235bff66f: Status 404 returned error can't find the container with id 12687fb50d7ef33d5581e0da65ffd8cba2dfdc7498a978d2863da75235bff66f
Jul 20 10:11:13.850657 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:13.850617    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c" event={"ID":"b306f8d8-3900-4432-bbab-b8be3191e22d","Type":"ContainerStarted","Data":"1a78e5fbd99c7f59b5047a1d42d0ca6b936731d11fd196491e888f73ff61ac3b"}
Jul 20 10:11:13.851052 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:13.850678    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c" event={"ID":"b306f8d8-3900-4432-bbab-b8be3191e22d","Type":"ContainerStarted","Data":"12687fb50d7ef33d5581e0da65ffd8cba2dfdc7498a978d2863da75235bff66f"}
Jul 20 10:11:13.851052 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:13.850711    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c"
Jul 20 10:11:13.870309 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:13.870262    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c" podStartSLOduration=2.8702472869999998 podStartE2EDuration="2.870247287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:11:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:11:13.869219662 +0000 UTC m=+847.586134962" watchObservedRunningTime="2026-07-20 10:11:13.870247287 +0000 UTC m=+847.587162552"
Jul 20 10:11:19.860085 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:19.860054    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c"
Jul 20 10:11:21.179701 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:21.179666    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c"]
Jul 20 10:11:21.180104 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:21.179899    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c" podUID="b306f8d8-3900-4432-bbab-b8be3191e22d" containerName="model-chainer" containerID="cri-o://1a78e5fbd99c7f59b5047a1d42d0ca6b936731d11fd196491e888f73ff61ac3b" gracePeriod=30
Jul 20 10:11:24.858145 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:24.858108    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c" podUID="b306f8d8-3900-4432-bbab-b8be3191e22d" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:11:29.858323 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:29.858283    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c" podUID="b306f8d8-3900-4432-bbab-b8be3191e22d" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:11:31.525517 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:31.525488    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m"]
Jul 20 10:11:31.528931 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:31.528909    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m"
Jul 20 10:11:31.530768 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:31.530746    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-7f819-serving-cert\""
Jul 20 10:11:31.530912 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:31.530873    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-7f819-kube-rbac-proxy-sar-config\""
Jul 20 10:11:31.537508 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:31.537488    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m"]
Jul 20 10:11:31.565418 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:31.565392    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a7862ab-fc4c-460a-bbaf-e81634db9df3-openshift-service-ca-bundle\") pod \"switch-graph-7f819-56ff4d7f75-tqt8m\" (UID: \"5a7862ab-fc4c-460a-bbaf-e81634db9df3\") " pod="kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m"
Jul 20 10:11:31.565534 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:31.565432    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5a7862ab-fc4c-460a-bbaf-e81634db9df3-proxy-tls\") pod \"switch-graph-7f819-56ff4d7f75-tqt8m\" (UID: \"5a7862ab-fc4c-460a-bbaf-e81634db9df3\") " pod="kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m"
Jul 20 10:11:31.666204 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:31.666169    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5a7862ab-fc4c-460a-bbaf-e81634db9df3-proxy-tls\") pod \"switch-graph-7f819-56ff4d7f75-tqt8m\" (UID: \"5a7862ab-fc4c-460a-bbaf-e81634db9df3\") " pod="kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m"
Jul 20 10:11:31.666358 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:31.666262    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a7862ab-fc4c-460a-bbaf-e81634db9df3-openshift-service-ca-bundle\") pod \"switch-graph-7f819-56ff4d7f75-tqt8m\" (UID: \"5a7862ab-fc4c-460a-bbaf-e81634db9df3\") " pod="kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m"
Jul 20 10:11:31.666358 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:11:31.666317    2561 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-7f819-serving-cert: secret "switch-graph-7f819-serving-cert" not found
Jul 20 10:11:31.666428 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:11:31.666404    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a7862ab-fc4c-460a-bbaf-e81634db9df3-proxy-tls podName:5a7862ab-fc4c-460a-bbaf-e81634db9df3 nodeName:}" failed. No retries permitted until 2026-07-20 10:11:32.166387298 +0000 UTC m=+865.883302544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/5a7862ab-fc4c-460a-bbaf-e81634db9df3-proxy-tls") pod "switch-graph-7f819-56ff4d7f75-tqt8m" (UID: "5a7862ab-fc4c-460a-bbaf-e81634db9df3") : secret "switch-graph-7f819-serving-cert" not found
Jul 20 10:11:31.666846 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:31.666829    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a7862ab-fc4c-460a-bbaf-e81634db9df3-openshift-service-ca-bundle\") pod \"switch-graph-7f819-56ff4d7f75-tqt8m\" (UID: \"5a7862ab-fc4c-460a-bbaf-e81634db9df3\") " pod="kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m"
Jul 20 10:11:32.168917 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:32.168860    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5a7862ab-fc4c-460a-bbaf-e81634db9df3-proxy-tls\") pod \"switch-graph-7f819-56ff4d7f75-tqt8m\" (UID: \"5a7862ab-fc4c-460a-bbaf-e81634db9df3\") " pod="kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m"
Jul 20 10:11:32.171253 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:32.171227    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5a7862ab-fc4c-460a-bbaf-e81634db9df3-proxy-tls\") pod \"switch-graph-7f819-56ff4d7f75-tqt8m\" (UID: \"5a7862ab-fc4c-460a-bbaf-e81634db9df3\") " pod="kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m"
Jul 20 10:11:32.442075 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:32.441988    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m"
Jul 20 10:11:32.574269 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:32.572490    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m"]
Jul 20 10:11:32.922225 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:32.922188    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m" event={"ID":"5a7862ab-fc4c-460a-bbaf-e81634db9df3","Type":"ContainerStarted","Data":"9e5905a07e274df1355bcf9f2f3dff386bce23add2e628466b83ab5fb6d7e81f"}
Jul 20 10:11:32.922416 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:32.922244    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m" event={"ID":"5a7862ab-fc4c-460a-bbaf-e81634db9df3","Type":"ContainerStarted","Data":"5af1164015524117b7ec5ea87533a4f93bff07eab880e11294704e8ac8961d87"}
Jul 20 10:11:32.922416 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:32.922320    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m"
Jul 20 10:11:32.952146 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:32.952100    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m" podStartSLOduration=1.952084105 podStartE2EDuration="1.952084105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:11:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:11:32.951830475 +0000 UTC m=+866.668745757" watchObservedRunningTime="2026-07-20 10:11:32.952084105 +0000 UTC m=+866.668999393"
Jul 20 10:11:34.858140 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:34.858105    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c" podUID="b306f8d8-3900-4432-bbab-b8be3191e22d" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:11:34.858514 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:34.858199    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c"
Jul 20 10:11:38.932536 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:38.932510    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m"
Jul 20 10:11:39.859070 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:39.859032    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c" podUID="b306f8d8-3900-4432-bbab-b8be3191e22d" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:11:44.859246 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:44.859205    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c" podUID="b306f8d8-3900-4432-bbab-b8be3191e22d" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:11:49.858719 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:49.858679    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c" podUID="b306f8d8-3900-4432-bbab-b8be3191e22d" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:11:51.332368 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:51.332337    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c"
Jul 20 10:11:51.410383 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:51.410348    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b306f8d8-3900-4432-bbab-b8be3191e22d-openshift-service-ca-bundle\") pod \"b306f8d8-3900-4432-bbab-b8be3191e22d\" (UID: \"b306f8d8-3900-4432-bbab-b8be3191e22d\") "
Jul 20 10:11:51.410574 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:51.410398    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b306f8d8-3900-4432-bbab-b8be3191e22d-proxy-tls\") pod \"b306f8d8-3900-4432-bbab-b8be3191e22d\" (UID: \"b306f8d8-3900-4432-bbab-b8be3191e22d\") "
Jul 20 10:11:51.410711 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:51.410685    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b306f8d8-3900-4432-bbab-b8be3191e22d-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "b306f8d8-3900-4432-bbab-b8be3191e22d" (UID: "b306f8d8-3900-4432-bbab-b8be3191e22d"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 10:11:51.412489 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:51.412466    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b306f8d8-3900-4432-bbab-b8be3191e22d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "b306f8d8-3900-4432-bbab-b8be3191e22d" (UID: "b306f8d8-3900-4432-bbab-b8be3191e22d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:11:51.511112 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:51.511024    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b306f8d8-3900-4432-bbab-b8be3191e22d-openshift-service-ca-bundle\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:11:51.511112 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:51.511055    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b306f8d8-3900-4432-bbab-b8be3191e22d-proxy-tls\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:11:51.999407 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:51.999371    2561 generic.go:356] "Generic (PLEG): container finished" podID="b306f8d8-3900-4432-bbab-b8be3191e22d" containerID="1a78e5fbd99c7f59b5047a1d42d0ca6b936731d11fd196491e888f73ff61ac3b" exitCode=0
Jul 20 10:11:51.999581 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:51.999423    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c"
Jul 20 10:11:51.999581 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:51.999448    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c" event={"ID":"b306f8d8-3900-4432-bbab-b8be3191e22d","Type":"ContainerDied","Data":"1a78e5fbd99c7f59b5047a1d42d0ca6b936731d11fd196491e888f73ff61ac3b"}
Jul 20 10:11:51.999581 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:51.999518    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c" event={"ID":"b306f8d8-3900-4432-bbab-b8be3191e22d","Type":"ContainerDied","Data":"12687fb50d7ef33d5581e0da65ffd8cba2dfdc7498a978d2863da75235bff66f"}
Jul 20 10:11:51.999581 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:51.999541    2561 scope.go:117] "RemoveContainer" containerID="1a78e5fbd99c7f59b5047a1d42d0ca6b936731d11fd196491e888f73ff61ac3b"
Jul 20 10:11:52.008193 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:52.008168    2561 scope.go:117] "RemoveContainer" containerID="1a78e5fbd99c7f59b5047a1d42d0ca6b936731d11fd196491e888f73ff61ac3b"
Jul 20 10:11:52.008499 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:11:52.008476    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a78e5fbd99c7f59b5047a1d42d0ca6b936731d11fd196491e888f73ff61ac3b\": container with ID starting with 1a78e5fbd99c7f59b5047a1d42d0ca6b936731d11fd196491e888f73ff61ac3b not found: ID does not exist" containerID="1a78e5fbd99c7f59b5047a1d42d0ca6b936731d11fd196491e888f73ff61ac3b"
Jul 20 10:11:52.008557 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:52.008510    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a78e5fbd99c7f59b5047a1d42d0ca6b936731d11fd196491e888f73ff61ac3b"} err="failed to get container status \"1a78e5fbd99c7f59b5047a1d42d0ca6b936731d11fd196491e888f73ff61ac3b\": rpc error: code = NotFound desc = could not find container \"1a78e5fbd99c7f59b5047a1d42d0ca6b936731d11fd196491e888f73ff61ac3b\": container with ID starting with 1a78e5fbd99c7f59b5047a1d42d0ca6b936731d11fd196491e888f73ff61ac3b not found: ID does not exist"
Jul 20 10:11:52.020744 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:52.020711    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c"]
Jul 20 10:11:52.026233 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:52.026206    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-8df46b748-9ll4c"]
Jul 20 10:11:52.743175 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:11:52.743141    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b306f8d8-3900-4432-bbab-b8be3191e22d" path="/var/lib/kubelet/pods/b306f8d8-3900-4432-bbab-b8be3191e22d/volumes"
Jul 20 10:12:21.423896 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:12:21.423856    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9"]
Jul 20 10:12:21.424330 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:12:21.424188    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b306f8d8-3900-4432-bbab-b8be3191e22d" containerName="model-chainer"
Jul 20 10:12:21.424330 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:12:21.424200    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b306f8d8-3900-4432-bbab-b8be3191e22d" containerName="model-chainer"
Jul 20 10:12:21.424330 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:12:21.424244    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b306f8d8-3900-4432-bbab-b8be3191e22d" containerName="model-chainer"
Jul 20 10:12:21.428382 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:12:21.428364    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9"
Jul 20 10:12:21.430364 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:12:21.430344    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-78f99-serving-cert\""
Jul 20 10:12:21.430447 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:12:21.430400    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-78f99-kube-rbac-proxy-sar-config\""
Jul 20 10:12:21.435873 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:12:21.435804    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9"]
Jul 20 10:12:21.544231 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:12:21.544194    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b852594b-cab0-48ff-98d1-48993d9ff6a5-proxy-tls\") pod \"sequence-graph-78f99-5f589d8f54-4zpv9\" (UID: \"b852594b-cab0-48ff-98d1-48993d9ff6a5\") " pod="kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9"
Jul 20 10:12:21.544231 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:12:21.544242    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b852594b-cab0-48ff-98d1-48993d9ff6a5-openshift-service-ca-bundle\") pod \"sequence-graph-78f99-5f589d8f54-4zpv9\" (UID: \"b852594b-cab0-48ff-98d1-48993d9ff6a5\") " pod="kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9"
Jul 20 10:12:21.645321 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:12:21.645286    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b852594b-cab0-48ff-98d1-48993d9ff6a5-proxy-tls\") pod \"sequence-graph-78f99-5f589d8f54-4zpv9\" (UID: \"b852594b-cab0-48ff-98d1-48993d9ff6a5\") " pod="kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9"
Jul 20 10:12:21.645321 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:12:21.645331    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b852594b-cab0-48ff-98d1-48993d9ff6a5-openshift-service-ca-bundle\") pod \"sequence-graph-78f99-5f589d8f54-4zpv9\" (UID: \"b852594b-cab0-48ff-98d1-48993d9ff6a5\") " pod="kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9"
Jul 20 10:12:21.645958 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:12:21.645938    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b852594b-cab0-48ff-98d1-48993d9ff6a5-openshift-service-ca-bundle\") pod \"sequence-graph-78f99-5f589d8f54-4zpv9\" (UID: \"b852594b-cab0-48ff-98d1-48993d9ff6a5\") " pod="kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9"
Jul 20 10:12:21.647760 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:12:21.647737    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b852594b-cab0-48ff-98d1-48993d9ff6a5-proxy-tls\") pod \"sequence-graph-78f99-5f589d8f54-4zpv9\" (UID: \"b852594b-cab0-48ff-98d1-48993d9ff6a5\") " pod="kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9"
Jul 20 10:12:21.739868 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:12:21.739772    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9"
Jul 20 10:12:21.871562 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:12:21.871527    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9"]
Jul 20 10:12:21.874751 ip-10-0-138-143 kubenswrapper[2561]: W0720 10:12:21.874714    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb852594b_cab0_48ff_98d1_48993d9ff6a5.slice/crio-e6bd2dadd6c7c68bd2a34a1a706a73840a12e253d8e4b5ed2a548702984d3f59 WatchSource:0}: Error finding container e6bd2dadd6c7c68bd2a34a1a706a73840a12e253d8e4b5ed2a548702984d3f59: Status 404 returned error can't find the container with id e6bd2dadd6c7c68bd2a34a1a706a73840a12e253d8e4b5ed2a548702984d3f59
Jul 20 10:12:22.111509 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:12:22.111477    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9" event={"ID":"b852594b-cab0-48ff-98d1-48993d9ff6a5","Type":"ContainerStarted","Data":"9fa75b39ab976623fb77f4fd8b626535a03e7a6cef6be1aa1637fc51caccafa1"}
Jul 20 10:12:22.111679 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:12:22.111530    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9" event={"ID":"b852594b-cab0-48ff-98d1-48993d9ff6a5","Type":"ContainerStarted","Data":"e6bd2dadd6c7c68bd2a34a1a706a73840a12e253d8e4b5ed2a548702984d3f59"}
Jul 20 10:12:22.111679 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:12:22.111598    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9"
Jul 20 10:12:22.129422 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:12:22.129368    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9" podStartSLOduration=1.129348844 podStartE2EDuration="1.129348844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:12:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:12:22.128636176 +0000 UTC m=+915.845551444" watchObservedRunningTime="2026-07-20 10:12:22.129348844 +0000 UTC m=+915.846264114"
Jul 20 10:12:28.121629 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:12:28.121598    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9"
Jul 20 10:19:46.293964 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:19:46.293872    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m"]
Jul 20 10:19:46.296358 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:19:46.294095    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m" podUID="5a7862ab-fc4c-460a-bbaf-e81634db9df3" containerName="switch-graph-7f819" containerID="cri-o://9e5905a07e274df1355bcf9f2f3dff386bce23add2e628466b83ab5fb6d7e81f" gracePeriod=30
Jul 20 10:19:48.929536 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:19:48.929500    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m" podUID="5a7862ab-fc4c-460a-bbaf-e81634db9df3" containerName="switch-graph-7f819" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:19:53.930024 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:19:53.929987    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m" podUID="5a7862ab-fc4c-460a-bbaf-e81634db9df3" containerName="switch-graph-7f819" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:19:58.930258 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:19:58.930216    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m" podUID="5a7862ab-fc4c-460a-bbaf-e81634db9df3" containerName="switch-graph-7f819" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:19:58.930652 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:19:58.930333    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m"
Jul 20 10:20:03.930067 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:03.930025    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m" podUID="5a7862ab-fc4c-460a-bbaf-e81634db9df3" containerName="switch-graph-7f819" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:20:08.929786 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:08.929746    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m" podUID="5a7862ab-fc4c-460a-bbaf-e81634db9df3" containerName="switch-graph-7f819" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:20:13.930187 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:13.930139    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m" podUID="5a7862ab-fc4c-460a-bbaf-e81634db9df3" containerName="switch-graph-7f819" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:20:16.430725 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:16.430699    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m"
Jul 20 10:20:16.494849 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:16.494815    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5a7862ab-fc4c-460a-bbaf-e81634db9df3-proxy-tls\") pod \"5a7862ab-fc4c-460a-bbaf-e81634db9df3\" (UID: \"5a7862ab-fc4c-460a-bbaf-e81634db9df3\") "
Jul 20 10:20:16.495044 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:16.494924    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a7862ab-fc4c-460a-bbaf-e81634db9df3-openshift-service-ca-bundle\") pod \"5a7862ab-fc4c-460a-bbaf-e81634db9df3\" (UID: \"5a7862ab-fc4c-460a-bbaf-e81634db9df3\") "
Jul 20 10:20:16.495296 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:16.495272    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a7862ab-fc4c-460a-bbaf-e81634db9df3-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "5a7862ab-fc4c-460a-bbaf-e81634db9df3" (UID: "5a7862ab-fc4c-460a-bbaf-e81634db9df3"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 10:20:16.496886 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:16.496856    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a7862ab-fc4c-460a-bbaf-e81634db9df3-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "5a7862ab-fc4c-460a-bbaf-e81634db9df3" (UID: "5a7862ab-fc4c-460a-bbaf-e81634db9df3"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:20:16.595766 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:16.595686    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a7862ab-fc4c-460a-bbaf-e81634db9df3-openshift-service-ca-bundle\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:20:16.595766 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:16.595723    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5a7862ab-fc4c-460a-bbaf-e81634db9df3-proxy-tls\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:20:16.892183 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:16.892085    2561 generic.go:356] "Generic (PLEG): container finished" podID="5a7862ab-fc4c-460a-bbaf-e81634db9df3" containerID="9e5905a07e274df1355bcf9f2f3dff386bce23add2e628466b83ab5fb6d7e81f" exitCode=0
Jul 20 10:20:16.892183 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:16.892129    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m"
Jul 20 10:20:16.892183 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:16.892166    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m" event={"ID":"5a7862ab-fc4c-460a-bbaf-e81634db9df3","Type":"ContainerDied","Data":"9e5905a07e274df1355bcf9f2f3dff386bce23add2e628466b83ab5fb6d7e81f"}
Jul 20 10:20:16.892447 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:16.892215    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m" event={"ID":"5a7862ab-fc4c-460a-bbaf-e81634db9df3","Type":"ContainerDied","Data":"5af1164015524117b7ec5ea87533a4f93bff07eab880e11294704e8ac8961d87"}
Jul 20 10:20:16.892447 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:16.892238    2561 scope.go:117] "RemoveContainer" containerID="9e5905a07e274df1355bcf9f2f3dff386bce23add2e628466b83ab5fb6d7e81f"
Jul 20 10:20:16.900015 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:16.899984    2561 scope.go:117] "RemoveContainer" containerID="9e5905a07e274df1355bcf9f2f3dff386bce23add2e628466b83ab5fb6d7e81f"
Jul 20 10:20:16.900289 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:20:16.900269    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e5905a07e274df1355bcf9f2f3dff386bce23add2e628466b83ab5fb6d7e81f\": container with ID starting with 9e5905a07e274df1355bcf9f2f3dff386bce23add2e628466b83ab5fb6d7e81f not found: ID does not exist" containerID="9e5905a07e274df1355bcf9f2f3dff386bce23add2e628466b83ab5fb6d7e81f"
Jul 20 10:20:16.900354 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:16.900296    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e5905a07e274df1355bcf9f2f3dff386bce23add2e628466b83ab5fb6d7e81f"} err="failed to get container status \"9e5905a07e274df1355bcf9f2f3dff386bce23add2e628466b83ab5fb6d7e81f\": rpc error: code = NotFound desc = could not find container \"9e5905a07e274df1355bcf9f2f3dff386bce23add2e628466b83ab5fb6d7e81f\": container with ID starting with 9e5905a07e274df1355bcf9f2f3dff386bce23add2e628466b83ab5fb6d7e81f not found: ID does not exist"
Jul 20 10:20:16.911917 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:16.910940    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m"]
Jul 20 10:20:16.916554 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:16.916524    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-7f819-56ff4d7f75-tqt8m"]
Jul 20 10:20:18.743070 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:18.743035    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a7862ab-fc4c-460a-bbaf-e81634db9df3" path="/var/lib/kubelet/pods/5a7862ab-fc4c-460a-bbaf-e81634db9df3/volumes"
Jul 20 10:20:36.039499 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:36.039466    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9"]
Jul 20 10:20:36.039916 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:36.039677    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9" podUID="b852594b-cab0-48ff-98d1-48993d9ff6a5" containerName="sequence-graph-78f99" containerID="cri-o://9fa75b39ab976623fb77f4fd8b626535a03e7a6cef6be1aa1637fc51caccafa1" gracePeriod=30
Jul 20 10:20:38.120549 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:38.120509    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9" podUID="b852594b-cab0-48ff-98d1-48993d9ff6a5" containerName="sequence-graph-78f99" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:20:43.120139 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:43.120094    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9" podUID="b852594b-cab0-48ff-98d1-48993d9ff6a5" containerName="sequence-graph-78f99" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:20:46.546403 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:46.546370    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx"]
Jul 20 10:20:46.546892 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:46.546822    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a7862ab-fc4c-460a-bbaf-e81634db9df3" containerName="switch-graph-7f819"
Jul 20 10:20:46.546892 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:46.546840    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a7862ab-fc4c-460a-bbaf-e81634db9df3" containerName="switch-graph-7f819"
Jul 20 10:20:46.547023 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:46.546932    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a7862ab-fc4c-460a-bbaf-e81634db9df3" containerName="switch-graph-7f819"
Jul 20 10:20:46.549861 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:46.549842    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx"
Jul 20 10:20:46.551907 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:46.551869    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-242a5-kube-rbac-proxy-sar-config\""
Jul 20 10:20:46.552287 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:46.552273    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-242a5-serving-cert\""
Jul 20 10:20:46.563752 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:46.563727    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx"]
Jul 20 10:20:46.740302 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:46.740268    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fccc48c2-8b8c-4513-8748-4a3d803325cf-openshift-service-ca-bundle\") pod \"ensemble-graph-242a5-75b5874dcc-scmgx\" (UID: \"fccc48c2-8b8c-4513-8748-4a3d803325cf\") " pod="kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx"
Jul 20 10:20:46.740476 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:46.740414    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fccc48c2-8b8c-4513-8748-4a3d803325cf-proxy-tls\") pod \"ensemble-graph-242a5-75b5874dcc-scmgx\" (UID: \"fccc48c2-8b8c-4513-8748-4a3d803325cf\") " pod="kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx"
Jul 20 10:20:46.841084 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:46.841000    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fccc48c2-8b8c-4513-8748-4a3d803325cf-openshift-service-ca-bundle\") pod \"ensemble-graph-242a5-75b5874dcc-scmgx\" (UID: \"fccc48c2-8b8c-4513-8748-4a3d803325cf\") " pod="kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx"
Jul 20 10:20:46.841084 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:46.841072    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fccc48c2-8b8c-4513-8748-4a3d803325cf-proxy-tls\") pod \"ensemble-graph-242a5-75b5874dcc-scmgx\" (UID: \"fccc48c2-8b8c-4513-8748-4a3d803325cf\") " pod="kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx"
Jul 20 10:20:46.841310 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:20:46.841155    2561 secret.go:189] Couldn't get secret kserve-ci-e2e-test/ensemble-graph-242a5-serving-cert: secret "ensemble-graph-242a5-serving-cert" not found
Jul 20 10:20:46.841310 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:20:46.841216    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fccc48c2-8b8c-4513-8748-4a3d803325cf-proxy-tls podName:fccc48c2-8b8c-4513-8748-4a3d803325cf nodeName:}" failed. No retries permitted until 2026-07-20 10:20:47.34120128 +0000 UTC m=+1421.058116527 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/fccc48c2-8b8c-4513-8748-4a3d803325cf-proxy-tls") pod "ensemble-graph-242a5-75b5874dcc-scmgx" (UID: "fccc48c2-8b8c-4513-8748-4a3d803325cf") : secret "ensemble-graph-242a5-serving-cert" not found
Jul 20 10:20:46.841701 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:46.841676    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fccc48c2-8b8c-4513-8748-4a3d803325cf-openshift-service-ca-bundle\") pod \"ensemble-graph-242a5-75b5874dcc-scmgx\" (UID: \"fccc48c2-8b8c-4513-8748-4a3d803325cf\") " pod="kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx"
Jul 20 10:20:47.346075 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:47.346039    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fccc48c2-8b8c-4513-8748-4a3d803325cf-proxy-tls\") pod \"ensemble-graph-242a5-75b5874dcc-scmgx\" (UID: \"fccc48c2-8b8c-4513-8748-4a3d803325cf\") " pod="kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx"
Jul 20 10:20:47.348461 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:47.348440    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fccc48c2-8b8c-4513-8748-4a3d803325cf-proxy-tls\") pod \"ensemble-graph-242a5-75b5874dcc-scmgx\" (UID: \"fccc48c2-8b8c-4513-8748-4a3d803325cf\") " pod="kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx"
Jul 20 10:20:47.459537 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:47.459502    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx"
Jul 20 10:20:47.584816 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:47.584791    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx"]
Jul 20 10:20:47.587630 ip-10-0-138-143 kubenswrapper[2561]: W0720 10:20:47.587603    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfccc48c2_8b8c_4513_8748_4a3d803325cf.slice/crio-f6a713d3f1588f203bc8181308a870cf809c0c78422602a15b18517da49cb002 WatchSource:0}: Error finding container f6a713d3f1588f203bc8181308a870cf809c0c78422602a15b18517da49cb002: Status 404 returned error can't find the container with id f6a713d3f1588f203bc8181308a870cf809c0c78422602a15b18517da49cb002
Jul 20 10:20:48.010716 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:48.010624    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx" event={"ID":"fccc48c2-8b8c-4513-8748-4a3d803325cf","Type":"ContainerStarted","Data":"0537b7a7f7a2e7e55c476bcf6284888ca6d171798b7d3d2024e66b809873fbc2"}
Jul 20 10:20:48.010716 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:48.010675    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx" event={"ID":"fccc48c2-8b8c-4513-8748-4a3d803325cf","Type":"ContainerStarted","Data":"f6a713d3f1588f203bc8181308a870cf809c0c78422602a15b18517da49cb002"}
Jul 20 10:20:48.010716 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:48.010703    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx"
Jul 20 10:20:48.027854 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:48.027813    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx" podStartSLOduration=2.027799517 podStartE2EDuration="2.027799517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:20:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:20:48.026222345 +0000 UTC m=+1421.743137608" watchObservedRunningTime="2026-07-20 10:20:48.027799517 +0000 UTC m=+1421.744714786"
Jul 20 10:20:48.119754 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:48.119721    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9" podUID="b852594b-cab0-48ff-98d1-48993d9ff6a5" containerName="sequence-graph-78f99" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:20:48.119932 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:48.119824    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9"
Jul 20 10:20:53.120107 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:53.120060    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9" podUID="b852594b-cab0-48ff-98d1-48993d9ff6a5" containerName="sequence-graph-78f99" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:20:54.019458 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:54.019429    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx"
Jul 20 10:20:56.618659 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:56.618627    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx"]
Jul 20 10:20:56.619039 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:56.618836    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx" podUID="fccc48c2-8b8c-4513-8748-4a3d803325cf" containerName="ensemble-graph-242a5" containerID="cri-o://0537b7a7f7a2e7e55c476bcf6284888ca6d171798b7d3d2024e66b809873fbc2" gracePeriod=30
Jul 20 10:20:58.119834 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:58.119799    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9" podUID="b852594b-cab0-48ff-98d1-48993d9ff6a5" containerName="sequence-graph-78f99" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:20:59.018173 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:20:59.018136    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx" podUID="fccc48c2-8b8c-4513-8748-4a3d803325cf" containerName="ensemble-graph-242a5" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:21:03.119903 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:03.119838    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9" podUID="b852594b-cab0-48ff-98d1-48993d9ff6a5" containerName="sequence-graph-78f99" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:21:04.018606 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:04.018562    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx" podUID="fccc48c2-8b8c-4513-8748-4a3d803325cf" containerName="ensemble-graph-242a5" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:21:06.080907 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:06.080851    2561 generic.go:356] "Generic (PLEG): container finished" podID="b852594b-cab0-48ff-98d1-48993d9ff6a5" containerID="9fa75b39ab976623fb77f4fd8b626535a03e7a6cef6be1aa1637fc51caccafa1" exitCode=0
Jul 20 10:21:06.081272 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:06.080931    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9" event={"ID":"b852594b-cab0-48ff-98d1-48993d9ff6a5","Type":"ContainerDied","Data":"9fa75b39ab976623fb77f4fd8b626535a03e7a6cef6be1aa1637fc51caccafa1"}
Jul 20 10:21:06.183334 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:06.183310    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9"
Jul 20 10:21:06.280370 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:06.280336    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b852594b-cab0-48ff-98d1-48993d9ff6a5-proxy-tls\") pod \"b852594b-cab0-48ff-98d1-48993d9ff6a5\" (UID: \"b852594b-cab0-48ff-98d1-48993d9ff6a5\") "
Jul 20 10:21:06.280533 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:06.280391    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b852594b-cab0-48ff-98d1-48993d9ff6a5-openshift-service-ca-bundle\") pod \"b852594b-cab0-48ff-98d1-48993d9ff6a5\" (UID: \"b852594b-cab0-48ff-98d1-48993d9ff6a5\") "
Jul 20 10:21:06.280732 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:06.280706    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b852594b-cab0-48ff-98d1-48993d9ff6a5-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "b852594b-cab0-48ff-98d1-48993d9ff6a5" (UID: "b852594b-cab0-48ff-98d1-48993d9ff6a5"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 10:21:06.282385 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:06.282362    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b852594b-cab0-48ff-98d1-48993d9ff6a5-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "b852594b-cab0-48ff-98d1-48993d9ff6a5" (UID: "b852594b-cab0-48ff-98d1-48993d9ff6a5"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:21:06.381654 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:06.381579    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b852594b-cab0-48ff-98d1-48993d9ff6a5-proxy-tls\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:21:06.381654 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:06.381603    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b852594b-cab0-48ff-98d1-48993d9ff6a5-openshift-service-ca-bundle\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:21:06.746869 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:06.746799    2561 scope.go:117] "RemoveContainer" containerID="9fa75b39ab976623fb77f4fd8b626535a03e7a6cef6be1aa1637fc51caccafa1"
Jul 20 10:21:07.084681 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:07.084652    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9"
Jul 20 10:21:07.084681 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:07.084660    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9" event={"ID":"b852594b-cab0-48ff-98d1-48993d9ff6a5","Type":"ContainerDied","Data":"e6bd2dadd6c7c68bd2a34a1a706a73840a12e253d8e4b5ed2a548702984d3f59"}
Jul 20 10:21:07.111009 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:07.110983    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9"]
Jul 20 10:21:07.114524 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:07.114504    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-78f99-5f589d8f54-4zpv9"]
Jul 20 10:21:08.742606 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:08.742569    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b852594b-cab0-48ff-98d1-48993d9ff6a5" path="/var/lib/kubelet/pods/b852594b-cab0-48ff-98d1-48993d9ff6a5/volumes"
Jul 20 10:21:09.018388 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:09.018302    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx" podUID="fccc48c2-8b8c-4513-8748-4a3d803325cf" containerName="ensemble-graph-242a5" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:21:09.018528 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:09.018407    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx"
Jul 20 10:21:14.018196 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:14.018158    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx" podUID="fccc48c2-8b8c-4513-8748-4a3d803325cf" containerName="ensemble-graph-242a5" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:21:19.018061 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:19.018019    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx" podUID="fccc48c2-8b8c-4513-8748-4a3d803325cf" containerName="ensemble-graph-242a5" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:21:24.017902 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:24.017843    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx" podUID="fccc48c2-8b8c-4513-8748-4a3d803325cf" containerName="ensemble-graph-242a5" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:21:26.764992 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:26.764968    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx"
Jul 20 10:21:26.849614 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:26.849574    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fccc48c2-8b8c-4513-8748-4a3d803325cf-proxy-tls\") pod \"fccc48c2-8b8c-4513-8748-4a3d803325cf\" (UID: \"fccc48c2-8b8c-4513-8748-4a3d803325cf\") "
Jul 20 10:21:26.849765 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:26.849636    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fccc48c2-8b8c-4513-8748-4a3d803325cf-openshift-service-ca-bundle\") pod \"fccc48c2-8b8c-4513-8748-4a3d803325cf\" (UID: \"fccc48c2-8b8c-4513-8748-4a3d803325cf\") "
Jul 20 10:21:26.850030 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:26.850004    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fccc48c2-8b8c-4513-8748-4a3d803325cf-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "fccc48c2-8b8c-4513-8748-4a3d803325cf" (UID: "fccc48c2-8b8c-4513-8748-4a3d803325cf"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 10:21:26.851619 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:26.851598    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fccc48c2-8b8c-4513-8748-4a3d803325cf-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "fccc48c2-8b8c-4513-8748-4a3d803325cf" (UID: "fccc48c2-8b8c-4513-8748-4a3d803325cf"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:21:26.950340 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:26.950263    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fccc48c2-8b8c-4513-8748-4a3d803325cf-proxy-tls\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:21:26.950340 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:26.950292    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fccc48c2-8b8c-4513-8748-4a3d803325cf-openshift-service-ca-bundle\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:21:27.159933 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:27.159902    2561 generic.go:356] "Generic (PLEG): container finished" podID="fccc48c2-8b8c-4513-8748-4a3d803325cf" containerID="0537b7a7f7a2e7e55c476bcf6284888ca6d171798b7d3d2024e66b809873fbc2" exitCode=0
Jul 20 10:21:27.160084 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:27.159943    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx"
Jul 20 10:21:27.160084 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:27.159974    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx" event={"ID":"fccc48c2-8b8c-4513-8748-4a3d803325cf","Type":"ContainerDied","Data":"0537b7a7f7a2e7e55c476bcf6284888ca6d171798b7d3d2024e66b809873fbc2"}
Jul 20 10:21:27.160084 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:27.160028    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx" event={"ID":"fccc48c2-8b8c-4513-8748-4a3d803325cf","Type":"ContainerDied","Data":"f6a713d3f1588f203bc8181308a870cf809c0c78422602a15b18517da49cb002"}
Jul 20 10:21:27.160084 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:27.160051    2561 scope.go:117] "RemoveContainer" containerID="0537b7a7f7a2e7e55c476bcf6284888ca6d171798b7d3d2024e66b809873fbc2"
Jul 20 10:21:27.168825 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:27.168809    2561 scope.go:117] "RemoveContainer" containerID="0537b7a7f7a2e7e55c476bcf6284888ca6d171798b7d3d2024e66b809873fbc2"
Jul 20 10:21:27.169104 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:21:27.169081    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0537b7a7f7a2e7e55c476bcf6284888ca6d171798b7d3d2024e66b809873fbc2\": container with ID starting with 0537b7a7f7a2e7e55c476bcf6284888ca6d171798b7d3d2024e66b809873fbc2 not found: ID does not exist" containerID="0537b7a7f7a2e7e55c476bcf6284888ca6d171798b7d3d2024e66b809873fbc2"
Jul 20 10:21:27.169186 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:27.169117    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0537b7a7f7a2e7e55c476bcf6284888ca6d171798b7d3d2024e66b809873fbc2"} err="failed to get container status \"0537b7a7f7a2e7e55c476bcf6284888ca6d171798b7d3d2024e66b809873fbc2\": rpc error: code = NotFound desc = could not find container \"0537b7a7f7a2e7e55c476bcf6284888ca6d171798b7d3d2024e66b809873fbc2\": container with ID starting with 0537b7a7f7a2e7e55c476bcf6284888ca6d171798b7d3d2024e66b809873fbc2 not found: ID does not exist"
Jul 20 10:21:27.179263 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:27.179240    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx"]
Jul 20 10:21:27.181394 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:27.181375    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-242a5-75b5874dcc-scmgx"]
Jul 20 10:21:28.742810 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:28.742780    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fccc48c2-8b8c-4513-8748-4a3d803325cf" path="/var/lib/kubelet/pods/fccc48c2-8b8c-4513-8748-4a3d803325cf/volumes"
Jul 20 10:21:46.269082 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:46.269051    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj"]
Jul 20 10:21:46.269441 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:46.269369    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b852594b-cab0-48ff-98d1-48993d9ff6a5" containerName="sequence-graph-78f99"
Jul 20 10:21:46.269441 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:46.269381    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b852594b-cab0-48ff-98d1-48993d9ff6a5" containerName="sequence-graph-78f99"
Jul 20 10:21:46.269441 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:46.269397    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fccc48c2-8b8c-4513-8748-4a3d803325cf" containerName="ensemble-graph-242a5"
Jul 20 10:21:46.269441 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:46.269403    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fccc48c2-8b8c-4513-8748-4a3d803325cf" containerName="ensemble-graph-242a5"
Jul 20 10:21:46.269564 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:46.269446    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fccc48c2-8b8c-4513-8748-4a3d803325cf" containerName="ensemble-graph-242a5"
Jul 20 10:21:46.269564 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:46.269455    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b852594b-cab0-48ff-98d1-48993d9ff6a5" containerName="sequence-graph-78f99"
Jul 20 10:21:46.272289 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:46.272269    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj"
Jul 20 10:21:46.274491 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:46.274473    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-24b48-serving-cert\""
Jul 20 10:21:46.275239 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:46.275216    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-24b48-kube-rbac-proxy-sar-config\""
Jul 20 10:21:46.275329 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:46.275311    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-npdx9\""
Jul 20 10:21:46.275698 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:46.275684    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 20 10:21:46.281837 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:46.281814    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj"]
Jul 20 10:21:46.407498 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:46.407459    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de936678-cc94-44d5-ab32-1315bd54b2f1-openshift-service-ca-bundle\") pod \"sequence-graph-24b48-8867c854c-crmlj\" (UID: \"de936678-cc94-44d5-ab32-1315bd54b2f1\") " pod="kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj"
Jul 20 10:21:46.407658 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:46.407505    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/de936678-cc94-44d5-ab32-1315bd54b2f1-proxy-tls\") pod \"sequence-graph-24b48-8867c854c-crmlj\" (UID: \"de936678-cc94-44d5-ab32-1315bd54b2f1\") " pod="kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj"
Jul 20 10:21:46.508566 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:46.508533    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de936678-cc94-44d5-ab32-1315bd54b2f1-openshift-service-ca-bundle\") pod \"sequence-graph-24b48-8867c854c-crmlj\" (UID: \"de936678-cc94-44d5-ab32-1315bd54b2f1\") " pod="kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj"
Jul 20 10:21:46.508566 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:46.508570    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/de936678-cc94-44d5-ab32-1315bd54b2f1-proxy-tls\") pod \"sequence-graph-24b48-8867c854c-crmlj\" (UID: \"de936678-cc94-44d5-ab32-1315bd54b2f1\") " pod="kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj"
Jul 20 10:21:46.509199 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:46.509174    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de936678-cc94-44d5-ab32-1315bd54b2f1-openshift-service-ca-bundle\") pod \"sequence-graph-24b48-8867c854c-crmlj\" (UID: \"de936678-cc94-44d5-ab32-1315bd54b2f1\") " pod="kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj"
Jul 20 10:21:46.510934 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:46.510909    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/de936678-cc94-44d5-ab32-1315bd54b2f1-proxy-tls\") pod \"sequence-graph-24b48-8867c854c-crmlj\" (UID: \"de936678-cc94-44d5-ab32-1315bd54b2f1\") " pod="kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj"
Jul 20 10:21:46.584369 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:46.584339    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj"
Jul 20 10:21:46.712157 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:46.712050    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj"]
Jul 20 10:21:46.714694 ip-10-0-138-143 kubenswrapper[2561]: W0720 10:21:46.714666    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde936678_cc94_44d5_ab32_1315bd54b2f1.slice/crio-24977981efc9ec82f73b3d579158ac6cab69da469f3c6583a3db6c328b1ad362 WatchSource:0}: Error finding container 24977981efc9ec82f73b3d579158ac6cab69da469f3c6583a3db6c328b1ad362: Status 404 returned error can't find the container with id 24977981efc9ec82f73b3d579158ac6cab69da469f3c6583a3db6c328b1ad362
Jul 20 10:21:47.233929 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:47.233866    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj" event={"ID":"de936678-cc94-44d5-ab32-1315bd54b2f1","Type":"ContainerStarted","Data":"24af0c67d3807a0d98cbdaae23dedf4e47bea2b695d19f52a387ad2c91fd07ef"}
Jul 20 10:21:47.234139 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:47.233947    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj" event={"ID":"de936678-cc94-44d5-ab32-1315bd54b2f1","Type":"ContainerStarted","Data":"24977981efc9ec82f73b3d579158ac6cab69da469f3c6583a3db6c328b1ad362"}
Jul 20 10:21:47.234139 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:47.233969    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj"
Jul 20 10:21:47.253873 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:47.253825    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj" podStartSLOduration=1.253809982 podStartE2EDuration="1.253809982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:21:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:21:47.252638604 +0000 UTC m=+1480.969553899" watchObservedRunningTime="2026-07-20 10:21:47.253809982 +0000 UTC m=+1480.970725405"
Jul 20 10:21:53.243459 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:53.243430    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj"
Jul 20 10:21:56.327421 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:56.327384    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj"]
Jul 20 10:21:56.327854 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:56.327608    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj" podUID="de936678-cc94-44d5-ab32-1315bd54b2f1" containerName="sequence-graph-24b48" containerID="cri-o://24af0c67d3807a0d98cbdaae23dedf4e47bea2b695d19f52a387ad2c91fd07ef" gracePeriod=30
Jul 20 10:21:56.885371 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:56.885331    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm"]
Jul 20 10:21:56.888810 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:56.888785    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm"
Jul 20 10:21:56.890572 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:56.890542    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-53302-serving-cert\""
Jul 20 10:21:56.890683 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:56.890599    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-53302-kube-rbac-proxy-sar-config\""
Jul 20 10:21:56.902573 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:56.902542    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm"]
Jul 20 10:21:56.979725 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:56.979688    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/683dbf0e-ba1a-45e7-83a1-28813d7c4bdc-openshift-service-ca-bundle\") pod \"ensemble-graph-53302-75ff947f68-lkcrm\" (UID: \"683dbf0e-ba1a-45e7-83a1-28813d7c4bdc\") " pod="kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm"
Jul 20 10:21:56.979940 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:56.979782    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/683dbf0e-ba1a-45e7-83a1-28813d7c4bdc-proxy-tls\") pod \"ensemble-graph-53302-75ff947f68-lkcrm\" (UID: \"683dbf0e-ba1a-45e7-83a1-28813d7c4bdc\") " pod="kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm"
Jul 20 10:21:57.080938 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:57.080868    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/683dbf0e-ba1a-45e7-83a1-28813d7c4bdc-proxy-tls\") pod \"ensemble-graph-53302-75ff947f68-lkcrm\" (UID: \"683dbf0e-ba1a-45e7-83a1-28813d7c4bdc\") " pod="kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm"
Jul 20 10:21:57.081115 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:57.080963    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/683dbf0e-ba1a-45e7-83a1-28813d7c4bdc-openshift-service-ca-bundle\") pod \"ensemble-graph-53302-75ff947f68-lkcrm\" (UID: \"683dbf0e-ba1a-45e7-83a1-28813d7c4bdc\") " pod="kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm"
Jul 20 10:21:57.081115 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:21:57.081009    2561 secret.go:189] Couldn't get secret kserve-ci-e2e-test/ensemble-graph-53302-serving-cert: secret "ensemble-graph-53302-serving-cert" not found
Jul 20 10:21:57.081115 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:21:57.081074    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/683dbf0e-ba1a-45e7-83a1-28813d7c4bdc-proxy-tls podName:683dbf0e-ba1a-45e7-83a1-28813d7c4bdc nodeName:}" failed. No retries permitted until 2026-07-20 10:21:57.581056837 +0000 UTC m=+1491.297972084 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/683dbf0e-ba1a-45e7-83a1-28813d7c4bdc-proxy-tls") pod "ensemble-graph-53302-75ff947f68-lkcrm" (UID: "683dbf0e-ba1a-45e7-83a1-28813d7c4bdc") : secret "ensemble-graph-53302-serving-cert" not found
Jul 20 10:21:57.081607 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:57.081582    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/683dbf0e-ba1a-45e7-83a1-28813d7c4bdc-openshift-service-ca-bundle\") pod \"ensemble-graph-53302-75ff947f68-lkcrm\" (UID: \"683dbf0e-ba1a-45e7-83a1-28813d7c4bdc\") " pod="kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm"
Jul 20 10:21:57.583717 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:57.583680    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/683dbf0e-ba1a-45e7-83a1-28813d7c4bdc-proxy-tls\") pod \"ensemble-graph-53302-75ff947f68-lkcrm\" (UID: \"683dbf0e-ba1a-45e7-83a1-28813d7c4bdc\") " pod="kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm"
Jul 20 10:21:57.586055 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:57.586025    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/683dbf0e-ba1a-45e7-83a1-28813d7c4bdc-proxy-tls\") pod \"ensemble-graph-53302-75ff947f68-lkcrm\" (UID: \"683dbf0e-ba1a-45e7-83a1-28813d7c4bdc\") " pod="kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm"
Jul 20 10:21:57.798564 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:57.798533    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm"
Jul 20 10:21:57.928026 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:57.927996    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm"]
Jul 20 10:21:57.931274 ip-10-0-138-143 kubenswrapper[2561]: W0720 10:21:57.931247    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod683dbf0e_ba1a_45e7_83a1_28813d7c4bdc.slice/crio-53c4f4058c1de870bc512501af18535a4d785ba010aefe8ab46585ca2fade13c WatchSource:0}: Error finding container 53c4f4058c1de870bc512501af18535a4d785ba010aefe8ab46585ca2fade13c: Status 404 returned error can't find the container with id 53c4f4058c1de870bc512501af18535a4d785ba010aefe8ab46585ca2fade13c
Jul 20 10:21:58.242917 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:58.242813    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj" podUID="de936678-cc94-44d5-ab32-1315bd54b2f1" containerName="sequence-graph-24b48" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:21:58.280976 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:58.280940    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm" event={"ID":"683dbf0e-ba1a-45e7-83a1-28813d7c4bdc","Type":"ContainerStarted","Data":"a5becae4b8e9ea33c8f7df78cd1e890f358c68bd499cd8b1a90de69578b72807"}
Jul 20 10:21:58.281180 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:58.280998    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm" event={"ID":"683dbf0e-ba1a-45e7-83a1-28813d7c4bdc","Type":"ContainerStarted","Data":"53c4f4058c1de870bc512501af18535a4d785ba010aefe8ab46585ca2fade13c"}
Jul 20 10:21:58.281180 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:58.281026    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm"
Jul 20 10:21:58.304668 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:21:58.304611    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm" podStartSLOduration=2.304594858 podStartE2EDuration="2.304594858s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:21:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:21:58.302678988 +0000 UTC m=+1492.019594257" watchObservedRunningTime="2026-07-20 10:21:58.304594858 +0000 UTC m=+1492.021510126"
Jul 20 10:22:03.242702 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:03.242659    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj" podUID="de936678-cc94-44d5-ab32-1315bd54b2f1" containerName="sequence-graph-24b48" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:22:04.291613 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:04.291580    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm"
Jul 20 10:22:08.242788 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:08.242742    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj" podUID="de936678-cc94-44d5-ab32-1315bd54b2f1" containerName="sequence-graph-24b48" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:22:08.243211 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:08.242893    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj"
Jul 20 10:22:13.242498 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:13.242455    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj" podUID="de936678-cc94-44d5-ab32-1315bd54b2f1" containerName="sequence-graph-24b48" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:22:18.242492 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:18.242449    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj" podUID="de936678-cc94-44d5-ab32-1315bd54b2f1" containerName="sequence-graph-24b48" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:22:23.242686 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:23.242648    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj" podUID="de936678-cc94-44d5-ab32-1315bd54b2f1" containerName="sequence-graph-24b48" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:22:26.384803 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:26.384767    2561 generic.go:356] "Generic (PLEG): container finished" podID="de936678-cc94-44d5-ab32-1315bd54b2f1" containerID="24af0c67d3807a0d98cbdaae23dedf4e47bea2b695d19f52a387ad2c91fd07ef" exitCode=0
Jul 20 10:22:26.385262 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:26.384839    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj" event={"ID":"de936678-cc94-44d5-ab32-1315bd54b2f1","Type":"ContainerDied","Data":"24af0c67d3807a0d98cbdaae23dedf4e47bea2b695d19f52a387ad2c91fd07ef"}
Jul 20 10:22:26.473343 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:26.473318    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj"
Jul 20 10:22:26.597904 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:26.597808    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de936678-cc94-44d5-ab32-1315bd54b2f1-openshift-service-ca-bundle\") pod \"de936678-cc94-44d5-ab32-1315bd54b2f1\" (UID: \"de936678-cc94-44d5-ab32-1315bd54b2f1\") "
Jul 20 10:22:26.597904 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:26.597874    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/de936678-cc94-44d5-ab32-1315bd54b2f1-proxy-tls\") pod \"de936678-cc94-44d5-ab32-1315bd54b2f1\" (UID: \"de936678-cc94-44d5-ab32-1315bd54b2f1\") "
Jul 20 10:22:26.598202 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:26.598178    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de936678-cc94-44d5-ab32-1315bd54b2f1-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "de936678-cc94-44d5-ab32-1315bd54b2f1" (UID: "de936678-cc94-44d5-ab32-1315bd54b2f1"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 10:22:26.599870 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:26.599849    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de936678-cc94-44d5-ab32-1315bd54b2f1-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "de936678-cc94-44d5-ab32-1315bd54b2f1" (UID: "de936678-cc94-44d5-ab32-1315bd54b2f1"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:22:26.699147 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:26.699114    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de936678-cc94-44d5-ab32-1315bd54b2f1-openshift-service-ca-bundle\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:22:26.699147 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:26.699141    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/de936678-cc94-44d5-ab32-1315bd54b2f1-proxy-tls\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:22:27.390187 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:27.390161    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj"
Jul 20 10:22:27.390597 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:27.390192    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj" event={"ID":"de936678-cc94-44d5-ab32-1315bd54b2f1","Type":"ContainerDied","Data":"24977981efc9ec82f73b3d579158ac6cab69da469f3c6583a3db6c328b1ad362"}
Jul 20 10:22:27.390597 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:27.390246    2561 scope.go:117] "RemoveContainer" containerID="24af0c67d3807a0d98cbdaae23dedf4e47bea2b695d19f52a387ad2c91fd07ef"
Jul 20 10:22:27.404503 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:27.404481    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj"]
Jul 20 10:22:27.410551 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:27.410531    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-24b48-8867c854c-crmlj"]
Jul 20 10:22:28.742990 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:28.742957    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de936678-cc94-44d5-ab32-1315bd54b2f1" path="/var/lib/kubelet/pods/de936678-cc94-44d5-ab32-1315bd54b2f1/volumes"
Jul 20 10:22:56.621370 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:56.621336    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x"]
Jul 20 10:22:56.621789 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:56.621769    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de936678-cc94-44d5-ab32-1315bd54b2f1" containerName="sequence-graph-24b48"
Jul 20 10:22:56.621845 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:56.621793    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="de936678-cc94-44d5-ab32-1315bd54b2f1" containerName="sequence-graph-24b48"
Jul 20 10:22:56.621913 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:56.621869    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="de936678-cc94-44d5-ab32-1315bd54b2f1" containerName="sequence-graph-24b48"
Jul 20 10:22:56.624675 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:56.624660    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x"
Jul 20 10:22:56.626689 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:56.626656    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-64e78-kube-rbac-proxy-sar-config\""
Jul 20 10:22:56.626689 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:56.626681    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-64e78-serving-cert\""
Jul 20 10:22:56.640237 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:56.640214    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x"]
Jul 20 10:22:56.747279 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:56.747248    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/caaff770-02cb-454d-954b-f960bfc3638c-proxy-tls\") pod \"sequence-graph-64e78-fd7466b96-mj96x\" (UID: \"caaff770-02cb-454d-954b-f960bfc3638c\") " pod="kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x"
Jul 20 10:22:56.747456 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:56.747290    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caaff770-02cb-454d-954b-f960bfc3638c-openshift-service-ca-bundle\") pod \"sequence-graph-64e78-fd7466b96-mj96x\" (UID: \"caaff770-02cb-454d-954b-f960bfc3638c\") " pod="kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x"
Jul 20 10:22:56.847861 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:56.847823    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/caaff770-02cb-454d-954b-f960bfc3638c-proxy-tls\") pod \"sequence-graph-64e78-fd7466b96-mj96x\" (UID: \"caaff770-02cb-454d-954b-f960bfc3638c\") " pod="kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x"
Jul 20 10:22:56.848073 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:56.847866    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caaff770-02cb-454d-954b-f960bfc3638c-openshift-service-ca-bundle\") pod \"sequence-graph-64e78-fd7466b96-mj96x\" (UID: \"caaff770-02cb-454d-954b-f960bfc3638c\") " pod="kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x"
Jul 20 10:22:56.848073 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:22:56.847996    2561 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-64e78-serving-cert: secret "sequence-graph-64e78-serving-cert" not found
Jul 20 10:22:56.848073 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:22:56.848072    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caaff770-02cb-454d-954b-f960bfc3638c-proxy-tls podName:caaff770-02cb-454d-954b-f960bfc3638c nodeName:}" failed. No retries permitted until 2026-07-20 10:22:57.348054702 +0000 UTC m=+1551.064969954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/caaff770-02cb-454d-954b-f960bfc3638c-proxy-tls") pod "sequence-graph-64e78-fd7466b96-mj96x" (UID: "caaff770-02cb-454d-954b-f960bfc3638c") : secret "sequence-graph-64e78-serving-cert" not found
Jul 20 10:22:56.848486 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:56.848463    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caaff770-02cb-454d-954b-f960bfc3638c-openshift-service-ca-bundle\") pod \"sequence-graph-64e78-fd7466b96-mj96x\" (UID: \"caaff770-02cb-454d-954b-f960bfc3638c\") " pod="kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x"
Jul 20 10:22:57.353203 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:57.353163    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/caaff770-02cb-454d-954b-f960bfc3638c-proxy-tls\") pod \"sequence-graph-64e78-fd7466b96-mj96x\" (UID: \"caaff770-02cb-454d-954b-f960bfc3638c\") " pod="kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x"
Jul 20 10:22:57.355506 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:57.355488    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/caaff770-02cb-454d-954b-f960bfc3638c-proxy-tls\") pod \"sequence-graph-64e78-fd7466b96-mj96x\" (UID: \"caaff770-02cb-454d-954b-f960bfc3638c\") " pod="kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x"
Jul 20 10:22:57.534866 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:57.534830    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x"
Jul 20 10:22:57.663899 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:57.663801    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x"]
Jul 20 10:22:57.668016 ip-10-0-138-143 kubenswrapper[2561]: W0720 10:22:57.667993    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaaff770_02cb_454d_954b_f960bfc3638c.slice/crio-f0855595c8565901a7e7d2a94498e84d849dc15937f63f93d5141de049c14960 WatchSource:0}: Error finding container f0855595c8565901a7e7d2a94498e84d849dc15937f63f93d5141de049c14960: Status 404 returned error can't find the container with id f0855595c8565901a7e7d2a94498e84d849dc15937f63f93d5141de049c14960
Jul 20 10:22:58.511707 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:58.511666    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x" event={"ID":"caaff770-02cb-454d-954b-f960bfc3638c","Type":"ContainerStarted","Data":"87389c04f660859831c9eca5518a448a849e23b426507ab4ae3ec05541c95990"}
Jul 20 10:22:58.511917 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:58.511723    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x" event={"ID":"caaff770-02cb-454d-954b-f960bfc3638c","Type":"ContainerStarted","Data":"f0855595c8565901a7e7d2a94498e84d849dc15937f63f93d5141de049c14960"}
Jul 20 10:22:58.511917 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:58.511762    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x"
Jul 20 10:22:58.530344 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:22:58.530181    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x" podStartSLOduration=2.530162513 podStartE2EDuration="2.530162513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:22:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:22:58.529470869 +0000 UTC m=+1552.246386138" watchObservedRunningTime="2026-07-20 10:22:58.530162513 +0000 UTC m=+1552.247077786"
Jul 20 10:23:04.521674 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:23:04.521645    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x"
Jul 20 10:30:11.522776 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:30:11.522738    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm"]
Jul 20 10:30:11.525182 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:30:11.523127    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm" podUID="683dbf0e-ba1a-45e7-83a1-28813d7c4bdc" containerName="ensemble-graph-53302" containerID="cri-o://a5becae4b8e9ea33c8f7df78cd1e890f358c68bd499cd8b1a90de69578b72807" gracePeriod=30
Jul 20 10:30:14.289234 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:30:14.289187    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm" podUID="683dbf0e-ba1a-45e7-83a1-28813d7c4bdc" containerName="ensemble-graph-53302" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:30:19.289498 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:30:19.289457    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm" podUID="683dbf0e-ba1a-45e7-83a1-28813d7c4bdc" containerName="ensemble-graph-53302" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:30:24.289658 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:30:24.289618    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm" podUID="683dbf0e-ba1a-45e7-83a1-28813d7c4bdc" containerName="ensemble-graph-53302" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:30:24.290077 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:30:24.289724    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm"
Jul 20 10:30:29.289502 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:30:29.289457    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm" podUID="683dbf0e-ba1a-45e7-83a1-28813d7c4bdc" containerName="ensemble-graph-53302" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:30:34.289340 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:30:34.289294    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm" podUID="683dbf0e-ba1a-45e7-83a1-28813d7c4bdc" containerName="ensemble-graph-53302" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:30:39.288605 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:30:39.288560    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm" podUID="683dbf0e-ba1a-45e7-83a1-28813d7c4bdc" containerName="ensemble-graph-53302" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:30:41.671002 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:30:41.670971    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm"
Jul 20 10:30:41.732959 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:30:41.732918    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/683dbf0e-ba1a-45e7-83a1-28813d7c4bdc-openshift-service-ca-bundle\") pod \"683dbf0e-ba1a-45e7-83a1-28813d7c4bdc\" (UID: \"683dbf0e-ba1a-45e7-83a1-28813d7c4bdc\") "
Jul 20 10:30:41.733118 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:30:41.732981    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/683dbf0e-ba1a-45e7-83a1-28813d7c4bdc-proxy-tls\") pod \"683dbf0e-ba1a-45e7-83a1-28813d7c4bdc\" (UID: \"683dbf0e-ba1a-45e7-83a1-28813d7c4bdc\") "
Jul 20 10:30:41.733363 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:30:41.733338    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/683dbf0e-ba1a-45e7-83a1-28813d7c4bdc-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "683dbf0e-ba1a-45e7-83a1-28813d7c4bdc" (UID: "683dbf0e-ba1a-45e7-83a1-28813d7c4bdc"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 10:30:41.735050 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:30:41.735030    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/683dbf0e-ba1a-45e7-83a1-28813d7c4bdc-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "683dbf0e-ba1a-45e7-83a1-28813d7c4bdc" (UID: "683dbf0e-ba1a-45e7-83a1-28813d7c4bdc"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:30:41.834251 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:30:41.834167    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/683dbf0e-ba1a-45e7-83a1-28813d7c4bdc-proxy-tls\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:30:41.834251 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:30:41.834195    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/683dbf0e-ba1a-45e7-83a1-28813d7c4bdc-openshift-service-ca-bundle\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:30:42.266699 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:30:42.266611    2561 generic.go:356] "Generic (PLEG): container finished" podID="683dbf0e-ba1a-45e7-83a1-28813d7c4bdc" containerID="a5becae4b8e9ea33c8f7df78cd1e890f358c68bd499cd8b1a90de69578b72807" exitCode=0
Jul 20 10:30:42.266699 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:30:42.266655    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm"
Jul 20 10:30:42.266699 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:30:42.266677    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm" event={"ID":"683dbf0e-ba1a-45e7-83a1-28813d7c4bdc","Type":"ContainerDied","Data":"a5becae4b8e9ea33c8f7df78cd1e890f358c68bd499cd8b1a90de69578b72807"}
Jul 20 10:30:42.266943 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:30:42.266722    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm" event={"ID":"683dbf0e-ba1a-45e7-83a1-28813d7c4bdc","Type":"ContainerDied","Data":"53c4f4058c1de870bc512501af18535a4d785ba010aefe8ab46585ca2fade13c"}
Jul 20 10:30:42.266943 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:30:42.266744    2561 scope.go:117] "RemoveContainer" containerID="a5becae4b8e9ea33c8f7df78cd1e890f358c68bd499cd8b1a90de69578b72807"
Jul 20 10:30:42.275040 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:30:42.275026    2561 scope.go:117] "RemoveContainer" containerID="a5becae4b8e9ea33c8f7df78cd1e890f358c68bd499cd8b1a90de69578b72807"
Jul 20 10:30:42.275281 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:30:42.275262    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5becae4b8e9ea33c8f7df78cd1e890f358c68bd499cd8b1a90de69578b72807\": container with ID starting with a5becae4b8e9ea33c8f7df78cd1e890f358c68bd499cd8b1a90de69578b72807 not found: ID does not exist" containerID="a5becae4b8e9ea33c8f7df78cd1e890f358c68bd499cd8b1a90de69578b72807"
Jul 20 10:30:42.275323 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:30:42.275289    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5becae4b8e9ea33c8f7df78cd1e890f358c68bd499cd8b1a90de69578b72807"} err="failed to get container status \"a5becae4b8e9ea33c8f7df78cd1e890f358c68bd499cd8b1a90de69578b72807\": rpc error: code = NotFound desc = could not find container \"a5becae4b8e9ea33c8f7df78cd1e890f358c68bd499cd8b1a90de69578b72807\": container with ID starting with a5becae4b8e9ea33c8f7df78cd1e890f358c68bd499cd8b1a90de69578b72807 not found: ID does not exist"
Jul 20 10:30:42.286096 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:30:42.286073    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm"]
Jul 20 10:30:42.290246 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:30:42.290225    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-53302-75ff947f68-lkcrm"]
Jul 20 10:30:42.742870 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:30:42.742835    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="683dbf0e-ba1a-45e7-83a1-28813d7c4bdc" path="/var/lib/kubelet/pods/683dbf0e-ba1a-45e7-83a1-28813d7c4bdc/volumes"
Jul 20 10:31:11.142656 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:11.142623    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x"]
Jul 20 10:31:11.143132 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:11.142862    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x" podUID="caaff770-02cb-454d-954b-f960bfc3638c" containerName="sequence-graph-64e78" containerID="cri-o://87389c04f660859831c9eca5518a448a849e23b426507ab4ae3ec05541c95990" gracePeriod=30
Jul 20 10:31:11.790226 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:11.790193    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm"]
Jul 20 10:31:11.790499 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:11.790483    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="683dbf0e-ba1a-45e7-83a1-28813d7c4bdc" containerName="ensemble-graph-53302"
Jul 20 10:31:11.790564 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:11.790502    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="683dbf0e-ba1a-45e7-83a1-28813d7c4bdc" containerName="ensemble-graph-53302"
Jul 20 10:31:11.790599 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:11.790588    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="683dbf0e-ba1a-45e7-83a1-28813d7c4bdc" containerName="ensemble-graph-53302"
Jul 20 10:31:11.793420 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:11.793402    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm"
Jul 20 10:31:11.795518 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:11.795494    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-a956e-kube-rbac-proxy-sar-config\""
Jul 20 10:31:11.795629 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:11.795494    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-a956e-serving-cert\""
Jul 20 10:31:11.803750 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:11.803733    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm"]
Jul 20 10:31:11.875003 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:11.874962    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4705da1d-73a1-4c89-bd08-2bb501de3644-proxy-tls\") pod \"splitter-graph-a956e-7c868cfd4b-gl5tm\" (UID: \"4705da1d-73a1-4c89-bd08-2bb501de3644\") " pod="kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm"
Jul 20 10:31:11.875194 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:11.875010    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4705da1d-73a1-4c89-bd08-2bb501de3644-openshift-service-ca-bundle\") pod \"splitter-graph-a956e-7c868cfd4b-gl5tm\" (UID: \"4705da1d-73a1-4c89-bd08-2bb501de3644\") " pod="kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm"
Jul 20 10:31:11.975339 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:11.975310    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4705da1d-73a1-4c89-bd08-2bb501de3644-proxy-tls\") pod \"splitter-graph-a956e-7c868cfd4b-gl5tm\" (UID: \"4705da1d-73a1-4c89-bd08-2bb501de3644\") " pod="kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm"
Jul 20 10:31:11.975520 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:11.975346    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4705da1d-73a1-4c89-bd08-2bb501de3644-openshift-service-ca-bundle\") pod \"splitter-graph-a956e-7c868cfd4b-gl5tm\" (UID: \"4705da1d-73a1-4c89-bd08-2bb501de3644\") " pod="kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm"
Jul 20 10:31:11.975520 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:31:11.975469    2561 secret.go:189] Couldn't get secret kserve-ci-e2e-test/splitter-graph-a956e-serving-cert: secret "splitter-graph-a956e-serving-cert" not found
Jul 20 10:31:11.975632 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:31:11.975535    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4705da1d-73a1-4c89-bd08-2bb501de3644-proxy-tls podName:4705da1d-73a1-4c89-bd08-2bb501de3644 nodeName:}" failed. No retries permitted until 2026-07-20 10:31:12.475518288 +0000 UTC m=+2046.192433535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/4705da1d-73a1-4c89-bd08-2bb501de3644-proxy-tls") pod "splitter-graph-a956e-7c868cfd4b-gl5tm" (UID: "4705da1d-73a1-4c89-bd08-2bb501de3644") : secret "splitter-graph-a956e-serving-cert" not found
Jul 20 10:31:11.976012 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:11.975995    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4705da1d-73a1-4c89-bd08-2bb501de3644-openshift-service-ca-bundle\") pod \"splitter-graph-a956e-7c868cfd4b-gl5tm\" (UID: \"4705da1d-73a1-4c89-bd08-2bb501de3644\") " pod="kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm"
Jul 20 10:31:12.478843 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:12.478805    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4705da1d-73a1-4c89-bd08-2bb501de3644-proxy-tls\") pod \"splitter-graph-a956e-7c868cfd4b-gl5tm\" (UID: \"4705da1d-73a1-4c89-bd08-2bb501de3644\") " pod="kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm"
Jul 20 10:31:12.481172 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:12.481151    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4705da1d-73a1-4c89-bd08-2bb501de3644-proxy-tls\") pod \"splitter-graph-a956e-7c868cfd4b-gl5tm\" (UID: \"4705da1d-73a1-4c89-bd08-2bb501de3644\") " pod="kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm"
Jul 20 10:31:12.705833 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:12.705792    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm"
Jul 20 10:31:12.836460 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:12.836425    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm"]
Jul 20 10:31:12.839356 ip-10-0-138-143 kubenswrapper[2561]: W0720 10:31:12.839319    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4705da1d_73a1_4c89_bd08_2bb501de3644.slice/crio-6943e20aa8af383332021b150787db12eafd47853fdec9bd3f62a97cda34dbca WatchSource:0}: Error finding container 6943e20aa8af383332021b150787db12eafd47853fdec9bd3f62a97cda34dbca: Status 404 returned error can't find the container with id 6943e20aa8af383332021b150787db12eafd47853fdec9bd3f62a97cda34dbca
Jul 20 10:31:13.382515 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:13.382479    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm" event={"ID":"4705da1d-73a1-4c89-bd08-2bb501de3644","Type":"ContainerStarted","Data":"4204f089f8b49c5da11ad4ba6819d8c09985b3df4d3bfccd7d39f5fbf8770c0d"}
Jul 20 10:31:13.382701 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:13.382532    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm" event={"ID":"4705da1d-73a1-4c89-bd08-2bb501de3644","Type":"ContainerStarted","Data":"6943e20aa8af383332021b150787db12eafd47853fdec9bd3f62a97cda34dbca"}
Jul 20 10:31:13.382701 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:13.382608    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm"
Jul 20 10:31:13.398360 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:13.398298    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm" podStartSLOduration=2.398278544 podStartE2EDuration="2.398278544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:31:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:31:13.397993481 +0000 UTC m=+2047.114908799" watchObservedRunningTime="2026-07-20 10:31:13.398278544 +0000 UTC m=+2047.115193812"
Jul 20 10:31:14.520011 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:14.519975    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x" podUID="caaff770-02cb-454d-954b-f960bfc3638c" containerName="sequence-graph-64e78" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:31:19.392788 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:19.392758    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm"
Jul 20 10:31:19.519497 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:19.519462    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x" podUID="caaff770-02cb-454d-954b-f960bfc3638c" containerName="sequence-graph-64e78" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:31:21.877207 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:21.877167    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm"]
Jul 20 10:31:21.877588 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:21.877369    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm" podUID="4705da1d-73a1-4c89-bd08-2bb501de3644" containerName="splitter-graph-a956e" containerID="cri-o://4204f089f8b49c5da11ad4ba6819d8c09985b3df4d3bfccd7d39f5fbf8770c0d" gracePeriod=30
Jul 20 10:31:24.390683 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:24.390643    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm" podUID="4705da1d-73a1-4c89-bd08-2bb501de3644" containerName="splitter-graph-a956e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:31:24.519897 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:24.519838    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x" podUID="caaff770-02cb-454d-954b-f960bfc3638c" containerName="sequence-graph-64e78" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:31:24.520067 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:24.519954    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x"
Jul 20 10:31:29.391025 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:29.390936    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm" podUID="4705da1d-73a1-4c89-bd08-2bb501de3644" containerName="splitter-graph-a956e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:31:29.519530 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:29.519492    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x" podUID="caaff770-02cb-454d-954b-f960bfc3638c" containerName="sequence-graph-64e78" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:31:34.391144 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:34.391098    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm" podUID="4705da1d-73a1-4c89-bd08-2bb501de3644" containerName="splitter-graph-a956e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:31:34.391598 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:34.391205    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm"
Jul 20 10:31:34.520105 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:34.520067    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x" podUID="caaff770-02cb-454d-954b-f960bfc3638c" containerName="sequence-graph-64e78" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:31:39.390594 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:39.390552    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm" podUID="4705da1d-73a1-4c89-bd08-2bb501de3644" containerName="splitter-graph-a956e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:31:39.519568 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:39.519530    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x" podUID="caaff770-02cb-454d-954b-f960bfc3638c" containerName="sequence-graph-64e78" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:31:41.294298 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:41.294270    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x"
Jul 20 10:31:41.402074 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:41.401994    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caaff770-02cb-454d-954b-f960bfc3638c-openshift-service-ca-bundle\") pod \"caaff770-02cb-454d-954b-f960bfc3638c\" (UID: \"caaff770-02cb-454d-954b-f960bfc3638c\") "
Jul 20 10:31:41.402074 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:41.402048    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/caaff770-02cb-454d-954b-f960bfc3638c-proxy-tls\") pod \"caaff770-02cb-454d-954b-f960bfc3638c\" (UID: \"caaff770-02cb-454d-954b-f960bfc3638c\") "
Jul 20 10:31:41.402523 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:41.402501    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caaff770-02cb-454d-954b-f960bfc3638c-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "caaff770-02cb-454d-954b-f960bfc3638c" (UID: "caaff770-02cb-454d-954b-f960bfc3638c"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 10:31:41.404366 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:41.404344    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caaff770-02cb-454d-954b-f960bfc3638c-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "caaff770-02cb-454d-954b-f960bfc3638c" (UID: "caaff770-02cb-454d-954b-f960bfc3638c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:31:41.492688 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:41.492652    2561 generic.go:356] "Generic (PLEG): container finished" podID="caaff770-02cb-454d-954b-f960bfc3638c" containerID="87389c04f660859831c9eca5518a448a849e23b426507ab4ae3ec05541c95990" exitCode=0
Jul 20 10:31:41.492838 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:41.492698    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x"
Jul 20 10:31:41.492838 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:41.492698    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x" event={"ID":"caaff770-02cb-454d-954b-f960bfc3638c","Type":"ContainerDied","Data":"87389c04f660859831c9eca5518a448a849e23b426507ab4ae3ec05541c95990"}
Jul 20 10:31:41.493027 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:41.492830    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x" event={"ID":"caaff770-02cb-454d-954b-f960bfc3638c","Type":"ContainerDied","Data":"f0855595c8565901a7e7d2a94498e84d849dc15937f63f93d5141de049c14960"}
Jul 20 10:31:41.493027 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:41.492862    2561 scope.go:117] "RemoveContainer" containerID="87389c04f660859831c9eca5518a448a849e23b426507ab4ae3ec05541c95990"
Jul 20 10:31:41.500994 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:41.500980    2561 scope.go:117] "RemoveContainer" containerID="87389c04f660859831c9eca5518a448a849e23b426507ab4ae3ec05541c95990"
Jul 20 10:31:41.501224 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:31:41.501206    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87389c04f660859831c9eca5518a448a849e23b426507ab4ae3ec05541c95990\": container with ID starting with 87389c04f660859831c9eca5518a448a849e23b426507ab4ae3ec05541c95990 not found: ID does not exist" containerID="87389c04f660859831c9eca5518a448a849e23b426507ab4ae3ec05541c95990"
Jul 20 10:31:41.501282 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:41.501231    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87389c04f660859831c9eca5518a448a849e23b426507ab4ae3ec05541c95990"} err="failed to get container status \"87389c04f660859831c9eca5518a448a849e23b426507ab4ae3ec05541c95990\": rpc error: code = NotFound desc = could not find container \"87389c04f660859831c9eca5518a448a849e23b426507ab4ae3ec05541c95990\": container with ID starting with 87389c04f660859831c9eca5518a448a849e23b426507ab4ae3ec05541c95990 not found: ID does not exist"
Jul 20 10:31:41.503499 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:41.503483    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caaff770-02cb-454d-954b-f960bfc3638c-openshift-service-ca-bundle\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:31:41.503557 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:41.503502    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/caaff770-02cb-454d-954b-f960bfc3638c-proxy-tls\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:31:41.514731 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:41.514707    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x"]
Jul 20 10:31:41.521445 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:41.521427    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-64e78-fd7466b96-mj96x"]
Jul 20 10:31:42.742739 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:42.742708    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="caaff770-02cb-454d-954b-f960bfc3638c" path="/var/lib/kubelet/pods/caaff770-02cb-454d-954b-f960bfc3638c/volumes"
Jul 20 10:31:44.390747 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:44.390708    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm" podUID="4705da1d-73a1-4c89-bd08-2bb501de3644" containerName="splitter-graph-a956e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:31:49.390670 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:49.390632    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm" podUID="4705da1d-73a1-4c89-bd08-2bb501de3644" containerName="splitter-graph-a956e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:31:52.515996 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:52.515965    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm"
Jul 20 10:31:52.535438 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:52.535405    2561 generic.go:356] "Generic (PLEG): container finished" podID="4705da1d-73a1-4c89-bd08-2bb501de3644" containerID="4204f089f8b49c5da11ad4ba6819d8c09985b3df4d3bfccd7d39f5fbf8770c0d" exitCode=0
Jul 20 10:31:52.535571 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:52.535441    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm"
Jul 20 10:31:52.535571 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:52.535455    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm" event={"ID":"4705da1d-73a1-4c89-bd08-2bb501de3644","Type":"ContainerDied","Data":"4204f089f8b49c5da11ad4ba6819d8c09985b3df4d3bfccd7d39f5fbf8770c0d"}
Jul 20 10:31:52.535571 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:52.535507    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm" event={"ID":"4705da1d-73a1-4c89-bd08-2bb501de3644","Type":"ContainerDied","Data":"6943e20aa8af383332021b150787db12eafd47853fdec9bd3f62a97cda34dbca"}
Jul 20 10:31:52.535571 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:52.535540    2561 scope.go:117] "RemoveContainer" containerID="4204f089f8b49c5da11ad4ba6819d8c09985b3df4d3bfccd7d39f5fbf8770c0d"
Jul 20 10:31:52.543351 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:52.543330    2561 scope.go:117] "RemoveContainer" containerID="4204f089f8b49c5da11ad4ba6819d8c09985b3df4d3bfccd7d39f5fbf8770c0d"
Jul 20 10:31:52.543607 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:31:52.543587    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4204f089f8b49c5da11ad4ba6819d8c09985b3df4d3bfccd7d39f5fbf8770c0d\": container with ID starting with 4204f089f8b49c5da11ad4ba6819d8c09985b3df4d3bfccd7d39f5fbf8770c0d not found: ID does not exist" containerID="4204f089f8b49c5da11ad4ba6819d8c09985b3df4d3bfccd7d39f5fbf8770c0d"
Jul 20 10:31:52.543661 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:52.543617    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4204f089f8b49c5da11ad4ba6819d8c09985b3df4d3bfccd7d39f5fbf8770c0d"} err="failed to get container status \"4204f089f8b49c5da11ad4ba6819d8c09985b3df4d3bfccd7d39f5fbf8770c0d\": rpc error: code = NotFound desc = could not find container \"4204f089f8b49c5da11ad4ba6819d8c09985b3df4d3bfccd7d39f5fbf8770c0d\": container with ID starting with 4204f089f8b49c5da11ad4ba6819d8c09985b3df4d3bfccd7d39f5fbf8770c0d not found: ID does not exist"
Jul 20 10:31:52.589336 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:52.589306    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4705da1d-73a1-4c89-bd08-2bb501de3644-openshift-service-ca-bundle\") pod \"4705da1d-73a1-4c89-bd08-2bb501de3644\" (UID: \"4705da1d-73a1-4c89-bd08-2bb501de3644\") "
Jul 20 10:31:52.589475 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:52.589357    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4705da1d-73a1-4c89-bd08-2bb501de3644-proxy-tls\") pod \"4705da1d-73a1-4c89-bd08-2bb501de3644\" (UID: \"4705da1d-73a1-4c89-bd08-2bb501de3644\") "
Jul 20 10:31:52.589661 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:52.589638    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4705da1d-73a1-4c89-bd08-2bb501de3644-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "4705da1d-73a1-4c89-bd08-2bb501de3644" (UID: "4705da1d-73a1-4c89-bd08-2bb501de3644"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 10:31:52.591344 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:52.591323    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4705da1d-73a1-4c89-bd08-2bb501de3644-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "4705da1d-73a1-4c89-bd08-2bb501de3644" (UID: "4705da1d-73a1-4c89-bd08-2bb501de3644"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:31:52.689850 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:52.689776    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4705da1d-73a1-4c89-bd08-2bb501de3644-openshift-service-ca-bundle\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:31:52.689850 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:52.689802    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4705da1d-73a1-4c89-bd08-2bb501de3644-proxy-tls\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:31:52.849163 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:52.849132    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm"]
Jul 20 10:31:52.855252 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:52.855226    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-a956e-7c868cfd4b-gl5tm"]
Jul 20 10:31:54.742729 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:31:54.742696    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4705da1d-73a1-4c89-bd08-2bb501de3644" path="/var/lib/kubelet/pods/4705da1d-73a1-4c89-bd08-2bb501de3644/volumes"
Jul 20 10:32:11.528452 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:11.528413    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws"]
Jul 20 10:32:11.528963 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:11.528810    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4705da1d-73a1-4c89-bd08-2bb501de3644" containerName="splitter-graph-a956e"
Jul 20 10:32:11.528963 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:11.528827    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4705da1d-73a1-4c89-bd08-2bb501de3644" containerName="splitter-graph-a956e"
Jul 20 10:32:11.528963 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:11.528845    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caaff770-02cb-454d-954b-f960bfc3638c" containerName="sequence-graph-64e78"
Jul 20 10:32:11.528963 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:11.528850    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="caaff770-02cb-454d-954b-f960bfc3638c" containerName="sequence-graph-64e78"
Jul 20 10:32:11.528963 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:11.528920    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4705da1d-73a1-4c89-bd08-2bb501de3644" containerName="splitter-graph-a956e"
Jul 20 10:32:11.528963 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:11.528932    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="caaff770-02cb-454d-954b-f960bfc3638c" containerName="sequence-graph-64e78"
Jul 20 10:32:11.531656 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:11.531638    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws"
Jul 20 10:32:11.534215 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:11.534190    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-78ab0-kube-rbac-proxy-sar-config\""
Jul 20 10:32:11.534215 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:11.534205    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-78ab0-serving-cert\""
Jul 20 10:32:11.534387 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:11.534210    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 20 10:32:11.534617 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:11.534603    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-npdx9\""
Jul 20 10:32:11.542220 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:11.542199    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws"]
Jul 20 10:32:11.647304 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:11.647265    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f393f1ee-7ac2-428a-a1b4-d3eb85223f02-proxy-tls\") pod \"switch-graph-78ab0-55d644b55b-t2xws\" (UID: \"f393f1ee-7ac2-428a-a1b4-d3eb85223f02\") " pod="kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws"
Jul 20 10:32:11.647482 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:11.647311    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f393f1ee-7ac2-428a-a1b4-d3eb85223f02-openshift-service-ca-bundle\") pod \"switch-graph-78ab0-55d644b55b-t2xws\" (UID: \"f393f1ee-7ac2-428a-a1b4-d3eb85223f02\") " pod="kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws"
Jul 20 10:32:11.748439 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:11.748401    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f393f1ee-7ac2-428a-a1b4-d3eb85223f02-proxy-tls\") pod \"switch-graph-78ab0-55d644b55b-t2xws\" (UID: \"f393f1ee-7ac2-428a-a1b4-d3eb85223f02\") " pod="kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws"
Jul 20 10:32:11.748439 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:11.748444    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f393f1ee-7ac2-428a-a1b4-d3eb85223f02-openshift-service-ca-bundle\") pod \"switch-graph-78ab0-55d644b55b-t2xws\" (UID: \"f393f1ee-7ac2-428a-a1b4-d3eb85223f02\") " pod="kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws"
Jul 20 10:32:11.748681 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:32:11.748552    2561 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-78ab0-serving-cert: secret "switch-graph-78ab0-serving-cert" not found
Jul 20 10:32:11.748681 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:32:11.748634    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f393f1ee-7ac2-428a-a1b4-d3eb85223f02-proxy-tls podName:f393f1ee-7ac2-428a-a1b4-d3eb85223f02 nodeName:}" failed. No retries permitted until 2026-07-20 10:32:12.248614511 +0000 UTC m=+2105.965529772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/f393f1ee-7ac2-428a-a1b4-d3eb85223f02-proxy-tls") pod "switch-graph-78ab0-55d644b55b-t2xws" (UID: "f393f1ee-7ac2-428a-a1b4-d3eb85223f02") : secret "switch-graph-78ab0-serving-cert" not found
Jul 20 10:32:11.749155 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:11.749136    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f393f1ee-7ac2-428a-a1b4-d3eb85223f02-openshift-service-ca-bundle\") pod \"switch-graph-78ab0-55d644b55b-t2xws\" (UID: \"f393f1ee-7ac2-428a-a1b4-d3eb85223f02\") " pod="kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws"
Jul 20 10:32:12.251589 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:12.251544    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f393f1ee-7ac2-428a-a1b4-d3eb85223f02-proxy-tls\") pod \"switch-graph-78ab0-55d644b55b-t2xws\" (UID: \"f393f1ee-7ac2-428a-a1b4-d3eb85223f02\") " pod="kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws"
Jul 20 10:32:12.254256 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:12.254226    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f393f1ee-7ac2-428a-a1b4-d3eb85223f02-proxy-tls\") pod \"switch-graph-78ab0-55d644b55b-t2xws\" (UID: \"f393f1ee-7ac2-428a-a1b4-d3eb85223f02\") " pod="kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws"
Jul 20 10:32:12.442323 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:12.442288    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws"
Jul 20 10:32:12.572147 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:12.572116    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws"]
Jul 20 10:32:12.575417 ip-10-0-138-143 kubenswrapper[2561]: W0720 10:32:12.575391    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf393f1ee_7ac2_428a_a1b4_d3eb85223f02.slice/crio-75c27a64c3a7dc1d0696eea96bf19d26f673150da85e9b4cfc04e19e841bcbca WatchSource:0}: Error finding container 75c27a64c3a7dc1d0696eea96bf19d26f673150da85e9b4cfc04e19e841bcbca: Status 404 returned error can't find the container with id 75c27a64c3a7dc1d0696eea96bf19d26f673150da85e9b4cfc04e19e841bcbca
Jul 20 10:32:12.613011 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:12.612968    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws" event={"ID":"f393f1ee-7ac2-428a-a1b4-d3eb85223f02","Type":"ContainerStarted","Data":"75c27a64c3a7dc1d0696eea96bf19d26f673150da85e9b4cfc04e19e841bcbca"}
Jul 20 10:32:13.617660 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:13.617623    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws" event={"ID":"f393f1ee-7ac2-428a-a1b4-d3eb85223f02","Type":"ContainerStarted","Data":"49cc5fdbe3983a17441ccc6228dec91c892334c55a2cf56a359b2eca7fed89e2"}
Jul 20 10:32:13.618104 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:13.617696    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws"
Jul 20 10:32:13.640958 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:13.640909    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws" podStartSLOduration=2.640872538 podStartE2EDuration="2.640872538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:32:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:32:13.638942462 +0000 UTC m=+2107.355857726" watchObservedRunningTime="2026-07-20 10:32:13.640872538 +0000 UTC m=+2107.357787807"
Jul 20 10:32:19.627194 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:19.627168    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws"
Jul 20 10:32:32.222618 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:32.222578    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd"]
Jul 20 10:32:32.225861 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:32.225844    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd"
Jul 20 10:32:32.229809 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:32.229780    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-6e423-serving-cert\""
Jul 20 10:32:32.229957 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:32.229805    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-6e423-kube-rbac-proxy-sar-config\""
Jul 20 10:32:32.251923 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:32.251904    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd"]
Jul 20 10:32:32.290419 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:32.290383    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764-openshift-service-ca-bundle\") pod \"splitter-graph-6e423-b7859bb99-xcxhd\" (UID: \"8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764\") " pod="kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd"
Jul 20 10:32:32.290559 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:32.290441    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764-proxy-tls\") pod \"splitter-graph-6e423-b7859bb99-xcxhd\" (UID: \"8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764\") " pod="kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd"
Jul 20 10:32:32.391334 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:32.391299    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764-openshift-service-ca-bundle\") pod \"splitter-graph-6e423-b7859bb99-xcxhd\" (UID: \"8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764\") " pod="kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd"
Jul 20 10:32:32.391481 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:32.391347    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764-proxy-tls\") pod \"splitter-graph-6e423-b7859bb99-xcxhd\" (UID: \"8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764\") " pod="kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd"
Jul 20 10:32:32.391925 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:32.391905    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764-openshift-service-ca-bundle\") pod \"splitter-graph-6e423-b7859bb99-xcxhd\" (UID: \"8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764\") " pod="kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd"
Jul 20 10:32:32.393604 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:32.393585    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764-proxy-tls\") pod \"splitter-graph-6e423-b7859bb99-xcxhd\" (UID: \"8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764\") " pod="kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd"
Jul 20 10:32:32.535913 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:32.535865    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd"
Jul 20 10:32:32.663951 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:32.663774    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd"]
Jul 20 10:32:32.666542 ip-10-0-138-143 kubenswrapper[2561]: W0720 10:32:32.666511    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ffe3d4a_bf07_41a8_b3a0_cf24cea8b764.slice/crio-ba54d3a9dc99a36f9f724210903394e3818f1b2131ad11a4ee2483891bd02423 WatchSource:0}: Error finding container ba54d3a9dc99a36f9f724210903394e3818f1b2131ad11a4ee2483891bd02423: Status 404 returned error can't find the container with id ba54d3a9dc99a36f9f724210903394e3818f1b2131ad11a4ee2483891bd02423
Jul 20 10:32:32.687369 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:32.687342    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd" event={"ID":"8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764","Type":"ContainerStarted","Data":"ba54d3a9dc99a36f9f724210903394e3818f1b2131ad11a4ee2483891bd02423"}
Jul 20 10:32:33.693248 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:33.693213    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd" event={"ID":"8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764","Type":"ContainerStarted","Data":"a84c20b7dc0ccdc134f56e384281c8de3af80e97d3fe834ccef66d81241e5315"}
Jul 20 10:32:33.693714 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:33.693380    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd"
Jul 20 10:32:33.710403 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:33.710359    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd" podStartSLOduration=1.710344231 podStartE2EDuration="1.710344231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:32:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:32:33.709664775 +0000 UTC m=+2127.426580063" watchObservedRunningTime="2026-07-20 10:32:33.710344231 +0000 UTC m=+2127.427259500"
Jul 20 10:32:39.703173 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:32:39.703138    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd"
Jul 20 10:40:46.751169 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:40:46.751089    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd"]
Jul 20 10:40:46.751653 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:40:46.751316    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd" podUID="8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764" containerName="splitter-graph-6e423" containerID="cri-o://a84c20b7dc0ccdc134f56e384281c8de3af80e97d3fe834ccef66d81241e5315" gracePeriod=30
Jul 20 10:40:49.701445 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:40:49.701403    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd" podUID="8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764" containerName="splitter-graph-6e423" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:40:54.701116 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:40:54.701077    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd" podUID="8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764" containerName="splitter-graph-6e423" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:40:59.701855 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:40:59.701809    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd" podUID="8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764" containerName="splitter-graph-6e423" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:40:59.702321 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:40:59.701946    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd"
Jul 20 10:41:04.701225 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:41:04.701180    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd" podUID="8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764" containerName="splitter-graph-6e423" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:41:09.701532 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:41:09.701492    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd" podUID="8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764" containerName="splitter-graph-6e423" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:41:14.702043 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:41:14.701991    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd" podUID="8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764" containerName="splitter-graph-6e423" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:41:16.891616 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:41:16.891586    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd"
Jul 20 10:41:16.995757 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:41:16.995721    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764-openshift-service-ca-bundle\") pod \"8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764\" (UID: \"8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764\") "
Jul 20 10:41:16.995935 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:41:16.995786    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764-proxy-tls\") pod \"8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764\" (UID: \"8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764\") "
Jul 20 10:41:16.996095 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:41:16.996070    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764" (UID: "8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 10:41:16.997766 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:41:16.997734    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764" (UID: "8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:41:17.096604 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:41:17.096546    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764-openshift-service-ca-bundle\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:41:17.096604 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:41:17.096574    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764-proxy-tls\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:41:17.657215 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:41:17.657181    2561 generic.go:356] "Generic (PLEG): container finished" podID="8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764" containerID="a84c20b7dc0ccdc134f56e384281c8de3af80e97d3fe834ccef66d81241e5315" exitCode=0
Jul 20 10:41:17.657475 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:41:17.657214    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd" event={"ID":"8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764","Type":"ContainerDied","Data":"a84c20b7dc0ccdc134f56e384281c8de3af80e97d3fe834ccef66d81241e5315"}
Jul 20 10:41:17.657475 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:41:17.657232    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd"
Jul 20 10:41:17.657475 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:41:17.657281    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd" event={"ID":"8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764","Type":"ContainerDied","Data":"ba54d3a9dc99a36f9f724210903394e3818f1b2131ad11a4ee2483891bd02423"}
Jul 20 10:41:17.657475 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:41:17.657313    2561 scope.go:117] "RemoveContainer" containerID="a84c20b7dc0ccdc134f56e384281c8de3af80e97d3fe834ccef66d81241e5315"
Jul 20 10:41:17.667387 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:41:17.667359    2561 scope.go:117] "RemoveContainer" containerID="a84c20b7dc0ccdc134f56e384281c8de3af80e97d3fe834ccef66d81241e5315"
Jul 20 10:41:17.667707 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:41:17.667687    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a84c20b7dc0ccdc134f56e384281c8de3af80e97d3fe834ccef66d81241e5315\": container with ID starting with a84c20b7dc0ccdc134f56e384281c8de3af80e97d3fe834ccef66d81241e5315 not found: ID does not exist" containerID="a84c20b7dc0ccdc134f56e384281c8de3af80e97d3fe834ccef66d81241e5315"
Jul 20 10:41:17.667778 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:41:17.667716    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a84c20b7dc0ccdc134f56e384281c8de3af80e97d3fe834ccef66d81241e5315"} err="failed to get container status \"a84c20b7dc0ccdc134f56e384281c8de3af80e97d3fe834ccef66d81241e5315\": rpc error: code = NotFound desc = could not find container \"a84c20b7dc0ccdc134f56e384281c8de3af80e97d3fe834ccef66d81241e5315\": container with ID starting with a84c20b7dc0ccdc134f56e384281c8de3af80e97d3fe834ccef66d81241e5315 not found: ID does not exist"
Jul 20 10:41:17.681292 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:41:17.681272    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd"]
Jul 20 10:41:17.685162 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:41:17.685143    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-6e423-b7859bb99-xcxhd"]
Jul 20 10:41:18.743498 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:41:18.743458    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764" path="/var/lib/kubelet/pods/8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764/volumes"
Jul 20 10:48:30.538428 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:48:30.538388    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws"]
Jul 20 10:48:30.539049 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:48:30.538605    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws" podUID="f393f1ee-7ac2-428a-a1b4-d3eb85223f02" containerName="switch-graph-78ab0" containerID="cri-o://49cc5fdbe3983a17441ccc6228dec91c892334c55a2cf56a359b2eca7fed89e2" gracePeriod=30
Jul 20 10:48:34.625436 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:48:34.625395    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws" podUID="f393f1ee-7ac2-428a-a1b4-d3eb85223f02" containerName="switch-graph-78ab0" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:48:39.625575 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:48:39.625536    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws" podUID="f393f1ee-7ac2-428a-a1b4-d3eb85223f02" containerName="switch-graph-78ab0" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:48:44.626242 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:48:44.626193    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws" podUID="f393f1ee-7ac2-428a-a1b4-d3eb85223f02" containerName="switch-graph-78ab0" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:48:44.626637 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:48:44.626318    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws"
Jul 20 10:48:48.100788 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:48:48.100764    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-78ab0-55d644b55b-t2xws_f393f1ee-7ac2-428a-a1b4-d3eb85223f02/switch-graph-78ab0/0.log"
Jul 20 10:48:48.925022 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:48:48.924994    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-78ab0-55d644b55b-t2xws_f393f1ee-7ac2-428a-a1b4-d3eb85223f02/switch-graph-78ab0/0.log"
Jul 20 10:48:49.625502 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:48:49.625465    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws" podUID="f393f1ee-7ac2-428a-a1b4-d3eb85223f02" containerName="switch-graph-78ab0" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:48:49.745846 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:48:49.745808    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-78ab0-55d644b55b-t2xws_f393f1ee-7ac2-428a-a1b4-d3eb85223f02/switch-graph-78ab0/0.log"
Jul 20 10:48:50.560584 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:48:50.560551    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-78ab0-55d644b55b-t2xws_f393f1ee-7ac2-428a-a1b4-d3eb85223f02/switch-graph-78ab0/0.log"
Jul 20 10:48:51.358103 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:48:51.358070    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-78ab0-55d644b55b-t2xws_f393f1ee-7ac2-428a-a1b4-d3eb85223f02/switch-graph-78ab0/0.log"
Jul 20 10:48:52.153572 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:48:52.153543    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-78ab0-55d644b55b-t2xws_f393f1ee-7ac2-428a-a1b4-d3eb85223f02/switch-graph-78ab0/0.log"
Jul 20 10:48:52.939482 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:48:52.939456    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-78ab0-55d644b55b-t2xws_f393f1ee-7ac2-428a-a1b4-d3eb85223f02/switch-graph-78ab0/0.log"
Jul 20 10:48:53.760515 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:48:53.760492    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-78ab0-55d644b55b-t2xws_f393f1ee-7ac2-428a-a1b4-d3eb85223f02/switch-graph-78ab0/0.log"
Jul 20 10:48:54.575362 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:48:54.575324    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-78ab0-55d644b55b-t2xws_f393f1ee-7ac2-428a-a1b4-d3eb85223f02/switch-graph-78ab0/0.log"
Jul 20 10:48:54.625838 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:48:54.625806    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws" podUID="f393f1ee-7ac2-428a-a1b4-d3eb85223f02" containerName="switch-graph-78ab0" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:48:55.400274 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:48:55.400240    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-78ab0-55d644b55b-t2xws_f393f1ee-7ac2-428a-a1b4-d3eb85223f02/switch-graph-78ab0/0.log"
Jul 20 10:48:56.218765 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:48:56.218739    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-78ab0-55d644b55b-t2xws_f393f1ee-7ac2-428a-a1b4-d3eb85223f02/switch-graph-78ab0/0.log"
Jul 20 10:48:57.027010 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:48:57.026977    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-78ab0-55d644b55b-t2xws_f393f1ee-7ac2-428a-a1b4-d3eb85223f02/switch-graph-78ab0/0.log"
Jul 20 10:48:57.828416 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:48:57.828385    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-78ab0-55d644b55b-t2xws_f393f1ee-7ac2-428a-a1b4-d3eb85223f02/switch-graph-78ab0/0.log"
Jul 20 10:48:58.642634 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:48:58.642602    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-78ab0-55d644b55b-t2xws_f393f1ee-7ac2-428a-a1b4-d3eb85223f02/switch-graph-78ab0/0.log"
Jul 20 10:48:59.626358 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:48:59.626317    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws" podUID="f393f1ee-7ac2-428a-a1b4-d3eb85223f02" containerName="switch-graph-78ab0" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 10:49:00.686726 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:00.686703    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws"
Jul 20 10:49:00.773210 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:00.773180    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f393f1ee-7ac2-428a-a1b4-d3eb85223f02-proxy-tls\") pod \"f393f1ee-7ac2-428a-a1b4-d3eb85223f02\" (UID: \"f393f1ee-7ac2-428a-a1b4-d3eb85223f02\") "
Jul 20 10:49:00.773373 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:00.773217    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f393f1ee-7ac2-428a-a1b4-d3eb85223f02-openshift-service-ca-bundle\") pod \"f393f1ee-7ac2-428a-a1b4-d3eb85223f02\" (UID: \"f393f1ee-7ac2-428a-a1b4-d3eb85223f02\") "
Jul 20 10:49:00.773692 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:00.773664    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f393f1ee-7ac2-428a-a1b4-d3eb85223f02-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "f393f1ee-7ac2-428a-a1b4-d3eb85223f02" (UID: "f393f1ee-7ac2-428a-a1b4-d3eb85223f02"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 10:49:00.775136 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:00.775110    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f393f1ee-7ac2-428a-a1b4-d3eb85223f02-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "f393f1ee-7ac2-428a-a1b4-d3eb85223f02" (UID: "f393f1ee-7ac2-428a-a1b4-d3eb85223f02"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:49:00.874408 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:00.874316    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f393f1ee-7ac2-428a-a1b4-d3eb85223f02-proxy-tls\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:49:00.874408 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:00.874349    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f393f1ee-7ac2-428a-a1b4-d3eb85223f02-openshift-service-ca-bundle\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 20 10:49:01.355961 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:01.355925    2561 generic.go:356] "Generic (PLEG): container finished" podID="f393f1ee-7ac2-428a-a1b4-d3eb85223f02" containerID="49cc5fdbe3983a17441ccc6228dec91c892334c55a2cf56a359b2eca7fed89e2" exitCode=0
Jul 20 10:49:01.355961 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:01.355965    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws"
Jul 20 10:49:01.356158 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:01.356013    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws" event={"ID":"f393f1ee-7ac2-428a-a1b4-d3eb85223f02","Type":"ContainerDied","Data":"49cc5fdbe3983a17441ccc6228dec91c892334c55a2cf56a359b2eca7fed89e2"}
Jul 20 10:49:01.356158 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:01.356058    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws" event={"ID":"f393f1ee-7ac2-428a-a1b4-d3eb85223f02","Type":"ContainerDied","Data":"75c27a64c3a7dc1d0696eea96bf19d26f673150da85e9b4cfc04e19e841bcbca"}
Jul 20 10:49:01.356158 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:01.356078    2561 scope.go:117] "RemoveContainer" containerID="49cc5fdbe3983a17441ccc6228dec91c892334c55a2cf56a359b2eca7fed89e2"
Jul 20 10:49:01.364442 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:01.364418    2561 scope.go:117] "RemoveContainer" containerID="49cc5fdbe3983a17441ccc6228dec91c892334c55a2cf56a359b2eca7fed89e2"
Jul 20 10:49:01.364722 ip-10-0-138-143 kubenswrapper[2561]: E0720 10:49:01.364701    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49cc5fdbe3983a17441ccc6228dec91c892334c55a2cf56a359b2eca7fed89e2\": container with ID starting with 49cc5fdbe3983a17441ccc6228dec91c892334c55a2cf56a359b2eca7fed89e2 not found: ID does not exist" containerID="49cc5fdbe3983a17441ccc6228dec91c892334c55a2cf56a359b2eca7fed89e2"
Jul 20 10:49:01.364816 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:01.364730    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49cc5fdbe3983a17441ccc6228dec91c892334c55a2cf56a359b2eca7fed89e2"} err="failed to get container status \"49cc5fdbe3983a17441ccc6228dec91c892334c55a2cf56a359b2eca7fed89e2\": rpc error: code = NotFound desc = could not find container \"49cc5fdbe3983a17441ccc6228dec91c892334c55a2cf56a359b2eca7fed89e2\": container with ID starting with 49cc5fdbe3983a17441ccc6228dec91c892334c55a2cf56a359b2eca7fed89e2 not found: ID does not exist"
Jul 20 10:49:01.375503 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:01.375475    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws"]
Jul 20 10:49:01.379219 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:01.379193    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-78ab0-55d644b55b-t2xws"]
Jul 20 10:49:02.748634 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:02.748597    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f393f1ee-7ac2-428a-a1b4-d3eb85223f02" path="/var/lib/kubelet/pods/f393f1ee-7ac2-428a-a1b4-d3eb85223f02/volumes"
Jul 20 10:49:06.179444 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:06.179410    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-29gzc_559d8262-0cc6-4900-a6d2-52167877eb3c/global-pull-secret-syncer/0.log"
Jul 20 10:49:06.330838 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:06.330804    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6bh7x_b63f200f-1a84-43ec-95f8-d33f0f50cc20/konnectivity-agent/0.log"
Jul 20 10:49:06.405259 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:06.405234    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-143.ec2.internal_b627e4843adfbd64039515f41cb64e53/haproxy/0.log"
Jul 20 10:49:11.038691 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:11.038658    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6tz26_cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6/node-exporter/0.log"
Jul 20 10:49:11.061576 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:11.061548    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6tz26_cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6/kube-rbac-proxy/0.log"
Jul 20 10:49:11.081764 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:11.081746    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6tz26_cc3e1c08-a5e6-4ca8-9cd4-0dee6e0defe6/init-textfile/0.log"
Jul 20 10:49:11.286566 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:11.286531    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-djlzb_6a075bbf-41cc-4538-aa11-365447990fa1/kube-rbac-proxy-main/0.log"
Jul 20 10:49:11.309488 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:11.309411    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-djlzb_6a075bbf-41cc-4538-aa11-365447990fa1/kube-rbac-proxy-self/0.log"
Jul 20 10:49:11.329257 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:11.329214    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-djlzb_6a075bbf-41cc-4538-aa11-365447990fa1/openshift-state-metrics/0.log"
Jul 20 10:49:11.523246 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:11.523203    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-xh4xl_6d3122d4-7c16-42e0-916a-72c37e89a6e0/prometheus-operator/0.log"
Jul 20 10:49:11.541433 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:11.541399    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-xh4xl_6d3122d4-7c16-42e0-916a-72c37e89a6e0/kube-rbac-proxy/0.log"
Jul 20 10:49:14.250573 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:14.250540    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f7trj/perf-node-gather-daemonset-2twkt"]
Jul 20 10:49:14.250977 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:14.250832    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f393f1ee-7ac2-428a-a1b4-d3eb85223f02" containerName="switch-graph-78ab0"
Jul 20 10:49:14.250977 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:14.250843    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f393f1ee-7ac2-428a-a1b4-d3eb85223f02" containerName="switch-graph-78ab0"
Jul 20 10:49:14.250977 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:14.250868    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764" containerName="splitter-graph-6e423"
Jul 20 10:49:14.250977 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:14.250890    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764" containerName="splitter-graph-6e423"
Jul 20 10:49:14.250977 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:14.250954    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f393f1ee-7ac2-428a-a1b4-d3eb85223f02" containerName="switch-graph-78ab0"
Jul 20 10:49:14.250977 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:14.250967    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ffe3d4a-bf07-41a8-b3a0-cf24cea8b764" containerName="splitter-graph-6e423"
Jul 20 10:49:14.255233 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:14.255215    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-2twkt"
Jul 20 10:49:14.257294 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:14.257275    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f7trj\"/\"openshift-service-ca.crt\""
Jul 20 10:49:14.257385 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:14.257356    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-f7trj\"/\"default-dockercfg-rjvgf\""
Jul 20 10:49:14.257680 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:14.257665    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f7trj\"/\"kube-root-ca.crt\""
Jul 20 10:49:14.264118 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:14.264096    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f7trj/perf-node-gather-daemonset-2twkt"]
Jul 20 10:49:14.281739 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:14.281711    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn6g5\" (UniqueName: \"kubernetes.io/projected/309c630f-3541-4a1c-92da-de2916ae31a5-kube-api-access-xn6g5\") pod \"perf-node-gather-daemonset-2twkt\" (UID: \"309c630f-3541-4a1c-92da-de2916ae31a5\") " pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-2twkt"
Jul 20 10:49:14.281905 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:14.281751    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/309c630f-3541-4a1c-92da-de2916ae31a5-podres\") pod \"perf-node-gather-daemonset-2twkt\" (UID: \"309c630f-3541-4a1c-92da-de2916ae31a5\") " pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-2twkt"
Jul 20 10:49:14.281905 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:14.281821    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/309c630f-3541-4a1c-92da-de2916ae31a5-lib-modules\") pod \"perf-node-gather-daemonset-2twkt\" (UID: \"309c630f-3541-4a1c-92da-de2916ae31a5\") " pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-2twkt"
Jul 20 10:49:14.281905 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:14.281850    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/309c630f-3541-4a1c-92da-de2916ae31a5-proc\") pod \"perf-node-gather-daemonset-2twkt\" (UID: \"309c630f-3541-4a1c-92da-de2916ae31a5\") " pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-2twkt"
Jul 20 10:49:14.282034 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:14.281931    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/309c630f-3541-4a1c-92da-de2916ae31a5-sys\") pod \"perf-node-gather-daemonset-2twkt\" (UID: \"309c630f-3541-4a1c-92da-de2916ae31a5\") " pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-2twkt"
Jul 20 10:49:14.382761 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:14.382718    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/309c630f-3541-4a1c-92da-de2916ae31a5-sys\") pod \"perf-node-gather-daemonset-2twkt\" (UID: \"309c630f-3541-4a1c-92da-de2916ae31a5\") " pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-2twkt"
Jul 20 10:49:14.382972 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:14.382804    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn6g5\" (UniqueName: \"kubernetes.io/projected/309c630f-3541-4a1c-92da-de2916ae31a5-kube-api-access-xn6g5\") pod \"perf-node-gather-daemonset-2twkt\" (UID: \"309c630f-3541-4a1c-92da-de2916ae31a5\") " pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-2twkt"
Jul 20 10:49:14.382972 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:14.382831    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/309c630f-3541-4a1c-92da-de2916ae31a5-podres\") pod \"perf-node-gather-daemonset-2twkt\" (UID: \"309c630f-3541-4a1c-92da-de2916ae31a5\") " pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-2twkt"
Jul 20 10:49:14.382972 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:14.382848    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/309c630f-3541-4a1c-92da-de2916ae31a5-sys\") pod \"perf-node-gather-daemonset-2twkt\" (UID: \"309c630f-3541-4a1c-92da-de2916ae31a5\") " pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-2twkt"
Jul 20 10:49:14.382972 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:14.382871    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/309c630f-3541-4a1c-92da-de2916ae31a5-lib-modules\") pod \"perf-node-gather-daemonset-2twkt\" (UID: \"309c630f-3541-4a1c-92da-de2916ae31a5\") " pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-2twkt"
Jul 20 10:49:14.382972 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:14.382910    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/309c630f-3541-4a1c-92da-de2916ae31a5-proc\") pod \"perf-node-gather-daemonset-2twkt\" (UID: \"309c630f-3541-4a1c-92da-de2916ae31a5\") " pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-2twkt"
Jul 20 10:49:14.383189 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:14.382978    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/309c630f-3541-4a1c-92da-de2916ae31a5-proc\") pod \"perf-node-gather-daemonset-2twkt\" (UID: \"309c630f-3541-4a1c-92da-de2916ae31a5\") " pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-2twkt"
Jul 20 10:49:14.383189 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:14.383001    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/309c630f-3541-4a1c-92da-de2916ae31a5-podres\") pod \"perf-node-gather-daemonset-2twkt\" (UID: \"309c630f-3541-4a1c-92da-de2916ae31a5\") " pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-2twkt"
Jul 20 10:49:14.383189 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:14.383025    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/309c630f-3541-4a1c-92da-de2916ae31a5-lib-modules\") pod \"perf-node-gather-daemonset-2twkt\" (UID: \"309c630f-3541-4a1c-92da-de2916ae31a5\") " pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-2twkt"
Jul 20 10:49:14.391140 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:14.391120    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn6g5\" (UniqueName: \"kubernetes.io/projected/309c630f-3541-4a1c-92da-de2916ae31a5-kube-api-access-xn6g5\") pod \"perf-node-gather-daemonset-2twkt\" (UID: \"309c630f-3541-4a1c-92da-de2916ae31a5\") " pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-2twkt"
Jul 20 10:49:14.564726 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:14.564696    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-2twkt"
Jul 20 10:49:14.705049 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:14.705021    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f7trj/perf-node-gather-daemonset-2twkt"]
Jul 20 10:49:14.707540 ip-10-0-138-143 kubenswrapper[2561]: W0720 10:49:14.707509    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod309c630f_3541_4a1c_92da_de2916ae31a5.slice/crio-f5de0fb35ed0d58aec3ef401d1e3fa5e594678a25c16ffae0fd23dba969786cf WatchSource:0}: Error finding container f5de0fb35ed0d58aec3ef401d1e3fa5e594678a25c16ffae0fd23dba969786cf: Status 404 returned error can't find the container with id f5de0fb35ed0d58aec3ef401d1e3fa5e594678a25c16ffae0fd23dba969786cf
Jul 20 10:49:15.408196 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:15.408156    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-2twkt" event={"ID":"309c630f-3541-4a1c-92da-de2916ae31a5","Type":"ContainerStarted","Data":"14f7677dca14c7391baf2c1e4d7b591b44958b31aaf762d6e5c1b5254b1ebfae"}
Jul 20 10:49:15.408598 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:15.408206    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-2twkt" event={"ID":"309c630f-3541-4a1c-92da-de2916ae31a5","Type":"ContainerStarted","Data":"f5de0fb35ed0d58aec3ef401d1e3fa5e594678a25c16ffae0fd23dba969786cf"}
Jul 20 10:49:15.408598 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:15.408297    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-2twkt"
Jul 20 10:49:15.429702 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:15.429648    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-2twkt" podStartSLOduration=1.429633994 podStartE2EDuration="1.429633994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 10:49:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:49:15.429433765 +0000 UTC m=+3129.146349045" watchObservedRunningTime="2026-07-20 10:49:15.429633994 +0000 UTC m=+3129.146549262"
Jul 20 10:49:15.483179 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:15.483156    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nqn9s_906abe6c-f9a3-4ef8-80de-43d9ba0f79b2/dns/0.log"
Jul 20 10:49:15.508148 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:15.508127    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nqn9s_906abe6c-f9a3-4ef8-80de-43d9ba0f79b2/kube-rbac-proxy/0.log"
Jul 20 10:49:15.558261 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:15.558239    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hp5fq_74a3c5ba-e636-47df-b3cd-1ad53902bc5a/dns-node-resolver/0.log"
Jul 20 10:49:15.989045 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:15.989016    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-d66598b74-8fxp2_82a51935-5e62-4145-b5bb-a0553481b469/registry/0.log"
Jul 20 10:49:16.056529 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:16.056502    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gxfkw_c7e59906-508b-40d8-a8e4-4244d7c1cbbd/node-ca/0.log"
Jul 20 10:49:16.813487 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:16.813462    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-58c5b89866-b7ptf_ad001118-5c0b-498b-a99c-d04c846350bd/router/0.log"
Jul 20 10:49:17.142864 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:17.142786    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8w7nk_c734c345-3620-4c06-9f56-5178fd4ac3a8/serve-healthcheck-canary/0.log"
Jul 20 10:49:17.682402 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:17.682372    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pnzs5_2b58cbaa-28eb-4c6f-af79-543c2c843f35/kube-rbac-proxy/0.log"
Jul 20 10:49:17.702982 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:17.702959    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pnzs5_2b58cbaa-28eb-4c6f-af79-543c2c843f35/exporter/0.log"
Jul 20 10:49:17.724844 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:17.724821    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pnzs5_2b58cbaa-28eb-4c6f-af79-543c2c843f35/extractor/0.log"
Jul 20 10:49:19.880667 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:19.880641    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-654c557856-qw685_cb2fc65e-0e52-466b-9454-d930e6c059fc/manager/0.log"
Jul 20 10:49:19.901523 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:19.901501    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-fd65d7d6-94xhk_588ff7f0-0116-4a77-b204-30ad932bbc64/server/0.log"
Jul 20 10:49:21.421784 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:21.421756    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-2twkt"
Jul 20 10:49:24.328606 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:24.328578    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-8gn2c_9b9a399a-33c9-4c5f-a918-521c8b328583/kube-storage-version-migrator-operator/1.log"
Jul 20 10:49:24.329596 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:24.329578    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-8gn2c_9b9a399a-33c9-4c5f-a918-521c8b328583/kube-storage-version-migrator-operator/0.log"
Jul 20 10:49:25.248430 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:25.248407    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9msk6_d4ca0bdc-644a-4cc7-8e2c-3231dd869ec2/kube-multus/0.log"
Jul 20 10:49:25.450761 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:25.450685    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gx8fw_ad8a980a-797b-413a-9a49-c8d2fd36e4f5/kube-multus-additional-cni-plugins/0.log"
Jul 20 10:49:25.473948 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:25.473922    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gx8fw_ad8a980a-797b-413a-9a49-c8d2fd36e4f5/egress-router-binary-copy/0.log"
Jul 20 10:49:25.495804 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:25.495783    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gx8fw_ad8a980a-797b-413a-9a49-c8d2fd36e4f5/cni-plugins/0.log"
Jul 20 10:49:25.516594 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:25.516569    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gx8fw_ad8a980a-797b-413a-9a49-c8d2fd36e4f5/bond-cni-plugin/0.log"
Jul 20 10:49:25.542387 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:25.542359    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gx8fw_ad8a980a-797b-413a-9a49-c8d2fd36e4f5/routeoverride-cni/0.log"
Jul 20 10:49:25.562930 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:25.562908    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gx8fw_ad8a980a-797b-413a-9a49-c8d2fd36e4f5/whereabouts-cni-bincopy/0.log"
Jul 20 10:49:25.582935 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:25.582911    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gx8fw_ad8a980a-797b-413a-9a49-c8d2fd36e4f5/whereabouts-cni/0.log"
Jul 20 10:49:25.861049 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:25.861022    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w778v_10552df3-551a-4023-ad75-003c6559ce60/network-metrics-daemon/0.log"
Jul 20 10:49:25.890915 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:25.890888    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w778v_10552df3-551a-4023-ad75-003c6559ce60/kube-rbac-proxy/0.log"
Jul 20 10:49:26.809481 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:26.809454    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d48r5_4d1f349c-9b09-4f4c-9e38-403589ac8d3f/ovn-controller/0.log"
Jul 20 10:49:26.829305 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:26.829284    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d48r5_4d1f349c-9b09-4f4c-9e38-403589ac8d3f/ovn-acl-logging/0.log"
Jul 20 10:49:26.852750 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:26.852728    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d48r5_4d1f349c-9b09-4f4c-9e38-403589ac8d3f/kube-rbac-proxy-node/0.log"
Jul 20 10:49:26.873483 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:26.873444    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d48r5_4d1f349c-9b09-4f4c-9e38-403589ac8d3f/kube-rbac-proxy-ovn-metrics/0.log"
Jul 20 10:49:26.892392 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:26.892367    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d48r5_4d1f349c-9b09-4f4c-9e38-403589ac8d3f/northd/0.log"
Jul 20 10:49:26.911713 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:26.911688    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d48r5_4d1f349c-9b09-4f4c-9e38-403589ac8d3f/nbdb/0.log"
Jul 20 10:49:26.932542 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:26.932523    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d48r5_4d1f349c-9b09-4f4c-9e38-403589ac8d3f/sbdb/0.log"
Jul 20 10:49:26.976370 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:26.976342    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d48r5_4d1f349c-9b09-4f4c-9e38-403589ac8d3f/ovnkube-controller/0.log"
Jul 20 10:49:28.161295 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:28.161262    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-gr6fz_d8343adb-7f45-419c-b894-e9b307ecb5fd/network-check-target-container/0.log"
Jul 20 10:49:29.038761 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:29.038734    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-xbpjz_82acb4fa-dae4-4dfd-b56b-b4df34feddd4/iptables-alerter/0.log"
Jul 20 10:49:29.599370 ip-10-0-138-143 kubenswrapper[2561]: I0720 10:49:29.599345    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-hbqt8_762b4f6c-bad2-4382-a8c3-6944d0177fd3/tuned/0.log"