Jun 11 19:23:34.690798 ip-10-0-140-223 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jun 11 19:23:34.690808 ip-10-0-140-223 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jun 11 19:23:34.690815 ip-10-0-140-223 systemd[1]: kubelet.service: Failed with result 'resources'.
Jun 11 19:23:34.691075 ip-10-0-140-223 systemd[1]: Failed to start Kubernetes Kubelet.
Jun 11 19:23:44.930794 ip-10-0-140-223 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jun 11 19:23:44.930818 ip-10-0-140-223 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot fd27bcddfb2846f897decff272786c1d --
Jun 11 19:26:04.478203 ip-10-0-140-223 systemd[1]: Starting Kubernetes Kubelet...
Jun 11 19:26:04.898382 ip-10-0-140-223 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 11 19:26:04.898382 ip-10-0-140-223 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 11 19:26:04.898382 ip-10-0-140-223 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 11 19:26:04.898382 ip-10-0-140-223 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 11 19:26:04.898382 ip-10-0-140-223 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 11 19:26:04.898382 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.897909    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 11 19:26:04.903047 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903024    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 11 19:26:04.903047 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903043    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 11 19:26:04.903047 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903048    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 11 19:26:04.903047 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903052    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 11 19:26:04.903280 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903058    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 11 19:26:04.903280 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903063    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 11 19:26:04.903280 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903067    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 11 19:26:04.903280 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903071    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 11 19:26:04.903280 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903075    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 11 19:26:04.903280 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903079    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 11 19:26:04.903280 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903082    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 11 19:26:04.903280 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903086    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 11 19:26:04.903280 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903090    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 11 19:26:04.903280 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903094    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 11 19:26:04.903280 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903098    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 11 19:26:04.903280 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903102    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 11 19:26:04.903280 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903106    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 11 19:26:04.903280 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903110    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 11 19:26:04.903280 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903114    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 11 19:26:04.903280 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903118    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 11 19:26:04.903280 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903126    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 11 19:26:04.903280 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903132    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 11 19:26:04.903280 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903136    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 11 19:26:04.903280 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903141    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 11 19:26:04.904102 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903145    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 11 19:26:04.904102 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903149    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 11 19:26:04.904102 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903152    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 11 19:26:04.904102 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903159    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 11 19:26:04.904102 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903163    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 11 19:26:04.904102 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903167    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 11 19:26:04.904102 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903171    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 11 19:26:04.904102 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903176    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 11 19:26:04.904102 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903181    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 11 19:26:04.904102 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903186    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 11 19:26:04.904102 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903190    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 11 19:26:04.904102 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903195    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 11 19:26:04.904102 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903200    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 11 19:26:04.904102 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903204    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 11 19:26:04.904102 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903212    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 11 19:26:04.904102 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903218    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 11 19:26:04.904102 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903223    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 11 19:26:04.904102 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903228    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 11 19:26:04.904102 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903233    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 11 19:26:04.904906 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903238    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 11 19:26:04.904906 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903243    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 11 19:26:04.904906 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903247    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 11 19:26:04.904906 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903251    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 11 19:26:04.904906 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903256    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 11 19:26:04.904906 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903260    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 11 19:26:04.904906 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903264    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 11 19:26:04.904906 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903269    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 11 19:26:04.904906 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903273    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 11 19:26:04.904906 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903277    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 11 19:26:04.904906 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903282    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 11 19:26:04.904906 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903286    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 11 19:26:04.904906 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903291    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 11 19:26:04.904906 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903295    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 11 19:26:04.904906 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903299    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 11 19:26:04.904906 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903304    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 11 19:26:04.904906 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903310    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 11 19:26:04.904906 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903314    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 11 19:26:04.904906 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903319    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 11 19:26:04.904906 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903323    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 11 19:26:04.905755 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903328    2565 feature_gate.go:328] unrecognized feature gate: Example
Jun 11 19:26:04.905755 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903332    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 11 19:26:04.905755 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903337    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 11 19:26:04.905755 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903340    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 11 19:26:04.905755 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903345    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 11 19:26:04.905755 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903349    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 11 19:26:04.905755 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903354    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 11 19:26:04.905755 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903359    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 11 19:26:04.905755 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903363    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 11 19:26:04.905755 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903368    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 11 19:26:04.905755 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903372    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 11 19:26:04.905755 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903376    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 11 19:26:04.905755 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903381    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 11 19:26:04.905755 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903385    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 11 19:26:04.905755 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903391    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 11 19:26:04.905755 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903398    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 11 19:26:04.905755 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903402    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 11 19:26:04.905755 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903406    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 11 19:26:04.905755 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903411    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 11 19:26:04.905755 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903415    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 11 19:26:04.906617 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903420    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 11 19:26:04.906617 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903425    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 11 19:26:04.906617 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903429    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 11 19:26:04.906617 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903434    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 11 19:26:04.906617 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903438    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 11 19:26:04.906617 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903442    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 11 19:26:04.906617 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903446    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 11 19:26:04.906617 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903451    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 11 19:26:04.906617 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903455    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 11 19:26:04.906617 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903459    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 11 19:26:04.906617 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903463    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jun 11 19:26:04.906617 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903467    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 11 19:26:04.906617 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903472    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 11 19:26:04.906617 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903476    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 11 19:26:04.906617 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903480    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 11 19:26:04.906617 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.903484    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 11 19:26:04.906617 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904665    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 11 19:26:04.906617 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904677    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 11 19:26:04.906617 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904682    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 11 19:26:04.906617 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904686    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 11 19:26:04.907538 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904728    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 11 19:26:04.907538 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904735    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 11 19:26:04.907538 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904740    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 11 19:26:04.907538 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904746    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 11 19:26:04.907538 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904751    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 11 19:26:04.907538 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904755    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 11 19:26:04.907538 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904760    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 11 19:26:04.907538 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904765    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 11 19:26:04.907538 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904770    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 11 19:26:04.907538 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904774    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 11 19:26:04.907538 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904778    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 11 19:26:04.907538 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904782    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 11 19:26:04.907538 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904787    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 11 19:26:04.907538 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904792    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 11 19:26:04.907538 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904796    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 11 19:26:04.907538 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904801    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 11 19:26:04.907538 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904805    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 11 19:26:04.907538 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904809    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 11 19:26:04.907538 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904814    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 11 19:26:04.907538 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904818    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 11 19:26:04.908220 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904823    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 11 19:26:04.908220 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904827    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 11 19:26:04.908220 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904832    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 11 19:26:04.908220 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904836    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 11 19:26:04.908220 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904841    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 11 19:26:04.908220 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904845    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 11 19:26:04.908220 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904850    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 11 19:26:04.908220 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904855    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 11 19:26:04.908220 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904859    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 11 19:26:04.908220 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904863    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 11 19:26:04.908220 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904896    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 11 19:26:04.908220 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904902    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 11 19:26:04.908220 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904906    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 11 19:26:04.908220 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904910    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 11 19:26:04.908220 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904914    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 11 19:26:04.908220 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904918    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 11 19:26:04.908220 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904922    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 11 19:26:04.908220 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904926    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 11 19:26:04.908220 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904931    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 11 19:26:04.908803 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904935    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 11 19:26:04.908803 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904943    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 11 19:26:04.908803 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904948    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 11 19:26:04.908803 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904952    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 11 19:26:04.908803 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904957    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 11 19:26:04.908803 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904961    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 11 19:26:04.908803 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904965    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 11 19:26:04.908803 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904971    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 11 19:26:04.908803 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904975    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 11 19:26:04.908803 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904979    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 11 19:26:04.908803 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904986    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 11 19:26:04.908803 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904991    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 11 19:26:04.908803 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.904996    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 11 19:26:04.908803 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905001    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 11 19:26:04.908803 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905006    2565 feature_gate.go:328] unrecognized feature gate: Example
Jun 11 19:26:04.908803 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905011    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 11 19:26:04.908803 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905015    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 11 19:26:04.908803 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905020    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 11 19:26:04.908803 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905024    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 11 19:26:04.909310 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905028    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 11 19:26:04.909310 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905033    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 11 19:26:04.909310 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905037    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 11 19:26:04.909310 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905042    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 11 19:26:04.909310 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905046    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 11 19:26:04.909310 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905050    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 11 19:26:04.909310 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905054    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 11 19:26:04.909310 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905060    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 11 19:26:04.909310 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905065    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jun 11 19:26:04.909310 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905070    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 11 19:26:04.909310 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905076    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 11 19:26:04.909310 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905080    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 11 19:26:04.909310 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905084    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 11 19:26:04.909310 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905088    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 11 19:26:04.909310 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905093    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 11 19:26:04.909310 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905097    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 11 19:26:04.909310 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905101    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 11 19:26:04.909310 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905105    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 11 19:26:04.909310 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905109    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 11 19:26:04.909310 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905113    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 11 19:26:04.910060 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905117    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 11 19:26:04.910060 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905122    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 11 19:26:04.910060 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905127    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 11 19:26:04.910060 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905131    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 11 19:26:04.910060 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905135    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 11 19:26:04.910060 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905139    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 11 19:26:04.910060 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905146    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 11 19:26:04.910060 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905151    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 11 19:26:04.910060 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905157    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 11 19:26:04.910060 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905162    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 11 19:26:04.910060 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905166    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 11 19:26:04.910060 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905170    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 11 19:26:04.910060 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905175    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 11 19:26:04.910060 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905180    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 11 19:26:04.910060 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905184    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 11 19:26:04.910060 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905189    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 11 19:26:04.910060 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905194    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 11 19:26:04.910060 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905827    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 11 19:26:04.910060 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905837    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 11 19:26:04.910060 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905841    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 11 19:26:04.910550 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905846    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 11 19:26:04.910550 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905850    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 11 19:26:04.910550 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905855    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 11 19:26:04.910550 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905859    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 11 19:26:04.910550 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905863    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 11 19:26:04.910550 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905866    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 11 19:26:04.910550 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905871    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 11 19:26:04.910550 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905875    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 11 19:26:04.910550 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905904    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 11 19:26:04.910550 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905910    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 11 19:26:04.910550 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905915    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 11 19:26:04.910550 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905920    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 11 19:26:04.910550 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905925    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 11 19:26:04.910550 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905930    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 11 19:26:04.910550 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905935    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 11 19:26:04.910550 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905938    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 11 19:26:04.910550 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905943    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 11 19:26:04.910550 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905947    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 11 19:26:04.910550 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905951    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 11 19:26:04.910550 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905955    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 11 19:26:04.911183 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905960    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 11 19:26:04.911183 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905964    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 11 19:26:04.911183 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905969    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 11 19:26:04.911183 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905973    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 11 19:26:04.911183 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905978    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 11 19:26:04.911183 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905982    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jun 11 19:26:04.911183 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905987    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 11 19:26:04.911183 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905992    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 11 19:26:04.911183 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.905998    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 11 19:26:04.911183 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906003    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 11 19:26:04.911183 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906008    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 11 19:26:04.911183 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906012    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 11 19:26:04.911183 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906016    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 11 19:26:04.911183 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906020    2565 feature_gate.go:328] unrecognized feature gate: Example
Jun 11 19:26:04.911183 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906025    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 11 19:26:04.911183 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906029    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 11 19:26:04.911183 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906033    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 11 19:26:04.911183 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906038    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 11 19:26:04.911183 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906042    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 11 19:26:04.911183 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906046    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 11 19:26:04.911711 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906050    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 11 19:26:04.911711 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906054    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 11 19:26:04.911711 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906058    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 11 19:26:04.911711 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906063    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 11 19:26:04.911711 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906068    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 11 19:26:04.911711 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906072    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 11 19:26:04.911711 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906079    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 11 19:26:04.911711 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906083    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 11 19:26:04.911711 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906087    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 11 19:26:04.911711 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906091    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 11 19:26:04.911711 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906095    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 11 19:26:04.911711 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906099    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 11 19:26:04.911711 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906104    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 11 19:26:04.911711 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906108    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 11 19:26:04.911711 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906112    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 11 19:26:04.911711 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906116    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 11 19:26:04.911711 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906120    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 11 19:26:04.911711 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906126    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 11 19:26:04.911711 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906130    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 11 19:26:04.912249 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906135    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 11 19:26:04.912249 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906139    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 11 19:26:04.912249 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906144    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 11 19:26:04.912249 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906148    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 11 19:26:04.912249 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906152    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 11 19:26:04.912249 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906156    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 11 19:26:04.912249 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906161    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 11 19:26:04.912249 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906165    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 11 19:26:04.912249 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906169    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 11 19:26:04.912249 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906173    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 11 19:26:04.912249 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906177    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 11 19:26:04.912249 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906181    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 11 19:26:04.912249 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906185    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 11 19:26:04.912249 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906189    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 11 19:26:04.912249 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906193    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 11 19:26:04.912249 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906198    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 11 19:26:04.912249 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906205    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 11 19:26:04.912249 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906210    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 11 19:26:04.912249 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906216    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 11 19:26:04.912249 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906220    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 11 19:26:04.912726 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906229    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 11 19:26:04.912726 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906233    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 11 19:26:04.912726 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906238    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 11 19:26:04.912726 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906242    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 11 19:26:04.912726 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906246    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 11 19:26:04.912726 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906250    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 11 19:26:04.912726 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906254    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 11 19:26:04.912726 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906258    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 11 19:26:04.912726 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906262    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 11 19:26:04.912726 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906269    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 11 19:26:04.912726 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906275    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 11 19:26:04.912726 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906280    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 11 19:26:04.912726 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906285    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 11 19:26:04.912726 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906289    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 11 19:26:04.912726 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906294    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 11 19:26:04.912726 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906298    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 11 19:26:04.912726 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.906302    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 11 19:26:04.912726 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906401    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jun 11 19:26:04.912726 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906413    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 11 19:26:04.912726 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906423    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jun 11 19:26:04.913252 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906430    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 11 19:26:04.913252 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906436    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 11 19:26:04.913252 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906441    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 11 19:26:04.913252 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906448    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 11 19:26:04.913252 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906454    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 11 19:26:04.913252 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906459    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 11 19:26:04.913252 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906464    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 11 19:26:04.913252 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906470    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 11 19:26:04.913252 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906477    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 11 19:26:04.913252 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906482    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 11 19:26:04.913252 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906487    2565 flags.go:64] FLAG: --cgroup-root=""
Jun 11 19:26:04.913252 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906491    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 11 19:26:04.913252 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906496    2565 flags.go:64] FLAG: --client-ca-file=""
Jun 11 19:26:04.913252 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906502    2565 flags.go:64] FLAG: --cloud-provider="external"
Jun 11 19:26:04.913252 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906507    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jun 11 19:26:04.913252 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906514    2565 flags.go:64] FLAG: --cluster-domain=""
Jun 11 19:26:04.913252 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906518    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 11 19:26:04.913252 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906523    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jun 11 19:26:04.913252 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906528    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 11 19:26:04.913252 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906533    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jun 11 19:26:04.913252 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906539    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 11 19:26:04.913252 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906544    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 11 19:26:04.913252 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906549    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 11 19:26:04.913805 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906555    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 11 19:26:04.913805 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906561    2565 flags.go:64] FLAG: --contention-profiling="false"
Jun 11 19:26:04.913805 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906566    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 11 19:26:04.913805 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906571    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 11 19:26:04.913805 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906575    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 11 19:26:04.913805 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906580    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 11 19:26:04.913805 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906586    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 11 19:26:04.913805 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906592    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 11 19:26:04.913805 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906596    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 11 19:26:04.913805 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906601    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jun 11 19:26:04.913805 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906605    2565 flags.go:64] FLAG: --enable-server="true"
Jun 11 19:26:04.913805 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906610    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 11 19:26:04.913805 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906618    2565 flags.go:64] FLAG: --event-burst="100"
Jun 11 19:26:04.913805 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906622    2565 flags.go:64] FLAG: --event-qps="50"
Jun 11 19:26:04.913805 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906627    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 11 19:26:04.913805 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906631    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 11 19:26:04.913805 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906636    2565 flags.go:64] FLAG: --eviction-hard=""
Jun 11 19:26:04.913805 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906642    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 11 19:26:04.913805 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906646    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 11 19:26:04.913805 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906651    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 11 19:26:04.913805 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906656    2565 flags.go:64] FLAG: --eviction-soft=""
Jun 11 19:26:04.913805 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906661    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 11 19:26:04.913805 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906666    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 11 19:26:04.913805 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906671    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 11 19:26:04.913805 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906675    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 11 19:26:04.914476 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906680    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 11 19:26:04.914476 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906684    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jun 11 19:26:04.914476 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906689    2565 flags.go:64] FLAG: --feature-gates=""
Jun 11 19:26:04.914476 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906695    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 11 19:26:04.914476 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906700    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 11 19:26:04.914476 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906705    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 11 19:26:04.914476 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906710    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 11 19:26:04.914476 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906715    2565 flags.go:64] FLAG: --healthz-port="10248"
Jun 11 19:26:04.914476 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906720    2565 flags.go:64] FLAG: --help="false"
Jun 11 19:26:04.914476 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906724    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-140-223.ec2.internal"
Jun 11 19:26:04.914476 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906729    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 11 19:26:04.914476 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906734    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 11 19:26:04.914476 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906738    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 11 19:26:04.914476 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906744    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 11 19:26:04.914476 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906749    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 11 19:26:04.914476 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906754    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 11 19:26:04.914476 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906758    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jun 11 19:26:04.914476 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906762    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 11 19:26:04.914476 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906767    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jun 11 19:26:04.914476 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906771    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 11 19:26:04.914476 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906777    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jun 11 19:26:04.914476 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906781    2565 flags.go:64] FLAG: --kube-reserved=""
Jun 11 19:26:04.914476 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906786    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 11 19:26:04.914476 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906790    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 11 19:26:04.915120 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906795    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 11 19:26:04.915120 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906800    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 11 19:26:04.915120 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906805    2565 flags.go:64] FLAG: --lock-file=""
Jun 11 19:26:04.915120 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906809    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 11 19:26:04.915120 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906814    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 11 19:26:04.915120 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906818    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 11 19:26:04.915120 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906827    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 11 19:26:04.915120 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906832    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 11 19:26:04.915120 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906837    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 11 19:26:04.915120 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906841    2565 flags.go:64] FLAG: --logging-format="text"
Jun 11 19:26:04.915120 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906846    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 11 19:26:04.915120 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906851    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 11 19:26:04.915120 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906855    2565 flags.go:64] FLAG: --manifest-url=""
Jun 11 19:26:04.915120 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906860    2565 flags.go:64] FLAG: --manifest-url-header=""
Jun 11 19:26:04.915120 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906868    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 11 19:26:04.915120 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906872    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jun 11 19:26:04.915120 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906897    2565 flags.go:64] FLAG: --max-pods="110"
Jun 11 19:26:04.915120 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906903    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 11 19:26:04.915120 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906908    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 11 19:26:04.915120 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906912    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 11 19:26:04.915120 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906917    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 11 19:26:04.915120 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906922    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 11 19:26:04.915120 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906927    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 11 19:26:04.915120 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906932    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 11 19:26:04.915120 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906944    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jun 11 19:26:04.915716 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906949    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 11 19:26:04.915716 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906954    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 11 19:26:04.915716 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906958    2565 flags.go:64] FLAG: --pod-cidr=""
Jun 11 19:26:04.915716 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906962    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52"
Jun 11 19:26:04.915716 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906972    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jun 11 19:26:04.915716 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906977    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 11 19:26:04.915716 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906981    2565 flags.go:64] FLAG: --pods-per-core="0"
Jun 11 19:26:04.915716 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906986    2565 flags.go:64] FLAG: --port="10250"
Jun 11 19:26:04.915716 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906991    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 11 19:26:04.915716 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.906995    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05d3f5172469afe31"
Jun 11 19:26:04.915716 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907001    2565 flags.go:64] FLAG: --qos-reserved=""
Jun 11 19:26:04.915716 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907006    2565 flags.go:64] FLAG: --read-only-port="10255"
Jun 11 19:26:04.915716 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907010    2565 flags.go:64] FLAG: --register-node="true"
Jun 11 19:26:04.915716 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907015    2565 flags.go:64] FLAG: --register-with-taints=""
Jun 11 19:26:04.915716 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907021    2565 flags.go:64] FLAG: --registry-burst="10"
Jun 11 19:26:04.915716 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907027    2565 flags.go:64] FLAG: --registry-qps="5"
Jun 11 19:26:04.915716 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907031    2565 flags.go:64] FLAG: --reserved-cpus=""
Jun 11 19:26:04.915716 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907035    2565 flags.go:64] FLAG: --reserved-memory=""
Jun 11 19:26:04.915716 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907041    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 11 19:26:04.915716 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907046    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 11 19:26:04.915716 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907051    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jun 11 19:26:04.915716 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907056    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 11 19:26:04.915716 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907061    2565 flags.go:64] FLAG: --runonce="false"
Jun 11 19:26:04.915716 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907065    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 11 19:26:04.915716 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907070    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 11 19:26:04.916338 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907075    2565 flags.go:64] FLAG: --seccomp-default="false"
Jun 11 19:26:04.916338 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907080    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 11 19:26:04.916338 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907084    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 11 19:26:04.916338 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907089    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 11 19:26:04.916338 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907093    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 11 19:26:04.916338 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907098    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jun 11 19:26:04.916338 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907103    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 11 19:26:04.916338 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907108    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 11 19:26:04.916338 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907112    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jun 11 19:26:04.916338 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907117    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 11 19:26:04.916338 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907122    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 11 19:26:04.916338 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907127    2565 flags.go:64] FLAG: --system-cgroups=""
Jun 11 19:26:04.916338 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907131    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 11 19:26:04.916338 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907140    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 11 19:26:04.916338 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907145    2565 flags.go:64] FLAG: --tls-cert-file=""
Jun 11 19:26:04.916338 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907149    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 11 19:26:04.916338 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907157    2565 flags.go:64] FLAG: --tls-min-version=""
Jun 11 19:26:04.916338 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907161    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jun 11 19:26:04.916338 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907165    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 11 19:26:04.916338 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907170    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 11 19:26:04.916338 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907174    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 11 19:26:04.916338 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907179    2565 flags.go:64] FLAG: --v="2"
Jun 11 19:26:04.916338 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907186    2565 flags.go:64] FLAG: --version="false"
Jun 11 19:26:04.916338 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907193    2565 flags.go:64] FLAG: --vmodule=""
Jun 11 19:26:04.916338 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907198    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 11 19:26:04.916985 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.907203    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 11 19:26:04.916985 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907383    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 11 19:26:04.916985 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907391    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 11 19:26:04.916985 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907396    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 11 19:26:04.916985 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907400    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 11 19:26:04.916985 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907404    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 11 19:26:04.916985 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907408    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 11 19:26:04.916985 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907412    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 11 19:26:04.916985 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907416    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 11 19:26:04.916985 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907421    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 11 19:26:04.916985 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907425    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 11 19:26:04.916985 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907429    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 11 19:26:04.916985 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907433    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 11 19:26:04.916985 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907440    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 11 19:26:04.916985 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907446    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 11 19:26:04.916985 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907451    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 11 19:26:04.916985 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907455    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 11 19:26:04.916985 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907459    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 11 19:26:04.916985 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907463    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 11 19:26:04.916985 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907467    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 11 19:26:04.917471 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907472    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 11 19:26:04.917471 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907478    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 11 19:26:04.917471 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907482    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jun 11 19:26:04.917471 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907486    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 11 19:26:04.917471 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907490    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 11 19:26:04.917471 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907494    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 11 19:26:04.917471 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907498    2565 feature_gate.go:328] unrecognized feature gate: Example
Jun 11 19:26:04.917471 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907503    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 11 19:26:04.917471 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907507    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 11 19:26:04.917471 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907511    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 11 19:26:04.917471 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907516    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 11 19:26:04.917471 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907521    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 11 19:26:04.917471 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907528    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 11 19:26:04.917471 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907533    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 11 19:26:04.917471 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907538    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 11 19:26:04.917471 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907544    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 11 19:26:04.917471 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907548    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 11 19:26:04.917471 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907553    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 11 19:26:04.917471 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907557    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 11 19:26:04.917471 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907562    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 11 19:26:04.917978 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907567    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 11 19:26:04.917978 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907574    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 11 19:26:04.917978 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907580    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 11 19:26:04.917978 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907585    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 11 19:26:04.917978 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907589    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 11 19:26:04.917978 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907594    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 11 19:26:04.917978 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907599    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 11 19:26:04.917978 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907603    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 11 19:26:04.917978 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907607    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 11 19:26:04.917978 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907612    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 11 19:26:04.917978 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907616    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 11 19:26:04.917978 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907621    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 11 19:26:04.917978 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907625    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 11 19:26:04.917978 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907631    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 11 19:26:04.917978 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907635    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 11 19:26:04.917978 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907640    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 11 19:26:04.917978 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907644    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 11 19:26:04.917978 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907648    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 11 19:26:04.917978 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907652    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 11 19:26:04.917978 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907656    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 11 19:26:04.918504 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907661    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 11 19:26:04.918504 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907665    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 11 19:26:04.918504 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907669    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 11 19:26:04.918504 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907674    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 11 19:26:04.918504 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907679    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 11 19:26:04.918504 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907683    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 11 19:26:04.918504 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907687    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 11 19:26:04.918504 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907693    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 11 19:26:04.918504 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907698    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 11 19:26:04.918504 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907702    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 11 19:26:04.918504 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907706    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 11 19:26:04.918504 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907711    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 11 19:26:04.918504 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907715    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 11 19:26:04.918504 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907719    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 11 19:26:04.918504 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907723    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 11 19:26:04.918504 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907728    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 11 19:26:04.918504 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907732    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 11 19:26:04.918504 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907736    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 11 19:26:04.918504 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907740    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 11 19:26:04.918504 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907744    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 11 19:26:04.919011 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907748    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 11 19:26:04.919011 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907753    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 11 19:26:04.919011 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907757    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 11 19:26:04.919011 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907761    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 11 19:26:04.919011 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907765    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 11 19:26:04.919011 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907771    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 11 19:26:04.919011 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907775    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 11 19:26:04.919011 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907779    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 11 19:26:04.919011 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907784    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 11 19:26:04.919011 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907788    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 11 19:26:04.919011 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907792    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 11 19:26:04.919011 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907797    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 11 19:26:04.919011 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907801    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 11 19:26:04.919011 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907805    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 11 19:26:04.919011 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907809    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 11 19:26:04.919011 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907813    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 11 19:26:04.919011 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907817    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 11 19:26:04.919011 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907822    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 11 19:26:04.919011 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907826    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 11 19:26:04.919011 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.907832    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 11 19:26:04.919525 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.908565    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 11 19:26:04.919525 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.916104    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jun 11 19:26:04.919525 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.916122    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 11 19:26:04.919525 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.916144    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jun 11 19:26:04.919525 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.916150    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 11 19:26:04.919525 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916208    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 11 19:26:04.919525 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916212    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 11 19:26:04.919525 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916215    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 11 19:26:04.919525 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916218    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 11 19:26:04.919525 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916220    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 11 19:26:04.919525 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916223    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 11 19:26:04.919525 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916225    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 11 19:26:04.919525 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916229    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 11 19:26:04.919525 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916232    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 11 19:26:04.919877 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916234    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 11 19:26:04.919877 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916237    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 11 19:26:04.919877 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916239    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 11 19:26:04.919877 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916242    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 11 19:26:04.919877 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916245    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 11 19:26:04.919877 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916247    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 11 19:26:04.919877 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916251    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 11 19:26:04.919877 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916255    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 11 19:26:04.919877 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916258    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 11 19:26:04.919877 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916260    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 11 19:26:04.919877 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916263    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 11 19:26:04.919877 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916265    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 11 19:26:04.919877 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916268    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 11 19:26:04.919877 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916270    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 11 19:26:04.919877 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916273    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 11 19:26:04.919877 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916276    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 11 19:26:04.919877 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916278    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 11 19:26:04.919877 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916281    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 11 19:26:04.919877 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916283    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 11 19:26:04.920359 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916286    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 11 19:26:04.920359 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916290    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 11 19:26:04.920359 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916293    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 11 19:26:04.920359 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916295    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 11 19:26:04.920359 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916298    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 11 19:26:04.920359 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916300    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 11 19:26:04.920359 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916303    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 11 19:26:04.920359 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916305    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 11 19:26:04.920359 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916307    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 11 19:26:04.920359 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916310    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 11 19:26:04.920359 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916313    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 11 19:26:04.920359 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916315    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 11 19:26:04.920359 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916317    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 11 19:26:04.920359 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916319    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 11 19:26:04.920359 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916322    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 11 19:26:04.920359 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916324    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 11 19:26:04.920359 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916327    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 11 19:26:04.920359 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916329    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 11 19:26:04.920359 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916332    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 11 19:26:04.920359 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916334    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 11 19:26:04.920848 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916352    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 11 19:26:04.920848 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916356    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 11 19:26:04.920848 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916359    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jun 11 19:26:04.920848 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916362    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 11 19:26:04.920848 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916365    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 11 19:26:04.920848 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916367    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 11 19:26:04.920848 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916370    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 11 19:26:04.920848 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916373    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 11 19:26:04.920848 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916376    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 11 19:26:04.920848 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916379    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 11 19:26:04.920848 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916381    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 11 19:26:04.920848 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916384    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 11 19:26:04.920848 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916386    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 11 19:26:04.920848 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916390    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 11 19:26:04.920848 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916393    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 11 19:26:04.920848 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916396    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 11 19:26:04.920848 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916398    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 11 19:26:04.920848 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916401    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 11 19:26:04.920848 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916405    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 11 19:26:04.920848 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916408    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 11 19:26:04.921380 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916411    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 11 19:26:04.921380 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916414    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 11 19:26:04.921380 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916416    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 11 19:26:04.921380 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916419    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 11 19:26:04.921380 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916422    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 11 19:26:04.921380 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916424    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 11 19:26:04.921380 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916427    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 11 19:26:04.921380 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916429    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 11 19:26:04.921380 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916432    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 11 19:26:04.921380 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916434    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 11 19:26:04.921380 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916437    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 11 19:26:04.921380 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916439    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 11 19:26:04.921380 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916442    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 11 19:26:04.921380 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916444    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 11 19:26:04.921380 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916447    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 11 19:26:04.921380 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916449    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 11 19:26:04.921380 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916452    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 11 19:26:04.921380 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916456    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 11 19:26:04.921380 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916459    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 11 19:26:04.921992 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916463    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 11 19:26:04.921992 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916465    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 11 19:26:04.921992 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916468    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 11 19:26:04.921992 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916470    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 11 19:26:04.921992 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916473    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 11 19:26:04.921992 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916476    2565 feature_gate.go:328] unrecognized feature gate: Example
Jun 11 19:26:04.921992 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916479    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 11 19:26:04.921992 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916481    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 11 19:26:04.921992 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916485    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 11 19:26:04.921992 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916487    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 11 19:26:04.921992 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916490    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 11 19:26:04.921992 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916493    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 11 19:26:04.921992 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.916498    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 11 19:26:04.921992 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916616    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 11 19:26:04.921992 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916621    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 11 19:26:04.922370 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916624    2565 feature_gate.go:328] unrecognized feature gate: Example
Jun 11 19:26:04.922370 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916627    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 11 19:26:04.922370 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916630    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 11 19:26:04.922370 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916633    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 11 19:26:04.922370 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916635    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 11 19:26:04.922370 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916638    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 11 19:26:04.922370 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916641    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 11 19:26:04.922370 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916644    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 11 19:26:04.922370 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916646    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 11 19:26:04.922370 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916648    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 11 19:26:04.922370 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916651    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 11 19:26:04.922370 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916653    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 11 19:26:04.922370 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916656    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 11 19:26:04.922370 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916658    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 11 19:26:04.922370 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916661    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 11 19:26:04.922370 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916664    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 11 19:26:04.922370 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916667    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 11 19:26:04.922370 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916669    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 11 19:26:04.922370 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916672    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 11 19:26:04.922370 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916674    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 11 19:26:04.922855 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916677    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 11 19:26:04.922855 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916679    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 11 19:26:04.922855 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916682    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 11 19:26:04.922855 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916684    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 11 19:26:04.922855 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916686    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 11 19:26:04.922855 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916689    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 11 19:26:04.922855 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916692    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 11 19:26:04.922855 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916695    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 11 19:26:04.922855 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916697    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 11 19:26:04.922855 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916701    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 11 19:26:04.922855 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916705    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 11 19:26:04.922855 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916708    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 11 19:26:04.922855 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916711    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 11 19:26:04.922855 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916713    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 11 19:26:04.922855 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916716    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 11 19:26:04.922855 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916719    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 11 19:26:04.922855 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916721    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 11 19:26:04.922855 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916724    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 11 19:26:04.922855 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916726    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 11 19:26:04.923338 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916728    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 11 19:26:04.923338 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916731    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 11 19:26:04.923338 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916733    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 11 19:26:04.923338 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916735    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 11 19:26:04.923338 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916738    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 11 19:26:04.923338 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916740    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 11 19:26:04.923338 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916743    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 11 19:26:04.923338 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916745    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 11 19:26:04.923338 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916748    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 11 19:26:04.923338 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916751    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 11 19:26:04.923338 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916753    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 11 19:26:04.923338 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916756    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 11 19:26:04.923338 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916758    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 11 19:26:04.923338 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916761    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 11 19:26:04.923338 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916763    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 11 19:26:04.923338 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916766    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 11 19:26:04.923338 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916768    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 11 19:26:04.923338 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916771    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 11 19:26:04.923338 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916773    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 11 19:26:04.923338 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916776    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 11 19:26:04.923828 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916779    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 11 19:26:04.923828 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916781    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 11 19:26:04.923828 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916783    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 11 19:26:04.923828 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916787    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 11 19:26:04.923828 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916789    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 11 19:26:04.923828 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916792    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 11 19:26:04.923828 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916794    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 11 19:26:04.923828 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916797    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 11 19:26:04.923828 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916799    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 11 19:26:04.923828 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916801    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 11 19:26:04.923828 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916804    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 11 19:26:04.923828 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916806    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 11 19:26:04.923828 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916810    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 11 19:26:04.923828 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916813    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 11 19:26:04.923828 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916815    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 11 19:26:04.923828 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916818    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 11 19:26:04.923828 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916821    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 11 19:26:04.923828 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916823    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 11 19:26:04.923828 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916825    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 11 19:26:04.924299 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916828    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 11 19:26:04.924299 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916831    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jun 11 19:26:04.924299 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916834    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 11 19:26:04.924299 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916836    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 11 19:26:04.924299 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916839    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 11 19:26:04.924299 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916841    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 11 19:26:04.924299 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916843    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 11 19:26:04.924299 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916846    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 11 19:26:04.924299 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916848    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 11 19:26:04.924299 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916851    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 11 19:26:04.924299 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916853    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 11 19:26:04.924299 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916855    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 11 19:26:04.924299 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916857    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 11 19:26:04.924299 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916861    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 11 19:26:04.924299 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916873    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 11 19:26:04.924299 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916877    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 11 19:26:04.924299 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916896    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 11 19:26:04.924299 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916902    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 11 19:26:04.924299 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:04.916905    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 11 19:26:04.924747 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.916910    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 11 19:26:04.924747 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.917038    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 11 19:26:04.924747 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.919304    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 11 19:26:04.924747 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.921314    2565 server.go:1019] "Starting client certificate rotation"
Jun 11 19:26:04.924747 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.921418    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 11 19:26:04.924747 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.921448    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 11 19:26:04.925378 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.925364    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 11 19:26:04.929844 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.929824    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 11 19:26:04.942019 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.941997    2565 log.go:25] "Validated CRI v1 runtime API"
Jun 11 19:26:04.945946 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.945916    2565 log.go:25] "Validated CRI v1 image API"
Jun 11 19:26:04.946799 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.946782    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 11 19:26:04.951409 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.951376    2565 fs.go:135] Filesystem UUIDs: map[4e6023a4-31ac-4016-be0b-e935d2565f81:/dev/nvme0n1p3 71e7ae0f-e4f4-4d27-9dbe-04db2fb5803d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jun 11 19:26:04.951510 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.951407    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 11 19:26:04.951585 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.951566    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 11 19:26:04.958455 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.958305    2565 manager.go:216] Machine: {Timestamp:2026-06-11 19:26:04.956808881 +0000 UTC m=+0.360724985 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3123010 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29cbdf688e6746bb8d26335ea1ae54 SystemUUID:ec29cbdf-688e-6746-bb8d-26335ea1ae54 BootID:fd27bcdd-fb28-46f8-97de-cff272786c1d Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:74:dd:17:10:95 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:74:dd:17:10:95 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:56:41:66:20:3e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 11 19:26:04.958455 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.958450    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 11 19:26:04.958574 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.958543    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 11 19:26:04.962230 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.962196    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 11 19:26:04.962433 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.962234    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-223.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 11 19:26:04.963398 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.963385    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jun 11 19:26:04.963398 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.963399    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jun 11 19:26:04.963463 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.963408    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 11 19:26:04.964387 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.964373    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 11 19:26:04.966106 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.966091    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jun 11 19:26:04.970821 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.970806    2565 state_mem.go:36] "Initialized new in-memory state store"
Jun 11 19:26:04.970969 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.970959    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jun 11 19:26:04.971009 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.970993    2565 kubelet.go:486] "Attempting to sync node with API server"
Jun 11 19:26:04.971009 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.971005    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 11 19:26:04.971069 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.971019    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 11 19:26:04.971069 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.971030    2565 kubelet.go:398] "Adding apiserver pod source"
Jun 11 19:26:04.971069 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.971040    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 11 19:26:04.971449 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.971436    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 11 19:26:04.971517 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.971458    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 11 19:26:04.973946 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.973927    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jun 11 19:26:04.975622 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.975606    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 11 19:26:04.975701 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.975639    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jun 11 19:26:04.975819 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.975807    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 11 19:26:04.975861 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.975826    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 11 19:26:04.975861 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.975832    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 11 19:26:04.975861 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.975838    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 11 19:26:04.975861 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.975846    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 11 19:26:04.975861 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.975852    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 11 19:26:04.976515 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.976502    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 11 19:26:04.976515 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.976512    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 11 19:26:04.976515 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.976518    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 11 19:26:04.976657 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.976523    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 11 19:26:04.976657 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.976532    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 11 19:26:04.976657 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.976540    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 11 19:26:04.977377 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.977362    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 11 19:26:04.977377 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.977374    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 11 19:26:04.980794 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.980779    2565 server.go:1268] "Started kubelet"
Jun 11 19:26:04.980948 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.980917    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 11 19:26:04.981013 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.980898    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 11 19:26:04.981901 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.981865    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jun 11 19:26:04.982214 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:04.982190    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 11 19:26:04.982304 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:04.982288    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-223.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 11 19:26:04.982347 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.982311    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-223.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 11 19:26:04.982613 ip-10-0-140-223 systemd[1]: Started Kubernetes Kubelet.
Jun 11 19:26:04.984374 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.984352    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 11 19:26:04.984829 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.984805    2565 server.go:310] "Adding debug handlers to kubelet server"
Jun 11 19:26:04.991867 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.991847    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 11 19:26:04.991949 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.991862    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 11 19:26:04.992227 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:04.992192    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-223.ec2.internal\" not found"
Jun 11 19:26:04.992638 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.992621    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jun 11 19:26:04.992638 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.992624    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jun 11 19:26:04.992743 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.992643    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jun 11 19:26:04.992743 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.992720    2565 reconstruct.go:97] "Volume reconstruction finished"
Jun 11 19:26:04.992743 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.992730    2565 reconciler.go:29] "Reconciler: start to sync state"
Jun 11 19:26:04.993509 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.993488    2565 factory.go:55] Registering systemd factory
Jun 11 19:26:04.993509 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.993509    2565 factory.go:223] Registration of the systemd container factory successfully
Jun 11 19:26:04.994230 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.993736    2565 factory.go:153] Registering CRI-O factory
Jun 11 19:26:04.994230 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.993750    2565 factory.go:223] Registration of the crio container factory successfully
Jun 11 19:26:04.994230 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.993801    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 11 19:26:04.994230 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.993827    2565 factory.go:103] Registering Raw factory
Jun 11 19:26:04.994230 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.993841    2565 manager.go:1196] Started watching for new ooms in manager
Jun 11 19:26:04.994551 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:04.994396    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 11 19:26:04.994760 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:04.993545    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-223.ec2.internal.18b81d634e7c04af  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-223.ec2.internal,UID:ip-10-0-140-223.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-223.ec2.internal,},FirstTimestamp:2026-06-11 19:26:04.980749487 +0000 UTC m=+0.384665584,LastTimestamp:2026-06-11 19:26:04.980749487 +0000 UTC m=+0.384665584,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-223.ec2.internal,}"
Jun 11 19:26:04.995927 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:04.995910    2565 manager.go:349] Starting recovery of all containers
Jun 11 19:26:05.002624 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.002460    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9f4m7"
Jun 11 19:26:05.003293 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:05.003268    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jun 11 19:26:05.003435 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:05.003413    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-223.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jun 11 19:26:05.004938 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.004917    2565 manager.go:354] Recovery completed
Jun 11 19:26:05.006212 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.006193    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9f4m7"
Jun 11 19:26:05.010483 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.010421    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 11 19:26:05.016235 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.016217    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-223.ec2.internal" event="NodeHasSufficientMemory"
Jun 11 19:26:05.016317 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.016243    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-223.ec2.internal" event="NodeHasNoDiskPressure"
Jun 11 19:26:05.016317 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.016253    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-223.ec2.internal" event="NodeHasSufficientPID"
Jun 11 19:26:05.016805 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.016791    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 11 19:26:05.016805 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.016804    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 11 19:26:05.016942 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.016819    2565 state_mem.go:36] "Initialized new in-memory state store"
Jun 11 19:26:05.016942 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.016798    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 11 19:26:05.017642 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.017626    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-223.ec2.internal" event="NodeHasSufficientMemory"
Jun 11 19:26:05.017693 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.017657    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-223.ec2.internal" event="NodeHasNoDiskPressure"
Jun 11 19:26:05.017693 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.017668    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-223.ec2.internal" event="NodeHasSufficientPID"
Jun 11 19:26:05.018228 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:05.018144    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-223.ec2.internal.18b81d635099744a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-223.ec2.internal,UID:ip-10-0-140-223.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-223.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-223.ec2.internal,},FirstTimestamp:2026-06-11 19:26:05.016233034 +0000 UTC m=+0.420149132,LastTimestamp:2026-06-11 19:26:05.016233034 +0000 UTC m=+0.420149132,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-223.ec2.internal,}"
Jun 11 19:26:05.019001 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.018990    2565 policy_none.go:49] "None policy: Start"
Jun 11 19:26:05.019038 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.019006    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jun 11 19:26:05.019038 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.019017    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jun 11 19:26:05.020761 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.020749    2565 policy_none.go:47] "Start"
Jun 11 19:26:05.080290 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.059370    2565 manager.go:337] "Starting Device Plugin manager"
Jun 11 19:26:05.080290 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:05.059404    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 11 19:26:05.080290 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.059417    2565 server.go:87] "Starting device plugin registration server"
Jun 11 19:26:05.080290 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.059772    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 11 19:26:05.080290 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.059802    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 11 19:26:05.080290 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.059924    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 11 19:26:05.080290 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.060023    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 11 19:26:05.080290 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.060034    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 11 19:26:05.080290 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:05.060829    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 11 19:26:05.080290 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:05.060908    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-223.ec2.internal\" not found"
Jun 11 19:26:05.080290 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.070238    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jun 11 19:26:05.080290 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.071524    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jun 11 19:26:05.080290 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.071557    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jun 11 19:26:05.080290 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.071580    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jun 11 19:26:05.080290 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:05.071610    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 11 19:26:05.080290 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.073906    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 11 19:26:05.160915 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.160780    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 11 19:26:05.162046 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.162026    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-223.ec2.internal" event="NodeHasSufficientMemory"
Jun 11 19:26:05.162132 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.162071    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-223.ec2.internal" event="NodeHasNoDiskPressure"
Jun 11 19:26:05.162132 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.162087    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-223.ec2.internal" event="NodeHasSufficientPID"
Jun 11 19:26:05.162132 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.162120    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-223.ec2.internal"
Jun 11 19:26:05.171687 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.171659    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-223.ec2.internal"]
Jun 11 19:26:05.171687 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.171680    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-223.ec2.internal"
Jun 11 19:26:05.171812 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:05.171703    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-223.ec2.internal\": node \"ip-10-0-140-223.ec2.internal\" not found"
Jun 11 19:26:05.171812 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.171736    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 11 19:26:05.173573 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.173557    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-223.ec2.internal" event="NodeHasSufficientMemory"
Jun 11 19:26:05.173655 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.173589    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-223.ec2.internal" event="NodeHasNoDiskPressure"
Jun 11 19:26:05.173655 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.173603    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-223.ec2.internal" event="NodeHasSufficientPID"
Jun 11 19:26:05.176061 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.176045    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 11 19:26:05.176212 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.176198    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal"
Jun 11 19:26:05.176266 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.176229    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 11 19:26:05.176844 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.176831    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-223.ec2.internal" event="NodeHasSufficientMemory"
Jun 11 19:26:05.176934 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.176843    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-223.ec2.internal" event="NodeHasSufficientMemory"
Jun 11 19:26:05.176934 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.176857    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-223.ec2.internal" event="NodeHasNoDiskPressure"
Jun 11 19:26:05.176934 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.176873    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-223.ec2.internal" event="NodeHasNoDiskPressure"
Jun 11 19:26:05.176934 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.176877    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-223.ec2.internal" event="NodeHasSufficientPID"
Jun 11 19:26:05.177052 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.176906    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-223.ec2.internal" event="NodeHasSufficientPID"
Jun 11 19:26:05.179262 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.179246    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-223.ec2.internal"
Jun 11 19:26:05.179322 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.179300    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 11 19:26:05.180180 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.180166    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-223.ec2.internal" event="NodeHasSufficientMemory"
Jun 11 19:26:05.180244 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.180190    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-223.ec2.internal" event="NodeHasNoDiskPressure"
Jun 11 19:26:05.180244 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.180206    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-223.ec2.internal" event="NodeHasSufficientPID"
Jun 11 19:26:05.193967 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.193939    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b11adcad61b3d220a3d5857bba715038-config\") pod \"kube-apiserver-proxy-ip-10-0-140-223.ec2.internal\" (UID: \"b11adcad61b3d220a3d5857bba715038\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-223.ec2.internal"
Jun 11 19:26:05.193967 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.193967    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5a83bacba9328857248ca50116d2e702-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal\" (UID: \"5a83bacba9328857248ca50116d2e702\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal"
Jun 11 19:26:05.194124 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.193983    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a83bacba9328857248ca50116d2e702-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal\" (UID: \"5a83bacba9328857248ca50116d2e702\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal"
Jun 11 19:26:05.195338 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:05.195318    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-223.ec2.internal\" not found"
Jun 11 19:26:05.204674 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:05.204649    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-223.ec2.internal\" not found" node="ip-10-0-140-223.ec2.internal"
Jun 11 19:26:05.209226 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:05.209210    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-223.ec2.internal\" not found" node="ip-10-0-140-223.ec2.internal"
Jun 11 19:26:05.294123 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.294092    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b11adcad61b3d220a3d5857bba715038-config\") pod \"kube-apiserver-proxy-ip-10-0-140-223.ec2.internal\" (UID: \"b11adcad61b3d220a3d5857bba715038\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-223.ec2.internal"
Jun 11 19:26:05.294123 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.294125    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5a83bacba9328857248ca50116d2e702-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal\" (UID: \"5a83bacba9328857248ca50116d2e702\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal"
Jun 11 19:26:05.294271 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.294141    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a83bacba9328857248ca50116d2e702-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal\" (UID: \"5a83bacba9328857248ca50116d2e702\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal"
Jun 11 19:26:05.294271 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.294182    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a83bacba9328857248ca50116d2e702-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal\" (UID: \"5a83bacba9328857248ca50116d2e702\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal"
Jun 11 19:26:05.294271 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.294195    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5a83bacba9328857248ca50116d2e702-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal\" (UID: \"5a83bacba9328857248ca50116d2e702\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal"
Jun 11 19:26:05.294271 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.294195    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b11adcad61b3d220a3d5857bba715038-config\") pod \"kube-apiserver-proxy-ip-10-0-140-223.ec2.internal\" (UID: \"b11adcad61b3d220a3d5857bba715038\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-223.ec2.internal"
Jun 11 19:26:05.296191 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:05.296175    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-223.ec2.internal\" not found"
Jun 11 19:26:05.396750 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:05.396716    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-223.ec2.internal\" not found"
Jun 11 19:26:05.497589 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:05.497562    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-223.ec2.internal\" not found"
Jun 11 19:26:05.507737 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.507713    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal"
Jun 11 19:26:05.514797 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.514776    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-223.ec2.internal"
Jun 11 19:26:05.597964 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:05.597921    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-223.ec2.internal\" not found"
Jun 11 19:26:05.698456 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:05.698423    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-223.ec2.internal\" not found"
Jun 11 19:26:05.799011 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:05.798934    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-223.ec2.internal\" not found"
Jun 11 19:26:05.899703 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:05.899665    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-223.ec2.internal\" not found"
Jun 11 19:26:05.920868 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.920824    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 11 19:26:05.921028 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:05.921010    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 11 19:26:06.000213 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:06.000178    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-223.ec2.internal\" not found"
Jun 11 19:26:06.012510 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.012470    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 19:21:04 +0000 UTC" deadline="2028-02-28 12:49:03.560080468 +0000 UTC"
Jun 11 19:26:06.012510 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.012500    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15041h22m57.547583914s"
Jun 11 19:26:06.076146 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:06.076107    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a83bacba9328857248ca50116d2e702.slice/crio-b2d0e4a49acf8250948c59df70578bb0f5d244b422d3a558c36ed29911bd0503 WatchSource:0}: Error finding container b2d0e4a49acf8250948c59df70578bb0f5d244b422d3a558c36ed29911bd0503: Status 404 returned error can't find the container with id b2d0e4a49acf8250948c59df70578bb0f5d244b422d3a558c36ed29911bd0503
Jun 11 19:26:06.076644 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:06.076618    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb11adcad61b3d220a3d5857bba715038.slice/crio-2ce707ebb4cdbe35f1b1401db5d5036d5353ebd1b5868643b45863c64b392869 WatchSource:0}: Error finding container 2ce707ebb4cdbe35f1b1401db5d5036d5353ebd1b5868643b45863c64b392869: Status 404 returned error can't find the container with id 2ce707ebb4cdbe35f1b1401db5d5036d5353ebd1b5868643b45863c64b392869
Jun 11 19:26:06.082514 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.082489    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 11 19:26:06.101254 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:06.101228    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-223.ec2.internal\" not found"
Jun 11 19:26:06.201903 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:06.201845    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-223.ec2.internal\" not found"
Jun 11 19:26:06.271359 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.271328    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 11 19:26:06.304522 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:06.302839    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-223.ec2.internal\" not found"
Jun 11 19:26:06.364019 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.363941    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 11 19:26:06.377008 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.376983    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 11 19:26:06.392594 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.392569    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal"
Jun 11 19:26:06.410576 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.410553    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 11 19:26:06.411741 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.411727    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-223.ec2.internal"
Jun 11 19:26:06.420317 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.420286    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 11 19:26:06.973246 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.973198    2565 apiserver.go:52] "Watching apiserver"
Jun 11 19:26:06.982591 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.982265    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 11 19:26:06.982763 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.982619    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-dcw8t","kube-system/kube-apiserver-proxy-ip-10-0-140-223.ec2.internal","openshift-cluster-node-tuning-operator/tuned-jbjqk","openshift-image-registry/node-ca-jxggl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal","openshift-multus/multus-additional-cni-plugins-rllhm","openshift-multus/network-metrics-daemon-q665k","openshift-network-diagnostics/network-check-target-78njs","kube-system/global-pull-secret-syncer-tvlp6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2swm","openshift-dns/node-resolver-dgnbm","openshift-multus/multus-hzp4x","openshift-network-operator/iptables-alerter-97fzw","openshift-ovn-kubernetes/ovnkube-node-n2n72"]
Jun 11 19:26:06.985366 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.985341    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:26:06.985471 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:06.985419    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q665k" podUID="2dd52262-7f1b-440b-a020-a59da738c3c4"
Jun 11 19:26:06.987518 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.987493    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dgnbm"
Jun 11 19:26:06.989612 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.989591    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:06.990173 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.990153    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 11 19:26:06.990388 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.990368    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7ftpz\""
Jun 11 19:26:06.990388 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.990378    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 11 19:26:06.991813 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.991606    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 11 19:26:06.991813 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.991656    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jxggl"
Jun 11 19:26:06.991813 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.991707    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qtmrb\""
Jun 11 19:26:06.992012 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.991986    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 11 19:26:06.993917 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.993896    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 11 19:26:06.995152 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.994142    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 11 19:26:06.995152 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.994195    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-x7njh\""
Jun 11 19:26:06.995152 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.994286    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 11 19:26:06.995152 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.994370    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 11 19:26:06.995152 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.994472    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:06.996052 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.996031    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rllhm"
Jun 11 19:26:06.998027 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.996683    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 11 19:26:06.998027 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.996976    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 11 19:26:06.998027 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:06.997200    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 11 19:26:07.009160 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.007357    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-97fzw"
Jun 11 19:26:07.009160 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.007757    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:07.009160 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:07.007830    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvlp6" podUID="7cd450c3-fc87-48a3-b7ba-617cede6af81"
Jun 11 19:26:07.009160 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.007995    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 11 19:26:07.009160 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.008216    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 11 19:26:07.009160 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.008278    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 11 19:26:07.009160 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.008406    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 11 19:26:07.009160 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.008471    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 11 19:26:07.009160 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.008554    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 11 19:26:07.009160 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.008689    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ff67b\""
Jun 11 19:26:07.009160 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.008771    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 11 19:26:07.009160 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.008966    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rkz7g\""
Jun 11 19:26:07.009776 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.009348    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9dls\" (UniqueName: \"kubernetes.io/projected/54d4758a-7d2f-4b4d-9a03-4837465a51a0-kube-api-access-q9dls\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.009776 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.009386    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-host-kubelet\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.009776 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.009417    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-var-lib-openvswitch\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.009776 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.009448    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-node-log\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.009776 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.009477    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-host-cni-netd\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.009776 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.009506    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs\") pod \"network-metrics-daemon-q665k\" (UID: \"2dd52262-7f1b-440b-a020-a59da738c3c4\") " pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:26:07.009776 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.009537    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9hcd\" (UniqueName: \"kubernetes.io/projected/ace36f16-b3ef-4f51-90fc-40d44b9cb8b1-kube-api-access-k9hcd\") pod \"node-resolver-dgnbm\" (UID: \"ace36f16-b3ef-4f51-90fc-40d44b9cb8b1\") " pod="openshift-dns/node-resolver-dgnbm"
Jun 11 19:26:07.009776 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.009579    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-lib-modules\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.009776 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.009612    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-var-lib-kubelet\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.009776 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.009676    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.009776 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.009737    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/007c0c12-34f6-4d2b-9af7-9b265c041702-system-cni-dir\") pod \"multus-additional-cni-plugins-rllhm\" (UID: \"007c0c12-34f6-4d2b-9af7-9b265c041702\") " pod="openshift-multus/multus-additional-cni-plugins-rllhm"
Jun 11 19:26:07.010184 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.009787    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sgcr\" (UniqueName: \"kubernetes.io/projected/2dd52262-7f1b-440b-a020-a59da738c3c4-kube-api-access-5sgcr\") pod \"network-metrics-daemon-q665k\" (UID: \"2dd52262-7f1b-440b-a020-a59da738c3c4\") " pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:26:07.010184 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.009815    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-host\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.010184 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.009819    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:26:07.010184 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.009844    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-host-cni-bin\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.010184 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.009874    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/007c0c12-34f6-4d2b-9af7-9b265c041702-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rllhm\" (UID: \"007c0c12-34f6-4d2b-9af7-9b265c041702\") " pod="openshift-multus/multus-additional-cni-plugins-rllhm"
Jun 11 19:26:07.010184 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:07.009915    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78njs" podUID="a1e44196-5e2e-4051-b4aa-31782fb85476"
Jun 11 19:26:07.010184 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.009925    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ace36f16-b3ef-4f51-90fc-40d44b9cb8b1-tmp-dir\") pod \"node-resolver-dgnbm\" (UID: \"ace36f16-b3ef-4f51-90fc-40d44b9cb8b1\") " pod="openshift-dns/node-resolver-dgnbm"
Jun 11 19:26:07.010184 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.009954    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-etc-sysconfig\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.010184 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.009980    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-etc-sysctl-conf\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.010184 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010015    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-run\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.010184 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010074    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/50300198-b698-41ab-a551-04ad9bb274f7-serviceca\") pod \"node-ca-jxggl\" (UID: \"50300198-b698-41ab-a551-04ad9bb274f7\") " pod="openshift-image-registry/node-ca-jxggl"
Jun 11 19:26:07.010184 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010110    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-log-socket\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.010184 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010142    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-host-run-ovn-kubernetes\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.010184 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010167    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-etc-modprobe-d\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.010799 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010197    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-etc-kubernetes\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.010799 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010226    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-systemd-units\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.010799 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010256    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-host-slash\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.010799 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010283    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-run-ovn\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.010799 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010310    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b609134f-0739-46f3-966e-cc2c63aabe24-ovn-node-metrics-cert\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.010799 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010340    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/007c0c12-34f6-4d2b-9af7-9b265c041702-cnibin\") pod \"multus-additional-cni-plugins-rllhm\" (UID: \"007c0c12-34f6-4d2b-9af7-9b265c041702\") " pod="openshift-multus/multus-additional-cni-plugins-rllhm"
Jun 11 19:26:07.010799 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010401    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/007c0c12-34f6-4d2b-9af7-9b265c041702-os-release\") pod \"multus-additional-cni-plugins-rllhm\" (UID: \"007c0c12-34f6-4d2b-9af7-9b265c041702\") " pod="openshift-multus/multus-additional-cni-plugins-rllhm"
Jun 11 19:26:07.010799 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010441    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ace36f16-b3ef-4f51-90fc-40d44b9cb8b1-hosts-file\") pod \"node-resolver-dgnbm\" (UID: \"ace36f16-b3ef-4f51-90fc-40d44b9cb8b1\") " pod="openshift-dns/node-resolver-dgnbm"
Jun 11 19:26:07.010799 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010473    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2swm"
Jun 11 19:26:07.010799 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010480    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54d4758a-7d2f-4b4d-9a03-4837465a51a0-tmp\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.010799 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010510    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px4jl\" (UniqueName: \"kubernetes.io/projected/50300198-b698-41ab-a551-04ad9bb274f7-kube-api-access-px4jl\") pod \"node-ca-jxggl\" (UID: \"50300198-b698-41ab-a551-04ad9bb274f7\") " pod="openshift-image-registry/node-ca-jxggl"
Jun 11 19:26:07.010799 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010535    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-run-systemd\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.010799 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010592    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-etc-openvswitch\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.010799 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010624    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b609134f-0739-46f3-966e-cc2c63aabe24-ovnkube-config\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.010799 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010650    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/007c0c12-34f6-4d2b-9af7-9b265c041702-cni-binary-copy\") pod \"multus-additional-cni-plugins-rllhm\" (UID: \"007c0c12-34f6-4d2b-9af7-9b265c041702\") " pod="openshift-multus/multus-additional-cni-plugins-rllhm"
Jun 11 19:26:07.010799 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010681    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-host-run-netns\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.010799 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010711    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vmq8\" (UniqueName: \"kubernetes.io/projected/b609134f-0739-46f3-966e-cc2c63aabe24-kube-api-access-8vmq8\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.011520 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010740    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/007c0c12-34f6-4d2b-9af7-9b265c041702-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rllhm\" (UID: \"007c0c12-34f6-4d2b-9af7-9b265c041702\") " pod="openshift-multus/multus-additional-cni-plugins-rllhm"
Jun 11 19:26:07.011520 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010788    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgkxx\" (UniqueName: \"kubernetes.io/projected/007c0c12-34f6-4d2b-9af7-9b265c041702-kube-api-access-sgkxx\") pod \"multus-additional-cni-plugins-rllhm\" (UID: \"007c0c12-34f6-4d2b-9af7-9b265c041702\") " pod="openshift-multus/multus-additional-cni-plugins-rllhm"
Jun 11 19:26:07.011520 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010807    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-etc-systemd\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.011520 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010824    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/50300198-b698-41ab-a551-04ad9bb274f7-host\") pod \"node-ca-jxggl\" (UID: \"50300198-b698-41ab-a551-04ad9bb274f7\") " pod="openshift-image-registry/node-ca-jxggl"
Jun 11 19:26:07.011520 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010850    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-run-openvswitch\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.011520 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010873    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b609134f-0739-46f3-966e-cc2c63aabe24-env-overrides\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.011520 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010918    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b609134f-0739-46f3-966e-cc2c63aabe24-ovnkube-script-lib\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.011520 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010948    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/007c0c12-34f6-4d2b-9af7-9b265c041702-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rllhm\" (UID: \"007c0c12-34f6-4d2b-9af7-9b265c041702\") " pod="openshift-multus/multus-additional-cni-plugins-rllhm"
Jun 11 19:26:07.011520 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.010979    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-etc-sysctl-d\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.011520 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.011001    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-sys\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.011520 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.011029    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/54d4758a-7d2f-4b4d-9a03-4837465a51a0-etc-tuned\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.012470 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.012277    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 11 19:26:07.015973 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.013388    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dcw8t"
Jun 11 19:26:07.015973 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.013970    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 11 19:26:07.015973 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.014290    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 11 19:26:07.015973 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.014483    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 11 19:26:07.018708 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.018684    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 11 19:26:07.018708 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.018705    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 11 19:26:07.019404 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.019020    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 11 19:26:07.019404 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.019186    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mvn89\""
Jun 11 19:26:07.019404 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.019244    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 11 19:26:07.019404 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.019301    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rsl8b\""
Jun 11 19:26:07.022229 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.021423    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.022229 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.022066    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ng878\""
Jun 11 19:26:07.022229 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.022142    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 11 19:26:07.023580 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.023558    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 11 19:26:07.023684 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.023655    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lv2sj\""
Jun 11 19:26:07.023978 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.023868    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 11 19:26:07.046299 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.046274    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mgck6"
Jun 11 19:26:07.051943 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.051919    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mgck6"
Jun 11 19:26:07.079079 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.079030    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal" event={"ID":"5a83bacba9328857248ca50116d2e702","Type":"ContainerStarted","Data":"b2d0e4a49acf8250948c59df70578bb0f5d244b422d3a558c36ed29911bd0503"}
Jun 11 19:26:07.080955 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.080925    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-223.ec2.internal" event={"ID":"b11adcad61b3d220a3d5857bba715038","Type":"ContainerStarted","Data":"2ce707ebb4cdbe35f1b1401db5d5036d5353ebd1b5868643b45863c64b392869"}
Jun 11 19:26:07.093900 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.093864    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jun 11 19:26:07.111690 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.111648    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-system-cni-dir\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.111690 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.111693    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-multus-socket-dir-parent\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.111938 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.111726    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ace36f16-b3ef-4f51-90fc-40d44b9cb8b1-hosts-file\") pod \"node-resolver-dgnbm\" (UID: \"ace36f16-b3ef-4f51-90fc-40d44b9cb8b1\") " pod="openshift-dns/node-resolver-dgnbm"
Jun 11 19:26:07.111938 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.111750    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54d4758a-7d2f-4b4d-9a03-4837465a51a0-tmp\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.111938 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.111775    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b609134f-0739-46f3-966e-cc2c63aabe24-ovnkube-config\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.111938 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.111802    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/007c0c12-34f6-4d2b-9af7-9b265c041702-cni-binary-copy\") pod \"multus-additional-cni-plugins-rllhm\" (UID: \"007c0c12-34f6-4d2b-9af7-9b265c041702\") " pod="openshift-multus/multus-additional-cni-plugins-rllhm"
Jun 11 19:26:07.111938 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.111828    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13-registration-dir\") pod \"aws-ebs-csi-driver-node-n2swm\" (UID: \"fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2swm"
Jun 11 19:26:07.111938 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.111853    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgkxx\" (UniqueName: \"kubernetes.io/projected/007c0c12-34f6-4d2b-9af7-9b265c041702-kube-api-access-sgkxx\") pod \"multus-additional-cni-plugins-rllhm\" (UID: \"007c0c12-34f6-4d2b-9af7-9b265c041702\") " pod="openshift-multus/multus-additional-cni-plugins-rllhm"
Jun 11 19:26:07.112348 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112331    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-multus-conf-dir\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.112400 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112363    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-etc-systemd\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.112400 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112390    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/50300198-b698-41ab-a551-04ad9bb274f7-host\") pod \"node-ca-jxggl\" (UID: \"50300198-b698-41ab-a551-04ad9bb274f7\") " pod="openshift-image-registry/node-ca-jxggl"
Jun 11 19:26:07.112477 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112412    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b609134f-0739-46f3-966e-cc2c63aabe24-env-overrides\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.112477 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112438    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/007c0c12-34f6-4d2b-9af7-9b265c041702-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rllhm\" (UID: \"007c0c12-34f6-4d2b-9af7-9b265c041702\") " pod="openshift-multus/multus-additional-cni-plugins-rllhm"
Jun 11 19:26:07.112477 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112462    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7cd450c3-fc87-48a3-b7ba-617cede6af81-dbus\") pod \"global-pull-secret-syncer-tvlp6\" (UID: \"7cd450c3-fc87-48a3-b7ba-617cede6af81\") " pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:07.112578 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112486    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/54d4758a-7d2f-4b4d-9a03-4837465a51a0-etc-tuned\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.112578 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112510    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-host-kubelet\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.112578 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112544    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.112578 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112559    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13-device-dir\") pod \"aws-ebs-csi-driver-node-n2swm\" (UID: \"fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2swm"
Jun 11 19:26:07.112578 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112574    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13-etc-selinux\") pod \"aws-ebs-csi-driver-node-n2swm\" (UID: \"fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2swm"
Jun 11 19:26:07.112770 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112591    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9hcd\" (UniqueName: \"kubernetes.io/projected/ace36f16-b3ef-4f51-90fc-40d44b9cb8b1-kube-api-access-k9hcd\") pod \"node-resolver-dgnbm\" (UID: \"ace36f16-b3ef-4f51-90fc-40d44b9cb8b1\") " pod="openshift-dns/node-resolver-dgnbm"
Jun 11 19:26:07.112770 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112606    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-lib-modules\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.112770 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112621    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/007c0c12-34f6-4d2b-9af7-9b265c041702-system-cni-dir\") pod \"multus-additional-cni-plugins-rllhm\" (UID: \"007c0c12-34f6-4d2b-9af7-9b265c041702\") " pod="openshift-multus/multus-additional-cni-plugins-rllhm"
Jun 11 19:26:07.112770 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112634    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n2swm\" (UID: \"fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2swm"
Jun 11 19:26:07.112770 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112654    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-host-var-lib-cni-bin\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.112770 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112668    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7cd450c3-fc87-48a3-b7ba-617cede6af81-original-pull-secret\") pod \"global-pull-secret-syncer-tvlp6\" (UID: \"7cd450c3-fc87-48a3-b7ba-617cede6af81\") " pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:07.112770 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112685    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sgcr\" (UniqueName: \"kubernetes.io/projected/2dd52262-7f1b-440b-a020-a59da738c3c4-kube-api-access-5sgcr\") pod \"network-metrics-daemon-q665k\" (UID: \"2dd52262-7f1b-440b-a020-a59da738c3c4\") " pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:26:07.112770 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112701    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-host-cni-bin\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.112770 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112715    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/007c0c12-34f6-4d2b-9af7-9b265c041702-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rllhm\" (UID: \"007c0c12-34f6-4d2b-9af7-9b265c041702\") " pod="openshift-multus/multus-additional-cni-plugins-rllhm"
Jun 11 19:26:07.112770 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112730    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2rm7\" (UniqueName: \"kubernetes.io/projected/fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13-kube-api-access-g2rm7\") pod \"aws-ebs-csi-driver-node-n2swm\" (UID: \"fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2swm"
Jun 11 19:26:07.112770 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112744    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/99c61b60-d4aa-4190-95b4-78bb4bab2c71-cni-binary-copy\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.112770 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112758    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ace36f16-b3ef-4f51-90fc-40d44b9cb8b1-tmp-dir\") pod \"node-resolver-dgnbm\" (UID: \"ace36f16-b3ef-4f51-90fc-40d44b9cb8b1\") " pod="openshift-dns/node-resolver-dgnbm"
Jun 11 19:26:07.113250 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112771    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-etc-sysconfig\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.113250 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112797    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-etc-sysctl-conf\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.113250 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112817    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-run\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.113250 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112832    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/50300198-b698-41ab-a551-04ad9bb274f7-serviceca\") pod \"node-ca-jxggl\" (UID: \"50300198-b698-41ab-a551-04ad9bb274f7\") " pod="openshift-image-registry/node-ca-jxggl"
Jun 11 19:26:07.113250 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112853    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-host-run-ovn-kubernetes\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.113250 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112910    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13-socket-dir\") pod \"aws-ebs-csi-driver-node-n2swm\" (UID: \"fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2swm"
Jun 11 19:26:07.113250 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112927    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ae16dd28-35c8-4a34-ad9a-487fe90caabe-konnectivity-ca\") pod \"konnectivity-agent-dcw8t\" (UID: \"ae16dd28-35c8-4a34-ad9a-487fe90caabe\") " pod="kube-system/konnectivity-agent-dcw8t"
Jun 11 19:26:07.113250 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112942    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-etc-kubernetes\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.113250 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112955    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-host-slash\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.113250 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112974    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-run-ovn\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.113250 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.112988    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b609134f-0739-46f3-966e-cc2c63aabe24-ovn-node-metrics-cert\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.113250 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113002    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/007c0c12-34f6-4d2b-9af7-9b265c041702-cnibin\") pod \"multus-additional-cni-plugins-rllhm\" (UID: \"007c0c12-34f6-4d2b-9af7-9b265c041702\") " pod="openshift-multus/multus-additional-cni-plugins-rllhm"
Jun 11 19:26:07.113250 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113016    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/007c0c12-34f6-4d2b-9af7-9b265c041702-os-release\") pod \"multus-additional-cni-plugins-rllhm\" (UID: \"007c0c12-34f6-4d2b-9af7-9b265c041702\") " pod="openshift-multus/multus-additional-cni-plugins-rllhm"
Jun 11 19:26:07.113250 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113029    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ae16dd28-35c8-4a34-ad9a-487fe90caabe-agent-certs\") pod \"konnectivity-agent-dcw8t\" (UID: \"ae16dd28-35c8-4a34-ad9a-487fe90caabe\") " pod="kube-system/konnectivity-agent-dcw8t"
Jun 11 19:26:07.113250 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113046    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-cnibin\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.113250 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113061    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px4jl\" (UniqueName: \"kubernetes.io/projected/50300198-b698-41ab-a551-04ad9bb274f7-kube-api-access-px4jl\") pod \"node-ca-jxggl\" (UID: \"50300198-b698-41ab-a551-04ad9bb274f7\") " pod="openshift-image-registry/node-ca-jxggl"
Jun 11 19:26:07.113250 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113076    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-run-systemd\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.113877 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113091    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-etc-openvswitch\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.113877 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113114    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-os-release\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.113877 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113133    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-host-var-lib-kubelet\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.113877 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113147    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/99c61b60-d4aa-4190-95b4-78bb4bab2c71-multus-daemon-config\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.113877 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113162    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-host-run-netns\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.113877 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113177    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vmq8\" (UniqueName: \"kubernetes.io/projected/b609134f-0739-46f3-966e-cc2c63aabe24-kube-api-access-8vmq8\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.113877 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113193    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/007c0c12-34f6-4d2b-9af7-9b265c041702-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rllhm\" (UID: \"007c0c12-34f6-4d2b-9af7-9b265c041702\") " pod="openshift-multus/multus-additional-cni-plugins-rllhm"
Jun 11 19:26:07.113877 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113208    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzzd2\" (UniqueName: \"kubernetes.io/projected/8fd84b63-f9b6-483f-8ed3-f902d9bbd2e7-kube-api-access-gzzd2\") pod \"iptables-alerter-97fzw\" (UID: \"8fd84b63-f9b6-483f-8ed3-f902d9bbd2e7\") " pod="openshift-network-operator/iptables-alerter-97fzw"
Jun 11 19:26:07.113877 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113222    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-host-run-k8s-cni-cncf-io\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.113877 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113238    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwbgs\" (UniqueName: \"kubernetes.io/projected/a1e44196-5e2e-4051-b4aa-31782fb85476-kube-api-access-cwbgs\") pod \"network-check-target-78njs\" (UID: \"a1e44196-5e2e-4051-b4aa-31782fb85476\") " pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:26:07.113877 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113253    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-run-openvswitch\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.113877 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113267    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b609134f-0739-46f3-966e-cc2c63aabe24-ovnkube-script-lib\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.113877 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113281    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-host-var-lib-cni-multus\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.113877 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113296    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-etc-sysctl-d\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.113877 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113309    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-sys\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.113877 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113325    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9dls\" (UniqueName: \"kubernetes.io/projected/54d4758a-7d2f-4b4d-9a03-4837465a51a0-kube-api-access-q9dls\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.113877 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113341    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-var-lib-openvswitch\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.114611 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-node-log\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.114611 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113370    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-host-cni-netd\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.114611 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113384    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8fd84b63-f9b6-483f-8ed3-f902d9bbd2e7-host-slash\") pod \"iptables-alerter-97fzw\" (UID: \"8fd84b63-f9b6-483f-8ed3-f902d9bbd2e7\") " pod="openshift-network-operator/iptables-alerter-97fzw"
Jun 11 19:26:07.114611 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113399    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-etc-kubernetes\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.114611 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113414    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs\") pod \"network-metrics-daemon-q665k\" (UID: \"2dd52262-7f1b-440b-a020-a59da738c3c4\") " pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:26:07.114611 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113433    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-var-lib-kubelet\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.114611 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113448    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw2wd\" (UniqueName: \"kubernetes.io/projected/99c61b60-d4aa-4190-95b4-78bb4bab2c71-kube-api-access-rw2wd\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.114611 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113465    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-host\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.114611 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113479    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-multus-cni-dir\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.114611 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113492    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-host-run-netns\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.114611 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113510    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-log-socket\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.114611 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113524    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-hostroot\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.114611 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113537    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-host-run-multus-certs\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.114611 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113551    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7cd450c3-fc87-48a3-b7ba-617cede6af81-kubelet-config\") pod \"global-pull-secret-syncer-tvlp6\" (UID: \"7cd450c3-fc87-48a3-b7ba-617cede6af81\") " pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:07.114611 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113567    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-etc-modprobe-d\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.114611 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113583    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-systemd-units\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.114611 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113598    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8fd84b63-f9b6-483f-8ed3-f902d9bbd2e7-iptables-alerter-script\") pod \"iptables-alerter-97fzw\" (UID: \"8fd84b63-f9b6-483f-8ed3-f902d9bbd2e7\") " pod="openshift-network-operator/iptables-alerter-97fzw"
Jun 11 19:26:07.115293 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113613    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13-sys-fs\") pod \"aws-ebs-csi-driver-node-n2swm\" (UID: \"fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2swm"
Jun 11 19:26:07.115293 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.113713    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ace36f16-b3ef-4f51-90fc-40d44b9cb8b1-hosts-file\") pod \"node-resolver-dgnbm\" (UID: \"ace36f16-b3ef-4f51-90fc-40d44b9cb8b1\") " pod="openshift-dns/node-resolver-dgnbm"
Jun 11 19:26:07.115293 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.114144    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 11 19:26:07.115293 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.114494    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/007c0c12-34f6-4d2b-9af7-9b265c041702-cnibin\") pod \"multus-additional-cni-plugins-rllhm\" (UID: \"007c0c12-34f6-4d2b-9af7-9b265c041702\") " pod="openshift-multus/multus-additional-cni-plugins-rllhm"
Jun 11 19:26:07.115293 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.115081    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b609134f-0739-46f3-966e-cc2c63aabe24-ovnkube-config\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.115468 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.115446    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-host-cni-bin\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.115555 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.115538    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/007c0c12-34f6-4d2b-9af7-9b265c041702-cni-binary-copy\") pod \"multus-additional-cni-plugins-rllhm\" (UID: \"007c0c12-34f6-4d2b-9af7-9b265c041702\") " pod="openshift-multus/multus-additional-cni-plugins-rllhm"
Jun 11 19:26:07.115605 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.115592    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/007c0c12-34f6-4d2b-9af7-9b265c041702-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rllhm\" (UID: \"007c0c12-34f6-4d2b-9af7-9b265c041702\") " pod="openshift-multus/multus-additional-cni-plugins-rllhm"
Jun 11 19:26:07.115868 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.115849    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ace36f16-b3ef-4f51-90fc-40d44b9cb8b1-tmp-dir\") pod \"node-resolver-dgnbm\" (UID: \"ace36f16-b3ef-4f51-90fc-40d44b9cb8b1\") " pod="openshift-dns/node-resolver-dgnbm"
Jun 11 19:26:07.115940 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.115849    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-etc-systemd\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.115940 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.115910    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/50300198-b698-41ab-a551-04ad9bb274f7-host\") pod \"node-ca-jxggl\" (UID: \"50300198-b698-41ab-a551-04ad9bb274f7\") " pod="openshift-image-registry/node-ca-jxggl"
Jun 11 19:26:07.116033 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.115983    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-host-slash\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.116033 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.115990    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.116127 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.116055    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-etc-sysconfig\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.116127 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.116102    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-etc-sysctl-conf\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.116263 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.116240    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/007c0c12-34f6-4d2b-9af7-9b265c041702-os-release\") pod \"multus-additional-cni-plugins-rllhm\" (UID: \"007c0c12-34f6-4d2b-9af7-9b265c041702\") " pod="openshift-multus/multus-additional-cni-plugins-rllhm"
Jun 11 19:26:07.116328 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.116291    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-host-run-ovn-kubernetes\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.116389 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.116338    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-sys\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.116389 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.116381    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-systemd-units\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.116504 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.116450    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-run\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.116563 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.116493    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-host\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.116624 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.116587    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-node-log\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.116682 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.116628    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-var-lib-openvswitch\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.116737 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.116722    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/007c0c12-34f6-4d2b-9af7-9b265c041702-system-cni-dir\") pod \"multus-additional-cni-plugins-rllhm\" (UID: \"007c0c12-34f6-4d2b-9af7-9b265c041702\") " pod="openshift-multus/multus-additional-cni-plugins-rllhm"
Jun 11 19:26:07.116792 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.116745    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-lib-modules\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.116792 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.116771    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-log-socket\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.116792 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.116781    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-run-ovn\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.116964 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.116813    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-host-cni-netd\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.116964 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.116853    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-host-kubelet\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.117063 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.117035    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b609134f-0739-46f3-966e-cc2c63aabe24-env-overrides\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.117115 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.117058    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-etc-modprobe-d\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.117115 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.117092    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-etc-openvswitch\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.117209 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:07.117177    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 19:26:07.117271 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:07.117254    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs podName:2dd52262-7f1b-440b-a020-a59da738c3c4 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:07.617234459 +0000 UTC m=+3.021150561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs") pod "network-metrics-daemon-q665k" (UID: "2dd52262-7f1b-440b-a020-a59da738c3c4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 19:26:07.117271 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.117261    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/007c0c12-34f6-4d2b-9af7-9b265c041702-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rllhm\" (UID: \"007c0c12-34f6-4d2b-9af7-9b265c041702\") " pod="openshift-multus/multus-additional-cni-plugins-rllhm"
Jun 11 19:26:07.117385 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.117319    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-var-lib-kubelet\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.117435 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.117385    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-run-openvswitch\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.117721 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.117547    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-run-systemd\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.117721 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.117594    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b609134f-0739-46f3-966e-cc2c63aabe24-host-run-netns\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.117721 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.117649    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/50300198-b698-41ab-a551-04ad9bb274f7-serviceca\") pod \"node-ca-jxggl\" (UID: \"50300198-b698-41ab-a551-04ad9bb274f7\") " pod="openshift-image-registry/node-ca-jxggl"
Jun 11 19:26:07.117721 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.117683    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-etc-sysctl-d\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.117721 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.117707    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54d4758a-7d2f-4b4d-9a03-4837465a51a0-etc-kubernetes\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.122273 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.122241    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/007c0c12-34f6-4d2b-9af7-9b265c041702-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rllhm\" (UID: \"007c0c12-34f6-4d2b-9af7-9b265c041702\") " pod="openshift-multus/multus-additional-cni-plugins-rllhm"
Jun 11 19:26:07.122404 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.122279    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b609134f-0739-46f3-966e-cc2c63aabe24-ovn-node-metrics-cert\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.122519 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.122497    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b609134f-0739-46f3-966e-cc2c63aabe24-ovnkube-script-lib\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.123119 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.123078    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/54d4758a-7d2f-4b4d-9a03-4837465a51a0-etc-tuned\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.123509 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.123487    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54d4758a-7d2f-4b4d-9a03-4837465a51a0-tmp\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.125367 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.125346    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9hcd\" (UniqueName: \"kubernetes.io/projected/ace36f16-b3ef-4f51-90fc-40d44b9cb8b1-kube-api-access-k9hcd\") pod \"node-resolver-dgnbm\" (UID: \"ace36f16-b3ef-4f51-90fc-40d44b9cb8b1\") " pod="openshift-dns/node-resolver-dgnbm"
Jun 11 19:26:07.125454 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.125437    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px4jl\" (UniqueName: \"kubernetes.io/projected/50300198-b698-41ab-a551-04ad9bb274f7-kube-api-access-px4jl\") pod \"node-ca-jxggl\" (UID: \"50300198-b698-41ab-a551-04ad9bb274f7\") " pod="openshift-image-registry/node-ca-jxggl"
Jun 11 19:26:07.125923 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.125897    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgkxx\" (UniqueName: \"kubernetes.io/projected/007c0c12-34f6-4d2b-9af7-9b265c041702-kube-api-access-sgkxx\") pod \"multus-additional-cni-plugins-rllhm\" (UID: \"007c0c12-34f6-4d2b-9af7-9b265c041702\") " pod="openshift-multus/multus-additional-cni-plugins-rllhm"
Jun 11 19:26:07.126248 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.126231    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sgcr\" (UniqueName: \"kubernetes.io/projected/2dd52262-7f1b-440b-a020-a59da738c3c4-kube-api-access-5sgcr\") pod \"network-metrics-daemon-q665k\" (UID: \"2dd52262-7f1b-440b-a020-a59da738c3c4\") " pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:26:07.134338 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.134313    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vmq8\" (UniqueName: \"kubernetes.io/projected/b609134f-0739-46f3-966e-cc2c63aabe24-kube-api-access-8vmq8\") pod \"ovnkube-node-n2n72\" (UID: \"b609134f-0739-46f3-966e-cc2c63aabe24\") " pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.137408 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.137377    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9dls\" (UniqueName: \"kubernetes.io/projected/54d4758a-7d2f-4b4d-9a03-4837465a51a0-kube-api-access-q9dls\") pod \"tuned-jbjqk\" (UID: \"54d4758a-7d2f-4b4d-9a03-4837465a51a0\") " pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.214493 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.214446    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-hostroot\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.214493 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.214497    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-host-run-multus-certs\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.214706 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.214524    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7cd450c3-fc87-48a3-b7ba-617cede6af81-kubelet-config\") pod \"global-pull-secret-syncer-tvlp6\" (UID: \"7cd450c3-fc87-48a3-b7ba-617cede6af81\") " pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:07.214706 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.214523    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-hostroot\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.214706 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.214552    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8fd84b63-f9b6-483f-8ed3-f902d9bbd2e7-iptables-alerter-script\") pod \"iptables-alerter-97fzw\" (UID: \"8fd84b63-f9b6-483f-8ed3-f902d9bbd2e7\") " pod="openshift-network-operator/iptables-alerter-97fzw"
Jun 11 19:26:07.214706 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.214615    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-host-run-multus-certs\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.214706 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.214615    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7cd450c3-fc87-48a3-b7ba-617cede6af81-kubelet-config\") pod \"global-pull-secret-syncer-tvlp6\" (UID: \"7cd450c3-fc87-48a3-b7ba-617cede6af81\") " pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:07.214706 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.214641    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13-sys-fs\") pod \"aws-ebs-csi-driver-node-n2swm\" (UID: \"fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2swm"
Jun 11 19:26:07.214706 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.214671    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-system-cni-dir\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.214706 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.214698    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-multus-socket-dir-parent\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.215159 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.214730    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13-registration-dir\") pod \"aws-ebs-csi-driver-node-n2swm\" (UID: \"fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2swm"
Jun 11 19:26:07.215159 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.214758    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-multus-conf-dir\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.215159 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.214764    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13-sys-fs\") pod \"aws-ebs-csi-driver-node-n2swm\" (UID: \"fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2swm"
Jun 11 19:26:07.215159 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.214820    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-system-cni-dir\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.215159 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.214822    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-multus-conf-dir\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.215159 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.214840    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7cd450c3-fc87-48a3-b7ba-617cede6af81-dbus\") pod \"global-pull-secret-syncer-tvlp6\" (UID: \"7cd450c3-fc87-48a3-b7ba-617cede6af81\") " pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:07.215159 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.214872    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13-device-dir\") pod \"aws-ebs-csi-driver-node-n2swm\" (UID: \"fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2swm"
Jun 11 19:26:07.215159 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.214910    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-multus-socket-dir-parent\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.215159 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.214913    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13-etc-selinux\") pod \"aws-ebs-csi-driver-node-n2swm\" (UID: \"fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2swm"
Jun 11 19:26:07.215159 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.214950    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n2swm\" (UID: \"fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2swm"
Jun 11 19:26:07.215159 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.214976    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-host-var-lib-cni-bin\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.215159 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.215002    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7cd450c3-fc87-48a3-b7ba-617cede6af81-original-pull-secret\") pod \"global-pull-secret-syncer-tvlp6\" (UID: \"7cd450c3-fc87-48a3-b7ba-617cede6af81\") " pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:07.215159 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.215012    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13-etc-selinux\") pod \"aws-ebs-csi-driver-node-n2swm\" (UID: \"fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2swm"
Jun 11 19:26:07.215159 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.215022    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8fd84b63-f9b6-483f-8ed3-f902d9bbd2e7-iptables-alerter-script\") pod \"iptables-alerter-97fzw\" (UID: \"8fd84b63-f9b6-483f-8ed3-f902d9bbd2e7\") " pod="openshift-network-operator/iptables-alerter-97fzw"
Jun 11 19:26:07.215159 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.215031    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2rm7\" (UniqueName: \"kubernetes.io/projected/fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13-kube-api-access-g2rm7\") pod \"aws-ebs-csi-driver-node-n2swm\" (UID: \"fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2swm"
Jun 11 19:26:07.215159 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.215059    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/99c61b60-d4aa-4190-95b4-78bb4bab2c71-cni-binary-copy\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.215159 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.215091    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13-socket-dir\") pod \"aws-ebs-csi-driver-node-n2swm\" (UID: \"fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2swm"
Jun 11 19:26:07.215986 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.215093    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13-device-dir\") pod \"aws-ebs-csi-driver-node-n2swm\" (UID: \"fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2swm"
Jun 11 19:26:07.215986 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.215118    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7cd450c3-fc87-48a3-b7ba-617cede6af81-dbus\") pod \"global-pull-secret-syncer-tvlp6\" (UID: \"7cd450c3-fc87-48a3-b7ba-617cede6af81\") " pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:07.215986 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.215117    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ae16dd28-35c8-4a34-ad9a-487fe90caabe-konnectivity-ca\") pod \"konnectivity-agent-dcw8t\" (UID: \"ae16dd28-35c8-4a34-ad9a-487fe90caabe\") " pod="kube-system/konnectivity-agent-dcw8t"
Jun 11 19:26:07.215986 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:07.215182    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 11 19:26:07.215986 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:07.215252    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd450c3-fc87-48a3-b7ba-617cede6af81-original-pull-secret podName:7cd450c3-fc87-48a3-b7ba-617cede6af81 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:07.715233655 +0000 UTC m=+3.119149745 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7cd450c3-fc87-48a3-b7ba-617cede6af81-original-pull-secret") pod "global-pull-secret-syncer-tvlp6" (UID: "7cd450c3-fc87-48a3-b7ba-617cede6af81") : object "kube-system"/"original-pull-secret" not registered
Jun 11 19:26:07.215986 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.215271    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13-socket-dir\") pod \"aws-ebs-csi-driver-node-n2swm\" (UID: \"fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2swm"
Jun 11 19:26:07.215986 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.215449    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13-registration-dir\") pod \"aws-ebs-csi-driver-node-n2swm\" (UID: \"fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2swm"
Jun 11 19:26:07.215986 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.215493    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n2swm\" (UID: \"fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2swm"
Jun 11 19:26:07.215986 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.215532    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-host-var-lib-cni-bin\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.215986 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.215564    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ae16dd28-35c8-4a34-ad9a-487fe90caabe-agent-certs\") pod \"konnectivity-agent-dcw8t\" (UID: \"ae16dd28-35c8-4a34-ad9a-487fe90caabe\") " pod="kube-system/konnectivity-agent-dcw8t"
Jun 11 19:26:07.215986 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.215588    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-cnibin\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.215986 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.215617    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-os-release\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.215986 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.215641    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-host-var-lib-kubelet\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.215986 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.215663    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/99c61b60-d4aa-4190-95b4-78bb4bab2c71-cni-binary-copy\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.215986 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.215730    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-os-release\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.215986 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.215770    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-host-var-lib-kubelet\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.215986 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.215664    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/99c61b60-d4aa-4190-95b4-78bb4bab2c71-multus-daemon-config\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.216730 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.215806    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzzd2\" (UniqueName: \"kubernetes.io/projected/8fd84b63-f9b6-483f-8ed3-f902d9bbd2e7-kube-api-access-gzzd2\") pod \"iptables-alerter-97fzw\" (UID: \"8fd84b63-f9b6-483f-8ed3-f902d9bbd2e7\") " pod="openshift-network-operator/iptables-alerter-97fzw"
Jun 11 19:26:07.216730 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.215832    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-host-run-k8s-cni-cncf-io\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.216730 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.215859    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwbgs\" (UniqueName: \"kubernetes.io/projected/a1e44196-5e2e-4051-b4aa-31782fb85476-kube-api-access-cwbgs\") pod \"network-check-target-78njs\" (UID: \"a1e44196-5e2e-4051-b4aa-31782fb85476\") " pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:26:07.216730 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.215901    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-host-var-lib-cni-multus\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.216730 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.215931    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8fd84b63-f9b6-483f-8ed3-f902d9bbd2e7-host-slash\") pod \"iptables-alerter-97fzw\" (UID: \"8fd84b63-f9b6-483f-8ed3-f902d9bbd2e7\") " pod="openshift-network-operator/iptables-alerter-97fzw"
Jun 11 19:26:07.216730 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.215954    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-etc-kubernetes\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.216730 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.216000    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw2wd\" (UniqueName: \"kubernetes.io/projected/99c61b60-d4aa-4190-95b4-78bb4bab2c71-kube-api-access-rw2wd\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.216730 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.216026    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-multus-cni-dir\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.216730 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.216048    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-host-run-netns\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.216730 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.216072    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-host-var-lib-cni-multus\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.216730 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.216080    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ae16dd28-35c8-4a34-ad9a-487fe90caabe-konnectivity-ca\") pod \"konnectivity-agent-dcw8t\" (UID: \"ae16dd28-35c8-4a34-ad9a-487fe90caabe\") " pod="kube-system/konnectivity-agent-dcw8t"
Jun 11 19:26:07.216730 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.216117    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8fd84b63-f9b6-483f-8ed3-f902d9bbd2e7-host-slash\") pod \"iptables-alerter-97fzw\" (UID: \"8fd84b63-f9b6-483f-8ed3-f902d9bbd2e7\") " pod="openshift-network-operator/iptables-alerter-97fzw"
Jun 11 19:26:07.216730 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.216117    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/99c61b60-d4aa-4190-95b4-78bb4bab2c71-multus-daemon-config\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.216730 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.216099    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-host-run-netns\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.216730 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.216210    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-etc-kubernetes\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.216730 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.216274    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-multus-cni-dir\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.216730 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.216283    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-cnibin\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.216730 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.216335    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/99c61b60-d4aa-4190-95b4-78bb4bab2c71-host-run-k8s-cni-cncf-io\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.222257 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.222222    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ae16dd28-35c8-4a34-ad9a-487fe90caabe-agent-certs\") pod \"konnectivity-agent-dcw8t\" (UID: \"ae16dd28-35c8-4a34-ad9a-487fe90caabe\") " pod="kube-system/konnectivity-agent-dcw8t"
Jun 11 19:26:07.222419 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:07.222364    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 11 19:26:07.222419 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:07.222385    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 11 19:26:07.222419 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:07.222398    2565 projected.go:196] Error preparing data for projected volume kube-api-access-cwbgs for pod openshift-network-diagnostics/network-check-target-78njs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 19:26:07.222589 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:07.222464    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1e44196-5e2e-4051-b4aa-31782fb85476-kube-api-access-cwbgs podName:a1e44196-5e2e-4051-b4aa-31782fb85476 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:07.722446295 +0000 UTC m=+3.126362400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cwbgs" (UniqueName: "kubernetes.io/projected/a1e44196-5e2e-4051-b4aa-31782fb85476-kube-api-access-cwbgs") pod "network-check-target-78njs" (UID: "a1e44196-5e2e-4051-b4aa-31782fb85476") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 19:26:07.223656 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.223596    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2rm7\" (UniqueName: \"kubernetes.io/projected/fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13-kube-api-access-g2rm7\") pod \"aws-ebs-csi-driver-node-n2swm\" (UID: \"fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2swm"
Jun 11 19:26:07.224301 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.224279    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzzd2\" (UniqueName: \"kubernetes.io/projected/8fd84b63-f9b6-483f-8ed3-f902d9bbd2e7-kube-api-access-gzzd2\") pod \"iptables-alerter-97fzw\" (UID: \"8fd84b63-f9b6-483f-8ed3-f902d9bbd2e7\") " pod="openshift-network-operator/iptables-alerter-97fzw"
Jun 11 19:26:07.224514 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.224493    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw2wd\" (UniqueName: \"kubernetes.io/projected/99c61b60-d4aa-4190-95b4-78bb4bab2c71-kube-api-access-rw2wd\") pod \"multus-hzp4x\" (UID: \"99c61b60-d4aa-4190-95b4-78bb4bab2c71\") " pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.306918 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.306874    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 11 19:26:07.307949 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.307933    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dgnbm"
Jun 11 19:26:07.325104 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.325076    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jbjqk"
Jun 11 19:26:07.331831 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.331803    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jxggl"
Jun 11 19:26:07.340620 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.340599    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:07.348500 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.348474    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rllhm"
Jun 11 19:26:07.357338 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.357313    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-97fzw"
Jun 11 19:26:07.364255 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.364232    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2swm"
Jun 11 19:26:07.372988 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.372961    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dcw8t"
Jun 11 19:26:07.382812 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.382791    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hzp4x"
Jun 11 19:26:07.619821 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.619726    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs\") pod \"network-metrics-daemon-q665k\" (UID: \"2dd52262-7f1b-440b-a020-a59da738c3c4\") " pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:26:07.620019 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:07.619863    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 19:26:07.620019 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:07.619940    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs podName:2dd52262-7f1b-440b-a020-a59da738c3c4 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:08.619921991 +0000 UTC m=+4.023838077 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs") pod "network-metrics-daemon-q665k" (UID: "2dd52262-7f1b-440b-a020-a59da738c3c4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 19:26:07.720533 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.720499    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7cd450c3-fc87-48a3-b7ba-617cede6af81-original-pull-secret\") pod \"global-pull-secret-syncer-tvlp6\" (UID: \"7cd450c3-fc87-48a3-b7ba-617cede6af81\") " pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:07.720739 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:07.720636    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 11 19:26:07.720739 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:07.720711    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd450c3-fc87-48a3-b7ba-617cede6af81-original-pull-secret podName:7cd450c3-fc87-48a3-b7ba-617cede6af81 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:08.720690786 +0000 UTC m=+4.124606871 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7cd450c3-fc87-48a3-b7ba-617cede6af81-original-pull-secret") pod "global-pull-secret-syncer-tvlp6" (UID: "7cd450c3-fc87-48a3-b7ba-617cede6af81") : object "kube-system"/"original-pull-secret" not registered
Jun 11 19:26:07.821181 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:07.821136    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwbgs\" (UniqueName: \"kubernetes.io/projected/a1e44196-5e2e-4051-b4aa-31782fb85476-kube-api-access-cwbgs\") pod \"network-check-target-78njs\" (UID: \"a1e44196-5e2e-4051-b4aa-31782fb85476\") " pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:26:07.821356 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:07.821334    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 11 19:26:07.821404 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:07.821366    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 11 19:26:07.821404 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:07.821381    2565 projected.go:196] Error preparing data for projected volume kube-api-access-cwbgs for pod openshift-network-diagnostics/network-check-target-78njs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 19:26:07.821482 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:07.821449    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1e44196-5e2e-4051-b4aa-31782fb85476-kube-api-access-cwbgs podName:a1e44196-5e2e-4051-b4aa-31782fb85476 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:08.821427771 +0000 UTC m=+4.225343856 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cwbgs" (UniqueName: "kubernetes.io/projected/a1e44196-5e2e-4051-b4aa-31782fb85476-kube-api-access-cwbgs") pod "network-check-target-78njs" (UID: "a1e44196-5e2e-4051-b4aa-31782fb85476") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 19:26:08.055094 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:08.055048    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 19:21:07 +0000 UTC" deadline="2027-11-20 03:51:08.754827737 +0000 UTC"
Jun 11 19:26:08.055094 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:08.055089    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12632h25m0.699743728s"
Jun 11 19:26:08.072477 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:08.072450    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:08.072628 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:08.072570    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvlp6" podUID="7cd450c3-fc87-48a3-b7ba-617cede6af81"
Jun 11 19:26:08.225022 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:08.224977    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podace36f16_b3ef_4f51_90fc_40d44b9cb8b1.slice/crio-8e2d1902966e72fc88b254eb73fe6c4e6b3d7295bad6acd99360dfc1425baa3b WatchSource:0}: Error finding container 8e2d1902966e72fc88b254eb73fe6c4e6b3d7295bad6acd99360dfc1425baa3b: Status 404 returned error can't find the container with id 8e2d1902966e72fc88b254eb73fe6c4e6b3d7295bad6acd99360dfc1425baa3b
Jun 11 19:26:08.227503 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:08.227472    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod007c0c12_34f6_4d2b_9af7_9b265c041702.slice/crio-fe1cbd79fc33c7bf65fbab24555e5c04d63a87f0ec5d3a7eae0abd3735eb3f6c WatchSource:0}: Error finding container fe1cbd79fc33c7bf65fbab24555e5c04d63a87f0ec5d3a7eae0abd3735eb3f6c: Status 404 returned error can't find the container with id fe1cbd79fc33c7bf65fbab24555e5c04d63a87f0ec5d3a7eae0abd3735eb3f6c
Jun 11 19:26:08.232266 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:08.232235    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fd84b63_f9b6_483f_8ed3_f902d9bbd2e7.slice/crio-4ef7397800d0ef803ab1aff779ee2a91e73e6639606ea8ef3dadff7401c89cb8 WatchSource:0}: Error finding container 4ef7397800d0ef803ab1aff779ee2a91e73e6639606ea8ef3dadff7401c89cb8: Status 404 returned error can't find the container with id 4ef7397800d0ef803ab1aff779ee2a91e73e6639606ea8ef3dadff7401c89cb8
Jun 11 19:26:08.254905 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:08.254856    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae16dd28_35c8_4a34_ad9a_487fe90caabe.slice/crio-e483862d3f7f1158e4b12212833ef2ea4b75eeed575fa519bda5dfc7de5b4b6e WatchSource:0}: Error finding container e483862d3f7f1158e4b12212833ef2ea4b75eeed575fa519bda5dfc7de5b4b6e: Status 404 returned error can't find the container with id e483862d3f7f1158e4b12212833ef2ea4b75eeed575fa519bda5dfc7de5b4b6e
Jun 11 19:26:08.255840 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:08.255812    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99c61b60_d4aa_4190_95b4_78bb4bab2c71.slice/crio-effb7a1694f9a9078fc3dea14cad3679776072293725ddb1f289f54affd5ba5c WatchSource:0}: Error finding container effb7a1694f9a9078fc3dea14cad3679776072293725ddb1f289f54affd5ba5c: Status 404 returned error can't find the container with id effb7a1694f9a9078fc3dea14cad3679776072293725ddb1f289f54affd5ba5c
Jun 11 19:26:08.257526 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:08.257442    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb609134f_0739_46f3_966e_cc2c63aabe24.slice/crio-1d5c246dae283dcd4b3101d3a182e7a9f09eaf7a9e0dff6d7d0dd613fe64d030 WatchSource:0}: Error finding container 1d5c246dae283dcd4b3101d3a182e7a9f09eaf7a9e0dff6d7d0dd613fe64d030: Status 404 returned error can't find the container with id 1d5c246dae283dcd4b3101d3a182e7a9f09eaf7a9e0dff6d7d0dd613fe64d030
Jun 11 19:26:08.258646 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:08.258623    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50300198_b698_41ab_a551_04ad9bb274f7.slice/crio-f8c41d8857df06142b52c0b434dfb2a9e349e5ba076bed9cf7c66f2073ea427a WatchSource:0}: Error finding container f8c41d8857df06142b52c0b434dfb2a9e349e5ba076bed9cf7c66f2073ea427a: Status 404 returned error can't find the container with id f8c41d8857df06142b52c0b434dfb2a9e349e5ba076bed9cf7c66f2073ea427a
Jun 11 19:26:08.627073 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:08.626858    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs\") pod \"network-metrics-daemon-q665k\" (UID: \"2dd52262-7f1b-440b-a020-a59da738c3c4\") " pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:26:08.627226 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:08.627010    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 19:26:08.627226 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:08.627138    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs podName:2dd52262-7f1b-440b-a020-a59da738c3c4 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:10.627122202 +0000 UTC m=+6.031038287 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs") pod "network-metrics-daemon-q665k" (UID: "2dd52262-7f1b-440b-a020-a59da738c3c4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 19:26:08.728276 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:08.728237    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7cd450c3-fc87-48a3-b7ba-617cede6af81-original-pull-secret\") pod \"global-pull-secret-syncer-tvlp6\" (UID: \"7cd450c3-fc87-48a3-b7ba-617cede6af81\") " pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:08.728564 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:08.728516    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 11 19:26:08.728650 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:08.728635    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd450c3-fc87-48a3-b7ba-617cede6af81-original-pull-secret podName:7cd450c3-fc87-48a3-b7ba-617cede6af81 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:10.728613001 +0000 UTC m=+6.132529107 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7cd450c3-fc87-48a3-b7ba-617cede6af81-original-pull-secret") pod "global-pull-secret-syncer-tvlp6" (UID: "7cd450c3-fc87-48a3-b7ba-617cede6af81") : object "kube-system"/"original-pull-secret" not registered
Jun 11 19:26:08.829227 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:08.829138    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwbgs\" (UniqueName: \"kubernetes.io/projected/a1e44196-5e2e-4051-b4aa-31782fb85476-kube-api-access-cwbgs\") pod \"network-check-target-78njs\" (UID: \"a1e44196-5e2e-4051-b4aa-31782fb85476\") " pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:26:08.829420 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:08.829369    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 11 19:26:08.829420 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:08.829387    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 11 19:26:08.829420 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:08.829400    2565 projected.go:196] Error preparing data for projected volume kube-api-access-cwbgs for pod openshift-network-diagnostics/network-check-target-78njs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 19:26:08.829515 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:08.829456    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1e44196-5e2e-4051-b4aa-31782fb85476-kube-api-access-cwbgs podName:a1e44196-5e2e-4051-b4aa-31782fb85476 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:10.829439643 +0000 UTC m=+6.233355730 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cwbgs" (UniqueName: "kubernetes.io/projected/a1e44196-5e2e-4051-b4aa-31782fb85476-kube-api-access-cwbgs") pod "network-check-target-78njs" (UID: "a1e44196-5e2e-4051-b4aa-31782fb85476") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 19:26:09.055591 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:09.055523    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 19:21:07 +0000 UTC" deadline="2028-02-18 05:43:27.044376876 +0000 UTC"
Jun 11 19:26:09.055591 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:09.055589    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14794h17m17.988792549s"
Jun 11 19:26:09.074319 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:09.074253    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:26:09.074502 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:09.074393    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q665k" podUID="2dd52262-7f1b-440b-a020-a59da738c3c4"
Jun 11 19:26:09.074797 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:09.074770    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:26:09.074939 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:09.074911    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78njs" podUID="a1e44196-5e2e-4051-b4aa-31782fb85476"
Jun 11 19:26:09.101318 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:09.101216    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dcw8t" event={"ID":"ae16dd28-35c8-4a34-ad9a-487fe90caabe","Type":"ContainerStarted","Data":"e483862d3f7f1158e4b12212833ef2ea4b75eeed575fa519bda5dfc7de5b4b6e"}
Jun 11 19:26:09.109537 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:09.109497    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2swm" event={"ID":"fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13","Type":"ContainerStarted","Data":"578289439c0c5780b21034364fde34aaff992c1d08055578c6a9e34109ecde83"}
Jun 11 19:26:09.111574 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:09.111540    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dgnbm" event={"ID":"ace36f16-b3ef-4f51-90fc-40d44b9cb8b1","Type":"ContainerStarted","Data":"8e2d1902966e72fc88b254eb73fe6c4e6b3d7295bad6acd99360dfc1425baa3b"}
Jun 11 19:26:09.116709 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:09.116638    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jxggl" event={"ID":"50300198-b698-41ab-a551-04ad9bb274f7","Type":"ContainerStarted","Data":"f8c41d8857df06142b52c0b434dfb2a9e349e5ba076bed9cf7c66f2073ea427a"}
Jun 11 19:26:09.120258 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:09.120226    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n2n72" event={"ID":"b609134f-0739-46f3-966e-cc2c63aabe24","Type":"ContainerStarted","Data":"1d5c246dae283dcd4b3101d3a182e7a9f09eaf7a9e0dff6d7d0dd613fe64d030"}
Jun 11 19:26:09.123262 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:09.123231    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jbjqk" event={"ID":"54d4758a-7d2f-4b4d-9a03-4837465a51a0","Type":"ContainerStarted","Data":"840feb2541d58d368d83ce361d9247413c522c513369ef2cec612b81c6e99500"}
Jun 11 19:26:09.129059 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:09.129024    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-97fzw" event={"ID":"8fd84b63-f9b6-483f-8ed3-f902d9bbd2e7","Type":"ContainerStarted","Data":"4ef7397800d0ef803ab1aff779ee2a91e73e6639606ea8ef3dadff7401c89cb8"}
Jun 11 19:26:09.131827 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:09.131796    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rllhm" event={"ID":"007c0c12-34f6-4d2b-9af7-9b265c041702","Type":"ContainerStarted","Data":"fe1cbd79fc33c7bf65fbab24555e5c04d63a87f0ec5d3a7eae0abd3735eb3f6c"}
Jun 11 19:26:09.141520 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:09.141483    2565 generic.go:356] "Generic (PLEG): container finished" podID="5a83bacba9328857248ca50116d2e702" containerID="0b3f2f5a642076b02c70c35469173369611c50dda15e38dca457230d265ad86e" exitCode=0
Jun 11 19:26:09.141843 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:09.141781    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal" event={"ID":"5a83bacba9328857248ca50116d2e702","Type":"ContainerDied","Data":"0b3f2f5a642076b02c70c35469173369611c50dda15e38dca457230d265ad86e"}
Jun 11 19:26:09.149452 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:09.149230    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-223.ec2.internal" event={"ID":"b11adcad61b3d220a3d5857bba715038","Type":"ContainerStarted","Data":"d93bf7bb4c5ef60658d504199a09e8b5b2c76a9637baca571855e15153223e44"}
Jun 11 19:26:09.155002 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:09.154793    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hzp4x" event={"ID":"99c61b60-d4aa-4190-95b4-78bb4bab2c71","Type":"ContainerStarted","Data":"effb7a1694f9a9078fc3dea14cad3679776072293725ddb1f289f54affd5ba5c"}
Jun 11 19:26:09.173258 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:09.173178    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-223.ec2.internal" podStartSLOduration=3.173156594 podStartE2EDuration="3.173156594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:26:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:09.173121283 +0000 UTC m=+4.577037392" watchObservedRunningTime="2026-06-11 19:26:09.173156594 +0000 UTC m=+4.577072704"
Jun 11 19:26:10.072351 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:10.072321    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:10.072798 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:10.072447    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvlp6" podUID="7cd450c3-fc87-48a3-b7ba-617cede6af81"
Jun 11 19:26:10.172722 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:10.172682    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal" event={"ID":"5a83bacba9328857248ca50116d2e702","Type":"ContainerStarted","Data":"56dbd35228c60e9a80aab95122f25b1dbb1be9a7b61c09c91f1b32195b5ca123"}
Jun 11 19:26:10.193959 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:10.193878    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-223.ec2.internal" podStartSLOduration=4.193855918 podStartE2EDuration="4.193855918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:26:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:10.193146874 +0000 UTC m=+5.597062982" watchObservedRunningTime="2026-06-11 19:26:10.193855918 +0000 UTC m=+5.597772026"
Jun 11 19:26:10.647729 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:10.647690    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs\") pod \"network-metrics-daemon-q665k\" (UID: \"2dd52262-7f1b-440b-a020-a59da738c3c4\") " pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:26:10.647952 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:10.647842    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 19:26:10.647952 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:10.647926    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs podName:2dd52262-7f1b-440b-a020-a59da738c3c4 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:14.647907477 +0000 UTC m=+10.051823565 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs") pod "network-metrics-daemon-q665k" (UID: "2dd52262-7f1b-440b-a020-a59da738c3c4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 19:26:10.748635 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:10.748595    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7cd450c3-fc87-48a3-b7ba-617cede6af81-original-pull-secret\") pod \"global-pull-secret-syncer-tvlp6\" (UID: \"7cd450c3-fc87-48a3-b7ba-617cede6af81\") " pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:10.748862 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:10.748835    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 11 19:26:10.748990 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:10.748931    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd450c3-fc87-48a3-b7ba-617cede6af81-original-pull-secret podName:7cd450c3-fc87-48a3-b7ba-617cede6af81 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:14.748911461 +0000 UTC m=+10.152827549 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7cd450c3-fc87-48a3-b7ba-617cede6af81-original-pull-secret") pod "global-pull-secret-syncer-tvlp6" (UID: "7cd450c3-fc87-48a3-b7ba-617cede6af81") : object "kube-system"/"original-pull-secret" not registered
Jun 11 19:26:10.849920 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:10.849768    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwbgs\" (UniqueName: \"kubernetes.io/projected/a1e44196-5e2e-4051-b4aa-31782fb85476-kube-api-access-cwbgs\") pod \"network-check-target-78njs\" (UID: \"a1e44196-5e2e-4051-b4aa-31782fb85476\") " pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:26:10.850091 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:10.849992    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 11 19:26:10.850091 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:10.850015    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 11 19:26:10.850091 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:10.850027    2565 projected.go:196] Error preparing data for projected volume kube-api-access-cwbgs for pod openshift-network-diagnostics/network-check-target-78njs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 19:26:10.850091 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:10.850085    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1e44196-5e2e-4051-b4aa-31782fb85476-kube-api-access-cwbgs podName:a1e44196-5e2e-4051-b4aa-31782fb85476 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:14.850066131 +0000 UTC m=+10.253982270 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cwbgs" (UniqueName: "kubernetes.io/projected/a1e44196-5e2e-4051-b4aa-31782fb85476-kube-api-access-cwbgs") pod "network-check-target-78njs" (UID: "a1e44196-5e2e-4051-b4aa-31782fb85476") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 19:26:11.074948 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:11.074912    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:26:11.075397 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:11.075057    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78njs" podUID="a1e44196-5e2e-4051-b4aa-31782fb85476"
Jun 11 19:26:11.075458 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:11.075440    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:26:11.075571 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:11.075548    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q665k" podUID="2dd52262-7f1b-440b-a020-a59da738c3c4"
Jun 11 19:26:12.072476 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:12.071986    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:12.072476 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:12.072118    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvlp6" podUID="7cd450c3-fc87-48a3-b7ba-617cede6af81"
Jun 11 19:26:13.074428 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:13.074393    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:26:13.074902 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:13.074524    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q665k" podUID="2dd52262-7f1b-440b-a020-a59da738c3c4"
Jun 11 19:26:13.074969 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:13.074897    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:26:13.075018 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:13.075003    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78njs" podUID="a1e44196-5e2e-4051-b4aa-31782fb85476"
Jun 11 19:26:14.072213 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:14.072178    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:14.072397 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:14.072374    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvlp6" podUID="7cd450c3-fc87-48a3-b7ba-617cede6af81"
Jun 11 19:26:14.684278 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:14.684246    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs\") pod \"network-metrics-daemon-q665k\" (UID: \"2dd52262-7f1b-440b-a020-a59da738c3c4\") " pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:26:14.684682 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:14.684364    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 19:26:14.684682 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:14.684418    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs podName:2dd52262-7f1b-440b-a020-a59da738c3c4 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:22.684404875 +0000 UTC m=+18.088320960 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs") pod "network-metrics-daemon-q665k" (UID: "2dd52262-7f1b-440b-a020-a59da738c3c4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 19:26:14.785713 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:14.785214    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7cd450c3-fc87-48a3-b7ba-617cede6af81-original-pull-secret\") pod \"global-pull-secret-syncer-tvlp6\" (UID: \"7cd450c3-fc87-48a3-b7ba-617cede6af81\") " pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:14.785713 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:14.785344    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 11 19:26:14.785713 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:14.785405    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd450c3-fc87-48a3-b7ba-617cede6af81-original-pull-secret podName:7cd450c3-fc87-48a3-b7ba-617cede6af81 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:22.785389258 +0000 UTC m=+18.189305349 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7cd450c3-fc87-48a3-b7ba-617cede6af81-original-pull-secret") pod "global-pull-secret-syncer-tvlp6" (UID: "7cd450c3-fc87-48a3-b7ba-617cede6af81") : object "kube-system"/"original-pull-secret" not registered
Jun 11 19:26:14.886170 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:14.886131    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwbgs\" (UniqueName: \"kubernetes.io/projected/a1e44196-5e2e-4051-b4aa-31782fb85476-kube-api-access-cwbgs\") pod \"network-check-target-78njs\" (UID: \"a1e44196-5e2e-4051-b4aa-31782fb85476\") " pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:26:14.886362 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:14.886287    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 11 19:26:14.886362 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:14.886309    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 11 19:26:14.886362 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:14.886321    2565 projected.go:196] Error preparing data for projected volume kube-api-access-cwbgs for pod openshift-network-diagnostics/network-check-target-78njs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 19:26:14.886517 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:14.886373    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1e44196-5e2e-4051-b4aa-31782fb85476-kube-api-access-cwbgs podName:a1e44196-5e2e-4051-b4aa-31782fb85476 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:22.886355372 +0000 UTC m=+18.290271474 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cwbgs" (UniqueName: "kubernetes.io/projected/a1e44196-5e2e-4051-b4aa-31782fb85476-kube-api-access-cwbgs") pod "network-check-target-78njs" (UID: "a1e44196-5e2e-4051-b4aa-31782fb85476") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 19:26:15.074686 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:15.074657    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:26:15.074854 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:15.074763    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q665k" podUID="2dd52262-7f1b-440b-a020-a59da738c3c4"
Jun 11 19:26:15.075180 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:15.075157    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:26:15.075291 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:15.075253    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78njs" podUID="a1e44196-5e2e-4051-b4aa-31782fb85476"
Jun 11 19:26:16.072108 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:16.072069    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:16.072596 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:16.072216    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvlp6" podUID="7cd450c3-fc87-48a3-b7ba-617cede6af81"
Jun 11 19:26:17.073041 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:17.073006    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:26:17.073484 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:17.073191    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:26:17.073484 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:17.073219    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78njs" podUID="a1e44196-5e2e-4051-b4aa-31782fb85476"
Jun 11 19:26:17.073484 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:17.073308    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q665k" podUID="2dd52262-7f1b-440b-a020-a59da738c3c4"
Jun 11 19:26:18.072435 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:18.072399    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:18.072584 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:18.072517    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvlp6" podUID="7cd450c3-fc87-48a3-b7ba-617cede6af81"
Jun 11 19:26:19.072725 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:19.072694    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:26:19.073189 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:19.072829    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q665k" podUID="2dd52262-7f1b-440b-a020-a59da738c3c4"
Jun 11 19:26:19.073189 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:19.072899    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:26:19.073189 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:19.072993    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78njs" podUID="a1e44196-5e2e-4051-b4aa-31782fb85476"
Jun 11 19:26:20.071841 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:20.071803    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:20.071998 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:20.071932    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvlp6" podUID="7cd450c3-fc87-48a3-b7ba-617cede6af81"
Jun 11 19:26:21.072235 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:21.072194    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:26:21.072674 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:21.072194    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:26:21.072674 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:21.072337    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q665k" podUID="2dd52262-7f1b-440b-a020-a59da738c3c4"
Jun 11 19:26:21.072674 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:21.072403    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78njs" podUID="a1e44196-5e2e-4051-b4aa-31782fb85476"
Jun 11 19:26:22.072546 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:22.072511    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:22.072970 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:22.072623    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvlp6" podUID="7cd450c3-fc87-48a3-b7ba-617cede6af81"
Jun 11 19:26:22.744439 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:22.744344    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs\") pod \"network-metrics-daemon-q665k\" (UID: \"2dd52262-7f1b-440b-a020-a59da738c3c4\") " pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:26:22.744593 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:22.744520    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 19:26:22.744593 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:22.744585    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs podName:2dd52262-7f1b-440b-a020-a59da738c3c4 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:38.744567527 +0000 UTC m=+34.148483630 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs") pod "network-metrics-daemon-q665k" (UID: "2dd52262-7f1b-440b-a020-a59da738c3c4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 19:26:22.845095 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:22.845064    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7cd450c3-fc87-48a3-b7ba-617cede6af81-original-pull-secret\") pod \"global-pull-secret-syncer-tvlp6\" (UID: \"7cd450c3-fc87-48a3-b7ba-617cede6af81\") " pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:22.845283 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:22.845256    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 11 19:26:22.845387 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:22.845324    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd450c3-fc87-48a3-b7ba-617cede6af81-original-pull-secret podName:7cd450c3-fc87-48a3-b7ba-617cede6af81 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:38.845309412 +0000 UTC m=+34.249225498 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7cd450c3-fc87-48a3-b7ba-617cede6af81-original-pull-secret") pod "global-pull-secret-syncer-tvlp6" (UID: "7cd450c3-fc87-48a3-b7ba-617cede6af81") : object "kube-system"/"original-pull-secret" not registered
Jun 11 19:26:22.945927 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:22.945866    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwbgs\" (UniqueName: \"kubernetes.io/projected/a1e44196-5e2e-4051-b4aa-31782fb85476-kube-api-access-cwbgs\") pod \"network-check-target-78njs\" (UID: \"a1e44196-5e2e-4051-b4aa-31782fb85476\") " pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:26:22.946114 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:22.946093    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 11 19:26:22.946179 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:22.946122    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 11 19:26:22.946179 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:22.946138    2565 projected.go:196] Error preparing data for projected volume kube-api-access-cwbgs for pod openshift-network-diagnostics/network-check-target-78njs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 19:26:22.946259 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:22.946205    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1e44196-5e2e-4051-b4aa-31782fb85476-kube-api-access-cwbgs podName:a1e44196-5e2e-4051-b4aa-31782fb85476 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:38.946185683 +0000 UTC m=+34.350101788 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cwbgs" (UniqueName: "kubernetes.io/projected/a1e44196-5e2e-4051-b4aa-31782fb85476-kube-api-access-cwbgs") pod "network-check-target-78njs" (UID: "a1e44196-5e2e-4051-b4aa-31782fb85476") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 19:26:23.072267 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:23.072180    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:26:23.072411 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:23.072337    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q665k" podUID="2dd52262-7f1b-440b-a020-a59da738c3c4"
Jun 11 19:26:23.072869 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:23.072823    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:26:23.073187 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:23.072976    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78njs" podUID="a1e44196-5e2e-4051-b4aa-31782fb85476"
Jun 11 19:26:24.072172 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:24.072140    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:24.072466 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:24.072242    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvlp6" podUID="7cd450c3-fc87-48a3-b7ba-617cede6af81"
Jun 11 19:26:25.073473 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:25.073443    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:26:25.074024 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:25.073548    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q665k" podUID="2dd52262-7f1b-440b-a020-a59da738c3c4"
Jun 11 19:26:25.074024 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:25.073630    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:26:25.074024 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:25.073748    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78njs" podUID="a1e44196-5e2e-4051-b4aa-31782fb85476"
Jun 11 19:26:26.071828 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:26.071802    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:26.072018 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:26.071995    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvlp6" podUID="7cd450c3-fc87-48a3-b7ba-617cede6af81"
Jun 11 19:26:27.074664 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:27.074635    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:26:27.075058 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:27.074776    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q665k" podUID="2dd52262-7f1b-440b-a020-a59da738c3c4"
Jun 11 19:26:27.076663 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:27.076456    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:26:27.076781 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:27.076752    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78njs" podUID="a1e44196-5e2e-4051-b4aa-31782fb85476"
Jun 11 19:26:27.207254 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:27.207223    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jxggl" event={"ID":"50300198-b698-41ab-a551-04ad9bb274f7","Type":"ContainerStarted","Data":"ad093add71cab984866b57cb3f2f6ae0a333fe3c3f0509e50edc83792dbb4e87"}
Jun 11 19:26:27.208608 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:27.208587    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n2n72" event={"ID":"b609134f-0739-46f3-966e-cc2c63aabe24","Type":"ContainerStarted","Data":"aa37f5049b7665c6aa96ad6cbe1e0113be84004650fedab4c5bfe33191227cfa"}
Jun 11 19:26:27.210091 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:27.209819    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jbjqk" event={"ID":"54d4758a-7d2f-4b4d-9a03-4837465a51a0","Type":"ContainerStarted","Data":"827e614fa18ecb79d088041c6f15d2df4483ee5fd1400d40e9cfe78519fee9f1"}
Jun 11 19:26:27.211019 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:27.210998    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rllhm" event={"ID":"007c0c12-34f6-4d2b-9af7-9b265c041702","Type":"ContainerStarted","Data":"c361ade0a19ee7f93a53a87ca2f3903655d8d7b2551fb16bf6aba945238b6fb2"}
Jun 11 19:26:27.212099 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:27.212081    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hzp4x" event={"ID":"99c61b60-d4aa-4190-95b4-78bb4bab2c71","Type":"ContainerStarted","Data":"8ced364b0f52e5c44a351ef2cd4f86f0fe1847ab39931639c1889708b237df8c"}
Jun 11 19:26:27.213233 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:27.213213    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dcw8t" event={"ID":"ae16dd28-35c8-4a34-ad9a-487fe90caabe","Type":"ContainerStarted","Data":"aba31f20339fe578c1e40da6b3641338173da0480851fbe4800d1e92201ec030"}
Jun 11 19:26:27.215225 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:27.215198    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2swm" event={"ID":"fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13","Type":"ContainerStarted","Data":"100b26d47f19c3f6af82b1ac34b9261b009ad30112f604a4eb4a3d471976fe81"}
Jun 11 19:26:27.216428 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:27.216412    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dgnbm" event={"ID":"ace36f16-b3ef-4f51-90fc-40d44b9cb8b1","Type":"ContainerStarted","Data":"d85f8dfabe1d562dac0b680e4cf7f3e0c6275e62364284428f30c1615a8a4967"}
Jun 11 19:26:27.220369 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:27.220325    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jxggl" podStartSLOduration=3.766834286 podStartE2EDuration="22.220309892s" totalImagesPullingTime="18.453475606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:27.21997372 +0000 UTC m=+22.623889832" watchObservedRunningTime="2026-06-11 19:26:27.220309892 +0000 UTC m=+22.624226016"
Jun 11 19:26:27.250931 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:27.250852    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dgnbm" podStartSLOduration=3.539003917 podStartE2EDuration="22.250834466s" totalImagesPullingTime="18.711830549s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:27.250465233 +0000 UTC m=+22.654381339" watchObservedRunningTime="2026-06-11 19:26:27.250834466 +0000 UTC m=+22.654750574"
Jun 11 19:26:27.251020 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:27.250987    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hzp4x" podStartSLOduration=3.545768001 podStartE2EDuration="22.250975546s" totalImagesPullingTime="18.705207545s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:27.234987615 +0000 UTC m=+22.638903733" watchObservedRunningTime="2026-06-11 19:26:27.250975546 +0000 UTC m=+22.654891654"
Jun 11 19:26:27.266404 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:27.266346    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jbjqk" podStartSLOduration=3.601309542 podStartE2EDuration="22.266332979s" totalImagesPullingTime="18.665023437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:27.266262903 +0000 UTC m=+22.670179011" watchObservedRunningTime="2026-06-11 19:26:27.266332979 +0000 UTC m=+22.670249088"
Jun 11 19:26:27.311344 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:27.311296    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dcw8t" podStartSLOduration=8.079350015 podStartE2EDuration="22.311279489s" totalImagesPullingTime="14.231929474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:27.27975103 +0000 UTC m=+22.683667136" watchObservedRunningTime="2026-06-11 19:26:27.311279489 +0000 UTC m=+22.715195596"
Jun 11 19:26:28.072958 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:28.072749    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:28.073142 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:28.073055    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvlp6" podUID="7cd450c3-fc87-48a3-b7ba-617cede6af81"
Jun 11 19:26:28.220960 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:28.220936    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2n72_b609134f-0739-46f3-966e-cc2c63aabe24/ovn-acl-logging/0.log"
Jun 11 19:26:28.221654 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:28.221389    2565 generic.go:356] "Generic (PLEG): container finished" podID="b609134f-0739-46f3-966e-cc2c63aabe24" containerID="87411e029808e963fb1976dcd1734148cfb29f8da31e86b6e1b408a2b4f30f5a" exitCode=1
Jun 11 19:26:28.221654 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:28.221459    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n2n72" event={"ID":"b609134f-0739-46f3-966e-cc2c63aabe24","Type":"ContainerStarted","Data":"f833915001315ca6e6e63dba5b22bf20f36a0054ea297f3216ac0c3662b990a4"}
Jun 11 19:26:28.221654 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:28.221532    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n2n72" event={"ID":"b609134f-0739-46f3-966e-cc2c63aabe24","Type":"ContainerStarted","Data":"ee15c32250f40314ded412f3c2c2f40b1038725c7b0bb6d4dc3f598dc51e0449"}
Jun 11 19:26:28.221654 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:28.221576    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n2n72" event={"ID":"b609134f-0739-46f3-966e-cc2c63aabe24","Type":"ContainerStarted","Data":"0accf0fc138ae51846f1ab457a2a6eb6c20f50b006f02a3e5e00021b89348f5e"}
Jun 11 19:26:28.221654 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:28.221619    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n2n72" event={"ID":"b609134f-0739-46f3-966e-cc2c63aabe24","Type":"ContainerStarted","Data":"e05de3d1d5810c2218d05c99a15a52f1cea0a973aa412c37ad7bff0cc145a1c3"}
Jun 11 19:26:28.221654 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:28.221654    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n2n72" event={"ID":"b609134f-0739-46f3-966e-cc2c63aabe24","Type":"ContainerDied","Data":"87411e029808e963fb1976dcd1734148cfb29f8da31e86b6e1b408a2b4f30f5a"}
Jun 11 19:26:28.223014 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:28.222989    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-97fzw" event={"ID":"8fd84b63-f9b6-483f-8ed3-f902d9bbd2e7","Type":"ContainerStarted","Data":"b5ee70cadec4e2c216423d025662c64bbb42fc1dff1387349be53a2b00cb39b0"}
Jun 11 19:26:28.224486 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:28.224462    2565 generic.go:356] "Generic (PLEG): container finished" podID="007c0c12-34f6-4d2b-9af7-9b265c041702" containerID="c361ade0a19ee7f93a53a87ca2f3903655d8d7b2551fb16bf6aba945238b6fb2" exitCode=0
Jun 11 19:26:28.224591 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:28.224551    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rllhm" event={"ID":"007c0c12-34f6-4d2b-9af7-9b265c041702","Type":"ContainerDied","Data":"c361ade0a19ee7f93a53a87ca2f3903655d8d7b2551fb16bf6aba945238b6fb2"}
Jun 11 19:26:28.769244 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:28.769200    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 11 19:26:29.072486 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:29.072396    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T19:26:28.76922787Z","UUID":"361e8664-272e-4943-b14a-a2b462c6bbb8","Handler":null,"Name":"","Endpoint":""}
Jun 11 19:26:29.072702 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:29.072540    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:26:29.072702 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:29.072554    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:26:29.072702 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:29.072640    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78njs" podUID="a1e44196-5e2e-4051-b4aa-31782fb85476"
Jun 11 19:26:29.072851 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:29.072781    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q665k" podUID="2dd52262-7f1b-440b-a020-a59da738c3c4"
Jun 11 19:26:29.074130 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:29.074113    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 11 19:26:29.074227 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:29.074144    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 11 19:26:29.228614 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:29.228572    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2swm" event={"ID":"fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13","Type":"ContainerStarted","Data":"fb526cbb68594bc5ec8eef02747a639d64a658e19187c7af6403337f70a8cfbb"}
Jun 11 19:26:29.242864 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:29.242811    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-97fzw" podStartSLOduration=5.779195194 podStartE2EDuration="24.242791011s" totalImagesPullingTime="18.463595817s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:29.242342564 +0000 UTC m=+24.646258671" watchObservedRunningTime="2026-06-11 19:26:29.242791011 +0000 UTC m=+24.646707119"
Jun 11 19:26:30.072534 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:30.072503    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:30.072697 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:30.072603    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvlp6" podUID="7cd450c3-fc87-48a3-b7ba-617cede6af81"
Jun 11 19:26:30.233901 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:30.233861    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2n72_b609134f-0739-46f3-966e-cc2c63aabe24/ovn-acl-logging/0.log"
Jun 11 19:26:30.234307 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:30.234237    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n2n72" event={"ID":"b609134f-0739-46f3-966e-cc2c63aabe24","Type":"ContainerStarted","Data":"6f0ff1f95141f0bbbf2b4a4ab0932a87cc73677404418a8553d2e8f4bbf4d4d0"}
Jun 11 19:26:30.236154 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:30.236127    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2swm" event={"ID":"fdbb2d42-fa7c-4b60-b38f-8d1b71ed3a13","Type":"ContainerStarted","Data":"09058325aed88bebbd808b692b0e20939893342939112ca9c95d489fb630ed3b"}
Jun 11 19:26:30.253574 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:30.253535    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n2swm" podStartSLOduration=4.247803178 podStartE2EDuration="25.253519823s" totalImagesPullingTime="21.005716645s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:26:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:30.253499696 +0000 UTC m=+25.657415803" watchObservedRunningTime="2026-06-11 19:26:30.253519823 +0000 UTC m=+25.657435912"
Jun 11 19:26:31.072197 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:31.072168    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:26:31.072371 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:31.072286    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78njs" podUID="a1e44196-5e2e-4051-b4aa-31782fb85476"
Jun 11 19:26:31.072371 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:31.072345    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:26:31.072498 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:31.072453    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q665k" podUID="2dd52262-7f1b-440b-a020-a59da738c3c4"
Jun 11 19:26:31.330026 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:31.329945    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dcw8t"
Jun 11 19:26:31.330613 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:31.330596    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dcw8t"
Jun 11 19:26:32.072406 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:32.072317    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:32.072560 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:32.072516    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvlp6" podUID="7cd450c3-fc87-48a3-b7ba-617cede6af81"
Jun 11 19:26:32.244753 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:32.244714    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2n72_b609134f-0739-46f3-966e-cc2c63aabe24/ovn-acl-logging/0.log"
Jun 11 19:26:32.245151 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:32.245121    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n2n72" event={"ID":"b609134f-0739-46f3-966e-cc2c63aabe24","Type":"ContainerStarted","Data":"6382e3da7762f1ed459990c1f8541f71243fc43e6dc49461e84137bcae4fb0b3"}
Jun 11 19:26:32.245369 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:32.245347    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dcw8t"
Jun 11 19:26:32.246316 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:32.245937    2565 scope.go:117] "RemoveContainer" containerID="87411e029808e963fb1976dcd1734148cfb29f8da31e86b6e1b408a2b4f30f5a"
Jun 11 19:26:32.249080 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:32.249045    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dcw8t"
Jun 11 19:26:33.074746 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:33.072461    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:26:33.074746 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:33.072601    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q665k" podUID="2dd52262-7f1b-440b-a020-a59da738c3c4"
Jun 11 19:26:33.074746 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:33.073022    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:26:33.074746 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:33.073424    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78njs" podUID="a1e44196-5e2e-4051-b4aa-31782fb85476"
Jun 11 19:26:33.773987 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:33.773726    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tvlp6"]
Jun 11 19:26:33.774140 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:33.774071    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:33.774188 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:33.774167    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvlp6" podUID="7cd450c3-fc87-48a3-b7ba-617cede6af81"
Jun 11 19:26:33.777095 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:33.776815    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-78njs"]
Jun 11 19:26:33.777095 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:33.776945    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:26:33.777095 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:33.777048    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78njs" podUID="a1e44196-5e2e-4051-b4aa-31782fb85476"
Jun 11 19:26:33.777536 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:33.777510    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q665k"]
Jun 11 19:26:33.777627 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:33.777610    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:26:33.777736 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:33.777716    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q665k" podUID="2dd52262-7f1b-440b-a020-a59da738c3c4"
Jun 11 19:26:34.255154 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:34.255134    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2n72_b609134f-0739-46f3-966e-cc2c63aabe24/ovn-acl-logging/0.log"
Jun 11 19:26:34.255527 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:34.255504    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n2n72" event={"ID":"b609134f-0739-46f3-966e-cc2c63aabe24","Type":"ContainerStarted","Data":"78d681bf00f1d690153fd4cdbaef7aa911a0749ba06814e45a7e9061b8c8576c"}
Jun 11 19:26:34.255910 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:34.255728    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:34.255910 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:34.255822    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:34.255910 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:34.255854    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:34.272797 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:34.272776    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:34.272924 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:34.272912    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:26:34.304803 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:34.304328    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-n2n72" podStartSLOduration=10.560155720000001 podStartE2EDuration="29.304304502s" totalImagesPullingTime="18.744148782s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:34.302874849 +0000 UTC m=+29.706790949" watchObservedRunningTime="2026-06-11 19:26:34.304304502 +0000 UTC m=+29.708220611"
Jun 11 19:26:35.072634 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:35.072603    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:35.072778 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:35.072708    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvlp6" podUID="7cd450c3-fc87-48a3-b7ba-617cede6af81"
Jun 11 19:26:35.072778 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:35.072739    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:26:35.072871 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:35.072803    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78njs" podUID="a1e44196-5e2e-4051-b4aa-31782fb85476"
Jun 11 19:26:35.259458 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:35.259425    2565 generic.go:356] "Generic (PLEG): container finished" podID="007c0c12-34f6-4d2b-9af7-9b265c041702" containerID="a1f3f2c6828f7783bd931eeaa092ba47accce5dfdbbf7358899b0759876a0eb3" exitCode=0
Jun 11 19:26:35.259843 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:35.259511    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rllhm" event={"ID":"007c0c12-34f6-4d2b-9af7-9b265c041702","Type":"ContainerDied","Data":"a1f3f2c6828f7783bd931eeaa092ba47accce5dfdbbf7358899b0759876a0eb3"}
Jun 11 19:26:36.072774 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:36.072751    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:26:36.072894 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:36.072861    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q665k" podUID="2dd52262-7f1b-440b-a020-a59da738c3c4"
Jun 11 19:26:36.264949 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:36.264912    2565 generic.go:356] "Generic (PLEG): container finished" podID="007c0c12-34f6-4d2b-9af7-9b265c041702" containerID="59167f6ed01867cdd3f634520890b4017cb8071fb8b6ce7193b18909ff69f5fa" exitCode=0
Jun 11 19:26:36.265498 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:36.264980    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rllhm" event={"ID":"007c0c12-34f6-4d2b-9af7-9b265c041702","Type":"ContainerDied","Data":"59167f6ed01867cdd3f634520890b4017cb8071fb8b6ce7193b18909ff69f5fa"}
Jun 11 19:26:36.276151 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:36.276108    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-n2n72" podUID="b609134f-0739-46f3-966e-cc2c63aabe24" containerName="ovnkube-controller" probeResult="failure" output=""
Jun 11 19:26:37.071900 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:37.071842    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:37.072090 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:37.071852    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:26:37.072090 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:37.071973    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvlp6" podUID="7cd450c3-fc87-48a3-b7ba-617cede6af81"
Jun 11 19:26:37.072090 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:37.072058    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78njs" podUID="a1e44196-5e2e-4051-b4aa-31782fb85476"
Jun 11 19:26:37.271424 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:37.271237    2565 generic.go:356] "Generic (PLEG): container finished" podID="007c0c12-34f6-4d2b-9af7-9b265c041702" containerID="a97bdfe3067bd1145523d9ecb01cbff6d0cd27822a7dc722cb5629944d2e6f5a" exitCode=0
Jun 11 19:26:37.271424 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:37.271279    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rllhm" event={"ID":"007c0c12-34f6-4d2b-9af7-9b265c041702","Type":"ContainerDied","Data":"a97bdfe3067bd1145523d9ecb01cbff6d0cd27822a7dc722cb5629944d2e6f5a"}
Jun 11 19:26:38.072156 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:38.072123    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:26:38.072385 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:38.072248    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q665k" podUID="2dd52262-7f1b-440b-a020-a59da738c3c4"
Jun 11 19:26:38.765698 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:38.765658    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs\") pod \"network-metrics-daemon-q665k\" (UID: \"2dd52262-7f1b-440b-a020-a59da738c3c4\") " pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:26:38.766190 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:38.765818    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 19:26:38.766190 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:38.765912    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs podName:2dd52262-7f1b-440b-a020-a59da738c3c4 nodeName:}" failed. No retries permitted until 2026-06-11 19:27:10.765871241 +0000 UTC m=+66.169787347 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs") pod "network-metrics-daemon-q665k" (UID: "2dd52262-7f1b-440b-a020-a59da738c3c4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 19:26:38.866282 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:38.866243    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7cd450c3-fc87-48a3-b7ba-617cede6af81-original-pull-secret\") pod \"global-pull-secret-syncer-tvlp6\" (UID: \"7cd450c3-fc87-48a3-b7ba-617cede6af81\") " pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:38.866466 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:38.866383    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 11 19:26:38.866466 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:38.866456    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd450c3-fc87-48a3-b7ba-617cede6af81-original-pull-secret podName:7cd450c3-fc87-48a3-b7ba-617cede6af81 nodeName:}" failed. No retries permitted until 2026-06-11 19:27:10.866437943 +0000 UTC m=+66.270354032 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7cd450c3-fc87-48a3-b7ba-617cede6af81-original-pull-secret") pod "global-pull-secret-syncer-tvlp6" (UID: "7cd450c3-fc87-48a3-b7ba-617cede6af81") : object "kube-system"/"original-pull-secret" not registered
Jun 11 19:26:38.967334 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:38.967305    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwbgs\" (UniqueName: \"kubernetes.io/projected/a1e44196-5e2e-4051-b4aa-31782fb85476-kube-api-access-cwbgs\") pod \"network-check-target-78njs\" (UID: \"a1e44196-5e2e-4051-b4aa-31782fb85476\") " pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:26:38.967497 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:38.967454    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 11 19:26:38.967497 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:38.967472    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 11 19:26:38.967497 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:38.967481    2565 projected.go:196] Error preparing data for projected volume kube-api-access-cwbgs for pod openshift-network-diagnostics/network-check-target-78njs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 19:26:38.967601 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:38.967529    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1e44196-5e2e-4051-b4aa-31782fb85476-kube-api-access-cwbgs podName:a1e44196-5e2e-4051-b4aa-31782fb85476 nodeName:}" failed. No retries permitted until 2026-06-11 19:27:10.967515459 +0000 UTC m=+66.371431544 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cwbgs" (UniqueName: "kubernetes.io/projected/a1e44196-5e2e-4051-b4aa-31782fb85476-kube-api-access-cwbgs") pod "network-check-target-78njs" (UID: "a1e44196-5e2e-4051-b4aa-31782fb85476") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 19:26:39.071853 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.071771    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:39.071853 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.071795    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:26:39.072090 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:39.071924    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvlp6" podUID="7cd450c3-fc87-48a3-b7ba-617cede6af81"
Jun 11 19:26:39.072090 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:39.072062    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78njs" podUID="a1e44196-5e2e-4051-b4aa-31782fb85476"
Jun 11 19:26:39.885762 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.885690    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-223.ec2.internal" event="NodeReady"
Jun 11 19:26:39.886189 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.885793    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jun 11 19:26:39.919811 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.919773    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg"]
Jun 11 19:26:39.922540 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.922497    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h"]
Jun 11 19:26:39.922695 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.922624    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg"
Jun 11 19:26:39.926730 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.926709    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jun 11 19:26:39.927451 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.927240    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579f5dfbdb-g7hbc"]
Jun 11 19:26:39.927451 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.927291    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jun 11 19:26:39.927451 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.927347    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jun 11 19:26:39.927451 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.927354    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jun 11 19:26:39.927451 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.927406    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h"
Jun 11 19:26:39.927763 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.927686    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jun 11 19:26:39.927763 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.927702    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jun 11 19:26:39.928003 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.927982    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jun 11 19:26:39.929570 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.929552    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jun 11 19:26:39.930433 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.930415    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-788d696d79-ksrnk"]
Jun 11 19:26:39.930579 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.930564    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579f5dfbdb-g7hbc"
Jun 11 19:26:39.932599 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.932578    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-9m78w\""
Jun 11 19:26:39.932684 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.932601    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jun 11 19:26:39.932756 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.932739    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:26:39.935458 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.935310    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wsf99\""
Jun 11 19:26:39.935597 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.935580    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jun 11 19:26:39.935794 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.935772    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pvmdm"]
Jun 11 19:26:39.937236 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.937215    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jun 11 19:26:39.937456 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.937433    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jun 11 19:26:39.938667 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.938646    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h"]
Jun 11 19:26:39.938760 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.938684    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg"]
Jun 11 19:26:39.938760 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.938706    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cfb5n"]
Jun 11 19:26:39.938760 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.938754    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pvmdm"
Jun 11 19:26:39.941051 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.941027    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xk5k9\""
Jun 11 19:26:39.941267 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.941252    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 11 19:26:39.941528 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.941510    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579f5dfbdb-g7hbc"]
Jun 11 19:26:39.941615 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.941535    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-788d696d79-ksrnk"]
Jun 11 19:26:39.941615 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.941601    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cfb5n"
Jun 11 19:26:39.942057 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.942035    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jun 11 19:26:39.942624 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.942607    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 11 19:26:39.943962 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.943706    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 11 19:26:39.944135 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.944086    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 11 19:26:39.944210 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.944134    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 11 19:26:39.944210 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.944172    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wz2zc\""
Jun 11 19:26:39.947808 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.947767    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pvmdm"]
Jun 11 19:26:39.954415 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:39.954394    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cfb5n"]
Jun 11 19:26:40.072094 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.072060    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:26:40.074563 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.074539    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gdvp2\""
Jun 11 19:26:40.074563 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.074557    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 11 19:26:40.075637 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.075620    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-bound-sa-token\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:26:40.075710 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.075671    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2t24\" (UniqueName: \"kubernetes.io/projected/1ad225ed-be47-4bb0-85d0-abd03c041b65-kube-api-access-d2t24\") pod \"managed-serviceaccount-addon-agent-579f5dfbdb-g7hbc\" (UID: \"1ad225ed-be47-4bb0-85d0-abd03c041b65\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579f5dfbdb-g7hbc"
Jun 11 19:26:40.075760 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.075727    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztvlt\" (UniqueName: \"kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-kube-api-access-ztvlt\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:26:40.075812 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.075769    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-config-volume\") pod \"dns-default-pvmdm\" (UID: \"cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086\") " pod="openshift-dns/dns-default-pvmdm"
Jun 11 19:26:40.075812 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.075798    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b2d5e270-4904-401b-bd63-7846702c92de-hub\") pod \"cluster-proxy-proxy-agent-69c7d46b99-vqvkg\" (UID: \"b2d5e270-4904-401b-bd63-7846702c92de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg"
Jun 11 19:26:40.075907 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.075824    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b2d5e270-4904-401b-bd63-7846702c92de-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-69c7d46b99-vqvkg\" (UID: \"b2d5e270-4904-401b-bd63-7846702c92de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg"
Jun 11 19:26:40.075907 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.075850    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbd8m\" (UniqueName: \"kubernetes.io/projected/21a2f529-95bb-4c15-9a38-d28b5f63cd13-kube-api-access-hbd8m\") pod \"ingress-canary-cfb5n\" (UID: \"21a2f529-95bb-4c15-9a38-d28b5f63cd13\") " pod="openshift-ingress-canary/ingress-canary-cfb5n"
Jun 11 19:26:40.075978 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.075926    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1ad225ed-be47-4bb0-85d0-abd03c041b65-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-579f5dfbdb-g7hbc\" (UID: \"1ad225ed-be47-4bb0-85d0-abd03c041b65\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579f5dfbdb-g7hbc"
Jun 11 19:26:40.075978 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.075953    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-metrics-tls\") pod \"dns-default-pvmdm\" (UID: \"cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086\") " pod="openshift-dns/dns-default-pvmdm"
Jun 11 19:26:40.076058 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.075978    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b2d5e270-4904-401b-bd63-7846702c92de-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-69c7d46b99-vqvkg\" (UID: \"b2d5e270-4904-401b-bd63-7846702c92de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg"
Jun 11 19:26:40.076058 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.076002    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2d5e270-4904-401b-bd63-7846702c92de-additional-service-ca\") pod \"cluster-proxy-proxy-agent-69c7d46b99-vqvkg\" (UID: \"b2d5e270-4904-401b-bd63-7846702c92de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg"
Jun 11 19:26:40.076146 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.076055    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8e43f0e-9a35-46ba-a45f-0751c4315eee-tmp\") pod \"klusterlet-addon-workmgr-67f5d57965-nb97h\" (UID: \"b8e43f0e-9a35-46ba-a45f-0751c4315eee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h"
Jun 11 19:26:40.076146 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.076084    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21a2f529-95bb-4c15-9a38-d28b5f63cd13-cert\") pod \"ingress-canary-cfb5n\" (UID: \"21a2f529-95bb-4c15-9a38-d28b5f63cd13\") " pod="openshift-ingress-canary/ingress-canary-cfb5n"
Jun 11 19:26:40.076234 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.076176    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:26:40.076234 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.076208    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-ca-trust-extracted\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:26:40.076322 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.076236    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-installation-pull-secrets\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:26:40.076322 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.076296    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b2d5e270-4904-401b-bd63-7846702c92de-ca\") pod \"cluster-proxy-proxy-agent-69c7d46b99-vqvkg\" (UID: \"b2d5e270-4904-401b-bd63-7846702c92de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg"
Jun 11 19:26:40.076404 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.076343    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbqg7\" (UniqueName: \"kubernetes.io/projected/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-kube-api-access-kbqg7\") pod \"dns-default-pvmdm\" (UID: \"cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086\") " pod="openshift-dns/dns-default-pvmdm"
Jun 11 19:26:40.076404 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.076377    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wccz4\" (UniqueName: \"kubernetes.io/projected/b2d5e270-4904-401b-bd63-7846702c92de-kube-api-access-wccz4\") pod \"cluster-proxy-proxy-agent-69c7d46b99-vqvkg\" (UID: \"b2d5e270-4904-401b-bd63-7846702c92de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg"
Jun 11 19:26:40.076492 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.076413    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b8e43f0e-9a35-46ba-a45f-0751c4315eee-klusterlet-config\") pod \"klusterlet-addon-workmgr-67f5d57965-nb97h\" (UID: \"b8e43f0e-9a35-46ba-a45f-0751c4315eee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h"
Jun 11 19:26:40.076492 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.076438    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-tmp-dir\") pod \"dns-default-pvmdm\" (UID: \"cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086\") " pod="openshift-dns/dns-default-pvmdm"
Jun 11 19:26:40.076492 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.076478    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t28fs\" (UniqueName: \"kubernetes.io/projected/b8e43f0e-9a35-46ba-a45f-0751c4315eee-kube-api-access-t28fs\") pod \"klusterlet-addon-workmgr-67f5d57965-nb97h\" (UID: \"b8e43f0e-9a35-46ba-a45f-0751c4315eee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h"
Jun 11 19:26:40.076619 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.076504    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-certificates\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:26:40.076619 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.076575    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-image-registry-private-configuration\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:26:40.076619 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.076604    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-trusted-ca\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:26:40.177504 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.177432    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-trusted-ca\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:26:40.177504 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.177479    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-bound-sa-token\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:26:40.177504 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.177502    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2t24\" (UniqueName: \"kubernetes.io/projected/1ad225ed-be47-4bb0-85d0-abd03c041b65-kube-api-access-d2t24\") pod \"managed-serviceaccount-addon-agent-579f5dfbdb-g7hbc\" (UID: \"1ad225ed-be47-4bb0-85d0-abd03c041b65\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579f5dfbdb-g7hbc"
Jun 11 19:26:40.177766 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.177527    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztvlt\" (UniqueName: \"kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-kube-api-access-ztvlt\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:26:40.177766 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.177552    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-config-volume\") pod \"dns-default-pvmdm\" (UID: \"cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086\") " pod="openshift-dns/dns-default-pvmdm"
Jun 11 19:26:40.177766 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.177575    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b2d5e270-4904-401b-bd63-7846702c92de-hub\") pod \"cluster-proxy-proxy-agent-69c7d46b99-vqvkg\" (UID: \"b2d5e270-4904-401b-bd63-7846702c92de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg"
Jun 11 19:26:40.177766 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.177597    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b2d5e270-4904-401b-bd63-7846702c92de-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-69c7d46b99-vqvkg\" (UID: \"b2d5e270-4904-401b-bd63-7846702c92de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg"
Jun 11 19:26:40.177766 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.177619    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbd8m\" (UniqueName: \"kubernetes.io/projected/21a2f529-95bb-4c15-9a38-d28b5f63cd13-kube-api-access-hbd8m\") pod \"ingress-canary-cfb5n\" (UID: \"21a2f529-95bb-4c15-9a38-d28b5f63cd13\") " pod="openshift-ingress-canary/ingress-canary-cfb5n"
Jun 11 19:26:40.177766 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.177660    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1ad225ed-be47-4bb0-85d0-abd03c041b65-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-579f5dfbdb-g7hbc\" (UID: \"1ad225ed-be47-4bb0-85d0-abd03c041b65\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579f5dfbdb-g7hbc"
Jun 11 19:26:40.178072 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.177899    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-metrics-tls\") pod \"dns-default-pvmdm\" (UID: \"cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086\") " pod="openshift-dns/dns-default-pvmdm"
Jun 11 19:26:40.178072 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.177947    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b2d5e270-4904-401b-bd63-7846702c92de-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-69c7d46b99-vqvkg\" (UID: \"b2d5e270-4904-401b-bd63-7846702c92de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg"
Jun 11 19:26:40.178072 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.177978    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2d5e270-4904-401b-bd63-7846702c92de-additional-service-ca\") pod \"cluster-proxy-proxy-agent-69c7d46b99-vqvkg\" (UID: \"b2d5e270-4904-401b-bd63-7846702c92de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg"
Jun 11 19:26:40.178072 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.178012    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8e43f0e-9a35-46ba-a45f-0751c4315eee-tmp\") pod \"klusterlet-addon-workmgr-67f5d57965-nb97h\" (UID: \"b8e43f0e-9a35-46ba-a45f-0751c4315eee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h"
Jun 11 19:26:40.178072 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.178036    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21a2f529-95bb-4c15-9a38-d28b5f63cd13-cert\") pod \"ingress-canary-cfb5n\" (UID: \"21a2f529-95bb-4c15-9a38-d28b5f63cd13\") " pod="openshift-ingress-canary/ingress-canary-cfb5n"
Jun 11 19:26:40.178072 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:40.178038    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 19:26:40.178072 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.178067    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:26:40.178400 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.178093    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-ca-trust-extracted\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:26:40.178400 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:40.178109    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-metrics-tls podName:cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:40.678091038 +0000 UTC m=+36.082007137 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-metrics-tls") pod "dns-default-pvmdm" (UID: "cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086") : secret "dns-default-metrics-tls" not found
Jun 11 19:26:40.178400 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.178141    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-installation-pull-secrets\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:26:40.178400 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.178164    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b2d5e270-4904-401b-bd63-7846702c92de-ca\") pod \"cluster-proxy-proxy-agent-69c7d46b99-vqvkg\" (UID: \"b2d5e270-4904-401b-bd63-7846702c92de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg"
Jun 11 19:26:40.178400 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.178190    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbqg7\" (UniqueName: \"kubernetes.io/projected/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-kube-api-access-kbqg7\") pod \"dns-default-pvmdm\" (UID: \"cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086\") " pod="openshift-dns/dns-default-pvmdm"
Jun 11 19:26:40.178400 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.178224    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-config-volume\") pod \"dns-default-pvmdm\" (UID: \"cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086\") " pod="openshift-dns/dns-default-pvmdm"
Jun 11 19:26:40.178400 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.178229    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wccz4\" (UniqueName: \"kubernetes.io/projected/b2d5e270-4904-401b-bd63-7846702c92de-kube-api-access-wccz4\") pod \"cluster-proxy-proxy-agent-69c7d46b99-vqvkg\" (UID: \"b2d5e270-4904-401b-bd63-7846702c92de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg"
Jun 11 19:26:40.178400 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.178294    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b8e43f0e-9a35-46ba-a45f-0751c4315eee-klusterlet-config\") pod \"klusterlet-addon-workmgr-67f5d57965-nb97h\" (UID: \"b8e43f0e-9a35-46ba-a45f-0751c4315eee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h"
Jun 11 19:26:40.178400 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.178320    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-tmp-dir\") pod \"dns-default-pvmdm\" (UID: \"cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086\") " pod="openshift-dns/dns-default-pvmdm"
Jun 11 19:26:40.178400 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.178365    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t28fs\" (UniqueName: \"kubernetes.io/projected/b8e43f0e-9a35-46ba-a45f-0751c4315eee-kube-api-access-t28fs\") pod \"klusterlet-addon-workmgr-67f5d57965-nb97h\" (UID: \"b8e43f0e-9a35-46ba-a45f-0751c4315eee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h"
Jun 11 19:26:40.178400 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.178394    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-certificates\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:26:40.178941 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.178428    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-ca-trust-extracted\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:26:40.178941 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.178468    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-image-registry-private-configuration\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:26:40.178941 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.178587    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-trusted-ca\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:26:40.178941 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.178741    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8e43f0e-9a35-46ba-a45f-0751c4315eee-tmp\") pod \"klusterlet-addon-workmgr-67f5d57965-nb97h\" (UID: \"b8e43f0e-9a35-46ba-a45f-0751c4315eee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h"
Jun 11 19:26:40.179490 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.179290    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2d5e270-4904-401b-bd63-7846702c92de-additional-service-ca\") pod \"cluster-proxy-proxy-agent-69c7d46b99-vqvkg\" (UID: \"b2d5e270-4904-401b-bd63-7846702c92de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg"
Jun 11 19:26:40.179490 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:40.179388    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 11 19:26:40.179490 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:40.179401    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-788d696d79-ksrnk: secret "image-registry-tls" not found
Jun 11 19:26:40.179490 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:40.179451    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls podName:0a383c3c-0d8f-49a2-9c74-b406009b5dfc nodeName:}" failed. No retries permitted until 2026-06-11 19:26:40.679437483 +0000 UTC m=+36.083353583 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls") pod "image-registry-788d696d79-ksrnk" (UID: "0a383c3c-0d8f-49a2-9c74-b406009b5dfc") : secret "image-registry-tls" not found
Jun 11 19:26:40.180167 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.180138    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-certificates\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:26:40.180912 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.180871    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-tmp-dir\") pod \"dns-default-pvmdm\" (UID: \"cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086\") " pod="openshift-dns/dns-default-pvmdm"
Jun 11 19:26:40.183246 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.183224    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-installation-pull-secrets\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:26:40.183525 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.183483    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b8e43f0e-9a35-46ba-a45f-0751c4315eee-klusterlet-config\") pod \"klusterlet-addon-workmgr-67f5d57965-nb97h\" (UID: \"b8e43f0e-9a35-46ba-a45f-0751c4315eee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h"
Jun 11 19:26:40.183621 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.183490    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b2d5e270-4904-401b-bd63-7846702c92de-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-69c7d46b99-vqvkg\" (UID: \"b2d5e270-4904-401b-bd63-7846702c92de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg"
Jun 11 19:26:40.183621 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.183546    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b2d5e270-4904-401b-bd63-7846702c92de-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-69c7d46b99-vqvkg\" (UID: \"b2d5e270-4904-401b-bd63-7846702c92de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg"
Jun 11 19:26:40.183726 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.183620    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-image-registry-private-configuration\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:26:40.183825 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.183804    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b2d5e270-4904-401b-bd63-7846702c92de-hub\") pod \"cluster-proxy-proxy-agent-69c7d46b99-vqvkg\" (UID: \"b2d5e270-4904-401b-bd63-7846702c92de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg"
Jun 11 19:26:40.184247 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.184226    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21a2f529-95bb-4c15-9a38-d28b5f63cd13-cert\") pod \"ingress-canary-cfb5n\" (UID: \"21a2f529-95bb-4c15-9a38-d28b5f63cd13\") " pod="openshift-ingress-canary/ingress-canary-cfb5n"
Jun 11 19:26:40.184439 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.184414    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b2d5e270-4904-401b-bd63-7846702c92de-ca\") pod \"cluster-proxy-proxy-agent-69c7d46b99-vqvkg\" (UID: \"b2d5e270-4904-401b-bd63-7846702c92de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg"
Jun 11 19:26:40.186041 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.185809    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1ad225ed-be47-4bb0-85d0-abd03c041b65-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-579f5dfbdb-g7hbc\" (UID: \"1ad225ed-be47-4bb0-85d0-abd03c041b65\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579f5dfbdb-g7hbc"
Jun 11 19:26:40.187598 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.187552    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztvlt\" (UniqueName: \"kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-kube-api-access-ztvlt\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:26:40.187693 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.187599    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2t24\" (UniqueName: \"kubernetes.io/projected/1ad225ed-be47-4bb0-85d0-abd03c041b65-kube-api-access-d2t24\") pod \"managed-serviceaccount-addon-agent-579f5dfbdb-g7hbc\" (UID: \"1ad225ed-be47-4bb0-85d0-abd03c041b65\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579f5dfbdb-g7hbc"
Jun 11 19:26:40.188149 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.188127    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wccz4\" (UniqueName: \"kubernetes.io/projected/b2d5e270-4904-401b-bd63-7846702c92de-kube-api-access-wccz4\") pod \"cluster-proxy-proxy-agent-69c7d46b99-vqvkg\" (UID: \"b2d5e270-4904-401b-bd63-7846702c92de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg"
Jun 11 19:26:40.188777 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.188754    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t28fs\" (UniqueName: \"kubernetes.io/projected/b8e43f0e-9a35-46ba-a45f-0751c4315eee-kube-api-access-t28fs\") pod \"klusterlet-addon-workmgr-67f5d57965-nb97h\" (UID: \"b8e43f0e-9a35-46ba-a45f-0751c4315eee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h"
Jun 11 19:26:40.189084 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.189042    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbd8m\" (UniqueName: \"kubernetes.io/projected/21a2f529-95bb-4c15-9a38-d28b5f63cd13-kube-api-access-hbd8m\") pod \"ingress-canary-cfb5n\" (UID: \"21a2f529-95bb-4c15-9a38-d28b5f63cd13\") " pod="openshift-ingress-canary/ingress-canary-cfb5n"
Jun 11 19:26:40.189352 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.189328    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-bound-sa-token\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:26:40.190024 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.190003    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbqg7\" (UniqueName: \"kubernetes.io/projected/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-kube-api-access-kbqg7\") pod \"dns-default-pvmdm\" (UID: \"cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086\") " pod="openshift-dns/dns-default-pvmdm"
Jun 11 19:26:40.245942 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.245872    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg"
Jun 11 19:26:40.256301 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.256268    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h"
Jun 11 19:26:40.271387 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.271354    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579f5dfbdb-g7hbc"
Jun 11 19:26:40.290967 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.290936    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cfb5n"
Jun 11 19:26:40.449971 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.449938    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg"]
Jun 11 19:26:40.454085 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.453753    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h"]
Jun 11 19:26:40.457017 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:40.456992    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2d5e270_4904_401b_bd63_7846702c92de.slice/crio-8971b90c95bec9419b6e35769b3d6cbefe287ce8b914d75c71d017b4733502e0 WatchSource:0}: Error finding container 8971b90c95bec9419b6e35769b3d6cbefe287ce8b914d75c71d017b4733502e0: Status 404 returned error can't find the container with id 8971b90c95bec9419b6e35769b3d6cbefe287ce8b914d75c71d017b4733502e0
Jun 11 19:26:40.463634 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.463609    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579f5dfbdb-g7hbc"]
Jun 11 19:26:40.466669 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:40.466642    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ad225ed_be47_4bb0_85d0_abd03c041b65.slice/crio-7a1005e03155d6a5c716dce0dfee3b5f0761622967e80c61e3ec8f4f493393db WatchSource:0}: Error finding container 7a1005e03155d6a5c716dce0dfee3b5f0761622967e80c61e3ec8f4f493393db: Status 404 returned error can't find the container with id 7a1005e03155d6a5c716dce0dfee3b5f0761622967e80c61e3ec8f4f493393db
Jun 11 19:26:40.481241 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.481176    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cfb5n"]
Jun 11 19:26:40.485049 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:26:40.485027    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21a2f529_95bb_4c15_9a38_d28b5f63cd13.slice/crio-0844513833cb4b74942edc2d9474b90185db0774d88b546cae1deb424a8c0a0f WatchSource:0}: Error finding container 0844513833cb4b74942edc2d9474b90185db0774d88b546cae1deb424a8c0a0f: Status 404 returned error can't find the container with id 0844513833cb4b74942edc2d9474b90185db0774d88b546cae1deb424a8c0a0f
Jun 11 19:26:40.683380 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.683351    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-metrics-tls\") pod \"dns-default-pvmdm\" (UID: \"cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086\") " pod="openshift-dns/dns-default-pvmdm"
Jun 11 19:26:40.683536 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:40.683390    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:26:40.683536 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:40.683500    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 19:26:40.683536 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:40.683510    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 11 19:26:40.683536 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:40.683525    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-788d696d79-ksrnk: secret "image-registry-tls" not found
Jun 11 19:26:40.683656 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:40.683565    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-metrics-tls podName:cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:41.683548408 +0000 UTC m=+37.087464499 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-metrics-tls") pod "dns-default-pvmdm" (UID: "cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086") : secret "dns-default-metrics-tls" not found
Jun 11 19:26:40.683656 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:40.683579    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls podName:0a383c3c-0d8f-49a2-9c74-b406009b5dfc nodeName:}" failed. No retries permitted until 2026-06-11 19:26:41.683573265 +0000 UTC m=+37.087489349 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls") pod "image-registry-788d696d79-ksrnk" (UID: "0a383c3c-0d8f-49a2-9c74-b406009b5dfc") : secret "image-registry-tls" not found
Jun 11 19:26:41.072658 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:41.072628    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:26:41.073648 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:41.072851    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:26:41.075563 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:41.075536    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 11 19:26:41.075680 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:41.075538    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 11 19:26:41.077040 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:41.076646    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 11 19:26:41.077040 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:41.076872    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b5pkn\""
Jun 11 19:26:41.282289 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:41.282249    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cfb5n" event={"ID":"21a2f529-95bb-4c15-9a38-d28b5f63cd13","Type":"ContainerStarted","Data":"0844513833cb4b74942edc2d9474b90185db0774d88b546cae1deb424a8c0a0f"}
Jun 11 19:26:41.289080 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:41.289043    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h" event={"ID":"b8e43f0e-9a35-46ba-a45f-0751c4315eee","Type":"ContainerStarted","Data":"b1f7bfe71f61bac99fa612a1c95589c7fa3ada2823facdbe82c9b780d2efb445"}
Jun 11 19:26:41.290507 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:41.290479    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg" event={"ID":"b2d5e270-4904-401b-bd63-7846702c92de","Type":"ContainerStarted","Data":"8971b90c95bec9419b6e35769b3d6cbefe287ce8b914d75c71d017b4733502e0"}
Jun 11 19:26:41.292200 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:41.292173    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579f5dfbdb-g7hbc" event={"ID":"1ad225ed-be47-4bb0-85d0-abd03c041b65","Type":"ContainerStarted","Data":"7a1005e03155d6a5c716dce0dfee3b5f0761622967e80c61e3ec8f4f493393db"}
Jun 11 19:26:41.692771 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:41.692274    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-metrics-tls\") pod \"dns-default-pvmdm\" (UID: \"cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086\") " pod="openshift-dns/dns-default-pvmdm"
Jun 11 19:26:41.692771 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:41.692332    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:26:41.692771 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:41.692448    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 19:26:41.692771 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:41.692522    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-metrics-tls podName:cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:43.692501463 +0000 UTC m=+39.096417557 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-metrics-tls") pod "dns-default-pvmdm" (UID: "cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086") : secret "dns-default-metrics-tls" not found
Jun 11 19:26:41.692771 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:41.692613    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 11 19:26:41.692771 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:41.692629    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-788d696d79-ksrnk: secret "image-registry-tls" not found
Jun 11 19:26:41.692771 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:41.692740    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls podName:0a383c3c-0d8f-49a2-9c74-b406009b5dfc nodeName:}" failed. No retries permitted until 2026-06-11 19:26:43.692724438 +0000 UTC m=+39.096640541 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls") pod "image-registry-788d696d79-ksrnk" (UID: "0a383c3c-0d8f-49a2-9c74-b406009b5dfc") : secret "image-registry-tls" not found
Jun 11 19:26:43.711853 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:43.711817    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-metrics-tls\") pod \"dns-default-pvmdm\" (UID: \"cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086\") " pod="openshift-dns/dns-default-pvmdm"
Jun 11 19:26:43.711853 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:43.711863    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:26:43.712355 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:43.712004    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 19:26:43.712355 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:43.712029    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 11 19:26:43.712355 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:43.712044    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-788d696d79-ksrnk: secret "image-registry-tls" not found
Jun 11 19:26:43.712355 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:43.712087    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-metrics-tls podName:cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:47.712064758 +0000 UTC m=+43.115980853 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-metrics-tls") pod "dns-default-pvmdm" (UID: "cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086") : secret "dns-default-metrics-tls" not found
Jun 11 19:26:43.712355 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:43.712108    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls podName:0a383c3c-0d8f-49a2-9c74-b406009b5dfc nodeName:}" failed. No retries permitted until 2026-06-11 19:26:47.712097794 +0000 UTC m=+43.116013893 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls") pod "image-registry-788d696d79-ksrnk" (UID: "0a383c3c-0d8f-49a2-9c74-b406009b5dfc") : secret "image-registry-tls" not found
Jun 11 19:26:47.311671 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:47.311630    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cfb5n" event={"ID":"21a2f529-95bb-4c15-9a38-d28b5f63cd13","Type":"ContainerStarted","Data":"75d396f3d4c066324f3bfaa5c68c4ccacca4c71111159ede3d1f716b11d0e943"}
Jun 11 19:26:47.314486 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:47.314450    2565 generic.go:356] "Generic (PLEG): container finished" podID="007c0c12-34f6-4d2b-9af7-9b265c041702" containerID="77283c9f14b72bdcf1ad4febc6745c9d18879b765e5083ce489fb2c3921c692e" exitCode=0
Jun 11 19:26:47.314627 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:47.314521    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rllhm" event={"ID":"007c0c12-34f6-4d2b-9af7-9b265c041702","Type":"ContainerDied","Data":"77283c9f14b72bdcf1ad4febc6745c9d18879b765e5083ce489fb2c3921c692e"}
Jun 11 19:26:47.317039 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:47.316578    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579f5dfbdb-g7hbc" event={"ID":"1ad225ed-be47-4bb0-85d0-abd03c041b65","Type":"ContainerStarted","Data":"e2d6e02e504c9994f79c55107803294a16d434025564bc2f22ad21aa7fd901d0"}
Jun 11 19:26:47.327554 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:47.327506    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cfb5n" podStartSLOduration=2.427478596 podStartE2EDuration="8.327492041s" totalImagesPullingTime="5.900013445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:26:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:47.327376962 +0000 UTC m=+42.731293069" watchObservedRunningTime="2026-06-11 19:26:47.327492041 +0000 UTC m=+42.731408150"
Jun 11 19:26:47.342310 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:47.342113    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579f5dfbdb-g7hbc" podStartSLOduration=25.415359471 podStartE2EDuration="31.342096457s" totalImagesPullingTime="5.926736986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:26:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:47.341724934 +0000 UTC m=+42.745641041" watchObservedRunningTime="2026-06-11 19:26:47.342096457 +0000 UTC m=+42.746012559"
Jun 11 19:26:47.745232 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:47.745162    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-metrics-tls\") pod \"dns-default-pvmdm\" (UID: \"cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086\") " pod="openshift-dns/dns-default-pvmdm"
Jun 11 19:26:47.745439 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:47.745258    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:26:47.745439 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:47.745327    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 19:26:47.745439 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:47.745399    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-metrics-tls podName:cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:55.745378045 +0000 UTC m=+51.149294147 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-metrics-tls") pod "dns-default-pvmdm" (UID: "cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086") : secret "dns-default-metrics-tls" not found
Jun 11 19:26:47.745613 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:47.745550    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 11 19:26:47.745613 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:47.745566    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-788d696d79-ksrnk: secret "image-registry-tls" not found
Jun 11 19:26:47.745700 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:47.745616    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls podName:0a383c3c-0d8f-49a2-9c74-b406009b5dfc nodeName:}" failed. No retries permitted until 2026-06-11 19:26:55.745599481 +0000 UTC m=+51.149515568 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls") pod "image-registry-788d696d79-ksrnk" (UID: "0a383c3c-0d8f-49a2-9c74-b406009b5dfc") : secret "image-registry-tls" not found
Jun 11 19:26:48.325090 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:48.325053    2565 generic.go:356] "Generic (PLEG): container finished" podID="007c0c12-34f6-4d2b-9af7-9b265c041702" containerID="9a6cde13fd6ddab8b8b17596f2b5c8cddd2779979f719b67a0be12189eb54b18" exitCode=0
Jun 11 19:26:48.325530 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:48.325141    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rllhm" event={"ID":"007c0c12-34f6-4d2b-9af7-9b265c041702","Type":"ContainerDied","Data":"9a6cde13fd6ddab8b8b17596f2b5c8cddd2779979f719b67a0be12189eb54b18"}
Jun 11 19:26:49.331124 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:49.331091    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rllhm" event={"ID":"007c0c12-34f6-4d2b-9af7-9b265c041702","Type":"ContainerStarted","Data":"f6537868b4088f987bf9d4615d583b667d09f429b3ac4ca4f2658b635fcf2158"}
Jun 11 19:26:49.356031 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:49.355975    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rllhm" podStartSLOduration=9.039418931 podStartE2EDuration="44.355923894s" totalImagesPullingTime="35.316504963s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:26:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:49.354913146 +0000 UTC m=+44.758829250" watchObservedRunningTime="2026-06-11 19:26:49.355923894 +0000 UTC m=+44.759840001"
Jun 11 19:26:54.345332 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:54.345301    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg" event={"ID":"b2d5e270-4904-401b-bd63-7846702c92de","Type":"ContainerStarted","Data":"9006668e2f28372ef2bcb4bb7964b61c102188ca0dcc9e32cf8ceda4deb19edd"}
Jun 11 19:26:55.349373 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:55.349326    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg" event={"ID":"b2d5e270-4904-401b-bd63-7846702c92de","Type":"ContainerStarted","Data":"292d6d4d618bfd0b6896498b0f47fe58edc93268ad12861e658c1afedadf8389"}
Jun 11 19:26:55.349756 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:55.349382    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg" event={"ID":"b2d5e270-4904-401b-bd63-7846702c92de","Type":"ContainerStarted","Data":"81f3679db57b5e24669bea0fcbf590939244ce85c3aa539c1163be8fb148488a"}
Jun 11 19:26:55.369246 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:55.369202    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg" podStartSLOduration=25.622118167 podStartE2EDuration="39.369187999s" totalImagesPullingTime="13.747069832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:26:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:55.368081073 +0000 UTC m=+50.771997180" watchObservedRunningTime="2026-06-11 19:26:55.369187999 +0000 UTC m=+50.773104105"
Jun 11 19:26:55.808227 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:55.808193    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-metrics-tls\") pod \"dns-default-pvmdm\" (UID: \"cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086\") " pod="openshift-dns/dns-default-pvmdm"
Jun 11 19:26:55.808227 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:26:55.808234    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:26:55.808433 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:55.808340    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 11 19:26:55.808433 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:55.808352    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-788d696d79-ksrnk: secret "image-registry-tls" not found
Jun 11 19:26:55.808433 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:55.808350    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 19:26:55.808433 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:55.808404    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls podName:0a383c3c-0d8f-49a2-9c74-b406009b5dfc nodeName:}" failed. No retries permitted until 2026-06-11 19:27:11.808392093 +0000 UTC m=+67.212308179 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls") pod "image-registry-788d696d79-ksrnk" (UID: "0a383c3c-0d8f-49a2-9c74-b406009b5dfc") : secret "image-registry-tls" not found
Jun 11 19:26:55.808433 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:26:55.808416    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-metrics-tls podName:cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086 nodeName:}" failed. No retries permitted until 2026-06-11 19:27:11.808410699 +0000 UTC m=+67.212326784 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-metrics-tls") pod "dns-default-pvmdm" (UID: "cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086") : secret "dns-default-metrics-tls" not found
Jun 11 19:27:06.276815 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:06.276782    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n2n72"
Jun 11 19:27:07.380842 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:07.380808    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h" event={"ID":"b8e43f0e-9a35-46ba-a45f-0751c4315eee","Type":"ContainerStarted","Data":"d884a75ffc6bd96b7679dec422bbc2192aae97bae4dbe04d4a9465219e712c8b"}
Jun 11 19:27:07.381251 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:07.381003    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h"
Jun 11 19:27:07.382664 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:07.382645    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h"
Jun 11 19:27:07.398103 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:07.398059    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h" podStartSLOduration=25.048375792 podStartE2EDuration="51.398046942s" totalImagesPullingTime="26.34967115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:26:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:27:07.397059704 +0000 UTC m=+62.800975814" watchObservedRunningTime="2026-06-11 19:27:07.398046942 +0000 UTC m=+62.801963077"
Jun 11 19:27:10.820767 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:10.820724    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs\") pod \"network-metrics-daemon-q665k\" (UID: \"2dd52262-7f1b-440b-a020-a59da738c3c4\") " pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:27:10.823335 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:10.823316    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 11 19:27:10.831238 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:27:10.831219    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 11 19:27:10.831307 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:27:10.831272    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs podName:2dd52262-7f1b-440b-a020-a59da738c3c4 nodeName:}" failed. No retries permitted until 2026-06-11 19:28:14.83125741 +0000 UTC m=+130.235173495 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs") pod "network-metrics-daemon-q665k" (UID: "2dd52262-7f1b-440b-a020-a59da738c3c4") : secret "metrics-daemon-secret" not found
Jun 11 19:27:10.921898 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:10.921851    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7cd450c3-fc87-48a3-b7ba-617cede6af81-original-pull-secret\") pod \"global-pull-secret-syncer-tvlp6\" (UID: \"7cd450c3-fc87-48a3-b7ba-617cede6af81\") " pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:27:10.924317 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:10.924298    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 11 19:27:10.935713 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:10.935690    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7cd450c3-fc87-48a3-b7ba-617cede6af81-original-pull-secret\") pod \"global-pull-secret-syncer-tvlp6\" (UID: \"7cd450c3-fc87-48a3-b7ba-617cede6af81\") " pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:27:11.022331 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:11.022293    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwbgs\" (UniqueName: \"kubernetes.io/projected/a1e44196-5e2e-4051-b4aa-31782fb85476-kube-api-access-cwbgs\") pod \"network-check-target-78njs\" (UID: \"a1e44196-5e2e-4051-b4aa-31782fb85476\") " pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:27:11.024666 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:11.024645    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 11 19:27:11.034520 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:11.034500    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 11 19:27:11.045783 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:11.045755    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwbgs\" (UniqueName: \"kubernetes.io/projected/a1e44196-5e2e-4051-b4aa-31782fb85476-kube-api-access-cwbgs\") pod \"network-check-target-78njs\" (UID: \"a1e44196-5e2e-4051-b4aa-31782fb85476\") " pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:27:11.086417 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:11.086355    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvlp6"
Jun 11 19:27:11.095116 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:11.095092    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b5pkn\""
Jun 11 19:27:11.103299 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:11.103277    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:27:11.215874 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:11.215846    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tvlp6"]
Jun 11 19:27:11.218795 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:27:11.218767    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cd450c3_fc87_48a3_b7ba_617cede6af81.slice/crio-08bd75e472b142acbb65766bfe32adcc6adf97fe1152cd6a33f23a0f33935f24 WatchSource:0}: Error finding container 08bd75e472b142acbb65766bfe32adcc6adf97fe1152cd6a33f23a0f33935f24: Status 404 returned error can't find the container with id 08bd75e472b142acbb65766bfe32adcc6adf97fe1152cd6a33f23a0f33935f24
Jun 11 19:27:11.231157 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:11.231133    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-78njs"]
Jun 11 19:27:11.234099 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:27:11.234076    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1e44196_5e2e_4051_b4aa_31782fb85476.slice/crio-3bca84153aa1dc488a2dc48226822a0c0c9dc182180cb78b8454a17ab28fe950 WatchSource:0}: Error finding container 3bca84153aa1dc488a2dc48226822a0c0c9dc182180cb78b8454a17ab28fe950: Status 404 returned error can't find the container with id 3bca84153aa1dc488a2dc48226822a0c0c9dc182180cb78b8454a17ab28fe950
Jun 11 19:27:11.394464 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:11.394375    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tvlp6" event={"ID":"7cd450c3-fc87-48a3-b7ba-617cede6af81","Type":"ContainerStarted","Data":"08bd75e472b142acbb65766bfe32adcc6adf97fe1152cd6a33f23a0f33935f24"}
Jun 11 19:27:11.395461 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:11.395437    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-78njs" event={"ID":"a1e44196-5e2e-4051-b4aa-31782fb85476","Type":"ContainerStarted","Data":"3bca84153aa1dc488a2dc48226822a0c0c9dc182180cb78b8454a17ab28fe950"}
Jun 11 19:27:11.829018 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:11.828973    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-metrics-tls\") pod \"dns-default-pvmdm\" (UID: \"cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086\") " pod="openshift-dns/dns-default-pvmdm"
Jun 11 19:27:11.829447 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:11.829037    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:27:11.829447 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:27:11.829139    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 19:27:11.829447 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:27:11.829159    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 11 19:27:11.829447 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:27:11.829174    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-788d696d79-ksrnk: secret "image-registry-tls" not found
Jun 11 19:27:11.829447 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:27:11.829209    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-metrics-tls podName:cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086 nodeName:}" failed. No retries permitted until 2026-06-11 19:27:43.829191427 +0000 UTC m=+99.233107517 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-metrics-tls") pod "dns-default-pvmdm" (UID: "cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086") : secret "dns-default-metrics-tls" not found
Jun 11 19:27:11.829447 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:27:11.829230    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls podName:0a383c3c-0d8f-49a2-9c74-b406009b5dfc nodeName:}" failed. No retries permitted until 2026-06-11 19:27:43.829219869 +0000 UTC m=+99.233135954 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls") pod "image-registry-788d696d79-ksrnk" (UID: "0a383c3c-0d8f-49a2-9c74-b406009b5dfc") : secret "image-registry-tls" not found
Jun 11 19:27:17.416672 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:17.416633    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tvlp6" event={"ID":"7cd450c3-fc87-48a3-b7ba-617cede6af81","Type":"ContainerStarted","Data":"796668ebe0ad58a5eba2209df32fcc154ef0bc45d1cadba6950b09d469c5a30c"}
Jun 11 19:27:17.418290 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:17.418261    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-78njs" event={"ID":"a1e44196-5e2e-4051-b4aa-31782fb85476","Type":"ContainerStarted","Data":"69ec29b9de4bea71f3418d8993c40da459f608604c2e5e1483e5404ac5187351"}
Jun 11 19:27:17.418419 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:17.418396    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:27:17.432410 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:17.432361    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tvlp6" podStartSLOduration=66.960513402 podStartE2EDuration="1m12.432347548s" totalImagesPullingTime="5.471834146s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:27:17.432003792 +0000 UTC m=+72.835919899" watchObservedRunningTime="2026-06-11 19:27:17.432347548 +0000 UTC m=+72.836263655"
Jun 11 19:27:17.448227 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:17.448183    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-78njs" podStartSLOduration=67.00293204 podStartE2EDuration="1m12.448167134s" totalImagesPullingTime="5.445235094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:27:17.447704613 +0000 UTC m=+72.851620732" watchObservedRunningTime="2026-06-11 19:27:17.448167134 +0000 UTC m=+72.852083219"
Jun 11 19:27:43.879602 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:43.879550    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-metrics-tls\") pod \"dns-default-pvmdm\" (UID: \"cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086\") " pod="openshift-dns/dns-default-pvmdm"
Jun 11 19:27:43.879602 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:43.879607    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:27:43.880107 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:27:43.879712    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 19:27:43.880107 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:27:43.879735    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 11 19:27:43.880107 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:27:43.879746    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-788d696d79-ksrnk: secret "image-registry-tls" not found
Jun 11 19:27:43.880107 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:27:43.879791    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-metrics-tls podName:cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086 nodeName:}" failed. No retries permitted until 2026-06-11 19:28:47.879775822 +0000 UTC m=+163.283691906 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-metrics-tls") pod "dns-default-pvmdm" (UID: "cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086") : secret "dns-default-metrics-tls" not found
Jun 11 19:27:43.880107 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:27:43.879806    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls podName:0a383c3c-0d8f-49a2-9c74-b406009b5dfc nodeName:}" failed. No retries permitted until 2026-06-11 19:28:47.879800702 +0000 UTC m=+163.283716786 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls") pod "image-registry-788d696d79-ksrnk" (UID: "0a383c3c-0d8f-49a2-9c74-b406009b5dfc") : secret "image-registry-tls" not found
Jun 11 19:27:48.423049 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:27:48.423019    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-78njs"
Jun 11 19:28:14.900020 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:28:14.899973    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs\") pod \"network-metrics-daemon-q665k\" (UID: \"2dd52262-7f1b-440b-a020-a59da738c3c4\") " pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:28:14.900503 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:28:14.900128    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 11 19:28:14.900503 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:28:14.900204    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs podName:2dd52262-7f1b-440b-a020-a59da738c3c4 nodeName:}" failed. No retries permitted until 2026-06-11 19:30:16.900186594 +0000 UTC m=+252.304102679 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs") pod "network-metrics-daemon-q665k" (UID: "2dd52262-7f1b-440b-a020-a59da738c3c4") : secret "metrics-daemon-secret" not found
Jun 11 19:28:42.976288 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:28:42.976239    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-788d696d79-ksrnk" podUID="0a383c3c-0d8f-49a2-9c74-b406009b5dfc"
Jun 11 19:28:42.982340 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:28:42.982316    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pvmdm" podUID="cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086"
Jun 11 19:28:43.081902 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:28:43.081847    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-q665k" podUID="2dd52262-7f1b-440b-a020-a59da738c3c4"
Jun 11 19:28:43.667673 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:28:43.667599    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:28:43.667811 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:28:43.667599    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pvmdm"
Jun 11 19:28:46.678655 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:28:46.678622    2565 generic.go:356] "Generic (PLEG): container finished" podID="1ad225ed-be47-4bb0-85d0-abd03c041b65" containerID="e2d6e02e504c9994f79c55107803294a16d434025564bc2f22ad21aa7fd901d0" exitCode=255
Jun 11 19:28:46.678988 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:28:46.678680    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579f5dfbdb-g7hbc" event={"ID":"1ad225ed-be47-4bb0-85d0-abd03c041b65","Type":"ContainerDied","Data":"e2d6e02e504c9994f79c55107803294a16d434025564bc2f22ad21aa7fd901d0"}
Jun 11 19:28:46.678988 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:28:46.678969    2565 scope.go:117] "RemoveContainer" containerID="e2d6e02e504c9994f79c55107803294a16d434025564bc2f22ad21aa7fd901d0"
Jun 11 19:28:47.683466 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:28:47.683430    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579f5dfbdb-g7hbc" event={"ID":"1ad225ed-be47-4bb0-85d0-abd03c041b65","Type":"ContainerStarted","Data":"a74f40628642c297f2652e17519d99785d51ed6afdfd102fed45ee7bc9bdc935"}
Jun 11 19:28:47.942573 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:28:47.942479    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-metrics-tls\") pod \"dns-default-pvmdm\" (UID: \"cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086\") " pod="openshift-dns/dns-default-pvmdm"
Jun 11 19:28:47.942573 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:28:47.942543    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:28:47.942747 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:28:47.942636    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 19:28:47.942747 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:28:47.942704    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-metrics-tls podName:cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086 nodeName:}" failed. No retries permitted until 2026-06-11 19:30:49.942687282 +0000 UTC m=+285.346603370 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-metrics-tls") pod "dns-default-pvmdm" (UID: "cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086") : secret "dns-default-metrics-tls" not found
Jun 11 19:28:47.942747 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:28:47.942638    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 11 19:28:47.942747 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:28:47.942739    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-788d696d79-ksrnk: secret "image-registry-tls" not found
Jun 11 19:28:47.942872 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:28:47.942792    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls podName:0a383c3c-0d8f-49a2-9c74-b406009b5dfc nodeName:}" failed. No retries permitted until 2026-06-11 19:30:49.942776431 +0000 UTC m=+285.346692532 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls") pod "image-registry-788d696d79-ksrnk" (UID: "0a383c3c-0d8f-49a2-9c74-b406009b5dfc") : secret "image-registry-tls" not found
Jun 11 19:28:54.072650 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:28:54.072567    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:29:07.382329 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:29:07.382235    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h" podUID="b8e43f0e-9a35-46ba-a45f-0751c4315eee" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.7:8000/readyz\": dial tcp 10.132.0.7:8000: connect: connection refused"
Jun 11 19:29:07.742307 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:29:07.742273    2565 generic.go:356] "Generic (PLEG): container finished" podID="b8e43f0e-9a35-46ba-a45f-0751c4315eee" containerID="d884a75ffc6bd96b7679dec422bbc2192aae97bae4dbe04d4a9465219e712c8b" exitCode=1
Jun 11 19:29:07.742464 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:29:07.742335    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h" event={"ID":"b8e43f0e-9a35-46ba-a45f-0751c4315eee","Type":"ContainerDied","Data":"d884a75ffc6bd96b7679dec422bbc2192aae97bae4dbe04d4a9465219e712c8b"}
Jun 11 19:29:07.742627 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:29:07.742614    2565 scope.go:117] "RemoveContainer" containerID="d884a75ffc6bd96b7679dec422bbc2192aae97bae4dbe04d4a9465219e712c8b"
Jun 11 19:29:08.747389 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:29:08.747354    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h" event={"ID":"b8e43f0e-9a35-46ba-a45f-0751c4315eee","Type":"ContainerStarted","Data":"7b6f472b573a7831bbafa08d39141c506c0e093723bd0c8f0b371662311218ac"}
Jun 11 19:29:08.747764 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:29:08.747619    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h"
Jun 11 19:29:08.748293 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:29:08.748272    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h"
Jun 11 19:30:16.981947 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:16.981909    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs\") pod \"network-metrics-daemon-q665k\" (UID: \"2dd52262-7f1b-440b-a020-a59da738c3c4\") " pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:30:16.982433 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:30:16.982043    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 11 19:30:16.982433 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:30:16.982103    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs podName:2dd52262-7f1b-440b-a020-a59da738c3c4 nodeName:}" failed. No retries permitted until 2026-06-11 19:32:18.982088338 +0000 UTC m=+374.386004422 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs") pod "network-metrics-daemon-q665k" (UID: "2dd52262-7f1b-440b-a020-a59da738c3c4") : secret "metrics-daemon-secret" not found
Jun 11 19:30:22.185970 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:22.185934    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kf8f7"]
Jun 11 19:30:22.187851 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:22.187835    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kf8f7"
Jun 11 19:30:22.190503 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:22.190481    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5vpm4\""
Jun 11 19:30:22.191520 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:22.191485    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 11 19:30:22.191662 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:22.191525    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 11 19:30:22.191662 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:22.191548    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 11 19:30:22.191662 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:22.191568    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 11 19:30:22.247868 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:22.247831    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kf8f7"]
Jun 11 19:30:22.319959 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:22.319920    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jth8q\" (UniqueName: \"kubernetes.io/projected/c835962b-7d4a-4ff3-bd28-8642911c85d9-kube-api-access-jth8q\") pod \"insights-runtime-extractor-kf8f7\" (UID: \"c835962b-7d4a-4ff3-bd28-8642911c85d9\") " pod="openshift-insights/insights-runtime-extractor-kf8f7"
Jun 11 19:30:22.320153 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:22.320014    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c835962b-7d4a-4ff3-bd28-8642911c85d9-data-volume\") pod \"insights-runtime-extractor-kf8f7\" (UID: \"c835962b-7d4a-4ff3-bd28-8642911c85d9\") " pod="openshift-insights/insights-runtime-extractor-kf8f7"
Jun 11 19:30:22.320153 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:22.320042    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c835962b-7d4a-4ff3-bd28-8642911c85d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kf8f7\" (UID: \"c835962b-7d4a-4ff3-bd28-8642911c85d9\") " pod="openshift-insights/insights-runtime-extractor-kf8f7"
Jun 11 19:30:22.320153 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:22.320066    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c835962b-7d4a-4ff3-bd28-8642911c85d9-crio-socket\") pod \"insights-runtime-extractor-kf8f7\" (UID: \"c835962b-7d4a-4ff3-bd28-8642911c85d9\") " pod="openshift-insights/insights-runtime-extractor-kf8f7"
Jun 11 19:30:22.320287 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:22.320165    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c835962b-7d4a-4ff3-bd28-8642911c85d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kf8f7\" (UID: \"c835962b-7d4a-4ff3-bd28-8642911c85d9\") " pod="openshift-insights/insights-runtime-extractor-kf8f7"
Jun 11 19:30:22.421380 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:22.421341    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jth8q\" (UniqueName: \"kubernetes.io/projected/c835962b-7d4a-4ff3-bd28-8642911c85d9-kube-api-access-jth8q\") pod \"insights-runtime-extractor-kf8f7\" (UID: \"c835962b-7d4a-4ff3-bd28-8642911c85d9\") " pod="openshift-insights/insights-runtime-extractor-kf8f7"
Jun 11 19:30:22.421565 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:22.421424    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c835962b-7d4a-4ff3-bd28-8642911c85d9-data-volume\") pod \"insights-runtime-extractor-kf8f7\" (UID: \"c835962b-7d4a-4ff3-bd28-8642911c85d9\") " pod="openshift-insights/insights-runtime-extractor-kf8f7"
Jun 11 19:30:22.421565 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:22.421443    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c835962b-7d4a-4ff3-bd28-8642911c85d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kf8f7\" (UID: \"c835962b-7d4a-4ff3-bd28-8642911c85d9\") " pod="openshift-insights/insights-runtime-extractor-kf8f7"
Jun 11 19:30:22.421565 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:22.421458    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c835962b-7d4a-4ff3-bd28-8642911c85d9-crio-socket\") pod \"insights-runtime-extractor-kf8f7\" (UID: \"c835962b-7d4a-4ff3-bd28-8642911c85d9\") " pod="openshift-insights/insights-runtime-extractor-kf8f7"
Jun 11 19:30:22.421565 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:22.421488    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c835962b-7d4a-4ff3-bd28-8642911c85d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kf8f7\" (UID: \"c835962b-7d4a-4ff3-bd28-8642911c85d9\") " pod="openshift-insights/insights-runtime-extractor-kf8f7"
Jun 11 19:30:22.421565 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:30:22.421563    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 11 19:30:22.421769 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:30:22.421579    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 11 19:30:22.421769 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:22.421590    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c835962b-7d4a-4ff3-bd28-8642911c85d9-crio-socket\") pod \"insights-runtime-extractor-kf8f7\" (UID: \"c835962b-7d4a-4ff3-bd28-8642911c85d9\") " pod="openshift-insights/insights-runtime-extractor-kf8f7"
Jun 11 19:30:22.421769 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:30:22.421650    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c835962b-7d4a-4ff3-bd28-8642911c85d9-kube-rbac-proxy-cm podName:c835962b-7d4a-4ff3-bd28-8642911c85d9 nodeName:}" failed. No retries permitted until 2026-06-11 19:30:22.921631153 +0000 UTC m=+258.325547244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c835962b-7d4a-4ff3-bd28-8642911c85d9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kf8f7" (UID: "c835962b-7d4a-4ff3-bd28-8642911c85d9") : configmap "kube-rbac-proxy" not found
Jun 11 19:30:22.421769 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:30:22.421668    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c835962b-7d4a-4ff3-bd28-8642911c85d9-insights-runtime-extractor-tls podName:c835962b-7d4a-4ff3-bd28-8642911c85d9 nodeName:}" failed. No retries permitted until 2026-06-11 19:30:22.921659327 +0000 UTC m=+258.325575431 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c835962b-7d4a-4ff3-bd28-8642911c85d9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kf8f7" (UID: "c835962b-7d4a-4ff3-bd28-8642911c85d9") : secret "insights-runtime-extractor-tls" not found
Jun 11 19:30:22.421957 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:22.421941    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c835962b-7d4a-4ff3-bd28-8642911c85d9-data-volume\") pod \"insights-runtime-extractor-kf8f7\" (UID: \"c835962b-7d4a-4ff3-bd28-8642911c85d9\") " pod="openshift-insights/insights-runtime-extractor-kf8f7"
Jun 11 19:30:22.442506 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:22.442409    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jth8q\" (UniqueName: \"kubernetes.io/projected/c835962b-7d4a-4ff3-bd28-8642911c85d9-kube-api-access-jth8q\") pod \"insights-runtime-extractor-kf8f7\" (UID: \"c835962b-7d4a-4ff3-bd28-8642911c85d9\") " pod="openshift-insights/insights-runtime-extractor-kf8f7"
Jun 11 19:30:22.924942 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:22.924873    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c835962b-7d4a-4ff3-bd28-8642911c85d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kf8f7\" (UID: \"c835962b-7d4a-4ff3-bd28-8642911c85d9\") " pod="openshift-insights/insights-runtime-extractor-kf8f7"
Jun 11 19:30:22.925118 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:22.924974    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c835962b-7d4a-4ff3-bd28-8642911c85d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kf8f7\" (UID: \"c835962b-7d4a-4ff3-bd28-8642911c85d9\") " pod="openshift-insights/insights-runtime-extractor-kf8f7"
Jun 11 19:30:22.925118 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:30:22.925033    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 11 19:30:22.925118 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:30:22.925095    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c835962b-7d4a-4ff3-bd28-8642911c85d9-insights-runtime-extractor-tls podName:c835962b-7d4a-4ff3-bd28-8642911c85d9 nodeName:}" failed. No retries permitted until 2026-06-11 19:30:23.925080839 +0000 UTC m=+259.328996925 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c835962b-7d4a-4ff3-bd28-8642911c85d9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kf8f7" (UID: "c835962b-7d4a-4ff3-bd28-8642911c85d9") : secret "insights-runtime-extractor-tls" not found
Jun 11 19:30:22.925118 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:30:22.925100    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 11 19:30:22.925254 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:30:22.925161    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c835962b-7d4a-4ff3-bd28-8642911c85d9-kube-rbac-proxy-cm podName:c835962b-7d4a-4ff3-bd28-8642911c85d9 nodeName:}" failed. No retries permitted until 2026-06-11 19:30:23.925143913 +0000 UTC m=+259.329060002 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c835962b-7d4a-4ff3-bd28-8642911c85d9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kf8f7" (UID: "c835962b-7d4a-4ff3-bd28-8642911c85d9") : configmap "kube-rbac-proxy" not found
Jun 11 19:30:23.933156 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:23.933124    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c835962b-7d4a-4ff3-bd28-8642911c85d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kf8f7\" (UID: \"c835962b-7d4a-4ff3-bd28-8642911c85d9\") " pod="openshift-insights/insights-runtime-extractor-kf8f7"
Jun 11 19:30:23.933543 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:23.933169    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c835962b-7d4a-4ff3-bd28-8642911c85d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kf8f7\" (UID: \"c835962b-7d4a-4ff3-bd28-8642911c85d9\") " pod="openshift-insights/insights-runtime-extractor-kf8f7"
Jun 11 19:30:23.933543 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:30:23.933255    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 11 19:30:23.933543 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:30:23.933284    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 11 19:30:23.933543 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:30:23.933322    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c835962b-7d4a-4ff3-bd28-8642911c85d9-kube-rbac-proxy-cm podName:c835962b-7d4a-4ff3-bd28-8642911c85d9 nodeName:}" failed. No retries permitted until 2026-06-11 19:30:25.933303206 +0000 UTC m=+261.337219305 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c835962b-7d4a-4ff3-bd28-8642911c85d9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kf8f7" (UID: "c835962b-7d4a-4ff3-bd28-8642911c85d9") : configmap "kube-rbac-proxy" not found
Jun 11 19:30:23.933543 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:30:23.933340    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c835962b-7d4a-4ff3-bd28-8642911c85d9-insights-runtime-extractor-tls podName:c835962b-7d4a-4ff3-bd28-8642911c85d9 nodeName:}" failed. No retries permitted until 2026-06-11 19:30:25.933331769 +0000 UTC m=+261.337247854 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c835962b-7d4a-4ff3-bd28-8642911c85d9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kf8f7" (UID: "c835962b-7d4a-4ff3-bd28-8642911c85d9") : secret "insights-runtime-extractor-tls" not found
Jun 11 19:30:23.964990 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:23.964964    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dgnbm_ace36f16-b3ef-4f51-90fc-40d44b9cb8b1/dns-node-resolver/0.log"
Jun 11 19:30:24.965399 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:24.965371    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jxggl_50300198-b698-41ab-a551-04ad9bb274f7/node-ca/0.log"
Jun 11 19:30:25.766445 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:25.766407    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cfb5n_21a2f529-95bb-4c15-9a38-d28b5f63cd13/serve-healthcheck-canary/0.log"
Jun 11 19:30:25.946304 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:25.946273    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c835962b-7d4a-4ff3-bd28-8642911c85d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kf8f7\" (UID: \"c835962b-7d4a-4ff3-bd28-8642911c85d9\") " pod="openshift-insights/insights-runtime-extractor-kf8f7"
Jun 11 19:30:25.946456 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:25.946353    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c835962b-7d4a-4ff3-bd28-8642911c85d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kf8f7\" (UID: \"c835962b-7d4a-4ff3-bd28-8642911c85d9\") " pod="openshift-insights/insights-runtime-extractor-kf8f7"
Jun 11 19:30:25.946456 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:30:25.946417    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 11 19:30:25.946456 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:30:25.946448    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 11 19:30:25.946613 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:30:25.946514    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c835962b-7d4a-4ff3-bd28-8642911c85d9-kube-rbac-proxy-cm podName:c835962b-7d4a-4ff3-bd28-8642911c85d9 nodeName:}" failed. No retries permitted until 2026-06-11 19:30:29.946491026 +0000 UTC m=+265.350407117 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c835962b-7d4a-4ff3-bd28-8642911c85d9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kf8f7" (UID: "c835962b-7d4a-4ff3-bd28-8642911c85d9") : configmap "kube-rbac-proxy" not found
Jun 11 19:30:25.946613 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:30:25.946535    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c835962b-7d4a-4ff3-bd28-8642911c85d9-insights-runtime-extractor-tls podName:c835962b-7d4a-4ff3-bd28-8642911c85d9 nodeName:}" failed. No retries permitted until 2026-06-11 19:30:29.946525162 +0000 UTC m=+265.350441262 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c835962b-7d4a-4ff3-bd28-8642911c85d9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kf8f7" (UID: "c835962b-7d4a-4ff3-bd28-8642911c85d9") : secret "insights-runtime-extractor-tls" not found
Jun 11 19:30:29.976532 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:29.976503    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c835962b-7d4a-4ff3-bd28-8642911c85d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kf8f7\" (UID: \"c835962b-7d4a-4ff3-bd28-8642911c85d9\") " pod="openshift-insights/insights-runtime-extractor-kf8f7"
Jun 11 19:30:29.976965 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:29.976578    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c835962b-7d4a-4ff3-bd28-8642911c85d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kf8f7\" (UID: \"c835962b-7d4a-4ff3-bd28-8642911c85d9\") " pod="openshift-insights/insights-runtime-extractor-kf8f7"
Jun 11 19:30:29.976965 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:30:29.976615    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 11 19:30:29.976965 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:30:29.976666    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 11 19:30:29.976965 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:30:29.976674    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c835962b-7d4a-4ff3-bd28-8642911c85d9-kube-rbac-proxy-cm podName:c835962b-7d4a-4ff3-bd28-8642911c85d9 nodeName:}" failed. No retries permitted until 2026-06-11 19:30:37.976657888 +0000 UTC m=+273.380573990 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c835962b-7d4a-4ff3-bd28-8642911c85d9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kf8f7" (UID: "c835962b-7d4a-4ff3-bd28-8642911c85d9") : configmap "kube-rbac-proxy" not found
Jun 11 19:30:29.976965 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:30:29.976705    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c835962b-7d4a-4ff3-bd28-8642911c85d9-insights-runtime-extractor-tls podName:c835962b-7d4a-4ff3-bd28-8642911c85d9 nodeName:}" failed. No retries permitted until 2026-06-11 19:30:37.97669362 +0000 UTC m=+273.380609706 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c835962b-7d4a-4ff3-bd28-8642911c85d9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kf8f7" (UID: "c835962b-7d4a-4ff3-bd28-8642911c85d9") : secret "insights-runtime-extractor-tls" not found
Jun 11 19:30:38.034554 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:38.034519    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c835962b-7d4a-4ff3-bd28-8642911c85d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kf8f7\" (UID: \"c835962b-7d4a-4ff3-bd28-8642911c85d9\") " pod="openshift-insights/insights-runtime-extractor-kf8f7"
Jun 11 19:30:38.034554 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:38.034565    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c835962b-7d4a-4ff3-bd28-8642911c85d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kf8f7\" (UID: \"c835962b-7d4a-4ff3-bd28-8642911c85d9\") " pod="openshift-insights/insights-runtime-extractor-kf8f7"
Jun 11 19:30:38.035054 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:38.035041    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c835962b-7d4a-4ff3-bd28-8642911c85d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kf8f7\" (UID: \"c835962b-7d4a-4ff3-bd28-8642911c85d9\") " pod="openshift-insights/insights-runtime-extractor-kf8f7"
Jun 11 19:30:38.037011 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:38.036976    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c835962b-7d4a-4ff3-bd28-8642911c85d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kf8f7\" (UID: \"c835962b-7d4a-4ff3-bd28-8642911c85d9\") " pod="openshift-insights/insights-runtime-extractor-kf8f7"
Jun 11 19:30:38.097301 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:38.097267    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kf8f7"
Jun 11 19:30:38.220407 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:38.220375    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kf8f7"]
Jun 11 19:30:38.223540 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:30:38.223505    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc835962b_7d4a_4ff3_bd28_8642911c85d9.slice/crio-51e74bf7dc142b8d568f0672c09759cfda8e58e98814119b977bfcef77673600 WatchSource:0}: Error finding container 51e74bf7dc142b8d568f0672c09759cfda8e58e98814119b977bfcef77673600: Status 404 returned error can't find the container with id 51e74bf7dc142b8d568f0672c09759cfda8e58e98814119b977bfcef77673600
Jun 11 19:30:39.002555 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:39.002469    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kf8f7" event={"ID":"c835962b-7d4a-4ff3-bd28-8642911c85d9","Type":"ContainerStarted","Data":"51e74bf7dc142b8d568f0672c09759cfda8e58e98814119b977bfcef77673600"}
Jun 11 19:30:42.013848 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:42.013812    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kf8f7" event={"ID":"c835962b-7d4a-4ff3-bd28-8642911c85d9","Type":"ContainerStarted","Data":"34eea8ccd62455864e2623867e176488bba7305190b2ff6ef0ea47984448a587"}
Jun 11 19:30:43.020044 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:43.020010    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kf8f7" event={"ID":"c835962b-7d4a-4ff3-bd28-8642911c85d9","Type":"ContainerStarted","Data":"9b0417626501e914b3eea2b4dda6e98ff9f5ace1ceb9445a70a8d8fd64913ebf"}
Jun 11 19:30:44.025091 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:44.025054    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kf8f7" event={"ID":"c835962b-7d4a-4ff3-bd28-8642911c85d9","Type":"ContainerStarted","Data":"fb8c4aa040cf355c42817110d5075bbe7870a3000893490a5b3e3cf4ecb134e4"}
Jun 11 19:30:44.041295 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:44.041203    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kf8f7" podStartSLOduration=16.578336886 podStartE2EDuration="22.041186977s" totalImagesPullingTime="5.462850091s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:30:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:30:44.040766623 +0000 UTC m=+279.444682724" watchObservedRunningTime="2026-06-11 19:30:44.041186977 +0000 UTC m=+279.445103086"
Jun 11 19:30:46.668599 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:30:46.668530    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-788d696d79-ksrnk" podUID="0a383c3c-0d8f-49a2-9c74-b406009b5dfc"
Jun 11 19:30:46.668599 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:30:46.668529    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pvmdm" podUID="cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086"
Jun 11 19:30:47.035150 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:47.035114    2565 generic.go:356] "Generic (PLEG): container finished" podID="1ad225ed-be47-4bb0-85d0-abd03c041b65" containerID="a74f40628642c297f2652e17519d99785d51ed6afdfd102fed45ee7bc9bdc935" exitCode=255
Jun 11 19:30:47.035355 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:47.035188    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579f5dfbdb-g7hbc" event={"ID":"1ad225ed-be47-4bb0-85d0-abd03c041b65","Type":"ContainerDied","Data":"a74f40628642c297f2652e17519d99785d51ed6afdfd102fed45ee7bc9bdc935"}
Jun 11 19:30:47.035355 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:47.035212    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pvmdm"
Jun 11 19:30:47.035355 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:47.035231    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:30:47.035355 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:47.035237    2565 scope.go:117] "RemoveContainer" containerID="e2d6e02e504c9994f79c55107803294a16d434025564bc2f22ad21aa7fd901d0"
Jun 11 19:30:47.035783 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:47.035761    2565 scope.go:117] "RemoveContainer" containerID="a74f40628642c297f2652e17519d99785d51ed6afdfd102fed45ee7bc9bdc935"
Jun 11 19:30:47.035971 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:30:47.035951    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-579f5dfbdb-g7hbc_open-cluster-management-agent-addon(1ad225ed-be47-4bb0-85d0-abd03c041b65)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579f5dfbdb-g7hbc" podUID="1ad225ed-be47-4bb0-85d0-abd03c041b65"
Jun 11 19:30:50.024032 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:50.023996    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-metrics-tls\") pod \"dns-default-pvmdm\" (UID: \"cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086\") " pod="openshift-dns/dns-default-pvmdm"
Jun 11 19:30:50.024032 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:50.024034    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:30:50.026616 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:50.026592    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086-metrics-tls\") pod \"dns-default-pvmdm\" (UID: \"cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086\") " pod="openshift-dns/dns-default-pvmdm"
Jun 11 19:30:50.026683 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:50.026673    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls\") pod \"image-registry-788d696d79-ksrnk\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") " pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:30:50.041289 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:50.041262    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xk5k9\""
Jun 11 19:30:50.041289 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:50.041262    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wsf99\""
Jun 11 19:30:50.047363 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:50.047339    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:30:50.047467 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:50.047429    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pvmdm"
Jun 11 19:30:50.187458 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:50.187368    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pvmdm"]
Jun 11 19:30:50.189910 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:30:50.189868    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf1c4da8_6e98_4144_8d8a_ac6e7a9ab086.slice/crio-873333cf351084bc85ba6a8036f4bb798214e9ab8a8313bdd43dc58a279a4920 WatchSource:0}: Error finding container 873333cf351084bc85ba6a8036f4bb798214e9ab8a8313bdd43dc58a279a4920: Status 404 returned error can't find the container with id 873333cf351084bc85ba6a8036f4bb798214e9ab8a8313bdd43dc58a279a4920
Jun 11 19:30:50.209532 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:50.209501    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-788d696d79-ksrnk"]
Jun 11 19:30:50.214029 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:30:50.214000    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a383c3c_0d8f_49a2_9c74_b406009b5dfc.slice/crio-ea65a6bf4638d00af8cc083470f365d974724f27d56f75dbfc05433617d88c39 WatchSource:0}: Error finding container ea65a6bf4638d00af8cc083470f365d974724f27d56f75dbfc05433617d88c39: Status 404 returned error can't find the container with id ea65a6bf4638d00af8cc083470f365d974724f27d56f75dbfc05433617d88c39
Jun 11 19:30:50.272055 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:50.272029    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579f5dfbdb-g7hbc"
Jun 11 19:30:50.272377 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:50.272360    2565 scope.go:117] "RemoveContainer" containerID="a74f40628642c297f2652e17519d99785d51ed6afdfd102fed45ee7bc9bdc935"
Jun 11 19:30:50.272550 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:30:50.272530    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-579f5dfbdb-g7hbc_open-cluster-management-agent-addon(1ad225ed-be47-4bb0-85d0-abd03c041b65)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579f5dfbdb-g7hbc" podUID="1ad225ed-be47-4bb0-85d0-abd03c041b65"
Jun 11 19:30:51.051320 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:51.051274    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pvmdm" event={"ID":"cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086","Type":"ContainerStarted","Data":"873333cf351084bc85ba6a8036f4bb798214e9ab8a8313bdd43dc58a279a4920"}
Jun 11 19:30:51.052963 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:51.052931    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-788d696d79-ksrnk" event={"ID":"0a383c3c-0d8f-49a2-9c74-b406009b5dfc","Type":"ContainerStarted","Data":"7e664756a101be7c37aa08ac3144309500f193d82a9cf5e458d87790d3274a59"}
Jun 11 19:30:51.053093 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:51.052985    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-788d696d79-ksrnk" event={"ID":"0a383c3c-0d8f-49a2-9c74-b406009b5dfc","Type":"ContainerStarted","Data":"ea65a6bf4638d00af8cc083470f365d974724f27d56f75dbfc05433617d88c39"}
Jun 11 19:30:51.053093 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:51.053068    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:30:51.078523 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:51.078462    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-788d696d79-ksrnk" podStartSLOduration=286.078442987 podStartE2EDuration="4m46.078442987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:26:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:30:51.07515164 +0000 UTC m=+286.479067779" watchObservedRunningTime="2026-06-11 19:30:51.078442987 +0000 UTC m=+286.482359093"
Jun 11 19:30:52.057940 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:52.057907    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pvmdm" event={"ID":"cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086","Type":"ContainerStarted","Data":"ecfaf1551764e5ee7aeae91aca0aa5b11be6fcdf3deaae41ac1fc4b573057437"}
Jun 11 19:30:52.058317 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:52.057999    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pvmdm" event={"ID":"cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086","Type":"ContainerStarted","Data":"73a9250be594a28f4285b3e896bcb0d0fc2e058637bc54072b5279ebac4170fc"}
Jun 11 19:30:53.060809 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:30:53.060778    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pvmdm"
Jun 11 19:30:57.073566 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:30:57.073525    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-q665k" podUID="2dd52262-7f1b-440b-a020-a59da738c3c4"
Jun 11 19:31:00.247845 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:00.247806    2565 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg" podUID="b2d5e270-4904-401b-bd63-7846702c92de" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jun 11 19:31:03.066511 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:03.066484    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pvmdm"
Jun 11 19:31:03.072947 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:03.072923    2565 scope.go:117] "RemoveContainer" containerID="a74f40628642c297f2652e17519d99785d51ed6afdfd102fed45ee7bc9bdc935"
Jun 11 19:31:03.084014 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:03.083969    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pvmdm" podStartSLOduration=262.45392536 podStartE2EDuration="4m24.083950374s" totalImagesPullingTime="1.630025014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:26:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:30:52.084437607 +0000 UTC m=+287.488353715" watchObservedRunningTime="2026-06-11 19:31:03.083950374 +0000 UTC m=+298.487866481"
Jun 11 19:31:04.095639 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:04.095608    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-579f5dfbdb-g7hbc" event={"ID":"1ad225ed-be47-4bb0-85d0-abd03c041b65","Type":"ContainerStarted","Data":"b0549deca90e0d0231e60d8a2b62f67a65a7a485347ad6de08a981ddd79d35ba"}
Jun 11 19:31:04.936551 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:04.936513    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bztkw"]
Jun 11 19:31:04.938470 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:04.938453    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bztkw"
Jun 11 19:31:04.940846 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:04.940822    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 11 19:31:04.940846 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:04.940824    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 11 19:31:04.941189 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:04.941172    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 11 19:31:04.941244 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:04.941194    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-j46fw\""
Jun 11 19:31:04.941867 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:04.941850    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 11 19:31:04.941937 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:04.941850    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 11 19:31:04.941937 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:04.941926    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 11 19:31:05.013220 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.013186    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2n72_b609134f-0739-46f3-966e-cc2c63aabe24/ovn-acl-logging/0.log"
Jun 11 19:31:05.014425 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.014308    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2n72_b609134f-0739-46f3-966e-cc2c63aabe24/ovn-acl-logging/0.log"
Jun 11 19:31:05.019664 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.019635    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9-root\") pod \"node-exporter-bztkw\" (UID: \"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9\") " pod="openshift-monitoring/node-exporter-bztkw"
Jun 11 19:31:05.019795 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.019687    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9-node-exporter-accelerators-collector-config\") pod \"node-exporter-bztkw\" (UID: \"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9\") " pod="openshift-monitoring/node-exporter-bztkw"
Jun 11 19:31:05.019795 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.019751    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9-sys\") pod \"node-exporter-bztkw\" (UID: \"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9\") " pod="openshift-monitoring/node-exporter-bztkw"
Jun 11 19:31:05.019795 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.019782    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bztkw\" (UID: \"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9\") " pod="openshift-monitoring/node-exporter-bztkw"
Jun 11 19:31:05.020005 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.019903    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9-node-exporter-textfile\") pod \"node-exporter-bztkw\" (UID: \"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9\") " pod="openshift-monitoring/node-exporter-bztkw"
Jun 11 19:31:05.020005 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.019944    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9-node-exporter-wtmp\") pod \"node-exporter-bztkw\" (UID: \"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9\") " pod="openshift-monitoring/node-exporter-bztkw"
Jun 11 19:31:05.020005 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.019968    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9-node-exporter-tls\") pod \"node-exporter-bztkw\" (UID: \"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9\") " pod="openshift-monitoring/node-exporter-bztkw"
Jun 11 19:31:05.020210 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.020032    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9-metrics-client-ca\") pod \"node-exporter-bztkw\" (UID: \"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9\") " pod="openshift-monitoring/node-exporter-bztkw"
Jun 11 19:31:05.020210 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.020091    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkt5p\" (UniqueName: \"kubernetes.io/projected/fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9-kube-api-access-gkt5p\") pod \"node-exporter-bztkw\" (UID: \"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9\") " pod="openshift-monitoring/node-exporter-bztkw"
Jun 11 19:31:05.023950 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.023930    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jun 11 19:31:05.057348 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.057312    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-788d696d79-ksrnk"]
Jun 11 19:31:05.063172 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.063021    2565 patch_prober.go:28] interesting pod/image-registry-788d696d79-ksrnk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 11 19:31:05.063172 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.063073    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-788d696d79-ksrnk" podUID="0a383c3c-0d8f-49a2-9c74-b406009b5dfc" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 11 19:31:05.120388 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.120356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9-node-exporter-textfile\") pod \"node-exporter-bztkw\" (UID: \"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9\") " pod="openshift-monitoring/node-exporter-bztkw"
Jun 11 19:31:05.120845 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.120399    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9-node-exporter-wtmp\") pod \"node-exporter-bztkw\" (UID: \"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9\") " pod="openshift-monitoring/node-exporter-bztkw"
Jun 11 19:31:05.120845 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.120516    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9-node-exporter-tls\") pod \"node-exporter-bztkw\" (UID: \"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9\") " pod="openshift-monitoring/node-exporter-bztkw"
Jun 11 19:31:05.120845 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.120564    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9-metrics-client-ca\") pod \"node-exporter-bztkw\" (UID: \"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9\") " pod="openshift-monitoring/node-exporter-bztkw"
Jun 11 19:31:05.120845 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.120605    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkt5p\" (UniqueName: \"kubernetes.io/projected/fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9-kube-api-access-gkt5p\") pod \"node-exporter-bztkw\" (UID: \"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9\") " pod="openshift-monitoring/node-exporter-bztkw"
Jun 11 19:31:05.120845 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.120637    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9-root\") pod \"node-exporter-bztkw\" (UID: \"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9\") " pod="openshift-monitoring/node-exporter-bztkw"
Jun 11 19:31:05.120845 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.120672    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9-node-exporter-accelerators-collector-config\") pod \"node-exporter-bztkw\" (UID: \"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9\") " pod="openshift-monitoring/node-exporter-bztkw"
Jun 11 19:31:05.120845 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.120702    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9-sys\") pod \"node-exporter-bztkw\" (UID: \"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9\") " pod="openshift-monitoring/node-exporter-bztkw"
Jun 11 19:31:05.120845 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.120729    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bztkw\" (UID: \"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9\") " pod="openshift-monitoring/node-exporter-bztkw"
Jun 11 19:31:05.120845 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.120743    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9-node-exporter-textfile\") pod \"node-exporter-bztkw\" (UID: \"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9\") " pod="openshift-monitoring/node-exporter-bztkw"
Jun 11 19:31:05.120845 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.120815    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9-node-exporter-wtmp\") pod \"node-exporter-bztkw\" (UID: \"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9\") " pod="openshift-monitoring/node-exporter-bztkw"
Jun 11 19:31:05.121278 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.120869    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9-sys\") pod \"node-exporter-bztkw\" (UID: \"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9\") " pod="openshift-monitoring/node-exporter-bztkw"
Jun 11 19:31:05.121278 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.120871    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9-root\") pod \"node-exporter-bztkw\" (UID: \"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9\") " pod="openshift-monitoring/node-exporter-bztkw"
Jun 11 19:31:05.123342 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.123312    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 11 19:31:05.123342 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.123320    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 11 19:31:05.123535 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.123409    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 11 19:31:05.123535 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.123518    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 11 19:31:05.129014 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.128999    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 11 19:31:05.131258 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.131236    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9-metrics-client-ca\") pod \"node-exporter-bztkw\" (UID: \"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9\") " pod="openshift-monitoring/node-exporter-bztkw"
Jun 11 19:31:05.131566 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.131476    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9-node-exporter-accelerators-collector-config\") pod \"node-exporter-bztkw\" (UID: \"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9\") " pod="openshift-monitoring/node-exporter-bztkw"
Jun 11 19:31:05.133243 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.133214    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9-node-exporter-tls\") pod \"node-exporter-bztkw\" (UID: \"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9\") " pod="openshift-monitoring/node-exporter-bztkw"
Jun 11 19:31:05.133320 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.133250    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bztkw\" (UID: \"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9\") " pod="openshift-monitoring/node-exporter-bztkw"
Jun 11 19:31:05.139380 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.139362    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 11 19:31:05.150441 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.150421    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkt5p\" (UniqueName: \"kubernetes.io/projected/fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9-kube-api-access-gkt5p\") pod \"node-exporter-bztkw\" (UID: \"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9\") " pod="openshift-monitoring/node-exporter-bztkw"
Jun 11 19:31:05.250561 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.250533    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-j46fw\""
Jun 11 19:31:05.258568 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:05.258546    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bztkw"
Jun 11 19:31:05.268736 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:31:05.268711    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc7ec0fd_dd9d_4e9b_bd5c_96840eff0fe9.slice/crio-1506dbfb71bd5eb19c7c2298d5381a0a829e9252cfa2443edb4c59615a477524 WatchSource:0}: Error finding container 1506dbfb71bd5eb19c7c2298d5381a0a829e9252cfa2443edb4c59615a477524: Status 404 returned error can't find the container with id 1506dbfb71bd5eb19c7c2298d5381a0a829e9252cfa2443edb4c59615a477524
Jun 11 19:31:06.103764 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:06.103723    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bztkw" event={"ID":"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9","Type":"ContainerStarted","Data":"1506dbfb71bd5eb19c7c2298d5381a0a829e9252cfa2443edb4c59615a477524"}
Jun 11 19:31:07.108690 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:07.108657    2565 generic.go:356] "Generic (PLEG): container finished" podID="fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9" containerID="a54ef575f91713f5c7c7bd0c45a3664fcd0d23c7752485032cd721fd1fe5a3ad" exitCode=0
Jun 11 19:31:07.109136 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:07.108740    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bztkw" event={"ID":"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9","Type":"ContainerDied","Data":"a54ef575f91713f5c7c7bd0c45a3664fcd0d23c7752485032cd721fd1fe5a3ad"}
Jun 11 19:31:08.113782 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:08.113751    2565 generic.go:356] "Generic (PLEG): container finished" podID="b8e43f0e-9a35-46ba-a45f-0751c4315eee" containerID="7b6f472b573a7831bbafa08d39141c506c0e093723bd0c8f0b371662311218ac" exitCode=1
Jun 11 19:31:08.114256 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:08.113823    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h" event={"ID":"b8e43f0e-9a35-46ba-a45f-0751c4315eee","Type":"ContainerDied","Data":"7b6f472b573a7831bbafa08d39141c506c0e093723bd0c8f0b371662311218ac"}
Jun 11 19:31:08.114256 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:08.113916    2565 scope.go:117] "RemoveContainer" containerID="d884a75ffc6bd96b7679dec422bbc2192aae97bae4dbe04d4a9465219e712c8b"
Jun 11 19:31:08.114256 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:08.114232    2565 scope.go:117] "RemoveContainer" containerID="7b6f472b573a7831bbafa08d39141c506c0e093723bd0c8f0b371662311218ac"
Jun 11 19:31:08.114450 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:31:08.114428    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-67f5d57965-nb97h_open-cluster-management-agent-addon(b8e43f0e-9a35-46ba-a45f-0751c4315eee)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h" podUID="b8e43f0e-9a35-46ba-a45f-0751c4315eee"
Jun 11 19:31:08.116573 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:08.116551    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bztkw" event={"ID":"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9","Type":"ContainerStarted","Data":"d4dc8f6c0c774eefdb071e3cf6f654ad4176a5fc9592881e115b6bfe742f8e16"}
Jun 11 19:31:08.120992 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:08.116865    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bztkw" event={"ID":"fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9","Type":"ContainerStarted","Data":"ca1f6e2dbeecdf6ac41ed3750394b56665cc7e6b1d7ad7594efbc13b64b64c77"}
Jun 11 19:31:08.154120 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:08.154073    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bztkw" podStartSLOduration=2.999163482 podStartE2EDuration="4.154058394s" totalImagesPullingTime="1.083829066s" totalInitContainerRuntime="71.065846ms" isStatefulPod=true podCreationTimestamp="2026-06-11 19:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:31:08.152625195 +0000 UTC m=+303.556541303" watchObservedRunningTime="2026-06-11 19:31:08.154058394 +0000 UTC m=+303.557974501"
Jun 11 19:31:08.747951 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:08.747914    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h"
Jun 11 19:31:09.121659 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:09.121576    2565 scope.go:117] "RemoveContainer" containerID="7b6f472b573a7831bbafa08d39141c506c0e093723bd0c8f0b371662311218ac"
Jun 11 19:31:09.122096 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:31:09.121758    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-67f5d57965-nb97h_open-cluster-management-agent-addon(b8e43f0e-9a35-46ba-a45f-0751c4315eee)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h" podUID="b8e43f0e-9a35-46ba-a45f-0751c4315eee"
Jun 11 19:31:10.247243 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:10.247203    2565 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg" podUID="b2d5e270-4904-401b-bd63-7846702c92de" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jun 11 19:31:10.257021 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:10.256991    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h"
Jun 11 19:31:10.257331 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:10.257319    2565 scope.go:117] "RemoveContainer" containerID="7b6f472b573a7831bbafa08d39141c506c0e093723bd0c8f0b371662311218ac"
Jun 11 19:31:10.257476 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:31:10.257458    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-67f5d57965-nb97h_open-cluster-management-agent-addon(b8e43f0e-9a35-46ba-a45f-0751c4315eee)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h" podUID="b8e43f0e-9a35-46ba-a45f-0751c4315eee"
Jun 11 19:31:12.072402 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:12.072363    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:31:15.061802 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:15.061771    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:31:20.246978 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:20.246940    2565 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg" podUID="b2d5e270-4904-401b-bd63-7846702c92de" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jun 11 19:31:20.247472 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:20.247026    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg"
Jun 11 19:31:20.247622 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:20.247587    2565 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"292d6d4d618bfd0b6896498b0f47fe58edc93268ad12861e658c1afedadf8389"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jun 11 19:31:20.247691 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:20.247648    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg" podUID="b2d5e270-4904-401b-bd63-7846702c92de" containerName="service-proxy" containerID="cri-o://292d6d4d618bfd0b6896498b0f47fe58edc93268ad12861e658c1afedadf8389" gracePeriod=30
Jun 11 19:31:21.072662 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:21.072631    2565 scope.go:117] "RemoveContainer" containerID="7b6f472b573a7831bbafa08d39141c506c0e093723bd0c8f0b371662311218ac"
Jun 11 19:31:21.159234 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:21.159118    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h" event={"ID":"b8e43f0e-9a35-46ba-a45f-0751c4315eee","Type":"ContainerStarted","Data":"a79d96517bfdc3acbff282a16d40503f45bca3d7a925b4c5727a62678dc8c7ca"}
Jun 11 19:31:21.159596 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:21.159575    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h"
Jun 11 19:31:21.162718 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:21.162689    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67f5d57965-nb97h"
Jun 11 19:31:21.164192 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:21.164154    2565 generic.go:356] "Generic (PLEG): container finished" podID="b2d5e270-4904-401b-bd63-7846702c92de" containerID="292d6d4d618bfd0b6896498b0f47fe58edc93268ad12861e658c1afedadf8389" exitCode=2
Jun 11 19:31:21.164294 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:21.164230    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg" event={"ID":"b2d5e270-4904-401b-bd63-7846702c92de","Type":"ContainerDied","Data":"292d6d4d618bfd0b6896498b0f47fe58edc93268ad12861e658c1afedadf8389"}
Jun 11 19:31:21.164294 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:21.164279    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c7d46b99-vqvkg" event={"ID":"b2d5e270-4904-401b-bd63-7846702c92de","Type":"ContainerStarted","Data":"ff3a38175db40d90e38e623650b69fc07a1fb5e073afe6197a0b10ca6c1fa651"}
Jun 11 19:31:30.079123 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:30.079076    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-788d696d79-ksrnk" podUID="0a383c3c-0d8f-49a2-9c74-b406009b5dfc" containerName="registry" containerID="cri-o://7e664756a101be7c37aa08ac3144309500f193d82a9cf5e458d87790d3274a59" gracePeriod=30
Jun 11 19:31:30.195184 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:30.195147    2565 generic.go:356] "Generic (PLEG): container finished" podID="0a383c3c-0d8f-49a2-9c74-b406009b5dfc" containerID="7e664756a101be7c37aa08ac3144309500f193d82a9cf5e458d87790d3274a59" exitCode=0
Jun 11 19:31:30.195333 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:30.195219    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-788d696d79-ksrnk" event={"ID":"0a383c3c-0d8f-49a2-9c74-b406009b5dfc","Type":"ContainerDied","Data":"7e664756a101be7c37aa08ac3144309500f193d82a9cf5e458d87790d3274a59"}
Jun 11 19:31:30.319763 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:30.319730    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:31:30.411675 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:30.411577    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-image-registry-private-configuration\") pod \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") "
Jun 11 19:31:30.411675 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:30.411619    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-certificates\") pod \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") "
Jun 11 19:31:30.411675 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:30.411644    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-bound-sa-token\") pod \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") "
Jun 11 19:31:30.411675 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:30.411661    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-installation-pull-secrets\") pod \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") "
Jun 11 19:31:30.412037 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:30.411691    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztvlt\" (UniqueName: \"kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-kube-api-access-ztvlt\") pod \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") "
Jun 11 19:31:30.412037 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:30.411737    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-ca-trust-extracted\") pod \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") "
Jun 11 19:31:30.412037 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:30.411773    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-trusted-ca\") pod \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") "
Jun 11 19:31:30.412037 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:30.411810    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls\") pod \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\" (UID: \"0a383c3c-0d8f-49a2-9c74-b406009b5dfc\") "
Jun 11 19:31:30.412181 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:30.412033    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0a383c3c-0d8f-49a2-9c74-b406009b5dfc" (UID: "0a383c3c-0d8f-49a2-9c74-b406009b5dfc"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 11 19:31:30.412314 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:30.412248    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0a383c3c-0d8f-49a2-9c74-b406009b5dfc" (UID: "0a383c3c-0d8f-49a2-9c74-b406009b5dfc"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 11 19:31:30.414239 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:30.414211    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0a383c3c-0d8f-49a2-9c74-b406009b5dfc" (UID: "0a383c3c-0d8f-49a2-9c74-b406009b5dfc"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 19:31:30.414371 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:30.414353    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0a383c3c-0d8f-49a2-9c74-b406009b5dfc" (UID: "0a383c3c-0d8f-49a2-9c74-b406009b5dfc"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 19:31:30.414623 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:30.414597    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0a383c3c-0d8f-49a2-9c74-b406009b5dfc" (UID: "0a383c3c-0d8f-49a2-9c74-b406009b5dfc"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 19:31:30.414707 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:30.414629    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0a383c3c-0d8f-49a2-9c74-b406009b5dfc" (UID: "0a383c3c-0d8f-49a2-9c74-b406009b5dfc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 19:31:30.414707 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:30.414639    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-kube-api-access-ztvlt" (OuterVolumeSpecName: "kube-api-access-ztvlt") pod "0a383c3c-0d8f-49a2-9c74-b406009b5dfc" (UID: "0a383c3c-0d8f-49a2-9c74-b406009b5dfc"). InnerVolumeSpecName "kube-api-access-ztvlt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 19:31:30.423621 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:30.423587    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0a383c3c-0d8f-49a2-9c74-b406009b5dfc" (UID: "0a383c3c-0d8f-49a2-9c74-b406009b5dfc"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 11 19:31:30.512472 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:30.512433    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-tls\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
Jun 11 19:31:30.512472 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:30.512465    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-image-registry-private-configuration\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
Jun 11 19:31:30.512472 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:30.512475    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-registry-certificates\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
Jun 11 19:31:30.512701 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:30.512487    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-bound-sa-token\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
Jun 11 19:31:30.512701 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:30.512496    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-installation-pull-secrets\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
Jun 11 19:31:30.512701 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:30.512504    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztvlt\" (UniqueName: \"kubernetes.io/projected/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-kube-api-access-ztvlt\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
Jun 11 19:31:30.512701 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:30.512512    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-ca-trust-extracted\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
Jun 11 19:31:30.512701 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:30.512520    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a383c3c-0d8f-49a2-9c74-b406009b5dfc-trusted-ca\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
Jun 11 19:31:31.199628 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:31.199579    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-788d696d79-ksrnk" event={"ID":"0a383c3c-0d8f-49a2-9c74-b406009b5dfc","Type":"ContainerDied","Data":"ea65a6bf4638d00af8cc083470f365d974724f27d56f75dbfc05433617d88c39"}
Jun 11 19:31:31.200072 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:31.199640    2565 scope.go:117] "RemoveContainer" containerID="7e664756a101be7c37aa08ac3144309500f193d82a9cf5e458d87790d3274a59"
Jun 11 19:31:31.200072 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:31.199597    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-788d696d79-ksrnk"
Jun 11 19:31:31.221345 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:31.218258    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-788d696d79-ksrnk"]
Jun 11 19:31:31.222912 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:31.222869    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-788d696d79-ksrnk"]
Jun 11 19:31:33.076011 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:33.075979    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a383c3c-0d8f-49a2-9c74-b406009b5dfc" path="/var/lib/kubelet/pods/0a383c3c-0d8f-49a2-9c74-b406009b5dfc/volumes"
Jun 11 19:31:52.398592 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:31:52.398559    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cfb5n_21a2f529-95bb-4c15-9a38-d28b5f63cd13/serve-healthcheck-canary/0.log"
Jun 11 19:32:19.052232 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:32:19.052196    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs\") pod \"network-metrics-daemon-q665k\" (UID: \"2dd52262-7f1b-440b-a020-a59da738c3c4\") " pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:32:19.054592 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:32:19.054572    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2dd52262-7f1b-440b-a020-a59da738c3c4-metrics-certs\") pod \"network-metrics-daemon-q665k\" (UID: \"2dd52262-7f1b-440b-a020-a59da738c3c4\") " pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:32:19.275836 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:32:19.275809    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gdvp2\""
Jun 11 19:32:19.283907 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:32:19.283872    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q665k"
Jun 11 19:32:19.413212 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:32:19.413181    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q665k"]
Jun 11 19:32:19.416591 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:32:19.416562    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dd52262_7f1b_440b_a020_a59da738c3c4.slice/crio-43df4050de8eb8feb9a418d9943857d6c13f94cc10f38f1ece03b23d7b20f9f2 WatchSource:0}: Error finding container 43df4050de8eb8feb9a418d9943857d6c13f94cc10f38f1ece03b23d7b20f9f2: Status 404 returned error can't find the container with id 43df4050de8eb8feb9a418d9943857d6c13f94cc10f38f1ece03b23d7b20f9f2
Jun 11 19:32:19.418842 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:32:19.418828    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 11 19:32:20.362070 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:32:20.362035    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q665k" event={"ID":"2dd52262-7f1b-440b-a020-a59da738c3c4","Type":"ContainerStarted","Data":"43df4050de8eb8feb9a418d9943857d6c13f94cc10f38f1ece03b23d7b20f9f2"}
Jun 11 19:32:21.367074 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:32:21.367035    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q665k" event={"ID":"2dd52262-7f1b-440b-a020-a59da738c3c4","Type":"ContainerStarted","Data":"0c6a267d6cd728f09bd579128a62f3def2913bbda2e3d39355b6f14902bc1c4c"}
Jun 11 19:32:21.367454 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:32:21.367088    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q665k" event={"ID":"2dd52262-7f1b-440b-a020-a59da738c3c4","Type":"ContainerStarted","Data":"4c827b782ad820c1495d42d2e68afdcc024489b47b799f25c51784e5fd2fa461"}
Jun 11 19:32:21.383619 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:32:21.383570    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-q665k" podStartSLOduration=375.038050577 podStartE2EDuration="6m16.38355477s" totalImagesPullingTime="1.345504193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:32:21.38242602 +0000 UTC m=+376.786342126" watchObservedRunningTime="2026-06-11 19:32:21.38355477 +0000 UTC m=+376.787470868"
Jun 11 19:34:14.378602 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:14.378565    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-gwm5l"]
Jun 11 19:34:14.379093 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:14.378783    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a383c3c-0d8f-49a2-9c74-b406009b5dfc" containerName="registry"
Jun 11 19:34:14.379093 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:14.378794    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a383c3c-0d8f-49a2-9c74-b406009b5dfc" containerName="registry"
Jun 11 19:34:14.379093 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:14.378845    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a383c3c-0d8f-49a2-9c74-b406009b5dfc" containerName="registry"
Jun 11 19:34:14.381461 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:14.381444    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-gwm5l"
Jun 11 19:34:14.383780 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:14.383746    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-5jx7s\""
Jun 11 19:34:14.383951 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:14.383776    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jun 11 19:34:14.384513 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:14.384499    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jun 11 19:34:14.388816 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:14.388787    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-gwm5l"]
Jun 11 19:34:14.526025 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:14.525987    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjnhl\" (UniqueName: \"kubernetes.io/projected/5cd7c930-b24d-4e5e-afd3-5b05a06d88b7-kube-api-access-vjnhl\") pod \"cert-manager-59c77684cc-gwm5l\" (UID: \"5cd7c930-b24d-4e5e-afd3-5b05a06d88b7\") " pod="cert-manager/cert-manager-59c77684cc-gwm5l"
Jun 11 19:34:14.526025 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:14.526039    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cd7c930-b24d-4e5e-afd3-5b05a06d88b7-bound-sa-token\") pod \"cert-manager-59c77684cc-gwm5l\" (UID: \"5cd7c930-b24d-4e5e-afd3-5b05a06d88b7\") " pod="cert-manager/cert-manager-59c77684cc-gwm5l"
Jun 11 19:34:14.627307 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:14.627267    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjnhl\" (UniqueName: \"kubernetes.io/projected/5cd7c930-b24d-4e5e-afd3-5b05a06d88b7-kube-api-access-vjnhl\") pod \"cert-manager-59c77684cc-gwm5l\" (UID: \"5cd7c930-b24d-4e5e-afd3-5b05a06d88b7\") " pod="cert-manager/cert-manager-59c77684cc-gwm5l"
Jun 11 19:34:14.627435 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:14.627327    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cd7c930-b24d-4e5e-afd3-5b05a06d88b7-bound-sa-token\") pod \"cert-manager-59c77684cc-gwm5l\" (UID: \"5cd7c930-b24d-4e5e-afd3-5b05a06d88b7\") " pod="cert-manager/cert-manager-59c77684cc-gwm5l"
Jun 11 19:34:14.636769 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:14.636703    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cd7c930-b24d-4e5e-afd3-5b05a06d88b7-bound-sa-token\") pod \"cert-manager-59c77684cc-gwm5l\" (UID: \"5cd7c930-b24d-4e5e-afd3-5b05a06d88b7\") " pod="cert-manager/cert-manager-59c77684cc-gwm5l"
Jun 11 19:34:14.636872 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:14.636842    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjnhl\" (UniqueName: \"kubernetes.io/projected/5cd7c930-b24d-4e5e-afd3-5b05a06d88b7-kube-api-access-vjnhl\") pod \"cert-manager-59c77684cc-gwm5l\" (UID: \"5cd7c930-b24d-4e5e-afd3-5b05a06d88b7\") " pod="cert-manager/cert-manager-59c77684cc-gwm5l"
Jun 11 19:34:14.690814 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:14.690779    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-gwm5l"
Jun 11 19:34:14.819758 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:14.819731    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-gwm5l"]
Jun 11 19:34:14.822300 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:34:14.822262    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cd7c930_b24d_4e5e_afd3_5b05a06d88b7.slice/crio-ebd39035c09838a04ad1858fa98ff34bb7d6b9a9b79e8f27dabe7eea86502b10 WatchSource:0}: Error finding container ebd39035c09838a04ad1858fa98ff34bb7d6b9a9b79e8f27dabe7eea86502b10: Status 404 returned error can't find the container with id ebd39035c09838a04ad1858fa98ff34bb7d6b9a9b79e8f27dabe7eea86502b10
Jun 11 19:34:15.750254 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:15.750218    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-gwm5l" event={"ID":"5cd7c930-b24d-4e5e-afd3-5b05a06d88b7","Type":"ContainerStarted","Data":"ebd39035c09838a04ad1858fa98ff34bb7d6b9a9b79e8f27dabe7eea86502b10"}
Jun 11 19:34:18.766422 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:18.766388    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-gwm5l" event={"ID":"5cd7c930-b24d-4e5e-afd3-5b05a06d88b7","Type":"ContainerStarted","Data":"7339af22dab4e11d9108ee3067284cd7f65dfe6547aba440c199284bbf74fda5"}
Jun 11 19:34:18.781801 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:18.781746    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-gwm5l" podStartSLOduration=1.60253438 podStartE2EDuration="4.781730199s" totalImagesPullingTime="3.179195819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:34:18.780249361 +0000 UTC m=+494.184165468" watchObservedRunningTime="2026-06-11 19:34:18.781730199 +0000 UTC m=+494.185646305"
Jun 11 19:34:26.727993 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:26.727956    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c94886895-5j8q6"]
Jun 11 19:34:26.731097 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:26.731079    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-5j8q6"
Jun 11 19:34:26.733541 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:26.733519    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jun 11 19:34:26.733995 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:26.733798    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jun 11 19:34:26.734129 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:26.734041    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jun 11 19:34:26.734450 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:26.734433    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jun 11 19:34:26.734572 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:26.734501    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pxtxj\""
Jun 11 19:34:26.751285 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:26.751254    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c94886895-5j8q6"]
Jun 11 19:34:26.816054 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:26.816003    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fdbaa159-7c00-40ad-ad77-b2b18e41b6fa-manifests\") pod \"opendatahub-operator-controller-manager-6c94886895-5j8q6\" (UID: \"fdbaa159-7c00-40ad-ad77-b2b18e41b6fa\") " pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-5j8q6"
Jun 11 19:34:26.816054 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:26.816056    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fdbaa159-7c00-40ad-ad77-b2b18e41b6fa-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c94886895-5j8q6\" (UID: \"fdbaa159-7c00-40ad-ad77-b2b18e41b6fa\") " pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-5j8q6"
Jun 11 19:34:26.816270 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:26.816124    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9knw\" (UniqueName: \"kubernetes.io/projected/fdbaa159-7c00-40ad-ad77-b2b18e41b6fa-kube-api-access-q9knw\") pod \"opendatahub-operator-controller-manager-6c94886895-5j8q6\" (UID: \"fdbaa159-7c00-40ad-ad77-b2b18e41b6fa\") " pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-5j8q6"
Jun 11 19:34:26.816270 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:26.816195    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fdbaa159-7c00-40ad-ad77-b2b18e41b6fa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c94886895-5j8q6\" (UID: \"fdbaa159-7c00-40ad-ad77-b2b18e41b6fa\") " pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-5j8q6"
Jun 11 19:34:26.816270 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:26.816233    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdbaa159-7c00-40ad-ad77-b2b18e41b6fa-tmp\") pod \"opendatahub-operator-controller-manager-6c94886895-5j8q6\" (UID: \"fdbaa159-7c00-40ad-ad77-b2b18e41b6fa\") " pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-5j8q6"
Jun 11 19:34:26.917049 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:26.917001    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9knw\" (UniqueName: \"kubernetes.io/projected/fdbaa159-7c00-40ad-ad77-b2b18e41b6fa-kube-api-access-q9knw\") pod \"opendatahub-operator-controller-manager-6c94886895-5j8q6\" (UID: \"fdbaa159-7c00-40ad-ad77-b2b18e41b6fa\") " pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-5j8q6"
Jun 11 19:34:26.917049 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:26.917053    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fdbaa159-7c00-40ad-ad77-b2b18e41b6fa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c94886895-5j8q6\" (UID: \"fdbaa159-7c00-40ad-ad77-b2b18e41b6fa\") " pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-5j8q6"
Jun 11 19:34:26.917309 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:26.917129    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdbaa159-7c00-40ad-ad77-b2b18e41b6fa-tmp\") pod \"opendatahub-operator-controller-manager-6c94886895-5j8q6\" (UID: \"fdbaa159-7c00-40ad-ad77-b2b18e41b6fa\") " pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-5j8q6"
Jun 11 19:34:26.917309 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:26.917187    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fdbaa159-7c00-40ad-ad77-b2b18e41b6fa-manifests\") pod \"opendatahub-operator-controller-manager-6c94886895-5j8q6\" (UID: \"fdbaa159-7c00-40ad-ad77-b2b18e41b6fa\") " pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-5j8q6"
Jun 11 19:34:26.917309 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:26.917233    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fdbaa159-7c00-40ad-ad77-b2b18e41b6fa-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c94886895-5j8q6\" (UID: \"fdbaa159-7c00-40ad-ad77-b2b18e41b6fa\") " pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-5j8q6"
Jun 11 19:34:26.917667 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:26.917639    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fdbaa159-7c00-40ad-ad77-b2b18e41b6fa-manifests\") pod \"opendatahub-operator-controller-manager-6c94886895-5j8q6\" (UID: \"fdbaa159-7c00-40ad-ad77-b2b18e41b6fa\") " pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-5j8q6"
Jun 11 19:34:26.919548 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:26.919517    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdbaa159-7c00-40ad-ad77-b2b18e41b6fa-tmp\") pod \"opendatahub-operator-controller-manager-6c94886895-5j8q6\" (UID: \"fdbaa159-7c00-40ad-ad77-b2b18e41b6fa\") " pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-5j8q6"
Jun 11 19:34:26.919665 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:26.919609    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fdbaa159-7c00-40ad-ad77-b2b18e41b6fa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c94886895-5j8q6\" (UID: \"fdbaa159-7c00-40ad-ad77-b2b18e41b6fa\") " pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-5j8q6"
Jun 11 19:34:26.919723 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:26.919696    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fdbaa159-7c00-40ad-ad77-b2b18e41b6fa-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c94886895-5j8q6\" (UID: \"fdbaa159-7c00-40ad-ad77-b2b18e41b6fa\") " pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-5j8q6"
Jun 11 19:34:26.933458 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:26.933426    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9knw\" (UniqueName: \"kubernetes.io/projected/fdbaa159-7c00-40ad-ad77-b2b18e41b6fa-kube-api-access-q9knw\") pod \"opendatahub-operator-controller-manager-6c94886895-5j8q6\" (UID: \"fdbaa159-7c00-40ad-ad77-b2b18e41b6fa\") " pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-5j8q6"
Jun 11 19:34:27.041662 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:27.041566    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-5j8q6"
Jun 11 19:34:27.180673 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:27.180640    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c94886895-5j8q6"]
Jun 11 19:34:27.184125 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:34:27.184096    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdbaa159_7c00_40ad_ad77_b2b18e41b6fa.slice/crio-4849ea7fb4f2f85ed2882cac1422ca7fddf22419bd6fd7a5d69275ddf09618ac WatchSource:0}: Error finding container 4849ea7fb4f2f85ed2882cac1422ca7fddf22419bd6fd7a5d69275ddf09618ac: Status 404 returned error can't find the container with id 4849ea7fb4f2f85ed2882cac1422ca7fddf22419bd6fd7a5d69275ddf09618ac
Jun 11 19:34:27.797248 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:27.797210    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-5j8q6" event={"ID":"fdbaa159-7c00-40ad-ad77-b2b18e41b6fa","Type":"ContainerStarted","Data":"4849ea7fb4f2f85ed2882cac1422ca7fddf22419bd6fd7a5d69275ddf09618ac"}
Jun 11 19:34:30.810163 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:30.810119    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-5j8q6" event={"ID":"fdbaa159-7c00-40ad-ad77-b2b18e41b6fa","Type":"ContainerStarted","Data":"58f5a4dd3531670054334c2224be4c722b21b862ea605555a606bbfeed012760"}
Jun 11 19:34:31.815334 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:31.815296    2565 generic.go:356] "Generic (PLEG): container finished" podID="fdbaa159-7c00-40ad-ad77-b2b18e41b6fa" containerID="58f5a4dd3531670054334c2224be4c722b21b862ea605555a606bbfeed012760" exitCode=0
Jun 11 19:34:31.815334 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:31.815335    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-5j8q6" event={"ID":"fdbaa159-7c00-40ad-ad77-b2b18e41b6fa","Type":"ContainerDied","Data":"58f5a4dd3531670054334c2224be4c722b21b862ea605555a606bbfeed012760"}
Jun 11 19:34:32.821732 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:32.821690    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-5j8q6" event={"ID":"fdbaa159-7c00-40ad-ad77-b2b18e41b6fa","Type":"ContainerStarted","Data":"9f60b63b6ee7c1b304d0e954eeca929b081132f3a414c9194af1892aa85c8be1"}
Jun 11 19:34:32.822123 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:32.821816    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-5j8q6"
Jun 11 19:34:32.853039 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:32.852978    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-5j8q6" podStartSLOduration=2.705227876 podStartE2EDuration="6.852956644s" totalImagesPullingTime="3.230548762s" totalInitContainerRuntime="917.180006ms" isStatefulPod=false podCreationTimestamp="2026-06-11 19:34:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:34:32.851352141 +0000 UTC m=+508.255268248" watchObservedRunningTime="2026-06-11 19:34:32.852956644 +0000 UTC m=+508.256872753"
Jun 11 19:34:43.828121 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:43.828093    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6c94886895-5j8q6"
Jun 11 19:34:48.134439 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:48.134404    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-9b2s9"]
Jun 11 19:34:48.264962 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:48.264924    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-9b2s9"]
Jun 11 19:34:48.265137 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:48.265028    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-9b2s9"
Jun 11 19:34:48.268187 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:48.268163    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-7rq82\""
Jun 11 19:34:48.268272 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:48.268193    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jun 11 19:34:48.278690 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:48.278665    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c6432892-1948-4a58-8e0a-ba4f17aef5db-cert\") pod \"odh-model-controller-6dc94f689f-9b2s9\" (UID: \"c6432892-1948-4a58-8e0a-ba4f17aef5db\") " pod="opendatahub/odh-model-controller-6dc94f689f-9b2s9"
Jun 11 19:34:48.278803 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:48.278714    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqqsd\" (UniqueName: \"kubernetes.io/projected/c6432892-1948-4a58-8e0a-ba4f17aef5db-kube-api-access-bqqsd\") pod \"odh-model-controller-6dc94f689f-9b2s9\" (UID: \"c6432892-1948-4a58-8e0a-ba4f17aef5db\") " pod="opendatahub/odh-model-controller-6dc94f689f-9b2s9"
Jun 11 19:34:48.379209 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:48.379168    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqqsd\" (UniqueName: \"kubernetes.io/projected/c6432892-1948-4a58-8e0a-ba4f17aef5db-kube-api-access-bqqsd\") pod \"odh-model-controller-6dc94f689f-9b2s9\" (UID: \"c6432892-1948-4a58-8e0a-ba4f17aef5db\") " pod="opendatahub/odh-model-controller-6dc94f689f-9b2s9"
Jun 11 19:34:48.379381 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:48.379235    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c6432892-1948-4a58-8e0a-ba4f17aef5db-cert\") pod \"odh-model-controller-6dc94f689f-9b2s9\" (UID: \"c6432892-1948-4a58-8e0a-ba4f17aef5db\") " pod="opendatahub/odh-model-controller-6dc94f689f-9b2s9"
Jun 11 19:34:48.379381 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:34:48.379345    2565 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jun 11 19:34:48.379510 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:34:48.379421    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6432892-1948-4a58-8e0a-ba4f17aef5db-cert podName:c6432892-1948-4a58-8e0a-ba4f17aef5db nodeName:}" failed. No retries permitted until 2026-06-11 19:34:48.87940218 +0000 UTC m=+524.283318284 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c6432892-1948-4a58-8e0a-ba4f17aef5db-cert") pod "odh-model-controller-6dc94f689f-9b2s9" (UID: "c6432892-1948-4a58-8e0a-ba4f17aef5db") : secret "odh-model-controller-webhook-cert" not found
Jun 11 19:34:48.389333 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:48.389266    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqqsd\" (UniqueName: \"kubernetes.io/projected/c6432892-1948-4a58-8e0a-ba4f17aef5db-kube-api-access-bqqsd\") pod \"odh-model-controller-6dc94f689f-9b2s9\" (UID: \"c6432892-1948-4a58-8e0a-ba4f17aef5db\") " pod="opendatahub/odh-model-controller-6dc94f689f-9b2s9"
Jun 11 19:34:48.721753 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:48.721709    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-hn6jq"]
Jun 11 19:34:48.742987 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:48.742945    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-hn6jq"]
Jun 11 19:34:48.743148 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:48.743069    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-hn6jq"
Jun 11 19:34:48.745589 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:48.745565    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jun 11 19:34:48.781410 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:48.781370    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cccq\" (UniqueName: \"kubernetes.io/projected/7040120a-2e1c-4060-9f7b-4dd0b5960dbf-kube-api-access-8cccq\") pod \"model-serving-api-5dd488fc48-hn6jq\" (UID: \"7040120a-2e1c-4060-9f7b-4dd0b5960dbf\") " pod="opendatahub/model-serving-api-5dd488fc48-hn6jq"
Jun 11 19:34:48.781594 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:48.781443    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7040120a-2e1c-4060-9f7b-4dd0b5960dbf-tls-certs\") pod \"model-serving-api-5dd488fc48-hn6jq\" (UID: \"7040120a-2e1c-4060-9f7b-4dd0b5960dbf\") " pod="opendatahub/model-serving-api-5dd488fc48-hn6jq"
Jun 11 19:34:48.881943 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:48.881911    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cccq\" (UniqueName: \"kubernetes.io/projected/7040120a-2e1c-4060-9f7b-4dd0b5960dbf-kube-api-access-8cccq\") pod \"model-serving-api-5dd488fc48-hn6jq\" (UID: \"7040120a-2e1c-4060-9f7b-4dd0b5960dbf\") " pod="opendatahub/model-serving-api-5dd488fc48-hn6jq"
Jun 11 19:34:48.882138 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:48.881951    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c6432892-1948-4a58-8e0a-ba4f17aef5db-cert\") pod \"odh-model-controller-6dc94f689f-9b2s9\" (UID: \"c6432892-1948-4a58-8e0a-ba4f17aef5db\") " pod="opendatahub/odh-model-controller-6dc94f689f-9b2s9"
Jun 11 19:34:48.882138 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:48.881975    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7040120a-2e1c-4060-9f7b-4dd0b5960dbf-tls-certs\") pod \"model-serving-api-5dd488fc48-hn6jq\" (UID: \"7040120a-2e1c-4060-9f7b-4dd0b5960dbf\") " pod="opendatahub/model-serving-api-5dd488fc48-hn6jq"
Jun 11 19:34:48.884818 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:48.884790    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7040120a-2e1c-4060-9f7b-4dd0b5960dbf-tls-certs\") pod \"model-serving-api-5dd488fc48-hn6jq\" (UID: \"7040120a-2e1c-4060-9f7b-4dd0b5960dbf\") " pod="opendatahub/model-serving-api-5dd488fc48-hn6jq"
Jun 11 19:34:48.885225 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:48.885207    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c6432892-1948-4a58-8e0a-ba4f17aef5db-cert\") pod \"odh-model-controller-6dc94f689f-9b2s9\" (UID: \"c6432892-1948-4a58-8e0a-ba4f17aef5db\") " pod="opendatahub/odh-model-controller-6dc94f689f-9b2s9"
Jun 11 19:34:48.890864 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:48.890839    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cccq\" (UniqueName: \"kubernetes.io/projected/7040120a-2e1c-4060-9f7b-4dd0b5960dbf-kube-api-access-8cccq\") pod \"model-serving-api-5dd488fc48-hn6jq\" (UID: \"7040120a-2e1c-4060-9f7b-4dd0b5960dbf\") " pod="opendatahub/model-serving-api-5dd488fc48-hn6jq"
Jun 11 19:34:49.053815 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:49.053717    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-hn6jq"
Jun 11 19:34:49.175404 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:49.175369    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-9b2s9"
Jun 11 19:34:49.204819 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:49.204731    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-hn6jq"]
Jun 11 19:34:49.323846 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:49.323748    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-9b2s9"]
Jun 11 19:34:49.326747 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:34:49.326716    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6432892_1948_4a58_8e0a_ba4f17aef5db.slice/crio-0d638fa291e8439fa5ccff7d6daa01f26c4d582f19b12cb005c49f897f884b8f WatchSource:0}: Error finding container 0d638fa291e8439fa5ccff7d6daa01f26c4d582f19b12cb005c49f897f884b8f: Status 404 returned error can't find the container with id 0d638fa291e8439fa5ccff7d6daa01f26c4d582f19b12cb005c49f897f884b8f
Jun 11 19:34:49.619233 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:49.619153    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5b4bf4958f-cfv95"]
Jun 11 19:34:49.621769 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:49.621746    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b4bf4958f-cfv95"
Jun 11 19:34:49.624140 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:49.624114    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jun 11 19:34:49.624434 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:49.624266    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jun 11 19:34:49.624434 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:49.624293    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jun 11 19:34:49.624434 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:49.624349    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jun 11 19:34:49.624434 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:49.624370    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-kk2bf\""
Jun 11 19:34:49.635606 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:49.635581    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b4bf4958f-cfv95"]
Jun 11 19:34:49.689621 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:49.689582    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08d3362e-7a8e-4ac5-b5d8-a74c2c85fe20-tmp\") pod \"kube-auth-proxy-5b4bf4958f-cfv95\" (UID: \"08d3362e-7a8e-4ac5-b5d8-a74c2c85fe20\") " pod="openshift-ingress/kube-auth-proxy-5b4bf4958f-cfv95"
Jun 11 19:34:49.689621 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:49.689618    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzcft\" (UniqueName: \"kubernetes.io/projected/08d3362e-7a8e-4ac5-b5d8-a74c2c85fe20-kube-api-access-wzcft\") pod \"kube-auth-proxy-5b4bf4958f-cfv95\" (UID: \"08d3362e-7a8e-4ac5-b5d8-a74c2c85fe20\") " pod="openshift-ingress/kube-auth-proxy-5b4bf4958f-cfv95"
Jun 11 19:34:49.689910 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:49.689655    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08d3362e-7a8e-4ac5-b5d8-a74c2c85fe20-tls-certs\") pod \"kube-auth-proxy-5b4bf4958f-cfv95\" (UID: \"08d3362e-7a8e-4ac5-b5d8-a74c2c85fe20\") " pod="openshift-ingress/kube-auth-proxy-5b4bf4958f-cfv95"
Jun 11 19:34:49.790635 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:49.790586    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08d3362e-7a8e-4ac5-b5d8-a74c2c85fe20-tmp\") pod \"kube-auth-proxy-5b4bf4958f-cfv95\" (UID: \"08d3362e-7a8e-4ac5-b5d8-a74c2c85fe20\") " pod="openshift-ingress/kube-auth-proxy-5b4bf4958f-cfv95"
Jun 11 19:34:49.790635 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:49.790639    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzcft\" (UniqueName: \"kubernetes.io/projected/08d3362e-7a8e-4ac5-b5d8-a74c2c85fe20-kube-api-access-wzcft\") pod \"kube-auth-proxy-5b4bf4958f-cfv95\" (UID: \"08d3362e-7a8e-4ac5-b5d8-a74c2c85fe20\") " pod="openshift-ingress/kube-auth-proxy-5b4bf4958f-cfv95"
Jun 11 19:34:49.790905 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:49.790676    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08d3362e-7a8e-4ac5-b5d8-a74c2c85fe20-tls-certs\") pod \"kube-auth-proxy-5b4bf4958f-cfv95\" (UID: \"08d3362e-7a8e-4ac5-b5d8-a74c2c85fe20\") " pod="openshift-ingress/kube-auth-proxy-5b4bf4958f-cfv95"
Jun 11 19:34:49.793155 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:49.793121    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08d3362e-7a8e-4ac5-b5d8-a74c2c85fe20-tmp\") pod \"kube-auth-proxy-5b4bf4958f-cfv95\" (UID: \"08d3362e-7a8e-4ac5-b5d8-a74c2c85fe20\") " pod="openshift-ingress/kube-auth-proxy-5b4bf4958f-cfv95"
Jun 11 19:34:49.793436 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:49.793416    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08d3362e-7a8e-4ac5-b5d8-a74c2c85fe20-tls-certs\") pod \"kube-auth-proxy-5b4bf4958f-cfv95\" (UID: \"08d3362e-7a8e-4ac5-b5d8-a74c2c85fe20\") " pod="openshift-ingress/kube-auth-proxy-5b4bf4958f-cfv95"
Jun 11 19:34:49.798550 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:49.798489    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzcft\" (UniqueName: \"kubernetes.io/projected/08d3362e-7a8e-4ac5-b5d8-a74c2c85fe20-kube-api-access-wzcft\") pod \"kube-auth-proxy-5b4bf4958f-cfv95\" (UID: \"08d3362e-7a8e-4ac5-b5d8-a74c2c85fe20\") " pod="openshift-ingress/kube-auth-proxy-5b4bf4958f-cfv95"
Jun 11 19:34:49.885247 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:49.885153    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-hn6jq" event={"ID":"7040120a-2e1c-4060-9f7b-4dd0b5960dbf","Type":"ContainerStarted","Data":"0e37c2a50e85d28665b7cf4ca7e4b391db15100e639cd0a62088d17f76bfdde0"}
Jun 11 19:34:49.888008 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:49.887973    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-9b2s9" event={"ID":"c6432892-1948-4a58-8e0a-ba4f17aef5db","Type":"ContainerStarted","Data":"0d638fa291e8439fa5ccff7d6daa01f26c4d582f19b12cb005c49f897f884b8f"}
Jun 11 19:34:49.932052 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:49.932013    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b4bf4958f-cfv95"
Jun 11 19:34:50.114693 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:50.114602    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b4bf4958f-cfv95"]
Jun 11 19:34:50.119475 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:34:50.119440    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08d3362e_7a8e_4ac5_b5d8_a74c2c85fe20.slice/crio-cf1b3c73b95f00c7b05b53f587c29804e3e109665ec9601d7921986bc19d86d7 WatchSource:0}: Error finding container cf1b3c73b95f00c7b05b53f587c29804e3e109665ec9601d7921986bc19d86d7: Status 404 returned error can't find the container with id cf1b3c73b95f00c7b05b53f587c29804e3e109665ec9601d7921986bc19d86d7
Jun 11 19:34:50.897035 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:50.896947    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b4bf4958f-cfv95" event={"ID":"08d3362e-7a8e-4ac5-b5d8-a74c2c85fe20","Type":"ContainerStarted","Data":"cf1b3c73b95f00c7b05b53f587c29804e3e109665ec9601d7921986bc19d86d7"}
Jun 11 19:34:54.917872 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:54.917832    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-9b2s9" event={"ID":"c6432892-1948-4a58-8e0a-ba4f17aef5db","Type":"ContainerStarted","Data":"31a48394f30a5ea169d8dbdb9ae4559736053807aafd1f24d0c72110db31fe5c"}
Jun 11 19:34:54.918359 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:54.917929    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-9b2s9"
Jun 11 19:34:54.919491 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:54.919460    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-hn6jq" event={"ID":"7040120a-2e1c-4060-9f7b-4dd0b5960dbf","Type":"ContainerStarted","Data":"6f15209878cff90f6200bf7b627d169daa08b2f3c70fddbadf0be045d5480c8d"}
Jun 11 19:34:54.919616 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:54.919527    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-hn6jq"
Jun 11 19:34:54.921132 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:54.921111    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b4bf4958f-cfv95" event={"ID":"08d3362e-7a8e-4ac5-b5d8-a74c2c85fe20","Type":"ContainerStarted","Data":"dee62f957db6179fb36bf92a1e35d0d63f6313da681d2854c6d2a57b8fd4a3ca"}
Jun 11 19:34:54.936946 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:54.936874    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-9b2s9" podStartSLOduration=2.000691611 podStartE2EDuration="6.936860095s" totalImagesPullingTime="4.936168484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:34:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:34:54.935706888 +0000 UTC m=+530.339622995" watchObservedRunningTime="2026-06-11 19:34:54.936860095 +0000 UTC m=+530.340776203"
Jun 11 19:34:54.954218 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:54.954168    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-hn6jq" podStartSLOduration=1.907971956 podStartE2EDuration="6.95415209s" totalImagesPullingTime="5.046180134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:34:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:34:54.953157265 +0000 UTC m=+530.357073383" watchObservedRunningTime="2026-06-11 19:34:54.95415209 +0000 UTC m=+530.358068251"
Jun 11 19:34:54.969281 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:54.969231    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5b4bf4958f-cfv95" podStartSLOduration=1.818741841 podStartE2EDuration="5.969214368s" totalImagesPullingTime="4.150472527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:34:54.968478187 +0000 UTC m=+530.372394332" watchObservedRunningTime="2026-06-11 19:34:54.969214368 +0000 UTC m=+530.373130471"
Jun 11 19:34:59.014692 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:59.014649    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-nrzzr"]
Jun 11 19:34:59.018130 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:59.018106    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-nrzzr"
Jun 11 19:34:59.020828 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:59.020807    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jun 11 19:34:59.020996 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:59.020872    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-ztdt5\""
Jun 11 19:34:59.024048 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:59.024023    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-4rnlt"]
Jun 11 19:34:59.027110 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:59.027091    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4rnlt"
Jun 11 19:34:59.029959 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:59.029937    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-6znwt\""
Jun 11 19:34:59.030358 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:59.030337    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jun 11 19:34:59.030687 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:59.030668    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-nrzzr"]
Jun 11 19:34:59.050102 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:59.050065    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-4rnlt"]
Jun 11 19:34:59.075209 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:59.075179    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8eaabbf0-020a-4eb8-b1ea-f8b687e106d4-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-4rnlt\" (UID: \"8eaabbf0-020a-4eb8-b1ea-f8b687e106d4\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4rnlt"
Jun 11 19:34:59.075375 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:59.075214    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-264sw\" (UniqueName: \"kubernetes.io/projected/8eaabbf0-020a-4eb8-b1ea-f8b687e106d4-kube-api-access-264sw\") pod \"llmisvc-controller-manager-864bfd7bc9-4rnlt\" (UID: \"8eaabbf0-020a-4eb8-b1ea-f8b687e106d4\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4rnlt"
Jun 11 19:34:59.075375 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:59.075298    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvfhl\" (UniqueName: \"kubernetes.io/projected/76771886-5493-4fa4-81ea-0809feae2960-kube-api-access-qvfhl\") pod \"kserve-controller-manager-69fc866d76-nrzzr\" (UID: \"76771886-5493-4fa4-81ea-0809feae2960\") " pod="opendatahub/kserve-controller-manager-69fc866d76-nrzzr"
Jun 11 19:34:59.075375 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:59.075325    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76771886-5493-4fa4-81ea-0809feae2960-cert\") pod \"kserve-controller-manager-69fc866d76-nrzzr\" (UID: \"76771886-5493-4fa4-81ea-0809feae2960\") " pod="opendatahub/kserve-controller-manager-69fc866d76-nrzzr"
Jun 11 19:34:59.176302 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:59.176260    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvfhl\" (UniqueName: \"kubernetes.io/projected/76771886-5493-4fa4-81ea-0809feae2960-kube-api-access-qvfhl\") pod \"kserve-controller-manager-69fc866d76-nrzzr\" (UID: \"76771886-5493-4fa4-81ea-0809feae2960\") " pod="opendatahub/kserve-controller-manager-69fc866d76-nrzzr"
Jun 11 19:34:59.176302 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:59.176303    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76771886-5493-4fa4-81ea-0809feae2960-cert\") pod \"kserve-controller-manager-69fc866d76-nrzzr\" (UID: \"76771886-5493-4fa4-81ea-0809feae2960\") " pod="opendatahub/kserve-controller-manager-69fc866d76-nrzzr"
Jun 11 19:34:59.176589 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:59.176332    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8eaabbf0-020a-4eb8-b1ea-f8b687e106d4-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-4rnlt\" (UID: \"8eaabbf0-020a-4eb8-b1ea-f8b687e106d4\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4rnlt"
Jun 11 19:34:59.176589 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:59.176352    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-264sw\" (UniqueName: \"kubernetes.io/projected/8eaabbf0-020a-4eb8-b1ea-f8b687e106d4-kube-api-access-264sw\") pod \"llmisvc-controller-manager-864bfd7bc9-4rnlt\" (UID: \"8eaabbf0-020a-4eb8-b1ea-f8b687e106d4\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4rnlt"
Jun 11 19:34:59.176589 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:34:59.176484    2565 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jun 11 19:34:59.176589 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:34:59.176518    2565 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jun 11 19:34:59.176589 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:34:59.176553    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eaabbf0-020a-4eb8-b1ea-f8b687e106d4-cert podName:8eaabbf0-020a-4eb8-b1ea-f8b687e106d4 nodeName:}" failed. No retries permitted until 2026-06-11 19:34:59.676536986 +0000 UTC m=+535.080453090 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8eaabbf0-020a-4eb8-b1ea-f8b687e106d4-cert") pod "llmisvc-controller-manager-864bfd7bc9-4rnlt" (UID: "8eaabbf0-020a-4eb8-b1ea-f8b687e106d4") : secret "llmisvc-webhook-server-cert" not found
Jun 11 19:34:59.176589 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:34:59.176583    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76771886-5493-4fa4-81ea-0809feae2960-cert podName:76771886-5493-4fa4-81ea-0809feae2960 nodeName:}" failed. No retries permitted until 2026-06-11 19:34:59.676564543 +0000 UTC m=+535.080480630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/76771886-5493-4fa4-81ea-0809feae2960-cert") pod "kserve-controller-manager-69fc866d76-nrzzr" (UID: "76771886-5493-4fa4-81ea-0809feae2960") : secret "kserve-webhook-server-cert" not found
Jun 11 19:34:59.185620 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:59.185587    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-264sw\" (UniqueName: \"kubernetes.io/projected/8eaabbf0-020a-4eb8-b1ea-f8b687e106d4-kube-api-access-264sw\") pod \"llmisvc-controller-manager-864bfd7bc9-4rnlt\" (UID: \"8eaabbf0-020a-4eb8-b1ea-f8b687e106d4\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4rnlt"
Jun 11 19:34:59.185751 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:59.185649    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvfhl\" (UniqueName: \"kubernetes.io/projected/76771886-5493-4fa4-81ea-0809feae2960-kube-api-access-qvfhl\") pod \"kserve-controller-manager-69fc866d76-nrzzr\" (UID: \"76771886-5493-4fa4-81ea-0809feae2960\") " pod="opendatahub/kserve-controller-manager-69fc866d76-nrzzr"
Jun 11 19:34:59.680227 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:59.680178    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76771886-5493-4fa4-81ea-0809feae2960-cert\") pod \"kserve-controller-manager-69fc866d76-nrzzr\" (UID: \"76771886-5493-4fa4-81ea-0809feae2960\") " pod="opendatahub/kserve-controller-manager-69fc866d76-nrzzr"
Jun 11 19:34:59.680419 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:59.680246    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8eaabbf0-020a-4eb8-b1ea-f8b687e106d4-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-4rnlt\" (UID: \"8eaabbf0-020a-4eb8-b1ea-f8b687e106d4\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4rnlt"
Jun 11 19:34:59.682962 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:59.682935    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76771886-5493-4fa4-81ea-0809feae2960-cert\") pod \"kserve-controller-manager-69fc866d76-nrzzr\" (UID: \"76771886-5493-4fa4-81ea-0809feae2960\") " pod="opendatahub/kserve-controller-manager-69fc866d76-nrzzr"
Jun 11 19:34:59.683077 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:59.682936    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8eaabbf0-020a-4eb8-b1ea-f8b687e106d4-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-4rnlt\" (UID: \"8eaabbf0-020a-4eb8-b1ea-f8b687e106d4\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4rnlt"
Jun 11 19:34:59.929223 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:59.929180    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-nrzzr"
Jun 11 19:34:59.938547 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:34:59.938505    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4rnlt"
Jun 11 19:35:00.077497 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:00.077462    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-nrzzr"]
Jun 11 19:35:00.080767 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:35:00.080735    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76771886_5493_4fa4_81ea_0809feae2960.slice/crio-4b50276c9484eaed22185cc7715b1c2c8ef9162bc2239bc447c0e5237b0e86ac WatchSource:0}: Error finding container 4b50276c9484eaed22185cc7715b1c2c8ef9162bc2239bc447c0e5237b0e86ac: Status 404 returned error can't find the container with id 4b50276c9484eaed22185cc7715b1c2c8ef9162bc2239bc447c0e5237b0e86ac
Jun 11 19:35:00.098550 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:00.098528    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-4rnlt"]
Jun 11 19:35:00.100977 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:35:00.100951    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8eaabbf0_020a_4eb8_b1ea_f8b687e106d4.slice/crio-11d21891837e6d59b27b14cc5e2ea3bf1801a8e0de683e9037b5fffdf6cec1af WatchSource:0}: Error finding container 11d21891837e6d59b27b14cc5e2ea3bf1801a8e0de683e9037b5fffdf6cec1af: Status 404 returned error can't find the container with id 11d21891837e6d59b27b14cc5e2ea3bf1801a8e0de683e9037b5fffdf6cec1af
Jun 11 19:35:00.946469 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:00.946425    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-nrzzr" event={"ID":"76771886-5493-4fa4-81ea-0809feae2960","Type":"ContainerStarted","Data":"4b50276c9484eaed22185cc7715b1c2c8ef9162bc2239bc447c0e5237b0e86ac"}
Jun 11 19:35:00.948018 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:00.947991    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4rnlt" event={"ID":"8eaabbf0-020a-4eb8-b1ea-f8b687e106d4","Type":"ContainerStarted","Data":"11d21891837e6d59b27b14cc5e2ea3bf1801a8e0de683e9037b5fffdf6cec1af"}
Jun 11 19:35:03.962692 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:03.962583    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4rnlt" event={"ID":"8eaabbf0-020a-4eb8-b1ea-f8b687e106d4","Type":"ContainerStarted","Data":"743dc57b647d6fed208ae888c858b21791b54597106dff5d91eba5a1f9bf5c49"}
Jun 11 19:35:03.962692 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:03.962676    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4rnlt"
Jun 11 19:35:03.964170 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:03.964149    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-nrzzr" event={"ID":"76771886-5493-4fa4-81ea-0809feae2960","Type":"ContainerStarted","Data":"5329390da82bc40653aad2b87f1a2d5f0a2b504d4185d3b278af75da533e7cc9"}
Jun 11 19:35:03.964304 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:03.964293    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-nrzzr"
Jun 11 19:35:04.006156 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:04.006103    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4rnlt" podStartSLOduration=2.408167021 podStartE2EDuration="6.006089272s" totalImagesPullingTime="3.597922251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:34:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:35:04.004839973 +0000 UTC m=+539.408756082" watchObservedRunningTime="2026-06-11 19:35:04.006089272 +0000 UTC m=+539.410005358"
Jun 11 19:35:04.037873 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:04.037813    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-nrzzr" podStartSLOduration=2.423406264 podStartE2EDuration="6.037796287s" totalImagesPullingTime="3.614390023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:34:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:35:04.036288436 +0000 UTC m=+539.440204543" watchObservedRunningTime="2026-06-11 19:35:04.037796287 +0000 UTC m=+539.441712415"
Jun 11 19:35:05.597370 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:05.597329    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-shw2x"]
Jun 11 19:35:05.602236 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:05.602216    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-shw2x"
Jun 11 19:35:05.605232 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:05.605210    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-psqdm\""
Jun 11 19:35:05.605392 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:05.605290    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
Jun 11 19:35:05.605762 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:05.605743    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
Jun 11 19:35:05.616682 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:05.616653    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-shw2x"]
Jun 11 19:35:05.619455 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:05.619421    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/9017ee50-1d8b-4f7e-bd7f-3183b21fc6d3-operator-config\") pod \"servicemesh-operator3-57f65f65fb-shw2x\" (UID: \"9017ee50-1d8b-4f7e-bd7f-3183b21fc6d3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-shw2x"
Jun 11 19:35:05.619566 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:05.619474    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq5qs\" (UniqueName: \"kubernetes.io/projected/9017ee50-1d8b-4f7e-bd7f-3183b21fc6d3-kube-api-access-lq5qs\") pod \"servicemesh-operator3-57f65f65fb-shw2x\" (UID: \"9017ee50-1d8b-4f7e-bd7f-3183b21fc6d3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-shw2x"
Jun 11 19:35:05.720388 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:05.720345    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/9017ee50-1d8b-4f7e-bd7f-3183b21fc6d3-operator-config\") pod \"servicemesh-operator3-57f65f65fb-shw2x\" (UID: \"9017ee50-1d8b-4f7e-bd7f-3183b21fc6d3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-shw2x"
Jun 11 19:35:05.720590 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:05.720395    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq5qs\" (UniqueName: \"kubernetes.io/projected/9017ee50-1d8b-4f7e-bd7f-3183b21fc6d3-kube-api-access-lq5qs\") pod \"servicemesh-operator3-57f65f65fb-shw2x\" (UID: \"9017ee50-1d8b-4f7e-bd7f-3183b21fc6d3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-shw2x"
Jun 11 19:35:05.723235 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:05.723205    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/9017ee50-1d8b-4f7e-bd7f-3183b21fc6d3-operator-config\") pod \"servicemesh-operator3-57f65f65fb-shw2x\" (UID: \"9017ee50-1d8b-4f7e-bd7f-3183b21fc6d3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-shw2x"
Jun 11 19:35:05.737428 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:05.737393    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq5qs\" (UniqueName: \"kubernetes.io/projected/9017ee50-1d8b-4f7e-bd7f-3183b21fc6d3-kube-api-access-lq5qs\") pod \"servicemesh-operator3-57f65f65fb-shw2x\" (UID: \"9017ee50-1d8b-4f7e-bd7f-3183b21fc6d3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-shw2x"
Jun 11 19:35:05.911737 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:05.911638    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-shw2x"
Jun 11 19:35:05.928058 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:05.928035    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-9b2s9"
Jun 11 19:35:05.930762 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:05.930739    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-hn6jq"
Jun 11 19:35:06.084095 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:06.084062    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-shw2x"]
Jun 11 19:35:06.088856 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:35:06.088822    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9017ee50_1d8b_4f7e_bd7f_3183b21fc6d3.slice/crio-106ce5efdca6f224642c82a2bb493b00e18390cd82b19a7353cb3dd43089cd85 WatchSource:0}: Error finding container 106ce5efdca6f224642c82a2bb493b00e18390cd82b19a7353cb3dd43089cd85: Status 404 returned error can't find the container with id 106ce5efdca6f224642c82a2bb493b00e18390cd82b19a7353cb3dd43089cd85
Jun 11 19:35:06.713064 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:06.713023    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-56b4d94d65-dzfms"]
Jun 11 19:35:06.717745 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:06.717718    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-56b4d94d65-dzfms"
Jun 11 19:35:06.721676 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:06.721650    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-svpcz\""
Jun 11 19:35:06.722255 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:06.722236    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\""
Jun 11 19:35:06.726864 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:06.726837    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/22680655-940c-491d-9ccb-62f767c2931f-redirect-config\") pod \"dashboard-redirect-56b4d94d65-dzfms\" (UID: \"22680655-940c-491d-9ccb-62f767c2931f\") " pod="opendatahub/dashboard-redirect-56b4d94d65-dzfms"
Jun 11 19:35:06.726999 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:06.726901    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzwcz\" (UniqueName: \"kubernetes.io/projected/22680655-940c-491d-9ccb-62f767c2931f-kube-api-access-fzwcz\") pod \"dashboard-redirect-56b4d94d65-dzfms\" (UID: \"22680655-940c-491d-9ccb-62f767c2931f\") " pod="opendatahub/dashboard-redirect-56b4d94d65-dzfms"
Jun 11 19:35:06.745907 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:06.745860    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-56b4d94d65-dzfms"]
Jun 11 19:35:06.828293 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:06.828254    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/22680655-940c-491d-9ccb-62f767c2931f-redirect-config\") pod \"dashboard-redirect-56b4d94d65-dzfms\" (UID: \"22680655-940c-491d-9ccb-62f767c2931f\") " pod="opendatahub/dashboard-redirect-56b4d94d65-dzfms"
Jun 11 19:35:06.828480 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:06.828306    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzwcz\" (UniqueName: \"kubernetes.io/projected/22680655-940c-491d-9ccb-62f767c2931f-kube-api-access-fzwcz\") pod \"dashboard-redirect-56b4d94d65-dzfms\" (UID: \"22680655-940c-491d-9ccb-62f767c2931f\") " pod="opendatahub/dashboard-redirect-56b4d94d65-dzfms"
Jun 11 19:35:06.829048 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:06.829030    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/22680655-940c-491d-9ccb-62f767c2931f-redirect-config\") pod \"dashboard-redirect-56b4d94d65-dzfms\" (UID: \"22680655-940c-491d-9ccb-62f767c2931f\") " pod="opendatahub/dashboard-redirect-56b4d94d65-dzfms"
Jun 11 19:35:06.846448 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:06.846413    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzwcz\" (UniqueName: \"kubernetes.io/projected/22680655-940c-491d-9ccb-62f767c2931f-kube-api-access-fzwcz\") pod \"dashboard-redirect-56b4d94d65-dzfms\" (UID: \"22680655-940c-491d-9ccb-62f767c2931f\") " pod="opendatahub/dashboard-redirect-56b4d94d65-dzfms"
Jun 11 19:35:06.980317 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:06.980200    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-shw2x" event={"ID":"9017ee50-1d8b-4f7e-bd7f-3183b21fc6d3","Type":"ContainerStarted","Data":"106ce5efdca6f224642c82a2bb493b00e18390cd82b19a7353cb3dd43089cd85"}
Jun 11 19:35:07.029367 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:07.029327    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-56b4d94d65-dzfms"
Jun 11 19:35:07.168502 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:07.168305    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-56b4d94d65-dzfms"]
Jun 11 19:35:07.171700 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:35:07.171652    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22680655_940c_491d_9ccb_62f767c2931f.slice/crio-557ad5ac25a3b6e54ab865d375df1f07e6ba132db5936e3485338ac54919c615 WatchSource:0}: Error finding container 557ad5ac25a3b6e54ab865d375df1f07e6ba132db5936e3485338ac54919c615: Status 404 returned error can't find the container with id 557ad5ac25a3b6e54ab865d375df1f07e6ba132db5936e3485338ac54919c615
Jun 11 19:35:07.986427 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:07.986382    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-56b4d94d65-dzfms" event={"ID":"22680655-940c-491d-9ccb-62f767c2931f","Type":"ContainerStarted","Data":"557ad5ac25a3b6e54ab865d375df1f07e6ba132db5936e3485338ac54919c615"}
Jun 11 19:35:09.998586 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:09.998539    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-shw2x" event={"ID":"9017ee50-1d8b-4f7e-bd7f-3183b21fc6d3","Type":"ContainerStarted","Data":"d74fe7af3cc6fa70a1524f95651a2d560920310fa6d802a79fea445a7e07b633"}
Jun 11 19:35:09.999060 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:09.998655    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-shw2x"
Jun 11 19:35:10.037085 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:10.037009    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-shw2x" podStartSLOduration=2.118978193 podStartE2EDuration="5.036984388s" totalImagesPullingTime="2.918006195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:35:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:35:10.034463853 +0000 UTC m=+545.438379962" watchObservedRunningTime="2026-06-11 19:35:10.036984388 +0000 UTC m=+545.440900498"
Jun 11 19:35:11.003794 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:11.003748    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-56b4d94d65-dzfms" event={"ID":"22680655-940c-491d-9ccb-62f767c2931f","Type":"ContainerStarted","Data":"e5e49bdae8ca27721e28b090d29db800b76efeceee363939bb6c705c8279cf77"}
Jun 11 19:35:11.019485 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:11.019432    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-56b4d94d65-dzfms" podStartSLOduration=1.576179841 podStartE2EDuration="5.019417078s" totalImagesPullingTime="3.443237237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:35:11.017934945 +0000 UTC m=+546.421851052" watchObservedRunningTime="2026-06-11 19:35:11.019417078 +0000 UTC m=+546.423333213"
Jun 11 19:35:20.423579 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.423539    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn"]
Jun 11 19:35:20.429492 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.429471    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn"
Jun 11 19:35:20.431947 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.431921    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jun 11 19:35:20.431947 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.431945    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jun 11 19:35:20.432154 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.431952    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jun 11 19:35:20.432154 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.431967    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-tzv48\""
Jun 11 19:35:20.432154 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.431949    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jun 11 19:35:20.439640 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.439618    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn"]
Jun 11 19:35:20.540351 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.540311    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e24c47c-a518-4958-9bc2-9b98a846d9df-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-gc5tn\" (UID: \"8e24c47c-a518-4958-9bc2-9b98a846d9df\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn"
Jun 11 19:35:20.540351 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.540349    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8e24c47c-a518-4958-9bc2-9b98a846d9df-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-gc5tn\" (UID: \"8e24c47c-a518-4958-9bc2-9b98a846d9df\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn"
Jun 11 19:35:20.540614 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.540372    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8e24c47c-a518-4958-9bc2-9b98a846d9df-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-gc5tn\" (UID: \"8e24c47c-a518-4958-9bc2-9b98a846d9df\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn"
Jun 11 19:35:20.540614 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.540462    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8e24c47c-a518-4958-9bc2-9b98a846d9df-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-gc5tn\" (UID: \"8e24c47c-a518-4958-9bc2-9b98a846d9df\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn"
Jun 11 19:35:20.540614 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.540538    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j82mm\" (UniqueName: \"kubernetes.io/projected/8e24c47c-a518-4958-9bc2-9b98a846d9df-kube-api-access-j82mm\") pod \"istiod-openshift-gateway-75c67f8887-gc5tn\" (UID: \"8e24c47c-a518-4958-9bc2-9b98a846d9df\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn"
Jun 11 19:35:20.540614 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.540568    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8e24c47c-a518-4958-9bc2-9b98a846d9df-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-gc5tn\" (UID: \"8e24c47c-a518-4958-9bc2-9b98a846d9df\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn"
Jun 11 19:35:20.540770 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.540615    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e24c47c-a518-4958-9bc2-9b98a846d9df-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-gc5tn\" (UID: \"8e24c47c-a518-4958-9bc2-9b98a846d9df\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn"
Jun 11 19:35:20.641158 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.641121    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8e24c47c-a518-4958-9bc2-9b98a846d9df-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-gc5tn\" (UID: \"8e24c47c-a518-4958-9bc2-9b98a846d9df\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn"
Jun 11 19:35:20.641351 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.641175    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j82mm\" (UniqueName: \"kubernetes.io/projected/8e24c47c-a518-4958-9bc2-9b98a846d9df-kube-api-access-j82mm\") pod \"istiod-openshift-gateway-75c67f8887-gc5tn\" (UID: \"8e24c47c-a518-4958-9bc2-9b98a846d9df\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn"
Jun 11 19:35:20.641351 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.641196    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8e24c47c-a518-4958-9bc2-9b98a846d9df-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-gc5tn\" (UID: \"8e24c47c-a518-4958-9bc2-9b98a846d9df\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn"
Jun 11 19:35:20.641351 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.641223    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e24c47c-a518-4958-9bc2-9b98a846d9df-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-gc5tn\" (UID: \"8e24c47c-a518-4958-9bc2-9b98a846d9df\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn"
Jun 11 19:35:20.641351 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.641246    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e24c47c-a518-4958-9bc2-9b98a846d9df-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-gc5tn\" (UID: \"8e24c47c-a518-4958-9bc2-9b98a846d9df\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn"
Jun 11 19:35:20.641351 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.641261    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8e24c47c-a518-4958-9bc2-9b98a846d9df-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-gc5tn\" (UID: \"8e24c47c-a518-4958-9bc2-9b98a846d9df\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn"
Jun 11 19:35:20.641351 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.641279    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8e24c47c-a518-4958-9bc2-9b98a846d9df-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-gc5tn\" (UID: \"8e24c47c-a518-4958-9bc2-9b98a846d9df\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn"
Jun 11 19:35:20.642445 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.642411    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8e24c47c-a518-4958-9bc2-9b98a846d9df-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-gc5tn\" (UID: \"8e24c47c-a518-4958-9bc2-9b98a846d9df\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn"
Jun 11 19:35:20.643735 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.643705    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e24c47c-a518-4958-9bc2-9b98a846d9df-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-gc5tn\" (UID: \"8e24c47c-a518-4958-9bc2-9b98a846d9df\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn"
Jun 11 19:35:20.643971 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.643940    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8e24c47c-a518-4958-9bc2-9b98a846d9df-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-gc5tn\" (UID: \"8e24c47c-a518-4958-9bc2-9b98a846d9df\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn"
Jun 11 19:35:20.644277 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.644255    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8e24c47c-a518-4958-9bc2-9b98a846d9df-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-gc5tn\" (UID: \"8e24c47c-a518-4958-9bc2-9b98a846d9df\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn"
Jun 11 19:35:20.644322 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.644255    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8e24c47c-a518-4958-9bc2-9b98a846d9df-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-gc5tn\" (UID: \"8e24c47c-a518-4958-9bc2-9b98a846d9df\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn"
Jun 11 19:35:20.649780 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.649759    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j82mm\" (UniqueName: \"kubernetes.io/projected/8e24c47c-a518-4958-9bc2-9b98a846d9df-kube-api-access-j82mm\") pod \"istiod-openshift-gateway-75c67f8887-gc5tn\" (UID: \"8e24c47c-a518-4958-9bc2-9b98a846d9df\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn"
Jun 11 19:35:20.649780 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.649774    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e24c47c-a518-4958-9bc2-9b98a846d9df-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-gc5tn\" (UID: \"8e24c47c-a518-4958-9bc2-9b98a846d9df\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn"
Jun 11 19:35:20.739605 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.739568    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn"
Jun 11 19:35:20.885606 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:20.885580    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn"]
Jun 11 19:35:20.888298 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:35:20.888263    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e24c47c_a518_4958_9bc2_9b98a846d9df.slice/crio-bb6e9df3f074ea3a4691d2b7cae048215f91badd0ca2c19230fe9bb5b69b63bf WatchSource:0}: Error finding container bb6e9df3f074ea3a4691d2b7cae048215f91badd0ca2c19230fe9bb5b69b63bf: Status 404 returned error can't find the container with id bb6e9df3f074ea3a4691d2b7cae048215f91badd0ca2c19230fe9bb5b69b63bf
Jun 11 19:35:21.006533 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:21.006448    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-shw2x"
Jun 11 19:35:21.046803 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:21.046770    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn" event={"ID":"8e24c47c-a518-4958-9bc2-9b98a846d9df","Type":"ContainerStarted","Data":"bb6e9df3f074ea3a4691d2b7cae048215f91badd0ca2c19230fe9bb5b69b63bf"}
Jun 11 19:35:23.392846 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:23.392809    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jun 11 19:35:23.393132 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:23.392898    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jun 11 19:35:24.067139 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:24.067101    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn" event={"ID":"8e24c47c-a518-4958-9bc2-9b98a846d9df","Type":"ContainerStarted","Data":"06cef288b9e10ad82046eb4e28a0eacb5c0e0e2a4788c4346989c37df7c53e50"}
Jun 11 19:35:24.067338 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:24.067284    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn"
Jun 11 19:35:24.068622 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:24.068594    2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-gc5tn container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jun 11 19:35:24.068739 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:24.068642    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn" podUID="8e24c47c-a518-4958-9bc2-9b98a846d9df" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 11 19:35:24.088223 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:24.088171    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn" podStartSLOduration=1.586139627 podStartE2EDuration="4.088156078s" totalImagesPullingTime="2.502016451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:35:24.086140099 +0000 UTC m=+559.490056208" watchObservedRunningTime="2026-06-11 19:35:24.088156078 +0000 UTC m=+559.492072184"
Jun 11 19:35:25.077620 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:25.077591    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gc5tn"
Jun 11 19:35:34.970265 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:34.970227    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4rnlt"
Jun 11 19:35:34.973188 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:35:34.973164    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-nrzzr"
Jun 11 19:36:05.039920 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:36:05.039874    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2n72_b609134f-0739-46f3-966e-cc2c63aabe24/ovn-acl-logging/0.log"
Jun 11 19:36:05.042365 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:36:05.042343    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2n72_b609134f-0739-46f3-966e-cc2c63aabe24/ovn-acl-logging/0.log"
Jun 11 19:36:31.286865 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:36:31.286819    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ffbrz"]
Jun 11 19:36:31.290281 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:36:31.290254    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ffbrz"
Jun 11 19:36:31.293288 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:36:31.293263    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 11 19:36:31.294285 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:36:31.294270    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-pcbjh\""
Jun 11 19:36:31.294388 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:36:31.294287    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 11 19:36:31.303747 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:36:31.303720    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ffbrz"]
Jun 11 19:36:31.411699 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:36:31.411667    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6px4\" (UniqueName: \"kubernetes.io/projected/eeccc434-9a6f-47be-acac-f9dc52558b7c-kube-api-access-f6px4\") pod \"authorino-operator-75cc8d5cb7-ffbrz\" (UID: \"eeccc434-9a6f-47be-acac-f9dc52558b7c\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ffbrz"
Jun 11 19:36:31.512469 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:36:31.512414    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6px4\" (UniqueName: \"kubernetes.io/projected/eeccc434-9a6f-47be-acac-f9dc52558b7c-kube-api-access-f6px4\") pod \"authorino-operator-75cc8d5cb7-ffbrz\" (UID: \"eeccc434-9a6f-47be-acac-f9dc52558b7c\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ffbrz"
Jun 11 19:36:31.522971 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:36:31.522938    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6px4\" (UniqueName: \"kubernetes.io/projected/eeccc434-9a6f-47be-acac-f9dc52558b7c-kube-api-access-f6px4\") pod \"authorino-operator-75cc8d5cb7-ffbrz\" (UID: \"eeccc434-9a6f-47be-acac-f9dc52558b7c\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ffbrz"
Jun 11 19:36:31.600901 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:36:31.600854    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ffbrz"
Jun 11 19:36:31.735753 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:36:31.735727    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ffbrz"]
Jun 11 19:36:31.738469 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:36:31.738429    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeccc434_9a6f_47be_acac_f9dc52558b7c.slice/crio-37fda6171e4b762ec05f62001fb27b6fb0f92e42d76a76364521d34b8f516d3a WatchSource:0}: Error finding container 37fda6171e4b762ec05f62001fb27b6fb0f92e42d76a76364521d34b8f516d3a: Status 404 returned error can't find the container with id 37fda6171e4b762ec05f62001fb27b6fb0f92e42d76a76364521d34b8f516d3a
Jun 11 19:36:32.360077 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:36:32.360033    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ffbrz" event={"ID":"eeccc434-9a6f-47be-acac-f9dc52558b7c","Type":"ContainerStarted","Data":"37fda6171e4b762ec05f62001fb27b6fb0f92e42d76a76364521d34b8f516d3a"}
Jun 11 19:36:35.376168 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:36:35.376123    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ffbrz" event={"ID":"eeccc434-9a6f-47be-acac-f9dc52558b7c","Type":"ContainerStarted","Data":"9b1489549ac844dec36d46fc629ec596b4dddb4d47c131d970d6364c14656837"}
Jun 11 19:36:35.376584 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:36:35.376249    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ffbrz"
Jun 11 19:36:35.394425 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:36:35.394369    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ffbrz" podStartSLOduration=1.601462476 podStartE2EDuration="4.39435085s" totalImagesPullingTime="2.792888374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:36:35.393122359 +0000 UTC m=+630.797038483" watchObservedRunningTime="2026-06-11 19:36:35.39435085 +0000 UTC m=+630.798266957"
Jun 11 19:36:46.382624 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:36:46.382590    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ffbrz"
Jun 11 19:38:00.223413 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:38:00.223315    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-mfs8q"]
Jun 11 19:38:00.226515 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:38:00.226495    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-mfs8q"
Jun 11 19:38:00.228859 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:38:00.228838    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jun 11 19:38:00.234536 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:38:00.234512    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-mfs8q"]
Jun 11 19:38:00.331180 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:38:00.331144    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/14faa7c0-980a-4fb7-a0c6-4b5740698423-data\") pod \"postgres-69fb4594cf-mfs8q\" (UID: \"14faa7c0-980a-4fb7-a0c6-4b5740698423\") " pod="opendatahub/postgres-69fb4594cf-mfs8q"
Jun 11 19:38:00.331344 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:38:00.331192    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxctp\" (UniqueName: \"kubernetes.io/projected/14faa7c0-980a-4fb7-a0c6-4b5740698423-kube-api-access-qxctp\") pod \"postgres-69fb4594cf-mfs8q\" (UID: \"14faa7c0-980a-4fb7-a0c6-4b5740698423\") " pod="opendatahub/postgres-69fb4594cf-mfs8q"
Jun 11 19:38:00.432611 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:38:00.432573    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/14faa7c0-980a-4fb7-a0c6-4b5740698423-data\") pod \"postgres-69fb4594cf-mfs8q\" (UID: \"14faa7c0-980a-4fb7-a0c6-4b5740698423\") " pod="opendatahub/postgres-69fb4594cf-mfs8q"
Jun 11 19:38:00.432611 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:38:00.432610    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxctp\" (UniqueName: \"kubernetes.io/projected/14faa7c0-980a-4fb7-a0c6-4b5740698423-kube-api-access-qxctp\") pod \"postgres-69fb4594cf-mfs8q\" (UID: \"14faa7c0-980a-4fb7-a0c6-4b5740698423\") " pod="opendatahub/postgres-69fb4594cf-mfs8q"
Jun 11 19:38:00.433047 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:38:00.433022    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/14faa7c0-980a-4fb7-a0c6-4b5740698423-data\") pod \"postgres-69fb4594cf-mfs8q\" (UID: \"14faa7c0-980a-4fb7-a0c6-4b5740698423\") " pod="opendatahub/postgres-69fb4594cf-mfs8q"
Jun 11 19:38:00.441757 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:38:00.441732    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxctp\" (UniqueName: \"kubernetes.io/projected/14faa7c0-980a-4fb7-a0c6-4b5740698423-kube-api-access-qxctp\") pod \"postgres-69fb4594cf-mfs8q\" (UID: \"14faa7c0-980a-4fb7-a0c6-4b5740698423\") " pod="opendatahub/postgres-69fb4594cf-mfs8q"
Jun 11 19:38:00.536901 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:38:00.536790    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-mfs8q"
Jun 11 19:38:00.664199 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:38:00.664039    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-mfs8q"]
Jun 11 19:38:00.666409 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:38:00.666378    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14faa7c0_980a_4fb7_a0c6_4b5740698423.slice/crio-6a9a05c150cb6ed8495ba17a6ec2cc423d161886f7428b012d94f632a703ae46 WatchSource:0}: Error finding container 6a9a05c150cb6ed8495ba17a6ec2cc423d161886f7428b012d94f632a703ae46: Status 404 returned error can't find the container with id 6a9a05c150cb6ed8495ba17a6ec2cc423d161886f7428b012d94f632a703ae46
Jun 11 19:38:00.667691 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:38:00.667667    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 11 19:38:00.731444 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:38:00.731412    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-mfs8q" event={"ID":"14faa7c0-980a-4fb7-a0c6-4b5740698423","Type":"ContainerStarted","Data":"6a9a05c150cb6ed8495ba17a6ec2cc423d161886f7428b012d94f632a703ae46"}
Jun 11 19:38:03.748816 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:38:03.748781    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-mfs8q" event={"ID":"14faa7c0-980a-4fb7-a0c6-4b5740698423","Type":"ContainerStarted","Data":"8be94593ed7d1622c171d9d6125b51dbb3268c3aba39932db30076c74db94fd0"}
Jun 11 19:38:03.749322 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:38:03.748925    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-mfs8q"
Jun 11 19:38:03.764505 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:38:03.764455    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-mfs8q" podStartSLOduration=1.030508439 podStartE2EDuration="3.76443657s" totalImagesPullingTime="2.733928131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:38:03.763959659 +0000 UTC m=+719.167875767" watchObservedRunningTime="2026-06-11 19:38:03.76443657 +0000 UTC m=+719.168352678"
Jun 11 19:38:09.788995 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:38:09.788966    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-mfs8q"
Jun 11 19:39:16.760809 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:16.760770    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c4fbff486-6w6tw"]
Jun 11 19:39:16.764563 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:16.764539    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c4fbff486-6w6tw"
Jun 11 19:39:16.768013 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:16.767991    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-g8drz\""
Jun 11 19:39:16.771265 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:16.771245    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jun 11 19:39:16.771490 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:16.771469    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jun 11 19:39:16.780172 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:16.780146    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c4fbff486-6w6tw"]
Jun 11 19:39:16.853294 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:16.853251    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s72lb\" (UniqueName: \"kubernetes.io/projected/56edec9a-af7e-4f98-bf18-2fc1cfb88470-kube-api-access-s72lb\") pod \"maas-controller-5c4fbff486-6w6tw\" (UID: \"56edec9a-af7e-4f98-bf18-2fc1cfb88470\") " pod="opendatahub/maas-controller-5c4fbff486-6w6tw"
Jun 11 19:39:16.853468 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:16.853313    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/56edec9a-af7e-4f98-bf18-2fc1cfb88470-webhook-cert\") pod \"maas-controller-5c4fbff486-6w6tw\" (UID: \"56edec9a-af7e-4f98-bf18-2fc1cfb88470\") " pod="opendatahub/maas-controller-5c4fbff486-6w6tw"
Jun 11 19:39:16.954112 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:16.954076    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/56edec9a-af7e-4f98-bf18-2fc1cfb88470-webhook-cert\") pod \"maas-controller-5c4fbff486-6w6tw\" (UID: \"56edec9a-af7e-4f98-bf18-2fc1cfb88470\") " pod="opendatahub/maas-controller-5c4fbff486-6w6tw"
Jun 11 19:39:16.954297 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:16.954139    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s72lb\" (UniqueName: \"kubernetes.io/projected/56edec9a-af7e-4f98-bf18-2fc1cfb88470-kube-api-access-s72lb\") pod \"maas-controller-5c4fbff486-6w6tw\" (UID: \"56edec9a-af7e-4f98-bf18-2fc1cfb88470\") " pod="opendatahub/maas-controller-5c4fbff486-6w6tw"
Jun 11 19:39:16.954512 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:16.954486    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7cdd58fdb4-xjlrs"]
Jun 11 19:39:16.956725 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:16.956705    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/56edec9a-af7e-4f98-bf18-2fc1cfb88470-webhook-cert\") pod \"maas-controller-5c4fbff486-6w6tw\" (UID: \"56edec9a-af7e-4f98-bf18-2fc1cfb88470\") " pod="opendatahub/maas-controller-5c4fbff486-6w6tw"
Jun 11 19:39:16.957588 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:16.957572    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cdd58fdb4-xjlrs"
Jun 11 19:39:16.966510 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:16.966483    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s72lb\" (UniqueName: \"kubernetes.io/projected/56edec9a-af7e-4f98-bf18-2fc1cfb88470-kube-api-access-s72lb\") pod \"maas-controller-5c4fbff486-6w6tw\" (UID: \"56edec9a-af7e-4f98-bf18-2fc1cfb88470\") " pod="opendatahub/maas-controller-5c4fbff486-6w6tw"
Jun 11 19:39:16.969314 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:16.969276    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cdd58fdb4-xjlrs"]
Jun 11 19:39:17.055240 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:17.055149    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ce7a838-5577-49c0-b055-27f27bc51b8e-webhook-cert\") pod \"maas-controller-7cdd58fdb4-xjlrs\" (UID: \"9ce7a838-5577-49c0-b055-27f27bc51b8e\") " pod="opendatahub/maas-controller-7cdd58fdb4-xjlrs"
Jun 11 19:39:17.055240 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:17.055202    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c2vl\" (UniqueName: \"kubernetes.io/projected/9ce7a838-5577-49c0-b055-27f27bc51b8e-kube-api-access-6c2vl\") pod \"maas-controller-7cdd58fdb4-xjlrs\" (UID: \"9ce7a838-5577-49c0-b055-27f27bc51b8e\") " pod="opendatahub/maas-controller-7cdd58fdb4-xjlrs"
Jun 11 19:39:17.074824 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:17.074790    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c4fbff486-6w6tw"
Jun 11 19:39:17.155977 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:17.155941    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c2vl\" (UniqueName: \"kubernetes.io/projected/9ce7a838-5577-49c0-b055-27f27bc51b8e-kube-api-access-6c2vl\") pod \"maas-controller-7cdd58fdb4-xjlrs\" (UID: \"9ce7a838-5577-49c0-b055-27f27bc51b8e\") " pod="opendatahub/maas-controller-7cdd58fdb4-xjlrs"
Jun 11 19:39:17.156139 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:17.156050    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ce7a838-5577-49c0-b055-27f27bc51b8e-webhook-cert\") pod \"maas-controller-7cdd58fdb4-xjlrs\" (UID: \"9ce7a838-5577-49c0-b055-27f27bc51b8e\") " pod="opendatahub/maas-controller-7cdd58fdb4-xjlrs"
Jun 11 19:39:17.158975 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:17.158949    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ce7a838-5577-49c0-b055-27f27bc51b8e-webhook-cert\") pod \"maas-controller-7cdd58fdb4-xjlrs\" (UID: \"9ce7a838-5577-49c0-b055-27f27bc51b8e\") " pod="opendatahub/maas-controller-7cdd58fdb4-xjlrs"
Jun 11 19:39:17.164475 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:17.164451    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c2vl\" (UniqueName: \"kubernetes.io/projected/9ce7a838-5577-49c0-b055-27f27bc51b8e-kube-api-access-6c2vl\") pod \"maas-controller-7cdd58fdb4-xjlrs\" (UID: \"9ce7a838-5577-49c0-b055-27f27bc51b8e\") " pod="opendatahub/maas-controller-7cdd58fdb4-xjlrs"
Jun 11 19:39:17.209007 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:17.208978    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c4fbff486-6w6tw"]
Jun 11 19:39:17.211467 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:39:17.211441    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56edec9a_af7e_4f98_bf18_2fc1cfb88470.slice/crio-bac1b91d9ecaee8941c144cb595b988d2b603a474219003af145f583c2514360 WatchSource:0}: Error finding container bac1b91d9ecaee8941c144cb595b988d2b603a474219003af145f583c2514360: Status 404 returned error can't find the container with id bac1b91d9ecaee8941c144cb595b988d2b603a474219003af145f583c2514360
Jun 11 19:39:17.281306 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:17.281263    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cdd58fdb4-xjlrs"
Jun 11 19:39:17.414945 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:17.414920    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cdd58fdb4-xjlrs"]
Jun 11 19:39:17.417316 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:39:17.417292    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ce7a838_5577_49c0_b055_27f27bc51b8e.slice/crio-2494661ec49e64fd620035ba8bf9e0f6eb8c56c8578af823f6e9ca285d48e2ad WatchSource:0}: Error finding container 2494661ec49e64fd620035ba8bf9e0f6eb8c56c8578af823f6e9ca285d48e2ad: Status 404 returned error can't find the container with id 2494661ec49e64fd620035ba8bf9e0f6eb8c56c8578af823f6e9ca285d48e2ad
Jun 11 19:39:18.069184 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:18.069147    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cdd58fdb4-xjlrs" event={"ID":"9ce7a838-5577-49c0-b055-27f27bc51b8e","Type":"ContainerStarted","Data":"2494661ec49e64fd620035ba8bf9e0f6eb8c56c8578af823f6e9ca285d48e2ad"}
Jun 11 19:39:18.070265 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:18.070240    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c4fbff486-6w6tw" event={"ID":"56edec9a-af7e-4f98-bf18-2fc1cfb88470","Type":"ContainerStarted","Data":"bac1b91d9ecaee8941c144cb595b988d2b603a474219003af145f583c2514360"}
Jun 11 19:39:20.082411 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:20.082371    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cdd58fdb4-xjlrs" event={"ID":"9ce7a838-5577-49c0-b055-27f27bc51b8e","Type":"ContainerStarted","Data":"c991e6c4ded8d7e1c0ba64470430b2a9dfd696f699cf94424797ebbb104bafbb"}
Jun 11 19:39:20.082970 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:20.082444    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7cdd58fdb4-xjlrs"
Jun 11 19:39:20.083979 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:20.083954    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c4fbff486-6w6tw" event={"ID":"56edec9a-af7e-4f98-bf18-2fc1cfb88470","Type":"ContainerStarted","Data":"525119f50f672caeb6e14ff172b25ebe942c9f8df9602ef5eeb7de2036c59113"}
Jun 11 19:39:20.084078 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:20.084017    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c4fbff486-6w6tw"
Jun 11 19:39:20.157281 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:20.157223    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c4fbff486-6w6tw" podStartSLOduration=2.040277144 podStartE2EDuration="4.157205683s" totalImagesPullingTime="2.116928539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:39:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:39:20.156340142 +0000 UTC m=+795.560256250" watchObservedRunningTime="2026-06-11 19:39:20.157205683 +0000 UTC m=+795.561121839"
Jun 11 19:39:20.158368 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:20.158300    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7cdd58fdb4-xjlrs" podStartSLOduration=2.250521965 podStartE2EDuration="4.158287709s" totalImagesPullingTime="1.907765744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:39:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:39:20.112405915 +0000 UTC m=+795.516322022" watchObservedRunningTime="2026-06-11 19:39:20.158287709 +0000 UTC m=+795.562203853"
Jun 11 19:39:31.093506 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:31.093422    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c4fbff486-6w6tw"
Jun 11 19:39:31.093506 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:31.093495    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7cdd58fdb4-xjlrs"
Jun 11 19:39:31.156828 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:31.156798    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c4fbff486-6w6tw"]
Jun 11 19:39:31.157061 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:31.157030    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5c4fbff486-6w6tw" podUID="56edec9a-af7e-4f98-bf18-2fc1cfb88470" containerName="manager" containerID="cri-o://525119f50f672caeb6e14ff172b25ebe942c9f8df9602ef5eeb7de2036c59113" gracePeriod=30
Jun 11 19:39:31.405741 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:31.405705    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c4fbff486-6w6tw"
Jun 11 19:39:31.476504 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:31.476462    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/56edec9a-af7e-4f98-bf18-2fc1cfb88470-webhook-cert\") pod \"56edec9a-af7e-4f98-bf18-2fc1cfb88470\" (UID: \"56edec9a-af7e-4f98-bf18-2fc1cfb88470\") "
Jun 11 19:39:31.476677 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:31.476520    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s72lb\" (UniqueName: \"kubernetes.io/projected/56edec9a-af7e-4f98-bf18-2fc1cfb88470-kube-api-access-s72lb\") pod \"56edec9a-af7e-4f98-bf18-2fc1cfb88470\" (UID: \"56edec9a-af7e-4f98-bf18-2fc1cfb88470\") "
Jun 11 19:39:31.478876 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:31.478836    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56edec9a-af7e-4f98-bf18-2fc1cfb88470-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "56edec9a-af7e-4f98-bf18-2fc1cfb88470" (UID: "56edec9a-af7e-4f98-bf18-2fc1cfb88470"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 19:39:31.478876 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:31.478844    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56edec9a-af7e-4f98-bf18-2fc1cfb88470-kube-api-access-s72lb" (OuterVolumeSpecName: "kube-api-access-s72lb") pod "56edec9a-af7e-4f98-bf18-2fc1cfb88470" (UID: "56edec9a-af7e-4f98-bf18-2fc1cfb88470"). InnerVolumeSpecName "kube-api-access-s72lb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 19:39:31.577757 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:31.577717    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/56edec9a-af7e-4f98-bf18-2fc1cfb88470-webhook-cert\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
Jun 11 19:39:31.577757 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:31.577750    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s72lb\" (UniqueName: \"kubernetes.io/projected/56edec9a-af7e-4f98-bf18-2fc1cfb88470-kube-api-access-s72lb\") on node \"ip-10-0-140-223.ec2.internal\" DevicePath \"\""
Jun 11 19:39:32.134183 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:32.134145    2565 generic.go:356] "Generic (PLEG): container finished" podID="56edec9a-af7e-4f98-bf18-2fc1cfb88470" containerID="525119f50f672caeb6e14ff172b25ebe942c9f8df9602ef5eeb7de2036c59113" exitCode=0
Jun 11 19:39:32.134697 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:32.134196    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c4fbff486-6w6tw"
Jun 11 19:39:32.134697 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:32.134237    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c4fbff486-6w6tw" event={"ID":"56edec9a-af7e-4f98-bf18-2fc1cfb88470","Type":"ContainerDied","Data":"525119f50f672caeb6e14ff172b25ebe942c9f8df9602ef5eeb7de2036c59113"}
Jun 11 19:39:32.134697 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:32.134287    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c4fbff486-6w6tw" event={"ID":"56edec9a-af7e-4f98-bf18-2fc1cfb88470","Type":"ContainerDied","Data":"bac1b91d9ecaee8941c144cb595b988d2b603a474219003af145f583c2514360"}
Jun 11 19:39:32.134697 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:32.134308    2565 scope.go:117] "RemoveContainer" containerID="525119f50f672caeb6e14ff172b25ebe942c9f8df9602ef5eeb7de2036c59113"
Jun 11 19:39:32.143084 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:32.143068    2565 scope.go:117] "RemoveContainer" containerID="525119f50f672caeb6e14ff172b25ebe942c9f8df9602ef5eeb7de2036c59113"
Jun 11 19:39:32.143370 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:39:32.143350    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"525119f50f672caeb6e14ff172b25ebe942c9f8df9602ef5eeb7de2036c59113\": container with ID starting with 525119f50f672caeb6e14ff172b25ebe942c9f8df9602ef5eeb7de2036c59113 not found: ID does not exist" containerID="525119f50f672caeb6e14ff172b25ebe942c9f8df9602ef5eeb7de2036c59113"
Jun 11 19:39:32.143410 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:32.143380    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"525119f50f672caeb6e14ff172b25ebe942c9f8df9602ef5eeb7de2036c59113"} err="failed to get container status \"525119f50f672caeb6e14ff172b25ebe942c9f8df9602ef5eeb7de2036c59113\": rpc error: code = NotFound desc = could not find container \"525119f50f672caeb6e14ff172b25ebe942c9f8df9602ef5eeb7de2036c59113\": container with ID starting with 525119f50f672caeb6e14ff172b25ebe942c9f8df9602ef5eeb7de2036c59113 not found: ID does not exist"
Jun 11 19:39:32.184959 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:32.184917    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c4fbff486-6w6tw"]
Jun 11 19:39:32.190766 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:32.190736    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c4fbff486-6w6tw"]
Jun 11 19:39:33.077093 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:33.077058    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56edec9a-af7e-4f98-bf18-2fc1cfb88470" path="/var/lib/kubelet/pods/56edec9a-af7e-4f98-bf18-2fc1cfb88470/volumes"
Jun 11 19:39:48.614101 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:48.614056    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-556f4b589f-r8frl"]
Jun 11 19:39:48.614661 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:48.614525    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56edec9a-af7e-4f98-bf18-2fc1cfb88470" containerName="manager"
Jun 11 19:39:48.614661 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:48.614546    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="56edec9a-af7e-4f98-bf18-2fc1cfb88470" containerName="manager"
Jun 11 19:39:48.614661 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:48.614659    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="56edec9a-af7e-4f98-bf18-2fc1cfb88470" containerName="manager"
Jun 11 19:39:48.619054 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:48.619032    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-556f4b589f-r8frl"
Jun 11 19:39:48.621314 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:48.621289    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jun 11 19:39:48.621424 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:48.621344    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-6bhwc\""
Jun 11 19:39:48.629693 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:48.629666    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-556f4b589f-r8frl"]
Jun 11 19:39:48.720302 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:48.720269    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e25c137-2d1e-4d4a-962e-ba6aa6a04ece-maas-api-tls\") pod \"maas-api-556f4b589f-r8frl\" (UID: \"9e25c137-2d1e-4d4a-962e-ba6aa6a04ece\") " pod="opendatahub/maas-api-556f4b589f-r8frl"
Jun 11 19:39:48.720485 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:48.720313    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcrrg\" (UniqueName: \"kubernetes.io/projected/9e25c137-2d1e-4d4a-962e-ba6aa6a04ece-kube-api-access-qcrrg\") pod \"maas-api-556f4b589f-r8frl\" (UID: \"9e25c137-2d1e-4d4a-962e-ba6aa6a04ece\") " pod="opendatahub/maas-api-556f4b589f-r8frl"
Jun 11 19:39:48.720485 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:48.720346    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e25c137-2d1e-4d4a-962e-ba6aa6a04ece-openshift-service-ca\") pod \"maas-api-556f4b589f-r8frl\" (UID: \"9e25c137-2d1e-4d4a-962e-ba6aa6a04ece\") " pod="opendatahub/maas-api-556f4b589f-r8frl"
Jun 11 19:39:48.821659 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:48.821614    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e25c137-2d1e-4d4a-962e-ba6aa6a04ece-maas-api-tls\") pod \"maas-api-556f4b589f-r8frl\" (UID: \"9e25c137-2d1e-4d4a-962e-ba6aa6a04ece\") " pod="opendatahub/maas-api-556f4b589f-r8frl"
Jun 11 19:39:48.821659 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:48.821665    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcrrg\" (UniqueName: \"kubernetes.io/projected/9e25c137-2d1e-4d4a-962e-ba6aa6a04ece-kube-api-access-qcrrg\") pod \"maas-api-556f4b589f-r8frl\" (UID: \"9e25c137-2d1e-4d4a-962e-ba6aa6a04ece\") " pod="opendatahub/maas-api-556f4b589f-r8frl"
Jun 11 19:39:48.821952 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:48.821692    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e25c137-2d1e-4d4a-962e-ba6aa6a04ece-openshift-service-ca\") pod \"maas-api-556f4b589f-r8frl\" (UID: \"9e25c137-2d1e-4d4a-962e-ba6aa6a04ece\") " pod="opendatahub/maas-api-556f4b589f-r8frl"
Jun 11 19:39:48.821952 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:39:48.821789    2565 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jun 11 19:39:48.821952 ip-10-0-140-223 kubenswrapper[2565]: E0611 19:39:48.821860    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e25c137-2d1e-4d4a-962e-ba6aa6a04ece-maas-api-tls podName:9e25c137-2d1e-4d4a-962e-ba6aa6a04ece nodeName:}" failed. No retries permitted until 2026-06-11 19:39:49.32184054 +0000 UTC m=+824.725756633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9e25c137-2d1e-4d4a-962e-ba6aa6a04ece-maas-api-tls") pod "maas-api-556f4b589f-r8frl" (UID: "9e25c137-2d1e-4d4a-962e-ba6aa6a04ece") : secret "maas-api-serving-cert" not found
Jun 11 19:39:48.822289 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:48.822272    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e25c137-2d1e-4d4a-962e-ba6aa6a04ece-openshift-service-ca\") pod \"maas-api-556f4b589f-r8frl\" (UID: \"9e25c137-2d1e-4d4a-962e-ba6aa6a04ece\") " pod="opendatahub/maas-api-556f4b589f-r8frl"
Jun 11 19:39:48.833500 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:48.833472    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcrrg\" (UniqueName: \"kubernetes.io/projected/9e25c137-2d1e-4d4a-962e-ba6aa6a04ece-kube-api-access-qcrrg\") pod \"maas-api-556f4b589f-r8frl\" (UID: \"9e25c137-2d1e-4d4a-962e-ba6aa6a04ece\") " pod="opendatahub/maas-api-556f4b589f-r8frl"
Jun 11 19:39:49.092706 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:49.092671    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-rjdrt"]
Jun 11 19:39:49.095991 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:49.095975    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-rjdrt"
Jun 11 19:39:49.102984 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:49.102849    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jun 11 19:39:49.102984 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:49.102946    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-2fnh2\""
Jun 11 19:39:49.111630 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:49.111598    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-rjdrt"]
Jun 11 19:39:49.131164 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:49.131129    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-wd7j4"]
Jun 11 19:39:49.134371 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:49.134355    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-wd7j4"
Jun 11 19:39:49.151232 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:49.151206    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-wd7j4"]
Jun 11 19:39:49.225382 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:49.225350    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9k5b\" (UniqueName: \"kubernetes.io/projected/b32b6aba-777f-4683-b008-5cb223085885-kube-api-access-w9k5b\") pod \"payload-processing-699b6cd6c-wd7j4\" (UID: \"b32b6aba-777f-4683-b008-5cb223085885\") " pod="openshift-ingress/payload-processing-699b6cd6c-wd7j4"
Jun 11 19:39:49.225566 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:49.225408    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvnqq\" (UniqueName: \"kubernetes.io/projected/3a648529-8fad-43b4-8e74-9fc8cb2cb452-kube-api-access-cvnqq\") pod \"payload-pre-processing-579785bc64-rjdrt\" (UID: \"3a648529-8fad-43b4-8e74-9fc8cb2cb452\") " pod="openshift-ingress/payload-pre-processing-579785bc64-rjdrt"
Jun 11 19:39:49.326853 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:49.326805    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9k5b\" (UniqueName: \"kubernetes.io/projected/b32b6aba-777f-4683-b008-5cb223085885-kube-api-access-w9k5b\") pod \"payload-processing-699b6cd6c-wd7j4\" (UID: \"b32b6aba-777f-4683-b008-5cb223085885\") " pod="openshift-ingress/payload-processing-699b6cd6c-wd7j4"
Jun 11 19:39:49.327061 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:49.326870    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvnqq\" (UniqueName: \"kubernetes.io/projected/3a648529-8fad-43b4-8e74-9fc8cb2cb452-kube-api-access-cvnqq\") pod \"payload-pre-processing-579785bc64-rjdrt\" (UID: \"3a648529-8fad-43b4-8e74-9fc8cb2cb452\") " pod="openshift-ingress/payload-pre-processing-579785bc64-rjdrt"
Jun 11 19:39:49.327061 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:49.326960    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e25c137-2d1e-4d4a-962e-ba6aa6a04ece-maas-api-tls\") pod \"maas-api-556f4b589f-r8frl\" (UID: \"9e25c137-2d1e-4d4a-962e-ba6aa6a04ece\") " pod="opendatahub/maas-api-556f4b589f-r8frl"
Jun 11 19:39:49.329536 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:49.329506    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e25c137-2d1e-4d4a-962e-ba6aa6a04ece-maas-api-tls\") pod \"maas-api-556f4b589f-r8frl\" (UID: \"9e25c137-2d1e-4d4a-962e-ba6aa6a04ece\") " pod="opendatahub/maas-api-556f4b589f-r8frl"
Jun 11 19:39:49.335506 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:49.335476    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvnqq\" (UniqueName: \"kubernetes.io/projected/3a648529-8fad-43b4-8e74-9fc8cb2cb452-kube-api-access-cvnqq\") pod \"payload-pre-processing-579785bc64-rjdrt\" (UID: \"3a648529-8fad-43b4-8e74-9fc8cb2cb452\") " pod="openshift-ingress/payload-pre-processing-579785bc64-rjdrt"
Jun 11 19:39:49.335644 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:49.335527    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9k5b\" (UniqueName: \"kubernetes.io/projected/b32b6aba-777f-4683-b008-5cb223085885-kube-api-access-w9k5b\") pod \"payload-processing-699b6cd6c-wd7j4\" (UID: \"b32b6aba-777f-4683-b008-5cb223085885\") " pod="openshift-ingress/payload-processing-699b6cd6c-wd7j4"
Jun 11 19:39:49.406305 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:49.406218    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-rjdrt"
Jun 11 19:39:49.443813 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:49.443781    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-wd7j4"
Jun 11 19:39:49.530728 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:49.530696    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-556f4b589f-r8frl"
Jun 11 19:39:49.552529 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:49.552484    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-rjdrt"]
Jun 11 19:39:49.554723 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:39:49.554668    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a648529_8fad_43b4_8e74_9fc8cb2cb452.slice/crio-f1f703052ad90bca5525feb6d44626c46ab1eb521b100a7cd7a1a890afdf84dd WatchSource:0}: Error finding container f1f703052ad90bca5525feb6d44626c46ab1eb521b100a7cd7a1a890afdf84dd: Status 404 returned error can't find the container with id f1f703052ad90bca5525feb6d44626c46ab1eb521b100a7cd7a1a890afdf84dd
Jun 11 19:39:49.593600 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:49.593340    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-wd7j4"]
Jun 11 19:39:49.596603 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:39:49.596559    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb32b6aba_777f_4683_b008_5cb223085885.slice/crio-be33fef1f86474b39a77211057fd4f46756e574348bd43b623211a9c4f9229ea WatchSource:0}: Error finding container be33fef1f86474b39a77211057fd4f46756e574348bd43b623211a9c4f9229ea: Status 404 returned error can't find the container with id be33fef1f86474b39a77211057fd4f46756e574348bd43b623211a9c4f9229ea
Jun 11 19:39:49.679155 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:49.679127    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-556f4b589f-r8frl"]
Jun 11 19:39:49.681317 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:39:49.681289    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e25c137_2d1e_4d4a_962e_ba6aa6a04ece.slice/crio-b7354bcbdd46340390ec7eed644d4fab8c41c34919729c80859bf9e174ae4999 WatchSource:0}: Error finding container b7354bcbdd46340390ec7eed644d4fab8c41c34919729c80859bf9e174ae4999: Status 404 returned error can't find the container with id b7354bcbdd46340390ec7eed644d4fab8c41c34919729c80859bf9e174ae4999
Jun 11 19:39:50.224315 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:50.224269    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-wd7j4" event={"ID":"b32b6aba-777f-4683-b008-5cb223085885","Type":"ContainerStarted","Data":"be33fef1f86474b39a77211057fd4f46756e574348bd43b623211a9c4f9229ea"}
Jun 11 19:39:50.226798 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:50.226769    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-556f4b589f-r8frl" event={"ID":"9e25c137-2d1e-4d4a-962e-ba6aa6a04ece","Type":"ContainerStarted","Data":"b7354bcbdd46340390ec7eed644d4fab8c41c34919729c80859bf9e174ae4999"}
Jun 11 19:39:50.231294 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:50.231266    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-rjdrt" event={"ID":"3a648529-8fad-43b4-8e74-9fc8cb2cb452","Type":"ContainerStarted","Data":"f1f703052ad90bca5525feb6d44626c46ab1eb521b100a7cd7a1a890afdf84dd"}
Jun 11 19:39:53.249049 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:53.249003    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-wd7j4" event={"ID":"b32b6aba-777f-4683-b008-5cb223085885","Type":"ContainerStarted","Data":"42d22c69ee69a765e702a8d52e04fce22ff5bda5f746d97348436d339013c5b7"}
Jun 11 19:39:53.249524 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:53.249134    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-wd7j4"
Jun 11 19:39:53.250576 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:53.250550    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-556f4b589f-r8frl" event={"ID":"9e25c137-2d1e-4d4a-962e-ba6aa6a04ece","Type":"ContainerStarted","Data":"3c8793815d6f68dea2688d5693319c15cb076c177faa0f70042d77b79dda2d5e"}
Jun 11 19:39:53.250686 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:53.250596    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-556f4b589f-r8frl"
Jun 11 19:39:53.251877 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:53.251853    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-rjdrt" event={"ID":"3a648529-8fad-43b4-8e74-9fc8cb2cb452","Type":"ContainerStarted","Data":"47f8bdf49ae03df79e0a06dc5de571d4c65faa1f5aa47567d89b6d92f8742195"}
Jun 11 19:39:53.251994 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:53.251980    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-rjdrt"
Jun 11 19:39:53.271424 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:53.271384    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-wd7j4" podStartSLOduration=1.515697237 podStartE2EDuration="4.271372111s" totalImagesPullingTime="2.755674874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:39:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:39:53.269132782 +0000 UTC m=+828.673048890" watchObservedRunningTime="2026-06-11 19:39:53.271372111 +0000 UTC m=+828.675288218"
Jun 11 19:39:53.286671 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:53.286619    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-556f4b589f-r8frl" podStartSLOduration=2.674113376 podStartE2EDuration="5.286601003s" totalImagesPullingTime="2.612487627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:39:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:39:53.284952149 +0000 UTC m=+828.688868248" watchObservedRunningTime="2026-06-11 19:39:53.286601003 +0000 UTC m=+828.690517114"
Jun 11 19:39:53.301720 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:53.301679    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-rjdrt" podStartSLOduration=1.496445515 podStartE2EDuration="4.3016667s" totalImagesPullingTime="2.805221185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:39:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:39:53.301231719 +0000 UTC m=+828.705147829" watchObservedRunningTime="2026-06-11 19:39:53.3016667 +0000 UTC m=+828.705582806"
Jun 11 19:39:59.262441 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:39:59.262405    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-556f4b589f-r8frl"
Jun 11 19:40:04.258226 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:40:04.258181    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-wd7j4"
Jun 11 19:40:04.258669 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:40:04.258311    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-rjdrt"
Jun 11 19:41:05.063971 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:41:05.063872    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2n72_b609134f-0739-46f3-966e-cc2c63aabe24/ovn-acl-logging/0.log"
Jun 11 19:41:05.067477 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:41:05.067451    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2n72_b609134f-0739-46f3-966e-cc2c63aabe24/ovn-acl-logging/0.log"
Jun 11 19:42:50.358211 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:42:50.358170    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh"]
Jun 11 19:42:50.362243 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:42:50.362218    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh"
Jun 11 19:42:50.364945 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:42:50.364861    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jun 11 19:42:50.365116 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:42:50.365093    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jun 11 19:42:50.365722 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:42:50.365708    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gp98w\""
Jun 11 19:42:50.365722 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:42:50.365713    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jun 11 19:42:50.372381 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:42:50.372350    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh"]
Jun 11 19:42:50.489044 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:42:50.489006    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh\" (UID: \"dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh"
Jun 11 19:42:50.489206 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:42:50.489070    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh\" (UID: \"dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh"
Jun 11 19:42:50.489206 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:42:50.489092    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh\" (UID: \"dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh"
Jun 11 19:42:50.489206 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:42:50.489119    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj9cv\" (UniqueName: \"kubernetes.io/projected/dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f-kube-api-access-dj9cv\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh\" (UID: \"dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh"
Jun 11 19:42:50.489206 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:42:50.489140    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh\" (UID: \"dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh"
Jun 11 19:42:50.489339 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:42:50.489214    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh\" (UID: \"dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh"
Jun 11 19:42:50.590140 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:42:50.590099    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh\" (UID: \"dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh"
Jun 11 19:42:50.590140 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:42:50.590145    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh\" (UID: \"dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh"
Jun 11 19:42:50.590355 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:42:50.590189    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh\" (UID: \"dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh"
Jun 11 19:42:50.590355 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:42:50.590207    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh\" (UID: \"dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh"
Jun 11 19:42:50.590355 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:42:50.590234    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj9cv\" (UniqueName: \"kubernetes.io/projected/dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f-kube-api-access-dj9cv\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh\" (UID: \"dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh"
Jun 11 19:42:50.590355 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:42:50.590254    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh\" (UID: \"dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh"
Jun 11 19:42:50.590634 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:42:50.590611    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh\" (UID: \"dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh"
Jun 11 19:42:50.590710 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:42:50.590654    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh\" (UID: \"dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh"
Jun 11 19:42:50.590748 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:42:50.590713    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh\" (UID: \"dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh"
Jun 11 19:42:50.592588 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:42:50.592566    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh\" (UID: \"dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh"
Jun 11 19:42:50.592765 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:42:50.592745    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh\" (UID: \"dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh"
Jun 11 19:42:50.598007 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:42:50.597984    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj9cv\" (UniqueName: \"kubernetes.io/projected/dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f-kube-api-access-dj9cv\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh\" (UID: \"dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh"
Jun 11 19:42:50.673924 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:42:50.673810    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh"
Jun 11 19:42:50.812321 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:42:50.812130    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh"]
Jun 11 19:42:50.814988 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:42:50.814955    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcdeefbe_c0b4_4b5f_ad06_d3f1d606e13f.slice/crio-334857fc4bae72e4b7d3987817bf3d5bab168afc7b059f567de7ee95baeafb32 WatchSource:0}: Error finding container 334857fc4bae72e4b7d3987817bf3d5bab168afc7b059f567de7ee95baeafb32: Status 404 returned error can't find the container with id 334857fc4bae72e4b7d3987817bf3d5bab168afc7b059f567de7ee95baeafb32
Jun 11 19:42:51.034988 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:42:51.034946    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh" event={"ID":"dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f","Type":"ContainerStarted","Data":"334857fc4bae72e4b7d3987817bf3d5bab168afc7b059f567de7ee95baeafb32"}
Jun 11 19:42:55.054140 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:42:55.054045    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh" event={"ID":"dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f","Type":"ContainerStarted","Data":"54a1f40a5036ca34abebfa2eb83aef6f976453f1c1a66b87047bd5012b032bd1"}
Jun 11 19:43:05.426438 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:05.426358    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g"]
Jun 11 19:43:05.429829 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:05.429809    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g"
Jun 11 19:43:05.432170 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:05.432147    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jun 11 19:43:05.441984 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:05.441941    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g"]
Jun 11 19:43:05.521506 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:05.521467    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59b78ee4-f5da-4dcc-859d-9b4f99a7e718-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g\" (UID: \"59b78ee4-f5da-4dcc-859d-9b4f99a7e718\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g"
Jun 11 19:43:05.521674 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:05.521519    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq5vd\" (UniqueName: \"kubernetes.io/projected/59b78ee4-f5da-4dcc-859d-9b4f99a7e718-kube-api-access-zq5vd\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g\" (UID: \"59b78ee4-f5da-4dcc-859d-9b4f99a7e718\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g"
Jun 11 19:43:05.521674 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:05.521606    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/59b78ee4-f5da-4dcc-859d-9b4f99a7e718-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g\" (UID: \"59b78ee4-f5da-4dcc-859d-9b4f99a7e718\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g"
Jun 11 19:43:05.521674 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:05.521657    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59b78ee4-f5da-4dcc-859d-9b4f99a7e718-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g\" (UID: \"59b78ee4-f5da-4dcc-859d-9b4f99a7e718\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g"
Jun 11 19:43:05.521782 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:05.521688    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59b78ee4-f5da-4dcc-859d-9b4f99a7e718-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g\" (UID: \"59b78ee4-f5da-4dcc-859d-9b4f99a7e718\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g"
Jun 11 19:43:05.521782 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:05.521707    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59b78ee4-f5da-4dcc-859d-9b4f99a7e718-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g\" (UID: \"59b78ee4-f5da-4dcc-859d-9b4f99a7e718\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g"
Jun 11 19:43:05.622280 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:05.622238    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq5vd\" (UniqueName: \"kubernetes.io/projected/59b78ee4-f5da-4dcc-859d-9b4f99a7e718-kube-api-access-zq5vd\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g\" (UID: \"59b78ee4-f5da-4dcc-859d-9b4f99a7e718\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g"
Jun 11 19:43:05.622455 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:05.622313    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/59b78ee4-f5da-4dcc-859d-9b4f99a7e718-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g\" (UID: \"59b78ee4-f5da-4dcc-859d-9b4f99a7e718\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g"
Jun 11 19:43:05.622455 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:05.622366    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59b78ee4-f5da-4dcc-859d-9b4f99a7e718-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g\" (UID: \"59b78ee4-f5da-4dcc-859d-9b4f99a7e718\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g"
Jun 11 19:43:05.622455 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:05.622410    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59b78ee4-f5da-4dcc-859d-9b4f99a7e718-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g\" (UID: \"59b78ee4-f5da-4dcc-859d-9b4f99a7e718\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g"
Jun 11 19:43:05.622455 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:05.622435    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59b78ee4-f5da-4dcc-859d-9b4f99a7e718-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g\" (UID: \"59b78ee4-f5da-4dcc-859d-9b4f99a7e718\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g"
Jun 11 19:43:05.622614 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:05.622462    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59b78ee4-f5da-4dcc-859d-9b4f99a7e718-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g\" (UID: \"59b78ee4-f5da-4dcc-859d-9b4f99a7e718\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g"
Jun 11 19:43:05.622821 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:05.622791    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/59b78ee4-f5da-4dcc-859d-9b4f99a7e718-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g\" (UID: \"59b78ee4-f5da-4dcc-859d-9b4f99a7e718\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g"
Jun 11 19:43:05.622912 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:05.622843    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59b78ee4-f5da-4dcc-859d-9b4f99a7e718-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g\" (UID: \"59b78ee4-f5da-4dcc-859d-9b4f99a7e718\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g"
Jun 11 19:43:05.622912 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:05.622859    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59b78ee4-f5da-4dcc-859d-9b4f99a7e718-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g\" (UID: \"59b78ee4-f5da-4dcc-859d-9b4f99a7e718\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g"
Jun 11 19:43:05.624929 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:05.624907    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59b78ee4-f5da-4dcc-859d-9b4f99a7e718-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g\" (UID: \"59b78ee4-f5da-4dcc-859d-9b4f99a7e718\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g"
Jun 11 19:43:05.625104 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:05.625087    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59b78ee4-f5da-4dcc-859d-9b4f99a7e718-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g\" (UID: \"59b78ee4-f5da-4dcc-859d-9b4f99a7e718\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g"
Jun 11 19:43:05.629762 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:05.629739    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq5vd\" (UniqueName: \"kubernetes.io/projected/59b78ee4-f5da-4dcc-859d-9b4f99a7e718-kube-api-access-zq5vd\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g\" (UID: \"59b78ee4-f5da-4dcc-859d-9b4f99a7e718\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g"
Jun 11 19:43:05.742795 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:05.742758    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g"
Jun 11 19:43:05.880080 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:05.880046    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g"]
Jun 11 19:43:05.882374 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:43:05.882331    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59b78ee4_f5da_4dcc_859d_9b4f99a7e718.slice/crio-4a67539052d37d37a7ef4c98120c2518941f0d6c90a6268f4d625664440655c4 WatchSource:0}: Error finding container 4a67539052d37d37a7ef4c98120c2518941f0d6c90a6268f4d625664440655c4: Status 404 returned error can't find the container with id 4a67539052d37d37a7ef4c98120c2518941f0d6c90a6268f4d625664440655c4
Jun 11 19:43:06.103725 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:06.103641    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g" event={"ID":"59b78ee4-f5da-4dcc-859d-9b4f99a7e718","Type":"ContainerStarted","Data":"fdbf11ccdad9df4c690e6f9e5e2a8c0518b092e6a1192707df2fdcb0b16897fd"}
Jun 11 19:43:06.103725 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:06.103697    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g" event={"ID":"59b78ee4-f5da-4dcc-859d-9b4f99a7e718","Type":"ContainerStarted","Data":"4a67539052d37d37a7ef4c98120c2518941f0d6c90a6268f4d625664440655c4"}
Jun 11 19:43:08.115828 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:08.115788    2565 generic.go:356] "Generic (PLEG): container finished" podID="59b78ee4-f5da-4dcc-859d-9b4f99a7e718" containerID="fdbf11ccdad9df4c690e6f9e5e2a8c0518b092e6a1192707df2fdcb0b16897fd" exitCode=0
Jun 11 19:43:08.116258 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:08.115856    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g" event={"ID":"59b78ee4-f5da-4dcc-859d-9b4f99a7e718","Type":"ContainerDied","Data":"fdbf11ccdad9df4c690e6f9e5e2a8c0518b092e6a1192707df2fdcb0b16897fd"}
Jun 11 19:43:08.116558 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:08.116541    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 11 19:43:10.127272 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:10.127231    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g" event={"ID":"59b78ee4-f5da-4dcc-859d-9b4f99a7e718","Type":"ContainerStarted","Data":"2e7d22085cb52f48badca97cd91905333d95c59c14d81451a731bc9b318d1012"}
Jun 11 19:43:10.146550 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:10.146492    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g" podStartSLOduration=2.8357650960000003 podStartE2EDuration="5.146477811s" totalImagesPullingTime="1.031487041s" totalInitContainerRuntime="1.279225674s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:43:10.146208324 +0000 UTC m=+1025.550124431" watchObservedRunningTime="2026-06-11 19:43:10.146477811 +0000 UTC m=+1025.550393957"
Jun 11 19:43:15.743611 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:15.743570    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g"
Jun 11 19:43:15.744051 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:15.743637    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g"
Jun 11 19:43:15.756566 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:15.756538    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g"
Jun 11 19:43:16.166620 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:16.166545    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g"
Jun 11 19:43:28.934546 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:28.934499    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-fstb9"]
Jun 11 19:43:28.938503 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:28.938478    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fstb9"
Jun 11 19:43:28.941050 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:28.941024    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jun 11 19:43:28.948292 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:28.948263    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-fstb9"]
Jun 11 19:43:29.027610 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:29.027567    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55c5ac5e-ed62-4251-923c-b57c781b903c-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fstb9\" (UID: \"55c5ac5e-ed62-4251-923c-b57c781b903c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fstb9"
Jun 11 19:43:29.027804 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:29.027633    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vc9x\" (UniqueName: \"kubernetes.io/projected/55c5ac5e-ed62-4251-923c-b57c781b903c-kube-api-access-8vc9x\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fstb9\" (UID: \"55c5ac5e-ed62-4251-923c-b57c781b903c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fstb9"
Jun 11 19:43:29.027804 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:29.027669    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/55c5ac5e-ed62-4251-923c-b57c781b903c-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fstb9\" (UID: \"55c5ac5e-ed62-4251-923c-b57c781b903c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fstb9"
Jun 11 19:43:29.027804 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:29.027697    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55c5ac5e-ed62-4251-923c-b57c781b903c-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fstb9\" (UID: \"55c5ac5e-ed62-4251-923c-b57c781b903c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fstb9"
Jun 11 19:43:29.027804 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:29.027740    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55c5ac5e-ed62-4251-923c-b57c781b903c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fstb9\" (UID: \"55c5ac5e-ed62-4251-923c-b57c781b903c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fstb9"
Jun 11 19:43:29.028016 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:29.027827    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55c5ac5e-ed62-4251-923c-b57c781b903c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fstb9\" (UID: \"55c5ac5e-ed62-4251-923c-b57c781b903c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fstb9"
Jun 11 19:43:29.128688 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:29.128641    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vc9x\" (UniqueName: \"kubernetes.io/projected/55c5ac5e-ed62-4251-923c-b57c781b903c-kube-api-access-8vc9x\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fstb9\" (UID: \"55c5ac5e-ed62-4251-923c-b57c781b903c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fstb9"
Jun 11 19:43:29.128935 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:29.128697    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/55c5ac5e-ed62-4251-923c-b57c781b903c-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fstb9\" (UID: \"55c5ac5e-ed62-4251-923c-b57c781b903c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fstb9"
Jun 11 19:43:29.128935 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:29.128911    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55c5ac5e-ed62-4251-923c-b57c781b903c-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fstb9\" (UID: \"55c5ac5e-ed62-4251-923c-b57c781b903c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fstb9"
Jun 11 19:43:29.129085 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:29.128973    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55c5ac5e-ed62-4251-923c-b57c781b903c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fstb9\" (UID: \"55c5ac5e-ed62-4251-923c-b57c781b903c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fstb9"
Jun 11 19:43:29.129085 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:29.129017    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55c5ac5e-ed62-4251-923c-b57c781b903c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fstb9\" (UID: \"55c5ac5e-ed62-4251-923c-b57c781b903c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fstb9"
Jun 11 19:43:29.129188 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:29.129123    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55c5ac5e-ed62-4251-923c-b57c781b903c-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fstb9\" (UID: \"55c5ac5e-ed62-4251-923c-b57c781b903c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fstb9"
Jun 11 19:43:29.129188 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:29.129158    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/55c5ac5e-ed62-4251-923c-b57c781b903c-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fstb9\" (UID: \"55c5ac5e-ed62-4251-923c-b57c781b903c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fstb9"
Jun 11 19:43:29.129270 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:29.129251    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55c5ac5e-ed62-4251-923c-b57c781b903c-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fstb9\" (UID: \"55c5ac5e-ed62-4251-923c-b57c781b903c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fstb9"
Jun 11 19:43:29.129306 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:29.129268    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55c5ac5e-ed62-4251-923c-b57c781b903c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fstb9\" (UID: \"55c5ac5e-ed62-4251-923c-b57c781b903c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fstb9"
Jun 11 19:43:29.131494 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:29.131467    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55c5ac5e-ed62-4251-923c-b57c781b903c-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fstb9\" (UID: \"55c5ac5e-ed62-4251-923c-b57c781b903c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fstb9"
Jun 11 19:43:29.131823 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:29.131806    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55c5ac5e-ed62-4251-923c-b57c781b903c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fstb9\" (UID: \"55c5ac5e-ed62-4251-923c-b57c781b903c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fstb9"
Jun 11 19:43:29.137002 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:29.136979    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vc9x\" (UniqueName: \"kubernetes.io/projected/55c5ac5e-ed62-4251-923c-b57c781b903c-kube-api-access-8vc9x\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-fstb9\" (UID: \"55c5ac5e-ed62-4251-923c-b57c781b903c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fstb9"
Jun 11 19:43:29.251000 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:29.250955    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fstb9"
Jun 11 19:43:29.389356 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:29.389330    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-fstb9"]
Jun 11 19:43:29.391471 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:43:29.391442    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55c5ac5e_ed62_4251_923c_b57c781b903c.slice/crio-86a6824db75cf625fb9cd9f2c075f28d9295a125c942a6c3416a71b75485fe40 WatchSource:0}: Error finding container 86a6824db75cf625fb9cd9f2c075f28d9295a125c942a6c3416a71b75485fe40: Status 404 returned error can't find the container with id 86a6824db75cf625fb9cd9f2c075f28d9295a125c942a6c3416a71b75485fe40
Jun 11 19:43:30.221963 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:30.221923    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fstb9" event={"ID":"55c5ac5e-ed62-4251-923c-b57c781b903c","Type":"ContainerStarted","Data":"244d4c66233764428df2f25e689146526c38c2ea6cd0b9145d5ac6f9d414bc76"}
Jun 11 19:43:30.222452 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:30.221995    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-fstb9" event={"ID":"55c5ac5e-ed62-4251-923c-b57c781b903c","Type":"ContainerStarted","Data":"86a6824db75cf625fb9cd9f2c075f28d9295a125c942a6c3416a71b75485fe40"}
Jun 11 19:43:49.310835 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:49.310742    2565 generic.go:356] "Generic (PLEG): container finished" podID="dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f" containerID="54a1f40a5036ca34abebfa2eb83aef6f976453f1c1a66b87047bd5012b032bd1" exitCode=0
Jun 11 19:43:49.310835 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:49.310818    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh" event={"ID":"dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f","Type":"ContainerDied","Data":"54a1f40a5036ca34abebfa2eb83aef6f976453f1c1a66b87047bd5012b032bd1"}
Jun 11 19:43:50.322286 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:50.322247    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh" event={"ID":"dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f","Type":"ContainerStarted","Data":"81af1575ceff3b0a9615a3e7f3ac91bc7ea958dd061ec4087a9788eecf6a298c"}
Jun 11 19:43:50.341507 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:50.341449    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh" podStartSLOduration=1.9958149010000001 podStartE2EDuration="1m0.341434454s" totalImagesPullingTime="4.120108247s" totalInitContainerRuntime="54.225511306s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:42:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:43:50.339224984 +0000 UTC m=+1065.743141093" watchObservedRunningTime="2026-06-11 19:43:50.341434454 +0000 UTC m=+1065.745350560"
Jun 11 19:43:50.674751 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:50.674661    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh"
Jun 11 19:43:50.674751 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:50.674729    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh"
Jun 11 19:43:50.687210 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:50.687180    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh"
Jun 11 19:43:51.338528 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:51.338500    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh"
Jun 11 19:43:56.514267 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:56.514184    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf"]
Jun 11 19:43:56.518932 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:56.518906    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf"
Jun 11 19:43:56.521315 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:56.521293    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jun 11 19:43:56.525386 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:56.525352    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf"]
Jun 11 19:43:56.675872 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:56.675827    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w5tz\" (UniqueName: \"kubernetes.io/projected/4c935721-aa31-4a55-bd8e-238069884009-kube-api-access-6w5tz\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-f9ztf\" (UID: \"4c935721-aa31-4a55-bd8e-238069884009\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf"
Jun 11 19:43:56.675872 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:56.675875    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c935721-aa31-4a55-bd8e-238069884009-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-f9ztf\" (UID: \"4c935721-aa31-4a55-bd8e-238069884009\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf"
Jun 11 19:43:56.676160 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:56.676011    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c935721-aa31-4a55-bd8e-238069884009-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-f9ztf\" (UID: \"4c935721-aa31-4a55-bd8e-238069884009\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf"
Jun 11 19:43:56.676160 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:56.676081    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c935721-aa31-4a55-bd8e-238069884009-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-f9ztf\" (UID: \"4c935721-aa31-4a55-bd8e-238069884009\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf"
Jun 11 19:43:56.676160 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:56.676139    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4c935721-aa31-4a55-bd8e-238069884009-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-f9ztf\" (UID: \"4c935721-aa31-4a55-bd8e-238069884009\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf"
Jun 11 19:43:56.676286 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:56.676210    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c935721-aa31-4a55-bd8e-238069884009-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-f9ztf\" (UID: \"4c935721-aa31-4a55-bd8e-238069884009\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf"
Jun 11 19:43:56.777515 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:56.777418    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c935721-aa31-4a55-bd8e-238069884009-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-f9ztf\" (UID: \"4c935721-aa31-4a55-bd8e-238069884009\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf"
Jun 11 19:43:56.777515 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:56.777502    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w5tz\" (UniqueName: \"kubernetes.io/projected/4c935721-aa31-4a55-bd8e-238069884009-kube-api-access-6w5tz\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-f9ztf\" (UID: \"4c935721-aa31-4a55-bd8e-238069884009\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf"
Jun 11 19:43:56.777752 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:56.777531    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c935721-aa31-4a55-bd8e-238069884009-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-f9ztf\" (UID: \"4c935721-aa31-4a55-bd8e-238069884009\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf"
Jun 11 19:43:56.777752 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:56.777566    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c935721-aa31-4a55-bd8e-238069884009-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-f9ztf\" (UID: \"4c935721-aa31-4a55-bd8e-238069884009\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf"
Jun 11 19:43:56.777752 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:56.777701    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c935721-aa31-4a55-bd8e-238069884009-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-f9ztf\" (UID: \"4c935721-aa31-4a55-bd8e-238069884009\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf"
Jun 11 19:43:56.777947 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:56.777782    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4c935721-aa31-4a55-bd8e-238069884009-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-f9ztf\" (UID: \"4c935721-aa31-4a55-bd8e-238069884009\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf"
Jun 11 19:43:56.778110 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:56.778083    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c935721-aa31-4a55-bd8e-238069884009-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-f9ztf\" (UID: \"4c935721-aa31-4a55-bd8e-238069884009\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf"
Jun 11 19:43:56.778271 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:56.778244    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4c935721-aa31-4a55-bd8e-238069884009-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-f9ztf\" (UID: \"4c935721-aa31-4a55-bd8e-238069884009\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf"
Jun 11 19:43:56.778534 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:56.778117    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c935721-aa31-4a55-bd8e-238069884009-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-f9ztf\" (UID: \"4c935721-aa31-4a55-bd8e-238069884009\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf"
Jun 11 19:43:56.780058 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:56.780038    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c935721-aa31-4a55-bd8e-238069884009-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-f9ztf\" (UID: \"4c935721-aa31-4a55-bd8e-238069884009\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf"
Jun 11 19:43:56.780483 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:56.780466    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c935721-aa31-4a55-bd8e-238069884009-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-f9ztf\" (UID: \"4c935721-aa31-4a55-bd8e-238069884009\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf"
Jun 11 19:43:56.786164 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:56.786143    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w5tz\" (UniqueName: \"kubernetes.io/projected/4c935721-aa31-4a55-bd8e-238069884009-kube-api-access-6w5tz\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-f9ztf\" (UID: \"4c935721-aa31-4a55-bd8e-238069884009\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf"
Jun 11 19:43:56.831061 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:56.831024    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf"
Jun 11 19:43:56.970795 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:56.970768    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf"]
Jun 11 19:43:56.972813 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:43:56.972774    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c935721_aa31_4a55_bd8e_238069884009.slice/crio-0db2176ced09af47d2c84cbbac16abdf7784b974104667515771aa293a0516ca WatchSource:0}: Error finding container 0db2176ced09af47d2c84cbbac16abdf7784b974104667515771aa293a0516ca: Status 404 returned error can't find the container with id 0db2176ced09af47d2c84cbbac16abdf7784b974104667515771aa293a0516ca
Jun 11 19:43:57.359318 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:57.359227    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf" event={"ID":"4c935721-aa31-4a55-bd8e-238069884009","Type":"ContainerStarted","Data":"2c8775cc3aef65bb570d3bc213ab745772b1aa97474aeb0e13c74694bb41cdc7"}
Jun 11 19:43:57.359318 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:43:57.359275    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf" event={"ID":"4c935721-aa31-4a55-bd8e-238069884009","Type":"ContainerStarted","Data":"0db2176ced09af47d2c84cbbac16abdf7784b974104667515771aa293a0516ca"}
Jun 11 19:44:05.397819 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:44:05.397779    2565 generic.go:356] "Generic (PLEG): container finished" podID="4c935721-aa31-4a55-bd8e-238069884009" containerID="2c8775cc3aef65bb570d3bc213ab745772b1aa97474aeb0e13c74694bb41cdc7" exitCode=0
Jun 11 19:44:05.398242 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:44:05.397838    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf" event={"ID":"4c935721-aa31-4a55-bd8e-238069884009","Type":"ContainerDied","Data":"2c8775cc3aef65bb570d3bc213ab745772b1aa97474aeb0e13c74694bb41cdc7"}
Jun 11 19:44:06.404020 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:44:06.403986    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf" event={"ID":"4c935721-aa31-4a55-bd8e-238069884009","Type":"ContainerStarted","Data":"c699d79f77c7542f2c328d7816db0f4f957475e5a3a4570db8442470d4731530"}
Jun 11 19:44:06.422418 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:44:06.422369    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf" podStartSLOduration=1.832834485 podStartE2EDuration="10.422352778s" totalImagesPullingTime="262.588295ms" totalInitContainerRuntime="8.326929998s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:43:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:44:06.421102383 +0000 UTC m=+1081.825018492" watchObservedRunningTime="2026-06-11 19:44:06.422352778 +0000 UTC m=+1081.826268884"
Jun 11 19:44:06.831337 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:44:06.831284    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf"
Jun 11 19:44:06.831531 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:44:06.831382    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf"
Jun 11 19:44:06.843987 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:44:06.843955    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf"
Jun 11 19:44:07.419768 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:44:07.419730    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-f9ztf"
Jun 11 19:46:05.098197 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:46:05.098166    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2n72_b609134f-0739-46f3-966e-cc2c63aabe24/ovn-acl-logging/0.log"
Jun 11 19:46:05.099938 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:46:05.099917    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n2n72_b609134f-0739-46f3-966e-cc2c63aabe24/ovn-acl-logging/0.log"
Jun 11 19:47:47.178926 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:47:47.178870    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-fstb9_55c5ac5e-ed62-4251-923c-b57c781b903c/storage-initializer/0.log"
Jun 11 19:47:52.610077 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:47:52.610044    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-56b4d94d65-dzfms_22680655-940c-491d-9ccb-62f767c2931f/nginx/0.log"
Jun 11 19:47:52.851325 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:47:52.851286    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-nrzzr_76771886-5493-4fa4-81ea-0809feae2960/manager/0.log"
Jun 11 19:47:52.972043 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:47:52.972009    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-4rnlt_8eaabbf0-020a-4eb8-b1ea-f8b687e106d4/manager/0.log"
Jun 11 19:47:53.082150 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:47:53.082107    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-556f4b589f-r8frl_9e25c137-2d1e-4d4a-962e-ba6aa6a04ece/maas-api/0.log"
Jun 11 19:47:53.309336 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:47:53.309254    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7cdd58fdb4-xjlrs_9ce7a838-5577-49c0-b055-27f27bc51b8e/manager/0.log"
Jun 11 19:47:53.425445 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:47:53.425415    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-hn6jq_7040120a-2e1c-4060-9f7b-4dd0b5960dbf/server/0.log"
Jun 11 19:47:53.542933 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:47:53.542896    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-9b2s9_c6432892-1948-4a58-8e0a-ba4f17aef5db/manager/0.log"
Jun 11 19:47:53.656630 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:47:53.656534    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c94886895-5j8q6_fdbaa159-7c00-40ad-ad77-b2b18e41b6fa/copy-manifests/0.log"
Jun 11 19:47:53.674102 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:47:53.674067    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c94886895-5j8q6_fdbaa159-7c00-40ad-ad77-b2b18e41b6fa/manager/0.log"
Jun 11 19:47:54.033667 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:47:54.033639    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-mfs8q_14faa7c0-980a-4fb7-a0c6-4b5740698423/postgres/0.log"
Jun 11 19:47:55.418470 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:47:55.418429    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ffbrz_eeccc434-9a6f-47be-acac-f9dc52558b7c/manager/0.log"
Jun 11 19:47:56.569155 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:47:56.569107    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-gc5tn_8e24c47c-a518-4958-9bc2-9b98a846d9df/discovery/0.log"
Jun 11 19:47:56.789961 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:47:56.789929    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b4bf4958f-cfv95_08d3362e-7a8e-4ac5-b5d8-a74c2c85fe20/kube-auth-proxy/0.log"
Jun 11 19:47:57.015127 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:47:57.015081    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-rjdrt_3a648529-8fad-43b4-8e74-9fc8cb2cb452/payload-pre-processing/0.log"
Jun 11 19:47:57.127713 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:47:57.127679    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-wd7j4_b32b6aba-777f-4683-b008-5cb223085885/payload-processing/0.log"
Jun 11 19:47:57.586487 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:47:57.586452    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh_dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f/storage-initializer/0.log"
Jun 11 19:47:57.594158 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:47:57.594134    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-cwjvh_dcdeefbe-c0b4-4b5f-ad06-d3f1d606e13f/main/0.log"
Jun 11 19:47:57.825446 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:47:57.825412    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g_59b78ee4-f5da-4dcc-859d-9b4f99a7e718/storage-initializer/0.log"
Jun 11 19:47:57.833213 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:47:57.833175    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-86f6g_59b78ee4-f5da-4dcc-859d-9b4f99a7e718/main/0.log"
Jun 11 19:47:58.064221 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:47:58.064186    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-fstb9_55c5ac5e-ed62-4251-923c-b57c781b903c/storage-initializer/0.log"
Jun 11 19:47:58.182245 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:47:58.182211    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-f9ztf_4c935721-aa31-4a55-bd8e-238069884009/storage-initializer/0.log"
Jun 11 19:47:58.190500 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:47:58.190466    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-f9ztf_4c935721-aa31-4a55-bd8e-238069884009/main/0.log"
Jun 11 19:48:05.678262 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:05.678227    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tvlp6_7cd450c3-fc87-48a3-b7ba-617cede6af81/global-pull-secret-syncer/0.log"
Jun 11 19:48:05.784272 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:05.784243    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dcw8t_ae16dd28-35c8-4a34-ad9a-487fe90caabe/konnectivity-agent/0.log"
Jun 11 19:48:05.830206 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:05.830173    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-223.ec2.internal_b11adcad61b3d220a3d5857bba715038/haproxy/0.log"
Jun 11 19:48:09.589774 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:09.589738    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-shw2x_9017ee50-1d8b-4f7e-bd7f-3183b21fc6d3/sail-operator/0.log"
Jun 11 19:48:10.887792 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:10.887747    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ffbrz_eeccc434-9a6f-47be-acac-f9dc52558b7c/manager/0.log"
Jun 11 19:48:13.232124 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:13.232086    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bztkw_fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9/node-exporter/0.log"
Jun 11 19:48:13.252109 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:13.252082    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bztkw_fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9/kube-rbac-proxy/0.log"
Jun 11 19:48:13.269460 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:13.269436    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bztkw_fc7ec0fd-dd9d-4e9b-bd5c-96840eff0fe9/init-textfile/0.log"
Jun 11 19:48:16.397560 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:16.397522    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2hwgs/perf-node-gather-daemonset-rm5bm"]
Jun 11 19:48:16.400801 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:16.400784    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-rm5bm"
Jun 11 19:48:16.403145 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:16.403122    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2hwgs\"/\"default-dockercfg-g8n5m\""
Jun 11 19:48:16.403145 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:16.403130    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2hwgs\"/\"kube-root-ca.crt\""
Jun 11 19:48:16.403324 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:16.403122    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2hwgs\"/\"openshift-service-ca.crt\""
Jun 11 19:48:16.409742 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:16.409718    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2hwgs/perf-node-gather-daemonset-rm5bm"]
Jun 11 19:48:16.473250 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:16.473211    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76fb0570-a715-4dbc-8c94-eb48cdca02df-sys\") pod \"perf-node-gather-daemonset-rm5bm\" (UID: \"76fb0570-a715-4dbc-8c94-eb48cdca02df\") " pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-rm5bm"
Jun 11 19:48:16.473431 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:16.473285    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76fb0570-a715-4dbc-8c94-eb48cdca02df-lib-modules\") pod \"perf-node-gather-daemonset-rm5bm\" (UID: \"76fb0570-a715-4dbc-8c94-eb48cdca02df\") " pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-rm5bm"
Jun 11 19:48:16.473431 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:16.473319    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/76fb0570-a715-4dbc-8c94-eb48cdca02df-podres\") pod \"perf-node-gather-daemonset-rm5bm\" (UID: \"76fb0570-a715-4dbc-8c94-eb48cdca02df\") " pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-rm5bm"
Jun 11 19:48:16.473431 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:16.473337    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/76fb0570-a715-4dbc-8c94-eb48cdca02df-proc\") pod \"perf-node-gather-daemonset-rm5bm\" (UID: \"76fb0570-a715-4dbc-8c94-eb48cdca02df\") " pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-rm5bm"
Jun 11 19:48:16.473431 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:16.473359    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzp2q\" (UniqueName: \"kubernetes.io/projected/76fb0570-a715-4dbc-8c94-eb48cdca02df-kube-api-access-nzp2q\") pod \"perf-node-gather-daemonset-rm5bm\" (UID: \"76fb0570-a715-4dbc-8c94-eb48cdca02df\") " pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-rm5bm"
Jun 11 19:48:16.573978 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:16.573948    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/76fb0570-a715-4dbc-8c94-eb48cdca02df-podres\") pod \"perf-node-gather-daemonset-rm5bm\" (UID: \"76fb0570-a715-4dbc-8c94-eb48cdca02df\") " pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-rm5bm"
Jun 11 19:48:16.574158 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:16.573980    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/76fb0570-a715-4dbc-8c94-eb48cdca02df-proc\") pod \"perf-node-gather-daemonset-rm5bm\" (UID: \"76fb0570-a715-4dbc-8c94-eb48cdca02df\") " pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-rm5bm"
Jun 11 19:48:16.574158 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:16.574010    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzp2q\" (UniqueName: \"kubernetes.io/projected/76fb0570-a715-4dbc-8c94-eb48cdca02df-kube-api-access-nzp2q\") pod \"perf-node-gather-daemonset-rm5bm\" (UID: \"76fb0570-a715-4dbc-8c94-eb48cdca02df\") " pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-rm5bm"
Jun 11 19:48:16.574158 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:16.574067    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76fb0570-a715-4dbc-8c94-eb48cdca02df-sys\") pod \"perf-node-gather-daemonset-rm5bm\" (UID: \"76fb0570-a715-4dbc-8c94-eb48cdca02df\") " pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-rm5bm"
Jun 11 19:48:16.574158 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:16.574092    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/76fb0570-a715-4dbc-8c94-eb48cdca02df-proc\") pod \"perf-node-gather-daemonset-rm5bm\" (UID: \"76fb0570-a715-4dbc-8c94-eb48cdca02df\") " pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-rm5bm"
Jun 11 19:48:16.574158 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:16.574127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76fb0570-a715-4dbc-8c94-eb48cdca02df-lib-modules\") pod \"perf-node-gather-daemonset-rm5bm\" (UID: \"76fb0570-a715-4dbc-8c94-eb48cdca02df\") " pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-rm5bm"
Jun 11 19:48:16.574158 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:16.574110    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/76fb0570-a715-4dbc-8c94-eb48cdca02df-podres\") pod \"perf-node-gather-daemonset-rm5bm\" (UID: \"76fb0570-a715-4dbc-8c94-eb48cdca02df\") " pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-rm5bm"
Jun 11 19:48:16.574366 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:16.574177    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76fb0570-a715-4dbc-8c94-eb48cdca02df-sys\") pod \"perf-node-gather-daemonset-rm5bm\" (UID: \"76fb0570-a715-4dbc-8c94-eb48cdca02df\") " pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-rm5bm"
Jun 11 19:48:16.574366 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:16.574263    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76fb0570-a715-4dbc-8c94-eb48cdca02df-lib-modules\") pod \"perf-node-gather-daemonset-rm5bm\" (UID: \"76fb0570-a715-4dbc-8c94-eb48cdca02df\") " pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-rm5bm"
Jun 11 19:48:16.581604 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:16.581572    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzp2q\" (UniqueName: \"kubernetes.io/projected/76fb0570-a715-4dbc-8c94-eb48cdca02df-kube-api-access-nzp2q\") pod \"perf-node-gather-daemonset-rm5bm\" (UID: \"76fb0570-a715-4dbc-8c94-eb48cdca02df\") " pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-rm5bm"
Jun 11 19:48:16.711932 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:16.711875    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-rm5bm"
Jun 11 19:48:16.846872 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:16.846848    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2hwgs/perf-node-gather-daemonset-rm5bm"]
Jun 11 19:48:16.848759 ip-10-0-140-223 kubenswrapper[2565]: W0611 19:48:16.848728    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod76fb0570_a715_4dbc_8c94_eb48cdca02df.slice/crio-31a0d5ab0023a6adf5549151fca1e72dc8ba4f5e44f7deca2cc00659081bcaff WatchSource:0}: Error finding container 31a0d5ab0023a6adf5549151fca1e72dc8ba4f5e44f7deca2cc00659081bcaff: Status 404 returned error can't find the container with id 31a0d5ab0023a6adf5549151fca1e72dc8ba4f5e44f7deca2cc00659081bcaff
Jun 11 19:48:17.581586 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:17.581543    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-rm5bm" event={"ID":"76fb0570-a715-4dbc-8c94-eb48cdca02df","Type":"ContainerStarted","Data":"914ab38b9cce41f33d5748605c66431cfd60121691fdc6303e4256d279b3d9de"}
Jun 11 19:48:17.582059 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:17.581611    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-rm5bm" event={"ID":"76fb0570-a715-4dbc-8c94-eb48cdca02df","Type":"ContainerStarted","Data":"31a0d5ab0023a6adf5549151fca1e72dc8ba4f5e44f7deca2cc00659081bcaff"}
Jun 11 19:48:17.582059 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:17.581672    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-rm5bm"
Jun 11 19:48:17.597150 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:17.597098    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-rm5bm" podStartSLOduration=1.5970820620000001 podStartE2EDuration="1.597082062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:48:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:48:17.596018604 +0000 UTC m=+1332.999934713" watchObservedRunningTime="2026-06-11 19:48:17.597082062 +0000 UTC m=+1333.000998170"
Jun 11 19:48:18.761114 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:18.761076    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pvmdm_cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086/dns/0.log"
Jun 11 19:48:18.783428 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:18.783396    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pvmdm_cf1c4da8-6e98-4144-8d8a-ac6e7a9ab086/kube-rbac-proxy/0.log"
Jun 11 19:48:18.806301 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:18.806273    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dgnbm_ace36f16-b3ef-4f51-90fc-40d44b9cb8b1/dns-node-resolver/0.log"
Jun 11 19:48:19.423148 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:19.423121    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jxggl_50300198-b698-41ab-a551-04ad9bb274f7/node-ca/0.log"
Jun 11 19:48:20.503775 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:20.503737    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-gc5tn_8e24c47c-a518-4958-9bc2-9b98a846d9df/discovery/0.log"
Jun 11 19:48:20.549611 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:20.549576    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b4bf4958f-cfv95_08d3362e-7a8e-4ac5-b5d8-a74c2c85fe20/kube-auth-proxy/0.log"
Jun 11 19:48:20.597503 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:20.597474    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-rjdrt_3a648529-8fad-43b4-8e74-9fc8cb2cb452/payload-pre-processing/0.log"
Jun 11 19:48:20.621033 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:20.620995    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-wd7j4_b32b6aba-777f-4683-b008-5cb223085885/payload-processing/0.log"
Jun 11 19:48:21.298808 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:21.298778    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cfb5n_21a2f529-95bb-4c15-9a38-d28b5f63cd13/serve-healthcheck-canary/0.log"
Jun 11 19:48:21.974837 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:21.974799    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kf8f7_c835962b-7d4a-4ff3-bd28-8642911c85d9/kube-rbac-proxy/0.log"
Jun 11 19:48:21.994560 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:21.994529    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kf8f7_c835962b-7d4a-4ff3-bd28-8642911c85d9/exporter/0.log"
Jun 11 19:48:22.015380 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:22.015353    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kf8f7_c835962b-7d4a-4ff3-bd28-8642911c85d9/extractor/0.log"
Jun 11 19:48:23.596583 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:23.596553    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2hwgs/perf-node-gather-daemonset-rm5bm"
Jun 11 19:48:24.386131 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:24.386100    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-56b4d94d65-dzfms_22680655-940c-491d-9ccb-62f767c2931f/nginx/0.log"
Jun 11 19:48:24.437661 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:24.437630    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-nrzzr_76771886-5493-4fa4-81ea-0809feae2960/manager/0.log"
Jun 11 19:48:24.485266 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:24.485230    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-4rnlt_8eaabbf0-020a-4eb8-b1ea-f8b687e106d4/manager/0.log"
Jun 11 19:48:24.510294 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:24.510242    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-556f4b589f-r8frl_9e25c137-2d1e-4d4a-962e-ba6aa6a04ece/maas-api/0.log"
Jun 11 19:48:24.566268 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:24.566203    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7cdd58fdb4-xjlrs_9ce7a838-5577-49c0-b055-27f27bc51b8e/manager/0.log"
Jun 11 19:48:24.586842 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:24.586817    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-hn6jq_7040120a-2e1c-4060-9f7b-4dd0b5960dbf/server/0.log"
Jun 11 19:48:24.655215 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:24.655138    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-9b2s9_c6432892-1948-4a58-8e0a-ba4f17aef5db/manager/0.log"
Jun 11 19:48:24.736330 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:24.736290    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c94886895-5j8q6_fdbaa159-7c00-40ad-ad77-b2b18e41b6fa/manager/0.log"
Jun 11 19:48:24.751767 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:24.751738    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c94886895-5j8q6_fdbaa159-7c00-40ad-ad77-b2b18e41b6fa/copy-manifests/0.log"
Jun 11 19:48:24.875840 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:24.875799    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-mfs8q_14faa7c0-980a-4fb7-a0c6-4b5740698423/postgres/0.log"
Jun 11 19:48:31.749765 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:31.749731    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-gc5tn_8e24c47c-a518-4958-9bc2-9b98a846d9df/discovery/0.log"
Jun 11 19:48:31.774374 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:31.774348    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b4bf4958f-cfv95_08d3362e-7a8e-4ac5-b5d8-a74c2c85fe20/kube-auth-proxy/0.log"
Jun 11 19:48:31.804682 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:31.804647    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-rjdrt_3a648529-8fad-43b4-8e74-9fc8cb2cb452/payload-pre-processing/0.log"
Jun 11 19:48:31.821166 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:31.821118    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-wd7j4_b32b6aba-777f-4683-b008-5cb223085885/payload-processing/0.log"
Jun 11 19:48:33.015376 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:33.015342    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-gc5tn_8e24c47c-a518-4958-9bc2-9b98a846d9df/discovery/0.log"
Jun 11 19:48:33.045082 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:33.045049    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b4bf4958f-cfv95_08d3362e-7a8e-4ac5-b5d8-a74c2c85fe20/kube-auth-proxy/0.log"
Jun 11 19:48:33.077441 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:33.077408    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-rjdrt_3a648529-8fad-43b4-8e74-9fc8cb2cb452/payload-pre-processing/0.log"
Jun 11 19:48:33.094945 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:33.094916    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-wd7j4_b32b6aba-777f-4683-b008-5cb223085885/payload-processing/0.log"
Jun 11 19:48:33.964764 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:33.964732    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rllhm_007c0c12-34f6-4d2b-9af7-9b265c041702/kube-multus-additional-cni-plugins/0.log"
Jun 11 19:48:33.986743 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:33.986714    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rllhm_007c0c12-34f6-4d2b-9af7-9b265c041702/egress-router-binary-copy/0.log"
Jun 11 19:48:34.008941 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:34.008909    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rllhm_007c0c12-34f6-4d2b-9af7-9b265c041702/cni-plugins/0.log"
Jun 11 19:48:34.029659 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:34.029625    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rllhm_007c0c12-34f6-4d2b-9af7-9b265c041702/bond-cni-plugin/0.log"
Jun 11 19:48:34.050743 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:34.050714    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rllhm_007c0c12-34f6-4d2b-9af7-9b265c041702/routeoverride-cni/0.log"
Jun 11 19:48:34.071716 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:34.071690    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rllhm_007c0c12-34f6-4d2b-9af7-9b265c041702/whereabouts-cni-bincopy/0.log"
Jun 11 19:48:34.094116 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:34.094082    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rllhm_007c0c12-34f6-4d2b-9af7-9b265c041702/whereabouts-cni/0.log"
Jun 11 19:48:34.157999 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:34.157971    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hzp4x_99c61b60-d4aa-4190-95b4-78bb4bab2c71/kube-multus/0.log"
Jun 11 19:48:34.314803 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:34.314731    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q665k_2dd52262-7f1b-440b-a020-a59da738c3c4/network-metrics-daemon/0.log"
Jun 11 19:48:34.334275 ip-10-0-140-223 kubenswrapper[2565]: I0611 19:48:34.334245    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q665k_2dd52262-7f1b-440b-a020-a59da738c3c4/kube-rbac-proxy/0.log"