Jun 11 11:33:18.452822 ip-10-0-130-170 systemd[1]: Starting Kubernetes Kubelet... Jun 11 11:33:18.894070 ip-10-0-130-170 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 11:33:18.894070 ip-10-0-130-170 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 11:33:18.894070 ip-10-0-130-170 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 11:33:18.894070 ip-10-0-130-170 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 11:33:18.894070 ip-10-0-130-170 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 11:33:18.895261 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.895171 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 11:33:18.899082 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899060 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 11:33:18.899082 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899080 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 11:33:18.899082 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899084 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 11:33:18.899188 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899088 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 11:33:18.899188 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899091 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 11:33:18.899188 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899093 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 11:33:18.899188 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899096 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 11:33:18.899188 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899100 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 11:33:18.899188 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899102 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 11:33:18.899188 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899105 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 11:33:18.899188 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899108 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 11:33:18.899188 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899111 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 11:33:18.899188 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899113 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 11:33:18.899188 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899116 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 11:33:18.899188 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899118 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 11:33:18.899188 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899121 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 11:33:18.899188 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899125 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 11:33:18.899188 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899127 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 11:33:18.899188 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899130 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 11:33:18.899188 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899133 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 11:33:18.899188 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899136 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 11:33:18.899188 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899138 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 11:33:18.899188 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899147 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 11:33:18.899692 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899149 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 11:33:18.899692 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899152 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 11:33:18.899692 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899154 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 11:33:18.899692 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899157 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 11:33:18.899692 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899159 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 11:33:18.899692 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899162 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 11:33:18.899692 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899165 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 11:33:18.899692 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899167 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 11 11:33:18.899692 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899170 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 11:33:18.899692 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899172 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 11:33:18.899692 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899175 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 11:33:18.899692 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899177 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 11:33:18.899692 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899180 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 11:33:18.899692 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899183 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 11:33:18.899692 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899185 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 11:33:18.899692 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899188 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 11:33:18.899692 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899191 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 11:33:18.899692 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899194 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 11:33:18.899692 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899196 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 11:33:18.899692 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899199 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 11:33:18.900343 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899202 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 11:33:18.900343 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899205 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 11:33:18.900343 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899208 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 11:33:18.900343 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899210 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 11:33:18.900343 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899213 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 11:33:18.900343 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899223 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 11:33:18.900343 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899226 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 11:33:18.900343 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899228 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 11:33:18.900343 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899231 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 11:33:18.900343 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899233 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 11:33:18.900343 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899236 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 11:33:18.900343 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899239 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 11:33:18.900343 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899241 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 11:33:18.900343 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899244 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 11:33:18.900343 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899246 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 11:33:18.900343 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899250 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 11:33:18.900343 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899255 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 11:33:18.900343 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899258 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 11:33:18.900343 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899262 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 11:33:18.901138 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899264 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 11:33:18.901138 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899267 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 11:33:18.901138 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899270 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 11:33:18.901138 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899273 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 11:33:18.901138 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899276 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 11:33:18.901138 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899280 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 11:33:18.901138 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899284 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 11:33:18.901138 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899303 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 11:33:18.901138 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899306 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 11:33:18.901138 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899310 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 11:33:18.901138 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899312 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 11:33:18.901138 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899315 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 11:33:18.901138 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899318 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 11:33:18.901138 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899321 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 11:33:18.901138 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899324 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 11:33:18.901138 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899326 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 11:33:18.901138 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899329 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 11:33:18.901138 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899333 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 11:33:18.901138 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899336 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 11:33:18.901677 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899348 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 11:33:18.901677 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899351 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 11:33:18.901677 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899354 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 11:33:18.901677 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899357 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 11:33:18.901677 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899360 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 11:33:18.901677 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899362 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 11:33:18.901677 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899365 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 11:33:18.901677 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899367 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 11:33:18.901677 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899370 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 11:33:18.901677 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899372 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 11:33:18.901677 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899375 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 11:33:18.901677 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899378 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 11:33:18.901677 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899380 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 11:33:18.901677 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899383 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 11:33:18.901677 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899387 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 11:33:18.901677 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899389 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 11:33:18.901677 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899392 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 11:33:18.901677 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.899395 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 11:33:18.901677 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901115 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 11:33:18.901677 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901129 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 11:33:18.902264 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901133 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 11:33:18.902264 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901137 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 11:33:18.902264 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901141 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 11:33:18.902264 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901144 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 11:33:18.902264 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901147 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 11:33:18.902264 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901150 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 11:33:18.902264 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901153 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 11:33:18.902264 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901156 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 11:33:18.902264 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901159 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 11:33:18.902264 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901162 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 11:33:18.902264 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901165 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 11:33:18.902264 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901168 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 11:33:18.902264 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901171 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 11:33:18.902264 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901174 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 11:33:18.902264 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901176 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 11:33:18.902264 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901179 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 11:33:18.902264 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901181 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 11:33:18.902264 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901184 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 11:33:18.902264 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901187 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 11:33:18.902264 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901189 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 11:33:18.902796 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901192 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 11:33:18.902796 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901196 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 11:33:18.902796 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901201 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 11:33:18.902796 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901204 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 11:33:18.902796 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901208 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 11 11:33:18.902796 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901211 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 11:33:18.902796 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901214 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 11:33:18.902796 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901216 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 11:33:18.902796 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901219 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 11:33:18.902796 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901221 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 11:33:18.902796 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901224 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 11:33:18.902796 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901228 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 11:33:18.902796 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901231 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 11:33:18.902796 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901234 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 11:33:18.902796 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901236 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 11:33:18.902796 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901239 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 11:33:18.902796 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901242 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 11:33:18.902796 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901246 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 11:33:18.902796 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901249 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 11:33:18.902796 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901252 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 11:33:18.903295 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901254 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 11:33:18.903295 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901257 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 11:33:18.903295 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901259 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 11:33:18.903295 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901262 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 11:33:18.903295 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901265 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 11:33:18.903295 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901267 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 11:33:18.903295 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901270 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 11:33:18.903295 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901273 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 11:33:18.903295 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901276 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 11:33:18.903295 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901278 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 11:33:18.903295 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901281 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 11:33:18.903295 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901283 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 11:33:18.903295 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901286 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 11:33:18.903295 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901289 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 11:33:18.903295 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901291 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 11:33:18.903295 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901294 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 11:33:18.903295 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901297 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 11:33:18.903295 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901299 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 11:33:18.903295 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901302 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 11:33:18.903295 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901305 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 11:33:18.903806 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901307 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 11:33:18.903806 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901310 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 11:33:18.903806 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901313 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 11:33:18.903806 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901317 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 11:33:18.903806 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901322 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 11:33:18.903806 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901326 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 11:33:18.903806 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901329 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 11:33:18.903806 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901332 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 11:33:18.903806 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901334 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 11:33:18.903806 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901337 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 11:33:18.903806 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901340 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 11:33:18.903806 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901342 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 11:33:18.903806 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901345 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 11:33:18.903806 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901347 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 11:33:18.903806 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901350 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 11:33:18.903806 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901352 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 11:33:18.903806 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901355 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 11:33:18.903806 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901358 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 11:33:18.904247 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901361 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 11:33:18.904247 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901364 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 11:33:18.904247 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901368 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 11:33:18.904247 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901372 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 11:33:18.904247 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901375 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 11:33:18.904247 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901377 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 11:33:18.904247 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901380 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 11:33:18.904247 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901383 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 11:33:18.904247 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901386 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 11:33:18.904247 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901388 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 11:33:18.904247 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901391 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 11:33:18.904247 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901393 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 11:33:18.904247 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901396 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 11:33:18.904247 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901398 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 11:33:18.904247 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901401 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 11:33:18.904247 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901403 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 11:33:18.904247 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901406 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 11:33:18.904247 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901409 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 11:33:18.904247 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901412 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 11:33:18.904247 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901845 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 11:33:18.904771 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901850 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 11:33:18.904771 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901853 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 11:33:18.904771 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901856 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 11:33:18.904771 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901859 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 11:33:18.904771 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901861 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 11:33:18.904771 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901864 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 11:33:18.904771 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901867 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 11:33:18.904771 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901870 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 11:33:18.904771 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901872 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 11:33:18.904771 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901875 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 11:33:18.904771 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901878 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 11:33:18.904771 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901880 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 11:33:18.904771 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901883 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 11:33:18.904771 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901886 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 11:33:18.904771 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901889 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 11:33:18.904771 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901892 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 11:33:18.904771 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901894 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 11:33:18.904771 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901897 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 11:33:18.904771 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901899 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 11:33:18.904771 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901902 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 11:33:18.905283 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901904 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 11:33:18.905283 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901907 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 11:33:18.905283 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901909 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 11:33:18.905283 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901912 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 11:33:18.905283 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901914 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 11:33:18.905283 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901917 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 11:33:18.905283 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901919 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 11:33:18.905283 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901922 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 11:33:18.905283 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901925 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 11:33:18.905283 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901929 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 11:33:18.905283 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901932 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 11:33:18.905283 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901934 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 11 11:33:18.905283 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901937 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 11:33:18.905283 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901939 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 11:33:18.905283 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901942 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 11:33:18.905283 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901945 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 11:33:18.905283 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901947 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 11:33:18.905283 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901950 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 11:33:18.905283 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901953 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 11:33:18.905283 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901955 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 11:33:18.905798 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901959 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 11:33:18.905798 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901961 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 11:33:18.905798 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901963 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 11:33:18.905798 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901966 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 11:33:18.905798 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901968 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 11:33:18.905798 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901971 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 11:33:18.905798 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901974 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 11:33:18.905798 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901976 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 11:33:18.905798 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901979 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 11:33:18.905798 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901984 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 11:33:18.905798 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901987 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 11:33:18.905798 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901990 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 11:33:18.905798 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901993 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 11:33:18.905798 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901995 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 11:33:18.905798 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.901998 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 11:33:18.905798 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902001 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 11:33:18.905798 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902003 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 11:33:18.905798 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902007 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 11:33:18.906258 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902010 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 11:33:18.906258 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902012 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 11:33:18.906258 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902015 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 11:33:18.906258 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902018 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 11:33:18.906258 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902021 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 11:33:18.906258 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902025 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 11:33:18.906258 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902028 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 11:33:18.906258 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902031 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 11:33:18.906258 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902034 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 11:33:18.906258 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902037 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 11:33:18.906258 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902039 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 11:33:18.906258 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902042 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 11:33:18.906258 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902045 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 11:33:18.906258 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902048 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 11:33:18.906258 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902051 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 11:33:18.906258 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902053 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 11:33:18.906258 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902056 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 11:33:18.906258 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902061 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 11:33:18.906258 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902064 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 11:33:18.906787 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902067 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 11:33:18.906787 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902069 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 11:33:18.906787 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902072 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 11:33:18.906787 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902074 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 11:33:18.906787 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902078 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 11:33:18.906787 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902080 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 11:33:18.906787 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902083 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 11:33:18.906787 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902085 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 11:33:18.906787 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902088 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 11:33:18.906787 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902091 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 11:33:18.906787 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902093 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 11:33:18.906787 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902096 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 11:33:18.906787 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902098 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 11:33:18.906787 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902101 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 11:33:18.906787 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902104 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 11:33:18.906787 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902106 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 11:33:18.906787 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902109 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 11:33:18.906787 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902111 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 11:33:18.906787 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902114 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 11:33:18.906787 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902117 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 11:33:18.907284 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902119 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 11:33:18.907284 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902198 2580 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 11:33:18.907284 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902205 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 11:33:18.907284 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902212 2580 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 11:33:18.907284 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902217 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 11:33:18.907284 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902221 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 11:33:18.907284 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902224 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 11:33:18.907284 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902228 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 11:33:18.907284 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902233 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 11:33:18.907284 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902236 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 11:33:18.907284 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902239 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 11:33:18.907284 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902242 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 11:33:18.907284 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902246 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 11:33:18.907284 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902249 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 11:33:18.907284 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902252 2580 flags.go:64] FLAG: --cgroup-root="" Jun 11 11:33:18.907284 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902255 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 11:33:18.907284 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902258 2580 flags.go:64] FLAG: --client-ca-file="" Jun 11 11:33:18.907284 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902263 2580 flags.go:64] FLAG: --cloud-provider="external" Jun 11 11:33:18.907284 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902266 2580 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 11:33:18.907284 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902270 2580 flags.go:64] FLAG: --cluster-domain="" Jun 11 11:33:18.907284 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902274 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 11:33:18.907284 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902277 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 11:33:18.907284 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902280 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 11:33:18.907284 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902284 2580 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 11:33:18.907941 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902291 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 11:33:18.907941 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902295 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 11:33:18.907941 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902298 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 11:33:18.907941 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902302 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 11:33:18.907941 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902305 2580 flags.go:64] FLAG: --contention-profiling="false" Jun 11 11:33:18.907941 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902308 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 11:33:18.907941 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902311 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 11:33:18.907941 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902314 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 11:33:18.907941 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902317 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 11:33:18.907941 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902321 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 11:33:18.907941 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902324 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 11:33:18.907941 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902327 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 11:33:18.907941 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902330 2580 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 11:33:18.907941 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902333 2580 flags.go:64] FLAG: --enable-server="true" Jun 11 11:33:18.907941 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902336 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 11:33:18.907941 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902341 2580 flags.go:64] FLAG: --event-burst="100" Jun 11 11:33:18.907941 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902344 2580 flags.go:64] FLAG: --event-qps="50" Jun 11 11:33:18.907941 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902347 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 11:33:18.907941 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902350 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 11:33:18.907941 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902353 2580 flags.go:64] FLAG: --eviction-hard="" Jun 11 11:33:18.907941 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902357 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 11:33:18.907941 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902360 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 11:33:18.907941 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902364 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 11:33:18.907941 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902367 2580 flags.go:64] FLAG: --eviction-soft="" Jun 11 11:33:18.907941 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902369 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 11:33:18.908565 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902372 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 11:33:18.908565 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902376 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 11:33:18.908565 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902379 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 11:33:18.908565 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902382 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 11:33:18.908565 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902385 2580 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 11:33:18.908565 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902387 2580 flags.go:64] FLAG: --feature-gates="" Jun 11 11:33:18.908565 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902391 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 11:33:18.908565 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902394 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 11:33:18.908565 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902398 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 11:33:18.908565 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902401 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 11:33:18.908565 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902404 2580 flags.go:64] FLAG: --healthz-port="10248" Jun 11 11:33:18.908565 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902407 2580 flags.go:64] FLAG: --help="false" Jun 11 11:33:18.908565 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902410 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-130-170.ec2.internal" Jun 11 11:33:18.908565 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902413 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 11:33:18.908565 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902416 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 11:33:18.908565 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902419 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 11:33:18.908565 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902422 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 11:33:18.908565 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902425 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 11:33:18.908565 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902429 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 11:33:18.908565 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902431 2580 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 11:33:18.908565 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902434 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 11:33:18.908565 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902437 2580 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 11:33:18.908565 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902440 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 11:33:18.909199 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902443 2580 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 11:33:18.909199 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902446 2580 flags.go:64] FLAG: --kube-reserved="" Jun 11 11:33:18.909199 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902448 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 11:33:18.909199 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902451 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 11:33:18.909199 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902454 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 11:33:18.909199 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902457 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 11:33:18.909199 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902460 2580 flags.go:64] FLAG: --lock-file="" Jun 11 11:33:18.909199 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902463 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 11:33:18.909199 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902466 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 11:33:18.909199 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902469 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 11:33:18.909199 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902474 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 11:33:18.909199 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902477 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 11:33:18.909199 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902480 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 11:33:18.909199 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902483 2580 flags.go:64] FLAG: --logging-format="text" Jun 11 11:33:18.909199 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902486 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 11:33:18.909199 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902502 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 11:33:18.909199 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902505 2580 flags.go:64] FLAG: --manifest-url="" Jun 11 11:33:18.909199 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902512 2580 flags.go:64] FLAG: --manifest-url-header="" Jun 11 11:33:18.909199 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902517 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 11:33:18.909199 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902520 2580 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 11:33:18.909199 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902524 2580 flags.go:64] FLAG: --max-pods="110" Jun 11 11:33:18.909199 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902527 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 11:33:18.909199 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902530 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 11:33:18.909199 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902533 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 11:33:18.909199 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902536 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 11:33:18.909852 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902539 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 11:33:18.909852 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902542 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 11:33:18.909852 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902545 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 11:33:18.909852 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902554 2580 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 11:33:18.909852 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902557 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 11:33:18.909852 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902561 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 11:33:18.909852 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902564 2580 flags.go:64] FLAG: --pod-cidr="" Jun 11 11:33:18.909852 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902566 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 11:33:18.909852 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902572 2580 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 11:33:18.909852 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902575 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 11:33:18.909852 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902578 2580 flags.go:64] FLAG: --pods-per-core="0" Jun 11 11:33:18.909852 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902581 2580 flags.go:64] FLAG: --port="10250" Jun 11 11:33:18.909852 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902584 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 11:33:18.909852 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902587 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-069d7852c668bc4e9" Jun 11 11:33:18.909852 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902590 2580 flags.go:64] FLAG: --qos-reserved="" Jun 11 11:33:18.909852 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902593 2580 flags.go:64] FLAG: --read-only-port="10255" Jun 11 11:33:18.909852 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902596 2580 flags.go:64] FLAG: --register-node="true" Jun 11 11:33:18.909852 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902599 2580 flags.go:64] FLAG: --register-with-taints="" Jun 11 11:33:18.909852 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902603 2580 flags.go:64] FLAG: --registry-burst="10" Jun 11 11:33:18.909852 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902607 2580 flags.go:64] FLAG: --registry-qps="5" Jun 11 11:33:18.909852 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902610 2580 flags.go:64] FLAG: --reserved-cpus="" Jun 11 11:33:18.909852 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902613 2580 flags.go:64] FLAG: --reserved-memory="" Jun 11 11:33:18.909852 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902616 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 11:33:18.909852 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902619 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 11:33:18.909852 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902622 2580 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 11:33:18.910463 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902626 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 11:33:18.910463 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902629 2580 flags.go:64] FLAG: --runonce="false" Jun 11 11:33:18.910463 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902632 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 11:33:18.910463 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902635 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 11:33:18.910463 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902638 2580 flags.go:64] FLAG: --seccomp-default="false" Jun 11 11:33:18.910463 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902641 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 11:33:18.910463 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902644 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 11:33:18.910463 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902647 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 11:33:18.910463 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902650 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 11:33:18.910463 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902653 2580 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 11:33:18.910463 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902657 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 11:33:18.910463 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902660 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 11:33:18.910463 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902662 2580 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 11:33:18.910463 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902665 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 11:33:18.910463 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902669 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 11:33:18.910463 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902671 2580 flags.go:64] FLAG: --system-cgroups="" Jun 11 11:33:18.910463 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902675 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 11:33:18.910463 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902680 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 11:33:18.910463 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902683 2580 flags.go:64] FLAG: --tls-cert-file="" Jun 11 11:33:18.910463 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902686 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 11:33:18.910463 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902689 2580 flags.go:64] FLAG: --tls-min-version="" Jun 11 11:33:18.910463 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902692 2580 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 11:33:18.910463 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902695 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 11:33:18.910463 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902698 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 11:33:18.910463 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902701 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 11:33:18.911096 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902704 2580 flags.go:64] FLAG: --v="2" Jun 11 11:33:18.911096 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902707 2580 flags.go:64] FLAG: --version="false" Jun 11 11:33:18.911096 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902712 2580 flags.go:64] FLAG: --vmodule="" Jun 11 11:33:18.911096 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902716 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 11:33:18.911096 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.902719 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 11:33:18.911096 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902853 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 11:33:18.911096 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902857 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 11:33:18.911096 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902861 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 11:33:18.911096 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902865 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 11:33:18.911096 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902868 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 11:33:18.911096 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902871 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 11:33:18.911096 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902874 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 11:33:18.911096 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902877 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 11:33:18.911096 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902880 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 11:33:18.911096 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902883 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 11:33:18.911096 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902885 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 11:33:18.911096 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902888 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 11:33:18.911096 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902891 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 11:33:18.911096 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902894 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 11:33:18.911096 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902896 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 11:33:18.911096 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902899 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 11:33:18.911633 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902901 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 11:33:18.911633 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902904 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 11:33:18.911633 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902906 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 11:33:18.911633 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902910 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 11:33:18.911633 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902914 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 11:33:18.911633 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902916 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 11:33:18.911633 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902919 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 11:33:18.911633 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902922 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 11:33:18.911633 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902924 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 11:33:18.911633 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902927 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 11:33:18.911633 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902930 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 11:33:18.911633 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902932 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 11:33:18.911633 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902936 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 11:33:18.911633 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902940 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 11:33:18.911633 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902943 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 11:33:18.911633 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902946 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 11:33:18.911633 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902949 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 11:33:18.911633 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902952 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 11:33:18.911633 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902956 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 11:33:18.912106 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902959 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 11:33:18.912106 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902962 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 11:33:18.912106 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902966 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 11:33:18.912106 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902969 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 11:33:18.912106 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902972 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 11:33:18.912106 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902975 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 11:33:18.912106 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902978 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 11:33:18.912106 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902981 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 11:33:18.912106 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902984 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 11:33:18.912106 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902987 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 11:33:18.912106 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902990 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 11:33:18.912106 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902993 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 11:33:18.912106 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902995 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 11:33:18.912106 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.902998 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 11:33:18.912106 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903001 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 11:33:18.912106 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903003 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 11 11:33:18.912106 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903006 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 11:33:18.912106 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903009 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 11:33:18.912106 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903011 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 11:33:18.912666 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903014 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 11:33:18.912666 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903017 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 11:33:18.912666 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903019 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 11:33:18.912666 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903022 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 11:33:18.912666 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903025 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 11:33:18.912666 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903027 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 11:33:18.912666 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903030 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 11:33:18.912666 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903032 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 11:33:18.912666 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903035 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 11:33:18.912666 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903038 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 11:33:18.912666 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903040 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 11:33:18.912666 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903043 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 11:33:18.912666 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903048 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 11:33:18.912666 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903050 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 11:33:18.912666 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903053 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 11:33:18.912666 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903056 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 11:33:18.912666 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903058 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 11:33:18.912666 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903062 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 11:33:18.912666 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903064 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 11:33:18.912666 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903067 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 11:33:18.913159 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903069 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 11:33:18.913159 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903072 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 11:33:18.913159 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903074 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 11:33:18.913159 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903077 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 11:33:18.913159 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903080 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 11:33:18.913159 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903082 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 11:33:18.913159 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903085 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 11:33:18.913159 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903087 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 11:33:18.913159 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903090 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 11:33:18.913159 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903092 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 11:33:18.913159 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903095 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 11:33:18.913159 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903097 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 11:33:18.913159 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903100 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 11:33:18.913159 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903103 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 11:33:18.913159 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903105 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 11:33:18.913159 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903108 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 11:33:18.913159 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903111 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 11:33:18.913159 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903113 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 11:33:18.913159 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903116 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 11:33:18.913159 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903118 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 11:33:18.913669 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903121 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 11:33:18.913669 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903123 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 11:33:18.913669 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903126 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 11:33:18.913669 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903129 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 11:33:18.913669 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.903133 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 11:33:18.913669 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.903888 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 11:33:18.913669 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.910775 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 11:33:18.913669 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.910794 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 11:33:18.913669 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.910811 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 11:33:18.913669 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.910816 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 11:33:18.913669 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910876 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 11:33:18.913669 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910881 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 11:33:18.913669 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910885 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 11:33:18.913669 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910888 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 11:33:18.913669 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910891 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 11:33:18.914057 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910894 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 11:33:18.914057 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910897 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 11:33:18.914057 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910900 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 11:33:18.914057 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910902 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 11:33:18.914057 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910905 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 11:33:18.914057 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910908 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 11 11:33:18.914057 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910910 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 11:33:18.914057 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910913 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 11:33:18.914057 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910916 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 11:33:18.914057 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910918 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 11:33:18.914057 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910921 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 11:33:18.914057 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910924 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 11:33:18.914057 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910926 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 11:33:18.914057 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910929 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 11:33:18.914057 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910932 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 11:33:18.914057 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910934 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 11:33:18.914057 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910937 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 11:33:18.914057 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910940 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 11:33:18.914057 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910942 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 11:33:18.914057 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910949 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 11:33:18.914559 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910952 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 11:33:18.914559 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910955 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 11:33:18.914559 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910957 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 11:33:18.914559 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910960 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 11:33:18.914559 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910963 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 11:33:18.914559 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910966 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 11:33:18.914559 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910969 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 11:33:18.914559 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910972 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 11:33:18.914559 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910975 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 11:33:18.914559 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910978 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 11:33:18.914559 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910980 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 11:33:18.914559 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910983 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 11:33:18.914559 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910985 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 11:33:18.914559 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910988 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 11:33:18.914559 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910990 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 11:33:18.914559 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910993 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 11:33:18.914559 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910996 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 11:33:18.914559 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.910998 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 11:33:18.914559 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911001 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 11:33:18.914559 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911004 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 11:33:18.915085 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911006 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 11:33:18.915085 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911009 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 11:33:18.915085 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911011 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 11:33:18.915085 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911014 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 11:33:18.915085 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911016 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 11:33:18.915085 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911019 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 11:33:18.915085 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911022 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 11:33:18.915085 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911024 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 11:33:18.915085 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911027 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 11:33:18.915085 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911029 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 11:33:18.915085 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911032 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 11:33:18.915085 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911035 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 11:33:18.915085 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911042 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 11:33:18.915085 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911045 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 11:33:18.915085 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911049 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 11:33:18.915085 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911053 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 11:33:18.915085 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911056 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 11:33:18.915085 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911060 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 11:33:18.915085 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911063 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 11:33:18.915572 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911066 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 11:33:18.915572 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911069 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 11:33:18.915572 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911071 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 11:33:18.915572 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911074 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 11:33:18.915572 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911077 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 11:33:18.915572 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911080 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 11:33:18.915572 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911083 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 11:33:18.915572 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911086 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 11:33:18.915572 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911088 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 11:33:18.915572 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911091 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 11:33:18.915572 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911094 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 11:33:18.915572 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911096 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 11:33:18.915572 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911100 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 11:33:18.915572 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911102 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 11:33:18.915572 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911105 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 11:33:18.915572 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911108 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 11:33:18.915572 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911111 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 11:33:18.915572 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911114 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 11:33:18.915572 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911116 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 11:33:18.915572 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911119 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 11:33:18.916068 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911121 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 11:33:18.916068 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911124 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 11:33:18.916068 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911127 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 11:33:18.916068 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911130 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 11:33:18.916068 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911133 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 11:33:18.916068 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911136 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 11:33:18.916068 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911139 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 11:33:18.916068 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911141 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 11:33:18.916068 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911144 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 11:33:18.916068 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911148 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 11:33:18.916068 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911151 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 11:33:18.916068 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911155 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 11:33:18.916068 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911158 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 11:33:18.916068 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911161 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 11:33:18.916068 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911164 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 11:33:18.916442 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.911169 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 11:33:18.916442 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911293 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 11:33:18.916442 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911297 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 11:33:18.916442 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911300 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 11:33:18.916442 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911304 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 11:33:18.916442 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911307 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 11:33:18.916442 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911310 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 11:33:18.916442 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911314 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 11:33:18.916442 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911317 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 11:33:18.916442 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911320 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 11:33:18.916442 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911322 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 11:33:18.916442 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911325 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 11:33:18.916442 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911328 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 11:33:18.916442 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911331 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 11:33:18.916442 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911334 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 11:33:18.916901 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911336 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 11:33:18.916901 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911339 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 11:33:18.916901 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911341 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 11:33:18.916901 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911344 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 11:33:18.916901 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911347 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 11:33:18.916901 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911349 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 11:33:18.916901 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911352 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 11:33:18.916901 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911354 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 11:33:18.916901 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911357 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 11:33:18.916901 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911363 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 11:33:18.916901 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911366 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 11:33:18.916901 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911369 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 11:33:18.916901 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911371 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 11:33:18.916901 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911374 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 11 11:33:18.916901 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911377 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 11:33:18.916901 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911379 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 11:33:18.916901 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911382 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 11:33:18.916901 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911384 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 11:33:18.916901 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911387 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 11:33:18.916901 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911389 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 11:33:18.917388 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911392 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 11:33:18.917388 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911395 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 11:33:18.917388 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911397 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 11:33:18.917388 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911400 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 11:33:18.917388 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911402 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 11:33:18.917388 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911405 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 11:33:18.917388 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911407 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 11:33:18.917388 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911410 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 11:33:18.917388 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911412 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 11:33:18.917388 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911415 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 11:33:18.917388 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911418 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 11:33:18.917388 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911420 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 11:33:18.917388 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911422 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 11:33:18.917388 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911425 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 11:33:18.917388 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911428 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 11:33:18.917388 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911430 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 11:33:18.917388 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911433 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 11:33:18.917388 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911435 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 11:33:18.917388 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911438 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 11:33:18.917388 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911440 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 11:33:18.917897 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911443 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 11:33:18.917897 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911446 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 11:33:18.917897 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911454 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 11:33:18.917897 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911457 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 11:33:18.917897 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911460 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 11:33:18.917897 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911463 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 11:33:18.917897 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911465 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 11:33:18.917897 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911468 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 11:33:18.917897 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911470 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 11:33:18.917897 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911474 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 11:33:18.917897 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911478 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 11:33:18.917897 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911481 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 11:33:18.917897 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911484 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 11:33:18.917897 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911502 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 11:33:18.917897 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911506 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 11:33:18.917897 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911509 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 11:33:18.917897 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911512 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 11:33:18.917897 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911514 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 11:33:18.917897 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911517 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 11:33:18.917897 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911520 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 11:33:18.918380 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911522 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 11:33:18.918380 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911525 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 11:33:18.918380 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911527 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 11:33:18.918380 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911530 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 11:33:18.918380 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911533 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 11:33:18.918380 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911536 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 11:33:18.918380 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911538 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 11:33:18.918380 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911542 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 11:33:18.918380 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911546 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 11:33:18.918380 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911549 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 11:33:18.918380 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911551 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 11:33:18.918380 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911554 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 11:33:18.918380 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911557 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 11:33:18.918380 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911560 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 11:33:18.918380 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911564 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 11:33:18.918380 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911573 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 11:33:18.918380 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911577 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 11:33:18.918380 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911580 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 11:33:18.918838 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911583 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 11:33:18.918838 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911586 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 11:33:18.918838 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911589 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 11:33:18.918838 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911591 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 11:33:18.918838 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911594 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 11:33:18.918838 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911596 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 11:33:18.918838 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:18.911599 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 11:33:18.918838 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.911604 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 11:33:18.918838 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.911724 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 11:33:18.918838 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.914021 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 11:33:18.918838 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.915285 2580 server.go:1019] "Starting client certificate rotation" Jun 11 11:33:18.918838 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.915383 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 11:33:18.918838 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.915418 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 11:33:18.918838 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.917907 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 11:33:18.919297 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.919278 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 11:33:18.924967 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.924947 2580 log.go:25] "Validated CRI v1 runtime API" Jun 11 11:33:18.929426 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.929404 2580 log.go:25] "Validated CRI v1 image API" Jun 11 11:33:18.930203 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.930181 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 11:33:18.934458 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.934435 2580 fs.go:135] Filesystem UUIDs: map[23712dea-4840-4119-8c12-834d622edb82:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e3ce38bd-a279-4ee0-bb21-bdb3f59de234:/dev/nvme0n1p4] Jun 11 11:33:18.934556 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.934456 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 11:33:18.939889 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.939763 2580 manager.go:216] Machine: {Timestamp:2026-06-11 11:33:18.938193127 +0000 UTC m=+0.359142905 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099351 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20c2594e2eb34068140a9b9a5a3d4f SystemUUID:ec20c259-4e2e-b340-6814-0a9b9a5a3d4f BootID:c5b1c258-9b52-4e50-89ac-5b7f899fb1e3 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ea:39:47:86:0f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ea:39:47:86:0f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:2c:11:26:b5:93 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 11:33:18.939889 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.939882 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 11:33:18.940027 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.939966 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 11:33:18.944087 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.944054 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 11:33:18.944265 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.944089 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-170.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 11:33:18.944695 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.944673 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 11:33:18.944903 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.944890 2580 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 11:33:18.944903 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.944904 2580 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 11:33:18.944982 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.944913 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 11:33:18.945486 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.945475 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 11:33:18.946358 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.946347 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 11:33:18.949725 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.949710 2580 state_mem.go:36] "Initialized new in-memory state store" Jun 11 11:33:18.949851 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.949841 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 11:33:18.949881 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.949873 2580 kubelet.go:486] "Attempting to sync node with API server" Jun 11 11:33:18.949912 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.949883 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 11:33:18.949912 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.949898 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 11:33:18.949912 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.949913 2580 kubelet.go:398] "Adding apiserver pod source" Jun 11 11:33:18.950007 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.949922 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 11:33:18.950296 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.950285 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 11:33:18.950340 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.950304 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 11:33:18.952673 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.952653 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 11:33:18.954552 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.954535 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 11:33:18.954646 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.954575 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 11:33:18.955753 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.955739 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 11:33:18.955825 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.955761 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 11:33:18.955825 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.955770 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 11:33:18.955825 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.955778 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 11:33:18.955825 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.955791 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 11:33:18.955825 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.955800 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 11:33:18.955825 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.955813 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 11:33:18.955825 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.955821 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 11:33:18.956067 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.955831 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 11:33:18.956067 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.955840 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 11:33:18.956067 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.955863 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 11:33:18.956067 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.955872 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 11:33:18.956664 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.956652 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 11:33:18.956712 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.956667 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 11:33:18.959911 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.959886 2580 server.go:1268] "Started kubelet" Jun 11 11:33:18.960021 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.959996 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 11:33:18.960173 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.959994 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 11:33:18.960238 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.960223 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 11:33:18.960473 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.960440 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-170.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 11:33:18.960473 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:18.960439 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 11:33:18.960473 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:18.960440 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-170.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 11:33:18.961241 ip-10-0-130-170 systemd[1]: Started Kubernetes Kubelet. Jun 11 11:33:18.961634 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.961415 2580 server.go:310] "Adding debug handlers to kubelet server" Jun 11 11:33:18.965657 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.965630 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 11:33:18.968070 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:18.968030 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 11:33:18.970952 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.970848 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sv9nx" Jun 11 11:33:18.971115 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.970955 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 11:33:18.971115 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.970972 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 11:33:18.971274 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:18.971250 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-170.ec2.internal\" not found" Jun 11 11:33:18.971546 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.971529 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 11:33:18.971546 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.971549 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 11:33:18.971648 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.971627 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 11:33:18.971727 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.971714 2580 reconstruct.go:97] "Volume reconstruction finished" Jun 11 11:33:18.971783 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.971727 2580 reconciler.go:29] "Reconciler: start to sync state" Jun 11 11:33:18.972628 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.972610 2580 factory.go:55] Registering systemd factory Jun 11 11:33:18.972736 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.972668 2580 factory.go:223] Registration of the systemd container factory successfully Jun 11 11:33:18.972914 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.972901 2580 factory.go:153] Registering CRI-O factory Jun 11 11:33:18.972975 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.972917 2580 factory.go:223] Registration of the crio container factory successfully Jun 11 11:33:18.972975 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.972965 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 11:33:18.973082 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.972989 2580 factory.go:103] Registering Raw factory Jun 11 11:33:18.973082 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.973003 2580 manager.go:1196] Started watching for new ooms in manager Jun 11 11:33:18.973478 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.973463 2580 manager.go:349] Starting recovery of all containers Jun 11 11:33:18.973601 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:18.972272 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-170.ec2.internal.18b80396d3e2b2b2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-170.ec2.internal,UID:ip-10-0-130-170.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-170.ec2.internal,},FirstTimestamp:2026-06-11 11:33:18.959858354 +0000 UTC m=+0.380808112,LastTimestamp:2026-06-11 11:33:18.959858354 +0000 UTC m=+0.380808112,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-170.ec2.internal,}" Jun 11 11:33:18.975419 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:18.975391 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-170.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 11:33:18.975545 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:18.975522 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 11:33:18.980439 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.980297 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sv9nx" Jun 11 11:33:18.984405 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.984389 2580 manager.go:354] Recovery completed Jun 11 11:33:18.988903 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.988888 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 11:33:18.992076 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.992057 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasSufficientMemory" Jun 11 11:33:18.992174 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.992094 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 11:33:18.992174 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.992133 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasSufficientPID" Jun 11 11:33:18.992750 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.992725 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 11:33:18.992750 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.992737 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 11:33:18.992750 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.992754 2580 state_mem.go:36] "Initialized new in-memory state store" Jun 11 11:33:18.992887 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.992762 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 11:33:18.993462 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.993442 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasSufficientMemory" Jun 11 11:33:18.993574 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.993475 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 11:33:18.993574 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.993514 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasSufficientPID" Jun 11 11:33:18.993947 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.993934 2580 policy_none.go:49] "None policy: Start" Jun 11 11:33:18.993947 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.993950 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 11:33:18.994073 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.993960 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 11:33:18.994268 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:18.994203 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-170.ec2.internal.18b80396d5ce503a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-170.ec2.internal,UID:ip-10-0-130-170.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-170.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-170.ec2.internal,},FirstTimestamp:2026-06-11 11:33:18.992076858 +0000 UTC m=+0.413026619,LastTimestamp:2026-06-11 11:33:18.992076858 +0000 UTC m=+0.413026619,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-170.ec2.internal,}" Jun 11 11:33:18.995015 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:18.995003 2580 policy_none.go:47] "Start" Jun 11 11:33:19.024147 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.024129 2580 manager.go:337] "Starting Device Plugin manager" Jun 11 11:33:19.041794 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:19.024165 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 11:33:19.041794 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.024178 2580 server.go:87] "Starting device plugin registration server" Jun 11 11:33:19.041794 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.024470 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 11:33:19.041794 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.024481 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 11:33:19.041794 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.024607 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 11:33:19.041794 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.024684 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 11:33:19.041794 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.024692 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 11:33:19.041794 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:19.025312 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 11:33:19.041794 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:19.025365 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-170.ec2.internal\" not found" Jun 11 11:33:19.041794 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.037218 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 11:33:19.041794 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.038285 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 11:33:19.041794 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.038321 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 11:33:19.041794 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.038342 2580 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 11:33:19.041794 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:19.038376 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 11:33:19.041794 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.040699 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 11:33:19.124995 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.124958 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 11:33:19.126210 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.126195 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasSufficientMemory" Jun 11 11:33:19.126263 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.126226 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 11:33:19.126263 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.126237 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasSufficientPID" Jun 11 11:33:19.126263 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.126259 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-170.ec2.internal" Jun 11 11:33:19.135023 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.134993 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-170.ec2.internal" Jun 11 11:33:19.135023 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:19.135031 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-170.ec2.internal\": node \"ip-10-0-130-170.ec2.internal\" not found" Jun 11 11:33:19.139178 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.139154 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-170.ec2.internal"] Jun 11 11:33:19.139283 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.139224 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 11:33:19.140027 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.140013 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasSufficientMemory" Jun 11 11:33:19.140083 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.140042 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 11:33:19.140083 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.140051 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasSufficientPID" Jun 11 11:33:19.141281 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.141269 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 11:33:19.141376 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.141364 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal" Jun 11 11:33:19.141415 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.141393 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 11:33:19.141963 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.141936 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasSufficientMemory" Jun 11 11:33:19.142053 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.141976 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 11:33:19.142053 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.141988 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasSufficientPID" Jun 11 11:33:19.142053 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.141947 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasSufficientMemory" Jun 11 11:33:19.142053 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.142040 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 11:33:19.142053 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.142052 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasSufficientPID" Jun 11 11:33:19.143083 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.143070 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-170.ec2.internal" Jun 11 11:33:19.143130 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.143095 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 11:33:19.143756 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.143739 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasSufficientMemory" Jun 11 11:33:19.143835 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.143767 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 11:33:19.143835 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.143777 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasSufficientPID" Jun 11 11:33:19.157657 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:19.157631 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-170.ec2.internal\" not found" Jun 11 11:33:19.172363 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:19.172312 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-170.ec2.internal\" not found" node="ip-10-0-130-170.ec2.internal" Jun 11 11:33:19.176886 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:19.176865 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-170.ec2.internal\" not found" node="ip-10-0-130-170.ec2.internal" Jun 11 11:33:19.258324 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:19.258286 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-170.ec2.internal\" not found" Jun 11 11:33:19.272400 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.272374 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dc002ca7d3da33b34e8a0ef1296388b5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal\" (UID: \"dc002ca7d3da33b34e8a0ef1296388b5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal" Jun 11 11:33:19.272529 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.272430 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc002ca7d3da33b34e8a0ef1296388b5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal\" (UID: \"dc002ca7d3da33b34e8a0ef1296388b5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal" Jun 11 11:33:19.272529 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.272457 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ac99beb55fe5d8ad12db0962dadfdf0d-config\") pod \"kube-apiserver-proxy-ip-10-0-130-170.ec2.internal\" (UID: \"ac99beb55fe5d8ad12db0962dadfdf0d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-170.ec2.internal" Jun 11 11:33:19.358448 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:19.358406 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-170.ec2.internal\" not found" Jun 11 11:33:19.372764 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.372733 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dc002ca7d3da33b34e8a0ef1296388b5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal\" (UID: \"dc002ca7d3da33b34e8a0ef1296388b5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal" Jun 11 11:33:19.372818 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.372767 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc002ca7d3da33b34e8a0ef1296388b5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal\" (UID: \"dc002ca7d3da33b34e8a0ef1296388b5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal" Jun 11 11:33:19.372818 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.372784 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ac99beb55fe5d8ad12db0962dadfdf0d-config\") pod \"kube-apiserver-proxy-ip-10-0-130-170.ec2.internal\" (UID: \"ac99beb55fe5d8ad12db0962dadfdf0d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-170.ec2.internal" Jun 11 11:33:19.372926 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.372832 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ac99beb55fe5d8ad12db0962dadfdf0d-config\") pod \"kube-apiserver-proxy-ip-10-0-130-170.ec2.internal\" (UID: \"ac99beb55fe5d8ad12db0962dadfdf0d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-170.ec2.internal" Jun 11 11:33:19.372926 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.372835 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dc002ca7d3da33b34e8a0ef1296388b5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal\" (UID: \"dc002ca7d3da33b34e8a0ef1296388b5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal" Jun 11 11:33:19.372926 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.372868 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc002ca7d3da33b34e8a0ef1296388b5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal\" (UID: \"dc002ca7d3da33b34e8a0ef1296388b5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal" Jun 11 11:33:19.459235 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:19.459161 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-170.ec2.internal\" not found" Jun 11 11:33:19.476587 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.476560 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal" Jun 11 11:33:19.481272 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.481255 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-170.ec2.internal" Jun 11 11:33:19.560256 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:19.560211 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-170.ec2.internal\" not found" Jun 11 11:33:19.660758 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:19.660722 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-170.ec2.internal\" not found" Jun 11 11:33:19.761291 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:19.761194 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-170.ec2.internal\" not found" Jun 11 11:33:19.799752 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.799722 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 11:33:19.861896 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:19.861859 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-170.ec2.internal\" not found" Jun 11 11:33:19.915337 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.915305 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 11:33:19.916003 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.915506 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 11:33:19.916003 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.915504 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 11:33:19.962444 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:19.962415 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-170.ec2.internal\" not found" Jun 11 11:33:19.984860 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.984818 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 11:28:18 +0000 UTC" deadline="2028-01-24 14:59:38.981217414 +0000 UTC" Jun 11 11:33:19.984860 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:19.984853 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14211h26m18.996366943s" Jun 11 11:33:20.000449 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:20.000409 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac99beb55fe5d8ad12db0962dadfdf0d.slice/crio-d52b7bc57567814b707f0e0ff667c25f90a119336b66696db7b4bcd55cfda805 WatchSource:0}: Error finding container d52b7bc57567814b707f0e0ff667c25f90a119336b66696db7b4bcd55cfda805: Status 404 returned error can't find the container with id d52b7bc57567814b707f0e0ff667c25f90a119336b66696db7b4bcd55cfda805 Jun 11 11:33:20.000636 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:20.000623 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc002ca7d3da33b34e8a0ef1296388b5.slice/crio-1735102e10552ec94f3b343bd1eb977c0352e87cbeeccfc1e7f670ce7f0f8923 WatchSource:0}: Error finding container 1735102e10552ec94f3b343bd1eb977c0352e87cbeeccfc1e7f670ce7f0f8923: Status 404 returned error can't find the container with id 1735102e10552ec94f3b343bd1eb977c0352e87cbeeccfc1e7f670ce7f0f8923 Jun 11 11:33:20.005402 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.005383 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 11:33:20.041703 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.041599 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-170.ec2.internal" event={"ID":"ac99beb55fe5d8ad12db0962dadfdf0d","Type":"ContainerStarted","Data":"d52b7bc57567814b707f0e0ff667c25f90a119336b66696db7b4bcd55cfda805"} Jun 11 11:33:20.042659 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.042639 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal" event={"ID":"dc002ca7d3da33b34e8a0ef1296388b5","Type":"ContainerStarted","Data":"1735102e10552ec94f3b343bd1eb977c0352e87cbeeccfc1e7f670ce7f0f8923"} Jun 11 11:33:20.062903 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:20.062871 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-170.ec2.internal\" not found" Jun 11 11:33:20.163443 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:20.163404 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-170.ec2.internal\" not found" Jun 11 11:33:20.263979 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:20.263947 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-170.ec2.internal\" not found" Jun 11 11:33:20.355292 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.355215 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 11:33:20.364171 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:20.364145 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-170.ec2.internal\" not found" Jun 11 11:33:20.465076 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:20.465039 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-170.ec2.internal\" not found" Jun 11 11:33:20.532308 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.532121 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 11:33:20.571646 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.571614 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal" Jun 11 11:33:20.586066 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.586034 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 11:33:20.587360 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.587338 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-170.ec2.internal" Jun 11 11:33:20.596553 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.596524 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 11:33:20.858266 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.858238 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 11:33:20.950857 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.950820 2580 apiserver.go:52] "Watching apiserver" Jun 11 11:33:20.959205 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.959176 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 11:33:20.959594 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.959568 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-hgvgn","openshift-cluster-node-tuning-operator/tuned-hq2qg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal","openshift-multus/multus-8v8j2","openshift-multus/network-metrics-daemon-fm9jf","openshift-network-diagnostics/network-check-target-cmt44","kube-system/kube-apiserver-proxy-ip-10-0-130-170.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp4mh","openshift-dns/node-resolver-qzsk4","openshift-image-registry/node-ca-248kq","openshift-multus/multus-additional-cni-plugins-5dwmf","openshift-network-operator/iptables-alerter-zjsjx","openshift-ovn-kubernetes/ovnkube-node-nntvz","kube-system/global-pull-secret-syncer-gfgs7"] Jun 11 11:33:20.961026 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.961003 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-248kq" Jun 11 11:33:20.962267 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.962247 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:20.963464 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.963442 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:20.963589 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:20.963547 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfgs7" podUID="93730f02-47c1-4083-b8cb-cb6bcdb611c8" Jun 11 11:33:20.963643 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.963628 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 11:33:20.963812 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.963797 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 11:33:20.963921 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.963905 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 11:33:20.964028 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.964011 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2jl8j\"" Jun 11 11:33:20.964573 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.964549 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 11:33:20.964998 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.964978 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 11:33:20.965084 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.965013 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 11:33:20.965084 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.965047 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 11:33:20.965192 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.965180 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8v8j2" Jun 11 11:33:20.965245 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.965232 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 11:33:20.965303 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.965266 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 11:33:20.965353 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.965332 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ghg6q\"" Jun 11 11:33:20.966282 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.966264 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:33:20.966419 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:20.966395 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm9jf" podUID="ab22f9ba-926c-424d-92ba-70cdae2dbd6e" Jun 11 11:33:20.967401 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.967375 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 11:33:20.967537 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.967458 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-r46qp\"" Jun 11 11:33:20.967537 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.967529 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 11:33:20.967649 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.967632 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 11:33:20.967700 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.967671 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:33:20.967758 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.967676 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 11:33:20.967758 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:20.967735 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmt44" podUID="62cbd6f9-5887-46a3-bb97-9c6eebe11433" Jun 11 11:33:20.968800 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.968768 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qzsk4" Jun 11 11:33:20.970066 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.970049 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp4mh" Jun 11 11:33:20.970841 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.970822 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 11:33:20.970970 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.970954 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 11:33:20.971043 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.971022 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-99c2v\"" Jun 11 11:33:20.971220 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.971204 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 11:33:20.971686 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.971665 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:20.972355 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.972334 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-89gz6\"" Jun 11 11:33:20.972355 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.972363 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 11:33:20.972578 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.972382 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 11:33:20.972578 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.972466 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 11:33:20.972799 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.972778 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hgvgn" Jun 11 11:33:20.973857 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.973764 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 11:33:20.974014 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.973995 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 11:33:20.974082 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.974038 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wqmsw\"" Jun 11 11:33:20.974691 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.974674 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5dwmf" Jun 11 11:33:20.974789 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.974728 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 11:33:20.975439 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.975410 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-v2nmd\"" Jun 11 11:33:20.975540 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.975472 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 11:33:20.976664 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.976648 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zjsjx" Jun 11 11:33:20.977453 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.977428 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rtgmb\"" Jun 11 11:33:20.977563 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.977428 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 11:33:20.977802 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.977785 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 11:33:20.980385 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.980321 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 11:33:20.980603 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.980565 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 11:33:20.981065 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.981015 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 11:33:20.981372 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.981354 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-68xtr\"" Jun 11 11:33:20.981702 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.981678 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-etc-kubernetes\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:20.981793 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.981755 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnkmw\" (UniqueName: \"kubernetes.io/projected/f2b8386f-7ce4-4da0-9810-0ff144fc4739-kube-api-access-vnkmw\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:20.981853 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.981804 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c639b11-0c9c-4385-9ab7-1853aa425911-sys-fs\") pod \"aws-ebs-csi-driver-node-lp4mh\" (UID: \"3c639b11-0c9c-4385-9ab7-1853aa425911\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp4mh" Jun 11 11:33:20.981853 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.981837 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvg9n\" (UniqueName: \"kubernetes.io/projected/3c639b11-0c9c-4385-9ab7-1853aa425911-kube-api-access-rvg9n\") pod \"aws-ebs-csi-driver-node-lp4mh\" (UID: \"3c639b11-0c9c-4385-9ab7-1853aa425911\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp4mh" Jun 11 11:33:20.981953 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.981913 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-log-socket\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:20.981953 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.981947 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f2b8386f-7ce4-4da0-9810-0ff144fc4739-multus-daemon-config\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:20.982054 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.981977 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-etc-modprobe-d\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:20.982054 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.982003 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-etc-sysconfig\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:20.982054 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.982035 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-var-lib-kubelet\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:20.982192 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.982098 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c639b11-0c9c-4385-9ab7-1853aa425911-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lp4mh\" (UID: \"3c639b11-0c9c-4385-9ab7-1853aa425911\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp4mh" Jun 11 11:33:20.982192 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.982158 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9a1ee17d-116a-4dd7-8cb7-5fe10679d13f-host\") pod \"node-ca-248kq\" (UID: \"9a1ee17d-116a-4dd7-8cb7-5fe10679d13f\") " pod="openshift-image-registry/node-ca-248kq" Jun 11 11:33:20.982291 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.982206 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvqjt\" (UniqueName: \"kubernetes.io/projected/9a1ee17d-116a-4dd7-8cb7-5fe10679d13f-kube-api-access-fvqjt\") pod \"node-ca-248kq\" (UID: \"9a1ee17d-116a-4dd7-8cb7-5fe10679d13f\") " pod="openshift-image-registry/node-ca-248kq" Jun 11 11:33:20.982291 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.982275 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-host-kubelet\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:20.982377 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.982297 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-host-cni-bin\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:20.982377 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.982324 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-system-cni-dir\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:20.982377 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.982351 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w4sd\" (UniqueName: \"kubernetes.io/projected/62cbd6f9-5887-46a3-bb97-9c6eebe11433-kube-api-access-7w4sd\") pod \"network-check-target-cmt44\" (UID: \"62cbd6f9-5887-46a3-bb97-9c6eebe11433\") " pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:33:20.982533 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.982379 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpw5x\" (UniqueName: \"kubernetes.io/projected/75580ac2-a186-46af-a5c6-ab8523a85cb0-kube-api-access-rpw5x\") pod \"node-resolver-qzsk4\" (UID: \"75580ac2-a186-46af-a5c6-ab8523a85cb0\") " pod="openshift-dns/node-resolver-qzsk4" Jun 11 11:33:20.982533 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.982408 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9a1ee17d-116a-4dd7-8cb7-5fe10679d13f-serviceca\") pod \"node-ca-248kq\" (UID: \"9a1ee17d-116a-4dd7-8cb7-5fe10679d13f\") " pod="openshift-image-registry/node-ca-248kq" Jun 11 11:33:20.982533 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.982454 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-etc-openvswitch\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:20.982685 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.982546 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-metrics-certs\") pod \"network-metrics-daemon-fm9jf\" (UID: \"ab22f9ba-926c-424d-92ba-70cdae2dbd6e\") " pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:33:20.982685 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.982584 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpncj\" (UniqueName: \"kubernetes.io/projected/21918188-202c-44b2-b12c-c7aa5dcd0cec-kube-api-access-hpncj\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:20.982685 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.982611 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-run-ovn\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:20.982685 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.982640 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-ovnkube-script-lib\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:20.982685 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.982666 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/93730f02-47c1-4083-b8cb-cb6bcdb611c8-kubelet-config\") pod \"global-pull-secret-syncer-gfgs7\" (UID: \"93730f02-47c1-4083-b8cb-cb6bcdb611c8\") " pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:20.982926 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.982694 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-cnibin\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:20.982926 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.982725 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-host-var-lib-kubelet\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:20.982926 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.982758 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/21918188-202c-44b2-b12c-c7aa5dcd0cec-etc-tuned\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:20.982926 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.982788 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-run-systemd\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:20.982926 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.982819 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-run-openvswitch\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:20.982926 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.982848 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-etc-systemd\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:20.983211 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.982932 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a3d40af8-b3e3-4842-b7f3-2d942702a938-konnectivity-ca\") pod \"konnectivity-agent-hgvgn\" (UID: \"a3d40af8-b3e3-4842-b7f3-2d942702a938\") " pod="kube-system/konnectivity-agent-hgvgn" Jun 11 11:33:20.983211 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.983014 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-env-overrides\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:20.983211 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.983045 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-multus-socket-dir-parent\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:20.983211 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.983108 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtpmq\" (UniqueName: \"kubernetes.io/projected/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-kube-api-access-mtpmq\") pod \"network-metrics-daemon-fm9jf\" (UID: \"ab22f9ba-926c-424d-92ba-70cdae2dbd6e\") " pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:33:20.983211 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.983158 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c639b11-0c9c-4385-9ab7-1853aa425911-registration-dir\") pod \"aws-ebs-csi-driver-node-lp4mh\" (UID: \"3c639b11-0c9c-4385-9ab7-1853aa425911\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp4mh" Jun 11 11:33:20.983211 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.983207 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-etc-sysctl-conf\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:20.984703 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.983237 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21918188-202c-44b2-b12c-c7aa5dcd0cec-tmp\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:20.984703 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.983272 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp6c5\" (UniqueName: \"kubernetes.io/projected/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-kube-api-access-bp6c5\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:20.984703 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.983356 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-os-release\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:20.984703 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.983528 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-host-var-lib-cni-multus\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:20.984703 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.983568 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c639b11-0c9c-4385-9ab7-1853aa425911-device-dir\") pod \"aws-ebs-csi-driver-node-lp4mh\" (UID: \"3c639b11-0c9c-4385-9ab7-1853aa425911\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp4mh" Jun 11 11:33:20.984703 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.983599 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-systemd-units\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:20.984703 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.983630 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-host-run-k8s-cni-cncf-io\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:20.984703 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.983655 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-lib-modules\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:20.984703 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.983705 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c639b11-0c9c-4385-9ab7-1853aa425911-socket-dir\") pod \"aws-ebs-csi-driver-node-lp4mh\" (UID: \"3c639b11-0c9c-4385-9ab7-1853aa425911\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp4mh" Jun 11 11:33:20.984703 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.983754 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-var-lib-openvswitch\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:20.984703 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.983782 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-run\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:20.984703 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.983812 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a3d40af8-b3e3-4842-b7f3-2d942702a938-agent-certs\") pod \"konnectivity-agent-hgvgn\" (UID: \"a3d40af8-b3e3-4842-b7f3-2d942702a938\") " pod="kube-system/konnectivity-agent-hgvgn" Jun 11 11:33:20.984703 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.983844 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/75580ac2-a186-46af-a5c6-ab8523a85cb0-hosts-file\") pod \"node-resolver-qzsk4\" (UID: \"75580ac2-a186-46af-a5c6-ab8523a85cb0\") " pod="openshift-dns/node-resolver-qzsk4" Jun 11 11:33:20.984703 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.983922 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-host-run-netns\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:20.984703 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.984003 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-host-run-ovn-kubernetes\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:20.984703 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.984051 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-host-cni-netd\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:20.984703 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.984125 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-host-var-lib-cni-bin\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:20.985509 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.984152 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-host-slash\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:20.985509 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.984212 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93730f02-47c1-4083-b8cb-cb6bcdb611c8-original-pull-secret\") pod \"global-pull-secret-syncer-gfgs7\" (UID: \"93730f02-47c1-4083-b8cb-cb6bcdb611c8\") " pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:20.985509 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.984267 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-multus-conf-dir\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:20.985509 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.984317 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:20.985509 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.984373 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-ovnkube-config\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:20.985509 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.984402 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-multus-cni-dir\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:20.985509 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.984445 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2b8386f-7ce4-4da0-9810-0ff144fc4739-cni-binary-copy\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:20.985509 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.984472 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/93730f02-47c1-4083-b8cb-cb6bcdb611c8-dbus\") pod \"global-pull-secret-syncer-gfgs7\" (UID: \"93730f02-47c1-4083-b8cb-cb6bcdb611c8\") " pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:20.985509 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.984531 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-host-run-netns\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:20.985509 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.984672 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-node-log\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:20.985509 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.984709 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75580ac2-a186-46af-a5c6-ab8523a85cb0-tmp-dir\") pod \"node-resolver-qzsk4\" (UID: \"75580ac2-a186-46af-a5c6-ab8523a85cb0\") " pod="openshift-dns/node-resolver-qzsk4" Jun 11 11:33:20.985509 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.984783 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c639b11-0c9c-4385-9ab7-1853aa425911-etc-selinux\") pod \"aws-ebs-csi-driver-node-lp4mh\" (UID: \"3c639b11-0c9c-4385-9ab7-1853aa425911\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp4mh" Jun 11 11:33:20.985509 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.985309 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-etc-kubernetes\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:20.985509 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.985335 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-etc-sysctl-d\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:20.985509 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.985367 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-sys\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:20.985509 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.985388 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-host\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:20.985509 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.985375 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 11:33:20.986392 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.985410 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-ovn-node-metrics-cert\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:20.986392 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.985452 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-hostroot\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:20.986392 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:20.985473 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-host-run-multus-certs\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.008120 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.008099 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nqjtw" Jun 11 11:33:21.026461 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.026433 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nqjtw" Jun 11 11:33:21.072948 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.072915 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 11:33:21.086176 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.086140 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvg9n\" (UniqueName: \"kubernetes.io/projected/3c639b11-0c9c-4385-9ab7-1853aa425911-kube-api-access-rvg9n\") pod \"aws-ebs-csi-driver-node-lp4mh\" (UID: \"3c639b11-0c9c-4385-9ab7-1853aa425911\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp4mh" Jun 11 11:33:21.086351 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.086182 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-log-socket\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.086351 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.086245 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-log-socket\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.086351 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.086308 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f2b8386f-7ce4-4da0-9810-0ff144fc4739-multus-daemon-config\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.086351 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.086348 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-etc-modprobe-d\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:21.086589 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.086372 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-etc-sysconfig\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:21.086589 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.086394 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-var-lib-kubelet\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:21.086589 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.086424 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/637a52f4-ccd5-41dd-bb6d-ee7dccbd580b-host-slash\") pod \"iptables-alerter-zjsjx\" (UID: \"637a52f4-ccd5-41dd-bb6d-ee7dccbd580b\") " pod="openshift-network-operator/iptables-alerter-zjsjx" Jun 11 11:33:21.086589 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.086455 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c639b11-0c9c-4385-9ab7-1853aa425911-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lp4mh\" (UID: \"3c639b11-0c9c-4385-9ab7-1853aa425911\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp4mh" Jun 11 11:33:21.086589 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.086470 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-var-lib-kubelet\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:21.086589 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.086480 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9a1ee17d-116a-4dd7-8cb7-5fe10679d13f-host\") pod \"node-ca-248kq\" (UID: \"9a1ee17d-116a-4dd7-8cb7-5fe10679d13f\") " pod="openshift-image-registry/node-ca-248kq" Jun 11 11:33:21.086589 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.086514 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-etc-modprobe-d\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:21.086589 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.086538 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9a1ee17d-116a-4dd7-8cb7-5fe10679d13f-host\") pod \"node-ca-248kq\" (UID: \"9a1ee17d-116a-4dd7-8cb7-5fe10679d13f\") " pod="openshift-image-registry/node-ca-248kq" Jun 11 11:33:21.086589 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.086477 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-etc-sysconfig\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:21.086589 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.086540 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c639b11-0c9c-4385-9ab7-1853aa425911-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lp4mh\" (UID: \"3c639b11-0c9c-4385-9ab7-1853aa425911\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp4mh" Jun 11 11:33:21.086589 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.086542 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvqjt\" (UniqueName: \"kubernetes.io/projected/9a1ee17d-116a-4dd7-8cb7-5fe10679d13f-kube-api-access-fvqjt\") pod \"node-ca-248kq\" (UID: \"9a1ee17d-116a-4dd7-8cb7-5fe10679d13f\") " pod="openshift-image-registry/node-ca-248kq" Jun 11 11:33:21.087069 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.086622 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-host-kubelet\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.087069 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.086646 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-host-cni-bin\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.087069 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.086669 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-system-cni-dir\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.087069 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.086695 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w4sd\" (UniqueName: \"kubernetes.io/projected/62cbd6f9-5887-46a3-bb97-9c6eebe11433-kube-api-access-7w4sd\") pod \"network-check-target-cmt44\" (UID: \"62cbd6f9-5887-46a3-bb97-9c6eebe11433\") " pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:33:21.087069 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.086710 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-host-kubelet\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.087069 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.086719 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpw5x\" (UniqueName: \"kubernetes.io/projected/75580ac2-a186-46af-a5c6-ab8523a85cb0-kube-api-access-rpw5x\") pod \"node-resolver-qzsk4\" (UID: \"75580ac2-a186-46af-a5c6-ab8523a85cb0\") " pod="openshift-dns/node-resolver-qzsk4" Jun 11 11:33:21.087069 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.086722 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-host-cni-bin\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.087069 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.086755 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9a1ee17d-116a-4dd7-8cb7-5fe10679d13f-serviceca\") pod \"node-ca-248kq\" (UID: \"9a1ee17d-116a-4dd7-8cb7-5fe10679d13f\") " pod="openshift-image-registry/node-ca-248kq" Jun 11 11:33:21.087069 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.086758 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-system-cni-dir\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.087069 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.086830 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-etc-openvswitch\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.087069 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.086939 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-etc-openvswitch\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.087069 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.086942 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-metrics-certs\") pod \"network-metrics-daemon-fm9jf\" (UID: \"ab22f9ba-926c-424d-92ba-70cdae2dbd6e\") " pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:33:21.087069 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.086999 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpncj\" (UniqueName: \"kubernetes.io/projected/21918188-202c-44b2-b12c-c7aa5dcd0cec-kube-api-access-hpncj\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:21.087069 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087008 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f2b8386f-7ce4-4da0-9810-0ff144fc4739-multus-daemon-config\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.087069 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087026 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b82e26a-b5a2-4106-a531-52097cb4c72e-os-release\") pod \"multus-additional-cni-plugins-5dwmf\" (UID: \"5b82e26a-b5a2-4106-a531-52097cb4c72e\") " pod="openshift-multus/multus-additional-cni-plugins-5dwmf" Jun 11 11:33:21.087069 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:21.087034 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 11:33:21.087069 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087060 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-run-ovn\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.087069 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087084 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-ovnkube-script-lib\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.088013 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:21.087103 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-metrics-certs podName:ab22f9ba-926c-424d-92ba-70cdae2dbd6e nodeName:}" failed. No retries permitted until 2026-06-11 11:33:21.587080955 +0000 UTC m=+3.008030724 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-metrics-certs") pod "network-metrics-daemon-fm9jf" (UID: "ab22f9ba-926c-424d-92ba-70cdae2dbd6e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 11:33:21.088013 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087128 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/93730f02-47c1-4083-b8cb-cb6bcdb611c8-kubelet-config\") pod \"global-pull-secret-syncer-gfgs7\" (UID: \"93730f02-47c1-4083-b8cb-cb6bcdb611c8\") " pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:21.088013 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087153 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-cnibin\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.088013 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087168 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-run-ovn\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.088013 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087177 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-host-var-lib-kubelet\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.088013 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087204 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/21918188-202c-44b2-b12c-c7aa5dcd0cec-etc-tuned\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:21.088013 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087211 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-host-var-lib-kubelet\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.088013 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087226 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/637a52f4-ccd5-41dd-bb6d-ee7dccbd580b-iptables-alerter-script\") pod \"iptables-alerter-zjsjx\" (UID: \"637a52f4-ccd5-41dd-bb6d-ee7dccbd580b\") " pod="openshift-network-operator/iptables-alerter-zjsjx" Jun 11 11:33:21.088013 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087243 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9a1ee17d-116a-4dd7-8cb7-5fe10679d13f-serviceca\") pod \"node-ca-248kq\" (UID: \"9a1ee17d-116a-4dd7-8cb7-5fe10679d13f\") " pod="openshift-image-registry/node-ca-248kq" Jun 11 11:33:21.088013 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087251 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/93730f02-47c1-4083-b8cb-cb6bcdb611c8-kubelet-config\") pod \"global-pull-secret-syncer-gfgs7\" (UID: \"93730f02-47c1-4083-b8cb-cb6bcdb611c8\") " pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:21.088013 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087263 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-cnibin\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.088013 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087248 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-run-systemd\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.088013 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087268 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-run-systemd\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.088013 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087307 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-run-openvswitch\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.088013 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087344 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-etc-systemd\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:21.088013 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087385 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-run-openvswitch\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.088013 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087397 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a3d40af8-b3e3-4842-b7f3-2d942702a938-konnectivity-ca\") pod \"konnectivity-agent-hgvgn\" (UID: \"a3d40af8-b3e3-4842-b7f3-2d942702a938\") " pod="kube-system/konnectivity-agent-hgvgn" Jun 11 11:33:21.088919 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087441 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-etc-systemd\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:21.088919 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087440 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bprc2\" (UniqueName: \"kubernetes.io/projected/5b82e26a-b5a2-4106-a531-52097cb4c72e-kube-api-access-bprc2\") pod \"multus-additional-cni-plugins-5dwmf\" (UID: \"5b82e26a-b5a2-4106-a531-52097cb4c72e\") " pod="openshift-multus/multus-additional-cni-plugins-5dwmf" Jun 11 11:33:21.088919 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087480 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-env-overrides\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.088919 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087521 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-multus-socket-dir-parent\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.088919 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087530 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 11:33:21.088919 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087548 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtpmq\" (UniqueName: \"kubernetes.io/projected/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-kube-api-access-mtpmq\") pod \"network-metrics-daemon-fm9jf\" (UID: \"ab22f9ba-926c-424d-92ba-70cdae2dbd6e\") " pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:33:21.088919 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087573 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c639b11-0c9c-4385-9ab7-1853aa425911-registration-dir\") pod \"aws-ebs-csi-driver-node-lp4mh\" (UID: \"3c639b11-0c9c-4385-9ab7-1853aa425911\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp4mh" Jun 11 11:33:21.088919 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087619 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-etc-sysctl-conf\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:21.088919 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087641 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21918188-202c-44b2-b12c-c7aa5dcd0cec-tmp\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:21.088919 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087643 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-multus-socket-dir-parent\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.088919 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087668 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwk4f\" (UniqueName: \"kubernetes.io/projected/637a52f4-ccd5-41dd-bb6d-ee7dccbd580b-kube-api-access-xwk4f\") pod \"iptables-alerter-zjsjx\" (UID: \"637a52f4-ccd5-41dd-bb6d-ee7dccbd580b\") " pod="openshift-network-operator/iptables-alerter-zjsjx" Jun 11 11:33:21.088919 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087672 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-ovnkube-script-lib\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.088919 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087693 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c639b11-0c9c-4385-9ab7-1853aa425911-registration-dir\") pod \"aws-ebs-csi-driver-node-lp4mh\" (UID: \"3c639b11-0c9c-4385-9ab7-1853aa425911\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp4mh" Jun 11 11:33:21.088919 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087694 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp6c5\" (UniqueName: \"kubernetes.io/projected/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-kube-api-access-bp6c5\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.088919 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087737 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-os-release\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.088919 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087761 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-host-var-lib-cni-multus\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.088919 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087786 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c639b11-0c9c-4385-9ab7-1853aa425911-device-dir\") pod \"aws-ebs-csi-driver-node-lp4mh\" (UID: \"3c639b11-0c9c-4385-9ab7-1853aa425911\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp4mh" Jun 11 11:33:21.089743 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087812 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5b82e26a-b5a2-4106-a531-52097cb4c72e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5dwmf\" (UID: \"5b82e26a-b5a2-4106-a531-52097cb4c72e\") " pod="openshift-multus/multus-additional-cni-plugins-5dwmf" Jun 11 11:33:21.089743 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087848 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-systemd-units\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.089743 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087868 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c639b11-0c9c-4385-9ab7-1853aa425911-device-dir\") pod \"aws-ebs-csi-driver-node-lp4mh\" (UID: \"3c639b11-0c9c-4385-9ab7-1853aa425911\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp4mh" Jun 11 11:33:21.089743 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087880 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-os-release\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.089743 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087885 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-host-run-k8s-cni-cncf-io\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.089743 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087918 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-lib-modules\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:21.089743 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087920 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-systemd-units\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.089743 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087938 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c639b11-0c9c-4385-9ab7-1853aa425911-socket-dir\") pod \"aws-ebs-csi-driver-node-lp4mh\" (UID: \"3c639b11-0c9c-4385-9ab7-1853aa425911\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp4mh" Jun 11 11:33:21.089743 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087952 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a3d40af8-b3e3-4842-b7f3-2d942702a938-konnectivity-ca\") pod \"konnectivity-agent-hgvgn\" (UID: \"a3d40af8-b3e3-4842-b7f3-2d942702a938\") " pod="kube-system/konnectivity-agent-hgvgn" Jun 11 11:33:21.089743 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087960 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-var-lib-openvswitch\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.089743 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087978 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-host-run-k8s-cni-cncf-io\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.089743 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087984 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-run\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:21.089743 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.087996 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-etc-sysctl-conf\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:21.089743 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088019 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a3d40af8-b3e3-4842-b7f3-2d942702a938-agent-certs\") pod \"konnectivity-agent-hgvgn\" (UID: \"a3d40af8-b3e3-4842-b7f3-2d942702a938\") " pod="kube-system/konnectivity-agent-hgvgn" Jun 11 11:33:21.089743 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088035 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-run\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:21.089743 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088048 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/75580ac2-a186-46af-a5c6-ab8523a85cb0-hosts-file\") pod \"node-resolver-qzsk4\" (UID: \"75580ac2-a186-46af-a5c6-ab8523a85cb0\") " pod="openshift-dns/node-resolver-qzsk4" Jun 11 11:33:21.089743 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088082 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-lib-modules\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:21.090466 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088084 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-host-run-netns\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.090466 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088111 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c639b11-0c9c-4385-9ab7-1853aa425911-socket-dir\") pod \"aws-ebs-csi-driver-node-lp4mh\" (UID: \"3c639b11-0c9c-4385-9ab7-1853aa425911\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp4mh" Jun 11 11:33:21.090466 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088122 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-host-run-ovn-kubernetes\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.090466 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088124 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-host-run-netns\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.090466 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088157 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-var-lib-openvswitch\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.090466 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088165 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-host-var-lib-cni-multus\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.090466 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088169 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-host-run-ovn-kubernetes\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.090466 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088198 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-env-overrides\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.090466 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088200 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-host-cni-netd\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.090466 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088202 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/75580ac2-a186-46af-a5c6-ab8523a85cb0-hosts-file\") pod \"node-resolver-qzsk4\" (UID: \"75580ac2-a186-46af-a5c6-ab8523a85cb0\") " pod="openshift-dns/node-resolver-qzsk4" Jun 11 11:33:21.090466 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088236 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-host-cni-netd\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.090466 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088258 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-host-var-lib-cni-bin\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.090466 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088290 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-host-slash\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.090466 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088296 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-host-var-lib-cni-bin\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.090466 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088330 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93730f02-47c1-4083-b8cb-cb6bcdb611c8-original-pull-secret\") pod \"global-pull-secret-syncer-gfgs7\" (UID: \"93730f02-47c1-4083-b8cb-cb6bcdb611c8\") " pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:21.090466 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088338 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-host-slash\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.090466 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088391 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-multus-conf-dir\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.091249 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088418 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b82e26a-b5a2-4106-a531-52097cb4c72e-system-cni-dir\") pod \"multus-additional-cni-plugins-5dwmf\" (UID: \"5b82e26a-b5a2-4106-a531-52097cb4c72e\") " pod="openshift-multus/multus-additional-cni-plugins-5dwmf" Jun 11 11:33:21.091249 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088445 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-multus-conf-dir\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.091249 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:21.088468 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 11:33:21.091249 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088526 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5b82e26a-b5a2-4106-a531-52097cb4c72e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5dwmf\" (UID: \"5b82e26a-b5a2-4106-a531-52097cb4c72e\") " pod="openshift-multus/multus-additional-cni-plugins-5dwmf" Jun 11 11:33:21.091249 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:21.088553 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93730f02-47c1-4083-b8cb-cb6bcdb611c8-original-pull-secret podName:93730f02-47c1-4083-b8cb-cb6bcdb611c8 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:21.588540345 +0000 UTC m=+3.009490090 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/93730f02-47c1-4083-b8cb-cb6bcdb611c8-original-pull-secret") pod "global-pull-secret-syncer-gfgs7" (UID: "93730f02-47c1-4083-b8cb-cb6bcdb611c8") : object "kube-system"/"original-pull-secret" not registered Jun 11 11:33:21.091249 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088598 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.091249 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088664 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.091249 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088708 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-ovnkube-config\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.091249 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088742 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-multus-cni-dir\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.091249 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088779 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2b8386f-7ce4-4da0-9810-0ff144fc4739-cni-binary-copy\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.091249 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088800 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b82e26a-b5a2-4106-a531-52097cb4c72e-cnibin\") pod \"multus-additional-cni-plugins-5dwmf\" (UID: \"5b82e26a-b5a2-4106-a531-52097cb4c72e\") " pod="openshift-multus/multus-additional-cni-plugins-5dwmf" Jun 11 11:33:21.091249 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088816 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b82e26a-b5a2-4106-a531-52097cb4c72e-cni-binary-copy\") pod \"multus-additional-cni-plugins-5dwmf\" (UID: \"5b82e26a-b5a2-4106-a531-52097cb4c72e\") " pod="openshift-multus/multus-additional-cni-plugins-5dwmf" Jun 11 11:33:21.091249 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088835 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-multus-cni-dir\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.091249 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088842 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/93730f02-47c1-4083-b8cb-cb6bcdb611c8-dbus\") pod \"global-pull-secret-syncer-gfgs7\" (UID: \"93730f02-47c1-4083-b8cb-cb6bcdb611c8\") " pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:21.091249 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088878 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-host-run-netns\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.091249 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088904 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-node-log\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.091249 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088929 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75580ac2-a186-46af-a5c6-ab8523a85cb0-tmp-dir\") pod \"node-resolver-qzsk4\" (UID: \"75580ac2-a186-46af-a5c6-ab8523a85cb0\") " pod="openshift-dns/node-resolver-qzsk4" Jun 11 11:33:21.092099 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088945 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/93730f02-47c1-4083-b8cb-cb6bcdb611c8-dbus\") pod \"global-pull-secret-syncer-gfgs7\" (UID: \"93730f02-47c1-4083-b8cb-cb6bcdb611c8\") " pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:21.092099 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088966 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c639b11-0c9c-4385-9ab7-1853aa425911-etc-selinux\") pod \"aws-ebs-csi-driver-node-lp4mh\" (UID: \"3c639b11-0c9c-4385-9ab7-1853aa425911\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp4mh" Jun 11 11:33:21.092099 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.088996 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-etc-kubernetes\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:21.092099 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.089047 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-host-run-netns\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.092099 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.089073 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c639b11-0c9c-4385-9ab7-1853aa425911-etc-selinux\") pod \"aws-ebs-csi-driver-node-lp4mh\" (UID: \"3c639b11-0c9c-4385-9ab7-1853aa425911\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp4mh" Jun 11 11:33:21.092099 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.089082 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-etc-sysctl-d\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:21.092099 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.089099 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-etc-kubernetes\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:21.092099 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.089120 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-sys\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:21.092099 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.089147 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-host\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:21.092099 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.089191 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-etc-sysctl-d\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:21.092099 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.089188 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-ovnkube-config\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.092099 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.089199 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b82e26a-b5a2-4106-a531-52097cb4c72e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5dwmf\" (UID: \"5b82e26a-b5a2-4106-a531-52097cb4c72e\") " pod="openshift-multus/multus-additional-cni-plugins-5dwmf" Jun 11 11:33:21.092099 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.089226 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-node-log\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.092099 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.089241 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-host\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:21.092099 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.089280 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-ovn-node-metrics-cert\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.092099 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.089293 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2b8386f-7ce4-4da0-9810-0ff144fc4739-cni-binary-copy\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.092099 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.089306 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-hostroot\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.092099 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.089311 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75580ac2-a186-46af-a5c6-ab8523a85cb0-tmp-dir\") pod \"node-resolver-qzsk4\" (UID: \"75580ac2-a186-46af-a5c6-ab8523a85cb0\") " pod="openshift-dns/node-resolver-qzsk4" Jun 11 11:33:21.092983 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.089347 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-host-run-multus-certs\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.092983 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.089370 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/21918188-202c-44b2-b12c-c7aa5dcd0cec-sys\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:21.092983 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.089409 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-etc-kubernetes\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.092983 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.089448 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-host-run-multus-certs\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.092983 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.089456 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-hostroot\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.092983 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.089514 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2b8386f-7ce4-4da0-9810-0ff144fc4739-etc-kubernetes\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.092983 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.089520 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnkmw\" (UniqueName: \"kubernetes.io/projected/f2b8386f-7ce4-4da0-9810-0ff144fc4739-kube-api-access-vnkmw\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.092983 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.089559 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c639b11-0c9c-4385-9ab7-1853aa425911-sys-fs\") pod \"aws-ebs-csi-driver-node-lp4mh\" (UID: \"3c639b11-0c9c-4385-9ab7-1853aa425911\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp4mh" Jun 11 11:33:21.092983 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.089610 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c639b11-0c9c-4385-9ab7-1853aa425911-sys-fs\") pod \"aws-ebs-csi-driver-node-lp4mh\" (UID: \"3c639b11-0c9c-4385-9ab7-1853aa425911\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp4mh" Jun 11 11:33:21.092983 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.091331 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21918188-202c-44b2-b12c-c7aa5dcd0cec-tmp\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:21.092983 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.091391 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/21918188-202c-44b2-b12c-c7aa5dcd0cec-etc-tuned\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:21.092983 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.091625 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a3d40af8-b3e3-4842-b7f3-2d942702a938-agent-certs\") pod \"konnectivity-agent-hgvgn\" (UID: \"a3d40af8-b3e3-4842-b7f3-2d942702a938\") " pod="kube-system/konnectivity-agent-hgvgn" Jun 11 11:33:21.092983 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.091676 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-ovn-node-metrics-cert\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.097553 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:21.097356 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 11:33:21.097553 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:21.097425 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 11:33:21.097553 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:21.097450 2580 projected.go:196] Error preparing data for projected volume kube-api-access-7w4sd for pod openshift-network-diagnostics/network-check-target-cmt44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 11:33:21.099933 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:21.097568 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62cbd6f9-5887-46a3-bb97-9c6eebe11433-kube-api-access-7w4sd podName:62cbd6f9-5887-46a3-bb97-9c6eebe11433 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:21.597546089 +0000 UTC m=+3.018495836 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7w4sd" (UniqueName: "kubernetes.io/projected/62cbd6f9-5887-46a3-bb97-9c6eebe11433-kube-api-access-7w4sd") pod "network-check-target-cmt44" (UID: "62cbd6f9-5887-46a3-bb97-9c6eebe11433") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 11:33:21.100054 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.099384 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpw5x\" (UniqueName: \"kubernetes.io/projected/75580ac2-a186-46af-a5c6-ab8523a85cb0-kube-api-access-rpw5x\") pod \"node-resolver-qzsk4\" (UID: \"75580ac2-a186-46af-a5c6-ab8523a85cb0\") " pod="openshift-dns/node-resolver-qzsk4" Jun 11 11:33:21.100116 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.099548 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpncj\" (UniqueName: \"kubernetes.io/projected/21918188-202c-44b2-b12c-c7aa5dcd0cec-kube-api-access-hpncj\") pod \"tuned-hq2qg\" (UID: \"21918188-202c-44b2-b12c-c7aa5dcd0cec\") " pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:21.100954 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.100932 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnkmw\" (UniqueName: \"kubernetes.io/projected/f2b8386f-7ce4-4da0-9810-0ff144fc4739-kube-api-access-vnkmw\") pod \"multus-8v8j2\" (UID: \"f2b8386f-7ce4-4da0-9810-0ff144fc4739\") " pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.101070 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.101013 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvg9n\" (UniqueName: \"kubernetes.io/projected/3c639b11-0c9c-4385-9ab7-1853aa425911-kube-api-access-rvg9n\") pod \"aws-ebs-csi-driver-node-lp4mh\" (UID: \"3c639b11-0c9c-4385-9ab7-1853aa425911\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp4mh" Jun 11 11:33:21.101438 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.101417 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvqjt\" (UniqueName: \"kubernetes.io/projected/9a1ee17d-116a-4dd7-8cb7-5fe10679d13f-kube-api-access-fvqjt\") pod \"node-ca-248kq\" (UID: \"9a1ee17d-116a-4dd7-8cb7-5fe10679d13f\") " pod="openshift-image-registry/node-ca-248kq" Jun 11 11:33:21.101802 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.101779 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp6c5\" (UniqueName: \"kubernetes.io/projected/8ad3e9b6-2483-4aa5-9c8c-bc31ef592342-kube-api-access-bp6c5\") pod \"ovnkube-node-nntvz\" (UID: \"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342\") " pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.102262 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.102239 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtpmq\" (UniqueName: \"kubernetes.io/projected/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-kube-api-access-mtpmq\") pod \"network-metrics-daemon-fm9jf\" (UID: \"ab22f9ba-926c-424d-92ba-70cdae2dbd6e\") " pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:33:21.190679 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.190587 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b82e26a-b5a2-4106-a531-52097cb4c72e-system-cni-dir\") pod \"multus-additional-cni-plugins-5dwmf\" (UID: \"5b82e26a-b5a2-4106-a531-52097cb4c72e\") " pod="openshift-multus/multus-additional-cni-plugins-5dwmf" Jun 11 11:33:21.190679 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.190633 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5b82e26a-b5a2-4106-a531-52097cb4c72e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5dwmf\" (UID: \"5b82e26a-b5a2-4106-a531-52097cb4c72e\") " pod="openshift-multus/multus-additional-cni-plugins-5dwmf" Jun 11 11:33:21.190679 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.190663 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b82e26a-b5a2-4106-a531-52097cb4c72e-cnibin\") pod \"multus-additional-cni-plugins-5dwmf\" (UID: \"5b82e26a-b5a2-4106-a531-52097cb4c72e\") " pod="openshift-multus/multus-additional-cni-plugins-5dwmf" Jun 11 11:33:21.190952 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.190687 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b82e26a-b5a2-4106-a531-52097cb4c72e-cni-binary-copy\") pod \"multus-additional-cni-plugins-5dwmf\" (UID: \"5b82e26a-b5a2-4106-a531-52097cb4c72e\") " pod="openshift-multus/multus-additional-cni-plugins-5dwmf" Jun 11 11:33:21.190952 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.190719 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b82e26a-b5a2-4106-a531-52097cb4c72e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5dwmf\" (UID: \"5b82e26a-b5a2-4106-a531-52097cb4c72e\") " pod="openshift-multus/multus-additional-cni-plugins-5dwmf" Jun 11 11:33:21.190952 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.190787 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b82e26a-b5a2-4106-a531-52097cb4c72e-cnibin\") pod \"multus-additional-cni-plugins-5dwmf\" (UID: \"5b82e26a-b5a2-4106-a531-52097cb4c72e\") " pod="openshift-multus/multus-additional-cni-plugins-5dwmf" Jun 11 11:33:21.190952 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.190800 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b82e26a-b5a2-4106-a531-52097cb4c72e-system-cni-dir\") pod \"multus-additional-cni-plugins-5dwmf\" (UID: \"5b82e26a-b5a2-4106-a531-52097cb4c72e\") " pod="openshift-multus/multus-additional-cni-plugins-5dwmf" Jun 11 11:33:21.190952 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.190827 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/637a52f4-ccd5-41dd-bb6d-ee7dccbd580b-host-slash\") pod \"iptables-alerter-zjsjx\" (UID: \"637a52f4-ccd5-41dd-bb6d-ee7dccbd580b\") " pod="openshift-network-operator/iptables-alerter-zjsjx" Jun 11 11:33:21.190952 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.190894 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/637a52f4-ccd5-41dd-bb6d-ee7dccbd580b-host-slash\") pod \"iptables-alerter-zjsjx\" (UID: \"637a52f4-ccd5-41dd-bb6d-ee7dccbd580b\") " pod="openshift-network-operator/iptables-alerter-zjsjx" Jun 11 11:33:21.191235 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.190981 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b82e26a-b5a2-4106-a531-52097cb4c72e-os-release\") pod \"multus-additional-cni-plugins-5dwmf\" (UID: \"5b82e26a-b5a2-4106-a531-52097cb4c72e\") " pod="openshift-multus/multus-additional-cni-plugins-5dwmf" Jun 11 11:33:21.191235 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.190992 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b82e26a-b5a2-4106-a531-52097cb4c72e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5dwmf\" (UID: \"5b82e26a-b5a2-4106-a531-52097cb4c72e\") " pod="openshift-multus/multus-additional-cni-plugins-5dwmf" Jun 11 11:33:21.191235 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.191020 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/637a52f4-ccd5-41dd-bb6d-ee7dccbd580b-iptables-alerter-script\") pod \"iptables-alerter-zjsjx\" (UID: \"637a52f4-ccd5-41dd-bb6d-ee7dccbd580b\") " pod="openshift-network-operator/iptables-alerter-zjsjx" Jun 11 11:33:21.191235 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.191050 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bprc2\" (UniqueName: \"kubernetes.io/projected/5b82e26a-b5a2-4106-a531-52097cb4c72e-kube-api-access-bprc2\") pod \"multus-additional-cni-plugins-5dwmf\" (UID: \"5b82e26a-b5a2-4106-a531-52097cb4c72e\") " pod="openshift-multus/multus-additional-cni-plugins-5dwmf" Jun 11 11:33:21.191235 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.191082 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwk4f\" (UniqueName: \"kubernetes.io/projected/637a52f4-ccd5-41dd-bb6d-ee7dccbd580b-kube-api-access-xwk4f\") pod \"iptables-alerter-zjsjx\" (UID: \"637a52f4-ccd5-41dd-bb6d-ee7dccbd580b\") " pod="openshift-network-operator/iptables-alerter-zjsjx" Jun 11 11:33:21.191235 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.191126 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5b82e26a-b5a2-4106-a531-52097cb4c72e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5dwmf\" (UID: \"5b82e26a-b5a2-4106-a531-52097cb4c72e\") " pod="openshift-multus/multus-additional-cni-plugins-5dwmf" Jun 11 11:33:21.191235 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.191158 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b82e26a-b5a2-4106-a531-52097cb4c72e-os-release\") pod \"multus-additional-cni-plugins-5dwmf\" (UID: \"5b82e26a-b5a2-4106-a531-52097cb4c72e\") " pod="openshift-multus/multus-additional-cni-plugins-5dwmf" Jun 11 11:33:21.191567 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.191401 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b82e26a-b5a2-4106-a531-52097cb4c72e-cni-binary-copy\") pod \"multus-additional-cni-plugins-5dwmf\" (UID: \"5b82e26a-b5a2-4106-a531-52097cb4c72e\") " pod="openshift-multus/multus-additional-cni-plugins-5dwmf" Jun 11 11:33:21.191567 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.191531 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/637a52f4-ccd5-41dd-bb6d-ee7dccbd580b-iptables-alerter-script\") pod \"iptables-alerter-zjsjx\" (UID: \"637a52f4-ccd5-41dd-bb6d-ee7dccbd580b\") " pod="openshift-network-operator/iptables-alerter-zjsjx" Jun 11 11:33:21.191698 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.191676 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5b82e26a-b5a2-4106-a531-52097cb4c72e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5dwmf\" (UID: \"5b82e26a-b5a2-4106-a531-52097cb4c72e\") " pod="openshift-multus/multus-additional-cni-plugins-5dwmf" Jun 11 11:33:21.191854 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.191834 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5b82e26a-b5a2-4106-a531-52097cb4c72e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5dwmf\" (UID: \"5b82e26a-b5a2-4106-a531-52097cb4c72e\") " pod="openshift-multus/multus-additional-cni-plugins-5dwmf" Jun 11 11:33:21.200164 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.200137 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bprc2\" (UniqueName: \"kubernetes.io/projected/5b82e26a-b5a2-4106-a531-52097cb4c72e-kube-api-access-bprc2\") pod \"multus-additional-cni-plugins-5dwmf\" (UID: \"5b82e26a-b5a2-4106-a531-52097cb4c72e\") " pod="openshift-multus/multus-additional-cni-plugins-5dwmf" Jun 11 11:33:21.200321 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.200173 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwk4f\" (UniqueName: \"kubernetes.io/projected/637a52f4-ccd5-41dd-bb6d-ee7dccbd580b-kube-api-access-xwk4f\") pod \"iptables-alerter-zjsjx\" (UID: \"637a52f4-ccd5-41dd-bb6d-ee7dccbd580b\") " pod="openshift-network-operator/iptables-alerter-zjsjx" Jun 11 11:33:21.274061 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.274020 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-248kq" Jun 11 11:33:21.284381 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.284356 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:21.290367 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.290340 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8v8j2" Jun 11 11:33:21.296098 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.296075 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qzsk4" Jun 11 11:33:21.302791 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.302769 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp4mh" Jun 11 11:33:21.309158 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.309130 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" Jun 11 11:33:21.315707 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.315683 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hgvgn" Jun 11 11:33:21.322771 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.322752 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5dwmf" Jun 11 11:33:21.328577 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.328558 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zjsjx" Jun 11 11:33:21.593631 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.593549 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93730f02-47c1-4083-b8cb-cb6bcdb611c8-original-pull-secret\") pod \"global-pull-secret-syncer-gfgs7\" (UID: \"93730f02-47c1-4083-b8cb-cb6bcdb611c8\") " pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:21.593780 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.593644 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-metrics-certs\") pod \"network-metrics-daemon-fm9jf\" (UID: \"ab22f9ba-926c-424d-92ba-70cdae2dbd6e\") " pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:33:21.593780 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:21.593692 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 11:33:21.593780 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:21.593761 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93730f02-47c1-4083-b8cb-cb6bcdb611c8-original-pull-secret podName:93730f02-47c1-4083-b8cb-cb6bcdb611c8 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:22.593744039 +0000 UTC m=+4.014693787 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/93730f02-47c1-4083-b8cb-cb6bcdb611c8-original-pull-secret") pod "global-pull-secret-syncer-gfgs7" (UID: "93730f02-47c1-4083-b8cb-cb6bcdb611c8") : object "kube-system"/"original-pull-secret" not registered Jun 11 11:33:21.593780 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:21.593766 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 11:33:21.593929 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:21.593823 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-metrics-certs podName:ab22f9ba-926c-424d-92ba-70cdae2dbd6e nodeName:}" failed. No retries permitted until 2026-06-11 11:33:22.593802574 +0000 UTC m=+4.014752339 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-metrics-certs") pod "network-metrics-daemon-fm9jf" (UID: "ab22f9ba-926c-424d-92ba-70cdae2dbd6e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 11:33:21.694648 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:21.694614 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w4sd\" (UniqueName: \"kubernetes.io/projected/62cbd6f9-5887-46a3-bb97-9c6eebe11433-kube-api-access-7w4sd\") pod \"network-check-target-cmt44\" (UID: \"62cbd6f9-5887-46a3-bb97-9c6eebe11433\") " pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:33:21.694841 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:21.694772 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 11:33:21.694841 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:21.694792 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 11:33:21.694841 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:21.694805 2580 projected.go:196] Error preparing data for projected volume kube-api-access-7w4sd for pod openshift-network-diagnostics/network-check-target-cmt44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 11:33:21.694995 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:21.694872 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62cbd6f9-5887-46a3-bb97-9c6eebe11433-kube-api-access-7w4sd podName:62cbd6f9-5887-46a3-bb97-9c6eebe11433 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:22.694853125 +0000 UTC m=+4.115802873 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7w4sd" (UniqueName: "kubernetes.io/projected/62cbd6f9-5887-46a3-bb97-9c6eebe11433-kube-api-access-7w4sd") pod "network-check-target-cmt44" (UID: "62cbd6f9-5887-46a3-bb97-9c6eebe11433") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 11:33:21.956715 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:21.956592 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c639b11_0c9c_4385_9ab7_1853aa425911.slice/crio-ba3313984bceb12c11113fee3df68c0d64c92328f8330722dacc5d1cd359c13f WatchSource:0}: Error finding container ba3313984bceb12c11113fee3df68c0d64c92328f8330722dacc5d1cd359c13f: Status 404 returned error can't find the container with id ba3313984bceb12c11113fee3df68c0d64c92328f8330722dacc5d1cd359c13f Jun 11 11:33:21.957436 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:21.957234 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2b8386f_7ce4_4da0_9810_0ff144fc4739.slice/crio-ea10a5b50c0047e3e65e6b9bba67c5ad54ced97e8748c9342d7d2a264617cd98 WatchSource:0}: Error finding container ea10a5b50c0047e3e65e6b9bba67c5ad54ced97e8748c9342d7d2a264617cd98: Status 404 returned error can't find the container with id ea10a5b50c0047e3e65e6b9bba67c5ad54ced97e8748c9342d7d2a264617cd98 Jun 11 11:33:21.958894 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:21.958799 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod637a52f4_ccd5_41dd_bb6d_ee7dccbd580b.slice/crio-5ffa02fd8f912ba242b53b812de5ff20b9ca1b3cdddf3baf50437c0ff006ee9f WatchSource:0}: Error finding container 5ffa02fd8f912ba242b53b812de5ff20b9ca1b3cdddf3baf50437c0ff006ee9f: Status 404 returned error can't find the container with id 5ffa02fd8f912ba242b53b812de5ff20b9ca1b3cdddf3baf50437c0ff006ee9f Jun 11 11:33:21.961150 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:21.961127 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3d40af8_b3e3_4842_b7f3_2d942702a938.slice/crio-756d4371e1df8825dfd43c5401f6bcf3188fcb775228dbeeace76fec4c438926 WatchSource:0}: Error finding container 756d4371e1df8825dfd43c5401f6bcf3188fcb775228dbeeace76fec4c438926: Status 404 returned error can't find the container with id 756d4371e1df8825dfd43c5401f6bcf3188fcb775228dbeeace76fec4c438926 Jun 11 11:33:21.961743 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:21.961715 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75580ac2_a186_46af_a5c6_ab8523a85cb0.slice/crio-22b4eab10bf018ebdcce68654527404f2f86a3ed49828452221f7745a94a6e7f WatchSource:0}: Error finding container 22b4eab10bf018ebdcce68654527404f2f86a3ed49828452221f7745a94a6e7f: Status 404 returned error can't find the container with id 22b4eab10bf018ebdcce68654527404f2f86a3ed49828452221f7745a94a6e7f Jun 11 11:33:21.964042 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:21.963894 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a1ee17d_116a_4dd7_8cb7_5fe10679d13f.slice/crio-22ea1125d75a535d3e300300f545b130af0a70728f4e2cee559861ff32fca7d7 WatchSource:0}: Error finding container 22ea1125d75a535d3e300300f545b130af0a70728f4e2cee559861ff32fca7d7: Status 404 returned error can't find the container with id 22ea1125d75a535d3e300300f545b130af0a70728f4e2cee559861ff32fca7d7 Jun 11 11:33:21.964626 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:21.964602 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ad3e9b6_2483_4aa5_9c8c_bc31ef592342.slice/crio-e75e0f1d7f01af8fd534ac545b83feff7ea2f78606cb2c0b2af0e3f9c99f0175 WatchSource:0}: Error finding container e75e0f1d7f01af8fd534ac545b83feff7ea2f78606cb2c0b2af0e3f9c99f0175: Status 404 returned error can't find the container with id e75e0f1d7f01af8fd534ac545b83feff7ea2f78606cb2c0b2af0e3f9c99f0175 Jun 11 11:33:21.966402 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:21.966376 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b82e26a_b5a2_4106_a531_52097cb4c72e.slice/crio-e0d47d67d77a148a8f1d0d33d628a73baa2f0f1774e73ab78f9a5a8a07627aa1 WatchSource:0}: Error finding container e0d47d67d77a148a8f1d0d33d628a73baa2f0f1774e73ab78f9a5a8a07627aa1: Status 404 returned error can't find the container with id e0d47d67d77a148a8f1d0d33d628a73baa2f0f1774e73ab78f9a5a8a07627aa1 Jun 11 11:33:22.029803 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:22.029635 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 11:28:21 +0000 UTC" deadline="2028-03-08 15:18:47.638092452 +0000 UTC" Jun 11 11:33:22.029920 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:22.029805 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15267h45m25.608293152s" Jun 11 11:33:22.038588 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:22.038560 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:33:22.038727 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:22.038696 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm9jf" podUID="ab22f9ba-926c-424d-92ba-70cdae2dbd6e" Jun 11 11:33:22.046410 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:22.046376 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qzsk4" event={"ID":"75580ac2-a186-46af-a5c6-ab8523a85cb0","Type":"ContainerStarted","Data":"22b4eab10bf018ebdcce68654527404f2f86a3ed49828452221f7745a94a6e7f"} Jun 11 11:33:22.047503 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:22.047466 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hgvgn" event={"ID":"a3d40af8-b3e3-4842-b7f3-2d942702a938","Type":"ContainerStarted","Data":"756d4371e1df8825dfd43c5401f6bcf3188fcb775228dbeeace76fec4c438926"} Jun 11 11:33:22.048570 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:22.048551 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-248kq" event={"ID":"9a1ee17d-116a-4dd7-8cb7-5fe10679d13f","Type":"ContainerStarted","Data":"22ea1125d75a535d3e300300f545b130af0a70728f4e2cee559861ff32fca7d7"} Jun 11 11:33:22.049811 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:22.049778 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8v8j2" event={"ID":"f2b8386f-7ce4-4da0-9810-0ff144fc4739","Type":"ContainerStarted","Data":"ea10a5b50c0047e3e65e6b9bba67c5ad54ced97e8748c9342d7d2a264617cd98"} Jun 11 11:33:22.050852 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:22.050833 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zjsjx" event={"ID":"637a52f4-ccd5-41dd-bb6d-ee7dccbd580b","Type":"ContainerStarted","Data":"5ffa02fd8f912ba242b53b812de5ff20b9ca1b3cdddf3baf50437c0ff006ee9f"} Jun 11 11:33:22.051956 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:22.051936 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp4mh" event={"ID":"3c639b11-0c9c-4385-9ab7-1853aa425911","Type":"ContainerStarted","Data":"ba3313984bceb12c11113fee3df68c0d64c92328f8330722dacc5d1cd359c13f"} Jun 11 11:33:22.053146 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:22.053103 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" event={"ID":"21918188-202c-44b2-b12c-c7aa5dcd0cec","Type":"ContainerStarted","Data":"fac4568f1a0b138dfa67d22d059f31f0d749ed2cf45f4742a9754ce8a4d624d9"} Jun 11 11:33:22.054991 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:22.054966 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-170.ec2.internal" event={"ID":"ac99beb55fe5d8ad12db0962dadfdf0d","Type":"ContainerStarted","Data":"44fa349d8816eade7403e9cfc3b6539e664035e5116a1193708b3ae398589596"} Jun 11 11:33:22.056150 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:22.056130 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5dwmf" event={"ID":"5b82e26a-b5a2-4106-a531-52097cb4c72e","Type":"ContainerStarted","Data":"e0d47d67d77a148a8f1d0d33d628a73baa2f0f1774e73ab78f9a5a8a07627aa1"} Jun 11 11:33:22.057285 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:22.057265 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" event={"ID":"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342","Type":"ContainerStarted","Data":"e75e0f1d7f01af8fd534ac545b83feff7ea2f78606cb2c0b2af0e3f9c99f0175"} Jun 11 11:33:22.070254 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:22.070206 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-170.ec2.internal" podStartSLOduration=2.070188613 podStartE2EDuration="2.070188613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 11:33:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:33:22.069567447 +0000 UTC m=+3.490517232" watchObservedRunningTime="2026-06-11 11:33:22.070188613 +0000 UTC m=+3.491138379" Jun 11 11:33:22.126654 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:22.126611 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 11:33:22.601442 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:22.601346 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93730f02-47c1-4083-b8cb-cb6bcdb611c8-original-pull-secret\") pod \"global-pull-secret-syncer-gfgs7\" (UID: \"93730f02-47c1-4083-b8cb-cb6bcdb611c8\") " pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:22.601618 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:22.601442 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-metrics-certs\") pod \"network-metrics-daemon-fm9jf\" (UID: \"ab22f9ba-926c-424d-92ba-70cdae2dbd6e\") " pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:33:22.601618 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:22.601581 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 11:33:22.601734 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:22.601648 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-metrics-certs podName:ab22f9ba-926c-424d-92ba-70cdae2dbd6e nodeName:}" failed. No retries permitted until 2026-06-11 11:33:24.601629076 +0000 UTC m=+6.022578830 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-metrics-certs") pod "network-metrics-daemon-fm9jf" (UID: "ab22f9ba-926c-424d-92ba-70cdae2dbd6e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 11:33:22.601734 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:22.601710 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 11:33:22.601838 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:22.601742 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93730f02-47c1-4083-b8cb-cb6bcdb611c8-original-pull-secret podName:93730f02-47c1-4083-b8cb-cb6bcdb611c8 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:24.601730654 +0000 UTC m=+6.022680405 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/93730f02-47c1-4083-b8cb-cb6bcdb611c8-original-pull-secret") pod "global-pull-secret-syncer-gfgs7" (UID: "93730f02-47c1-4083-b8cb-cb6bcdb611c8") : object "kube-system"/"original-pull-secret" not registered Jun 11 11:33:22.702443 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:22.702402 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w4sd\" (UniqueName: \"kubernetes.io/projected/62cbd6f9-5887-46a3-bb97-9c6eebe11433-kube-api-access-7w4sd\") pod \"network-check-target-cmt44\" (UID: \"62cbd6f9-5887-46a3-bb97-9c6eebe11433\") " pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:33:22.702696 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:22.702644 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 11:33:22.702696 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:22.702667 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 11:33:22.702696 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:22.702682 2580 projected.go:196] Error preparing data for projected volume kube-api-access-7w4sd for pod openshift-network-diagnostics/network-check-target-cmt44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 11:33:22.702859 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:22.702742 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62cbd6f9-5887-46a3-bb97-9c6eebe11433-kube-api-access-7w4sd podName:62cbd6f9-5887-46a3-bb97-9c6eebe11433 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:24.702723096 +0000 UTC m=+6.123672845 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7w4sd" (UniqueName: "kubernetes.io/projected/62cbd6f9-5887-46a3-bb97-9c6eebe11433-kube-api-access-7w4sd") pod "network-check-target-cmt44" (UID: "62cbd6f9-5887-46a3-bb97-9c6eebe11433") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 11:33:23.030455 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:23.030385 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 11:28:21 +0000 UTC" deadline="2028-02-22 17:43:54.623442348 +0000 UTC" Jun 11 11:33:23.030455 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:23.030450 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14910h10m31.592996101s" Jun 11 11:33:23.039713 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:23.039687 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:23.039894 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:23.039821 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfgs7" podUID="93730f02-47c1-4083-b8cb-cb6bcdb611c8" Jun 11 11:33:23.040172 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:23.040028 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:33:23.040172 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:23.040131 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmt44" podUID="62cbd6f9-5887-46a3-bb97-9c6eebe11433" Jun 11 11:33:23.078991 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:23.078952 2580 generic.go:356] "Generic (PLEG): container finished" podID="dc002ca7d3da33b34e8a0ef1296388b5" containerID="e1a12bf05b75653aa1ccbb6ce4fefa87a7e835f60c43cf5e4c348cdbf1d9afcb" exitCode=0 Jun 11 11:33:23.079514 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:23.079473 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal" event={"ID":"dc002ca7d3da33b34e8a0ef1296388b5","Type":"ContainerDied","Data":"e1a12bf05b75653aa1ccbb6ce4fefa87a7e835f60c43cf5e4c348cdbf1d9afcb"} Jun 11 11:33:24.039244 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:24.039203 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:33:24.039793 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:24.039364 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm9jf" podUID="ab22f9ba-926c-424d-92ba-70cdae2dbd6e" Jun 11 11:33:24.095440 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:24.094726 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal" event={"ID":"dc002ca7d3da33b34e8a0ef1296388b5","Type":"ContainerStarted","Data":"27f1c87738a906e1c574260e47b80493b569b89281b5e68485448971dcf73436"} Jun 11 11:33:24.112610 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:24.112531 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal" podStartSLOduration=4.112508842 podStartE2EDuration="4.112508842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 11:33:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:33:24.111545552 +0000 UTC m=+5.532495321" watchObservedRunningTime="2026-06-11 11:33:24.112508842 +0000 UTC m=+5.533458601" Jun 11 11:33:24.620708 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:24.620669 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93730f02-47c1-4083-b8cb-cb6bcdb611c8-original-pull-secret\") pod \"global-pull-secret-syncer-gfgs7\" (UID: \"93730f02-47c1-4083-b8cb-cb6bcdb611c8\") " pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:24.620913 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:24.620756 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-metrics-certs\") pod \"network-metrics-daemon-fm9jf\" (UID: \"ab22f9ba-926c-424d-92ba-70cdae2dbd6e\") " pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:33:24.620988 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:24.620931 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 11:33:24.621045 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:24.621012 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-metrics-certs podName:ab22f9ba-926c-424d-92ba-70cdae2dbd6e nodeName:}" failed. No retries permitted until 2026-06-11 11:33:28.620977884 +0000 UTC m=+10.041927632 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-metrics-certs") pod "network-metrics-daemon-fm9jf" (UID: "ab22f9ba-926c-424d-92ba-70cdae2dbd6e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 11:33:24.621419 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:24.621400 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 11:33:24.621520 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:24.621480 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93730f02-47c1-4083-b8cb-cb6bcdb611c8-original-pull-secret podName:93730f02-47c1-4083-b8cb-cb6bcdb611c8 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:28.621437684 +0000 UTC m=+10.042387437 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/93730f02-47c1-4083-b8cb-cb6bcdb611c8-original-pull-secret") pod "global-pull-secret-syncer-gfgs7" (UID: "93730f02-47c1-4083-b8cb-cb6bcdb611c8") : object "kube-system"/"original-pull-secret" not registered Jun 11 11:33:24.721543 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:24.721504 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w4sd\" (UniqueName: \"kubernetes.io/projected/62cbd6f9-5887-46a3-bb97-9c6eebe11433-kube-api-access-7w4sd\") pod \"network-check-target-cmt44\" (UID: \"62cbd6f9-5887-46a3-bb97-9c6eebe11433\") " pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:33:24.721799 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:24.721743 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 11:33:24.721799 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:24.721770 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 11:33:24.721799 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:24.721784 2580 projected.go:196] Error preparing data for projected volume kube-api-access-7w4sd for pod openshift-network-diagnostics/network-check-target-cmt44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 11:33:24.721987 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:24.721843 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62cbd6f9-5887-46a3-bb97-9c6eebe11433-kube-api-access-7w4sd podName:62cbd6f9-5887-46a3-bb97-9c6eebe11433 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:28.721824857 +0000 UTC m=+10.142774605 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7w4sd" (UniqueName: "kubernetes.io/projected/62cbd6f9-5887-46a3-bb97-9c6eebe11433-kube-api-access-7w4sd") pod "network-check-target-cmt44" (UID: "62cbd6f9-5887-46a3-bb97-9c6eebe11433") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 11:33:25.039963 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:25.039313 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:33:25.039963 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:25.039448 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmt44" podUID="62cbd6f9-5887-46a3-bb97-9c6eebe11433" Jun 11 11:33:25.039963 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:25.039835 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:25.039963 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:25.039922 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfgs7" podUID="93730f02-47c1-4083-b8cb-cb6bcdb611c8" Jun 11 11:33:26.038996 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:26.038952 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:33:26.039174 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:26.039102 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm9jf" podUID="ab22f9ba-926c-424d-92ba-70cdae2dbd6e" Jun 11 11:33:27.039601 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:27.039547 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:33:27.040065 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:27.039547 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:27.040065 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:27.039673 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmt44" podUID="62cbd6f9-5887-46a3-bb97-9c6eebe11433" Jun 11 11:33:27.040065 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:27.039745 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfgs7" podUID="93730f02-47c1-4083-b8cb-cb6bcdb611c8" Jun 11 11:33:28.039176 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:28.038963 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:33:28.039176 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:28.039107 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm9jf" podUID="ab22f9ba-926c-424d-92ba-70cdae2dbd6e" Jun 11 11:33:28.657068 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:28.657025 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-metrics-certs\") pod \"network-metrics-daemon-fm9jf\" (UID: \"ab22f9ba-926c-424d-92ba-70cdae2dbd6e\") " pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:33:28.657583 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:28.657094 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93730f02-47c1-4083-b8cb-cb6bcdb611c8-original-pull-secret\") pod \"global-pull-secret-syncer-gfgs7\" (UID: \"93730f02-47c1-4083-b8cb-cb6bcdb611c8\") " pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:28.657583 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:28.657193 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 11:33:28.657583 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:28.657231 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 11:33:28.657583 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:28.657264 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-metrics-certs podName:ab22f9ba-926c-424d-92ba-70cdae2dbd6e nodeName:}" failed. No retries permitted until 2026-06-11 11:33:36.657243598 +0000 UTC m=+18.078193361 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-metrics-certs") pod "network-metrics-daemon-fm9jf" (UID: "ab22f9ba-926c-424d-92ba-70cdae2dbd6e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 11:33:28.657583 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:28.657288 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93730f02-47c1-4083-b8cb-cb6bcdb611c8-original-pull-secret podName:93730f02-47c1-4083-b8cb-cb6bcdb611c8 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:36.657276182 +0000 UTC m=+18.078225933 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/93730f02-47c1-4083-b8cb-cb6bcdb611c8-original-pull-secret") pod "global-pull-secret-syncer-gfgs7" (UID: "93730f02-47c1-4083-b8cb-cb6bcdb611c8") : object "kube-system"/"original-pull-secret" not registered Jun 11 11:33:28.757908 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:28.757863 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w4sd\" (UniqueName: \"kubernetes.io/projected/62cbd6f9-5887-46a3-bb97-9c6eebe11433-kube-api-access-7w4sd\") pod \"network-check-target-cmt44\" (UID: \"62cbd6f9-5887-46a3-bb97-9c6eebe11433\") " pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:33:28.758096 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:28.758045 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 11:33:28.758096 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:28.758069 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 11:33:28.758096 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:28.758082 2580 projected.go:196] Error preparing data for projected volume kube-api-access-7w4sd for pod openshift-network-diagnostics/network-check-target-cmt44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 11:33:28.758243 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:28.758147 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62cbd6f9-5887-46a3-bb97-9c6eebe11433-kube-api-access-7w4sd podName:62cbd6f9-5887-46a3-bb97-9c6eebe11433 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:36.758125481 +0000 UTC m=+18.179075248 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7w4sd" (UniqueName: "kubernetes.io/projected/62cbd6f9-5887-46a3-bb97-9c6eebe11433-kube-api-access-7w4sd") pod "network-check-target-cmt44" (UID: "62cbd6f9-5887-46a3-bb97-9c6eebe11433") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 11:33:29.040947 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:29.039661 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:29.040947 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:29.039795 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfgs7" podUID="93730f02-47c1-4083-b8cb-cb6bcdb611c8" Jun 11 11:33:29.041179 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:29.041154 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:33:29.041284 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:29.041244 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmt44" podUID="62cbd6f9-5887-46a3-bb97-9c6eebe11433" Jun 11 11:33:30.040132 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:30.039596 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:33:30.040132 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:30.039743 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm9jf" podUID="ab22f9ba-926c-424d-92ba-70cdae2dbd6e" Jun 11 11:33:31.038860 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:31.038822 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:33:31.039041 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:31.038831 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:31.039041 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:31.038955 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmt44" podUID="62cbd6f9-5887-46a3-bb97-9c6eebe11433" Jun 11 11:33:31.039041 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:31.039033 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfgs7" podUID="93730f02-47c1-4083-b8cb-cb6bcdb611c8" Jun 11 11:33:32.039099 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:32.039064 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:33:32.039565 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:32.039203 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm9jf" podUID="ab22f9ba-926c-424d-92ba-70cdae2dbd6e" Jun 11 11:33:33.039325 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:33.039286 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:33.039934 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:33.039434 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfgs7" podUID="93730f02-47c1-4083-b8cb-cb6bcdb611c8" Jun 11 11:33:33.039934 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:33.039481 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:33:33.039934 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:33.039617 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmt44" podUID="62cbd6f9-5887-46a3-bb97-9c6eebe11433" Jun 11 11:33:34.038966 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:34.038930 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:33:34.039160 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:34.039058 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm9jf" podUID="ab22f9ba-926c-424d-92ba-70cdae2dbd6e" Jun 11 11:33:35.039267 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:35.039233 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:35.039794 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:35.039361 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfgs7" podUID="93730f02-47c1-4083-b8cb-cb6bcdb611c8" Jun 11 11:33:35.039794 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:35.039237 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:33:35.039794 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:35.039747 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmt44" podUID="62cbd6f9-5887-46a3-bb97-9c6eebe11433" Jun 11 11:33:36.039570 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:36.039473 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:33:36.040037 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:36.039640 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm9jf" podUID="ab22f9ba-926c-424d-92ba-70cdae2dbd6e" Jun 11 11:33:36.712796 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:36.712755 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93730f02-47c1-4083-b8cb-cb6bcdb611c8-original-pull-secret\") pod \"global-pull-secret-syncer-gfgs7\" (UID: \"93730f02-47c1-4083-b8cb-cb6bcdb611c8\") " pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:36.713018 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:36.712824 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-metrics-certs\") pod \"network-metrics-daemon-fm9jf\" (UID: \"ab22f9ba-926c-424d-92ba-70cdae2dbd6e\") " pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:33:36.713018 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:36.712915 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 11:33:36.713018 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:36.712974 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-metrics-certs podName:ab22f9ba-926c-424d-92ba-70cdae2dbd6e nodeName:}" failed. No retries permitted until 2026-06-11 11:33:52.712957831 +0000 UTC m=+34.133907593 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-metrics-certs") pod "network-metrics-daemon-fm9jf" (UID: "ab22f9ba-926c-424d-92ba-70cdae2dbd6e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 11:33:36.713018 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:36.712915 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 11:33:36.713241 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:36.713036 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93730f02-47c1-4083-b8cb-cb6bcdb611c8-original-pull-secret podName:93730f02-47c1-4083-b8cb-cb6bcdb611c8 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:52.713024223 +0000 UTC m=+34.133973983 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/93730f02-47c1-4083-b8cb-cb6bcdb611c8-original-pull-secret") pod "global-pull-secret-syncer-gfgs7" (UID: "93730f02-47c1-4083-b8cb-cb6bcdb611c8") : object "kube-system"/"original-pull-secret" not registered Jun 11 11:33:36.813327 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:36.813273 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w4sd\" (UniqueName: \"kubernetes.io/projected/62cbd6f9-5887-46a3-bb97-9c6eebe11433-kube-api-access-7w4sd\") pod \"network-check-target-cmt44\" (UID: \"62cbd6f9-5887-46a3-bb97-9c6eebe11433\") " pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:33:36.813531 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:36.813444 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 11:33:36.813531 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:36.813470 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 11:33:36.813531 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:36.813480 2580 projected.go:196] Error preparing data for projected volume kube-api-access-7w4sd for pod openshift-network-diagnostics/network-check-target-cmt44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 11:33:36.813682 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:36.813548 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62cbd6f9-5887-46a3-bb97-9c6eebe11433-kube-api-access-7w4sd podName:62cbd6f9-5887-46a3-bb97-9c6eebe11433 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:52.813533154 +0000 UTC m=+34.234482898 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7w4sd" (UniqueName: "kubernetes.io/projected/62cbd6f9-5887-46a3-bb97-9c6eebe11433-kube-api-access-7w4sd") pod "network-check-target-cmt44" (UID: "62cbd6f9-5887-46a3-bb97-9c6eebe11433") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 11:33:37.038870 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:37.038784 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:37.039037 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:37.038914 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfgs7" podUID="93730f02-47c1-4083-b8cb-cb6bcdb611c8" Jun 11 11:33:37.039037 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:37.038957 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:33:37.039132 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:37.039051 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmt44" podUID="62cbd6f9-5887-46a3-bb97-9c6eebe11433" Jun 11 11:33:38.038806 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:38.038773 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:33:38.039241 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:38.038901 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm9jf" podUID="ab22f9ba-926c-424d-92ba-70cdae2dbd6e" Jun 11 11:33:39.040133 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:39.040092 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:39.040613 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:39.040213 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfgs7" podUID="93730f02-47c1-4083-b8cb-cb6bcdb611c8" Jun 11 11:33:39.040613 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:39.040282 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:33:39.040613 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:39.040397 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmt44" podUID="62cbd6f9-5887-46a3-bb97-9c6eebe11433" Jun 11 11:33:40.038979 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:40.038939 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:33:40.039157 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:40.039052 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm9jf" podUID="ab22f9ba-926c-424d-92ba-70cdae2dbd6e" Jun 11 11:33:41.038832 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:41.038675 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:41.039437 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:41.038686 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:33:41.039437 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:41.038912 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfgs7" podUID="93730f02-47c1-4083-b8cb-cb6bcdb611c8" Jun 11 11:33:41.039437 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:41.039022 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmt44" podUID="62cbd6f9-5887-46a3-bb97-9c6eebe11433" Jun 11 11:33:41.129066 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:41.129036 2580 generic.go:356] "Generic (PLEG): container finished" podID="5b82e26a-b5a2-4106-a531-52097cb4c72e" containerID="acf6740c5f9166395cc32187d20372b52547614ba4f7b2ba138a295678cf71d9" exitCode=0 Jun 11 11:33:41.129172 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:41.129123 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5dwmf" event={"ID":"5b82e26a-b5a2-4106-a531-52097cb4c72e","Type":"ContainerDied","Data":"acf6740c5f9166395cc32187d20372b52547614ba4f7b2ba138a295678cf71d9"} Jun 11 11:33:41.133654 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:41.133637 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nntvz_8ad3e9b6-2483-4aa5-9c8c-bc31ef592342/ovn-acl-logging/0.log" Jun 11 11:33:41.134001 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:41.133978 2580 generic.go:356] "Generic (PLEG): container finished" podID="8ad3e9b6-2483-4aa5-9c8c-bc31ef592342" containerID="e7b9b4c048f883036058de4170ae85ad9ad9f97dbe97fdcc3e8d405e4516fbf0" exitCode=1 Jun 11 11:33:41.134071 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:41.134043 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" event={"ID":"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342","Type":"ContainerStarted","Data":"1abe96b7d3a8772144e5610c2cc5ac040852c38552f330c694f8bb547768e64a"} Jun 11 11:33:41.134148 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:41.134127 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" event={"ID":"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342","Type":"ContainerStarted","Data":"8e6f2e158fad8678be1819bde06d3839cc8496300f044e6e0cf62f4789abed75"} Jun 11 11:33:41.134266 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:41.134186 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" event={"ID":"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342","Type":"ContainerStarted","Data":"3bf5459f05d189826759df6aba0894035009f246fbe1b4bceccbe0635e9451fc"} Jun 11 11:33:41.134266 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:41.134236 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" event={"ID":"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342","Type":"ContainerDied","Data":"e7b9b4c048f883036058de4170ae85ad9ad9f97dbe97fdcc3e8d405e4516fbf0"} Jun 11 11:33:41.134371 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:41.134286 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" event={"ID":"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342","Type":"ContainerStarted","Data":"fcae8230d4fdc99ab65e0b5dbe34d84c619444e08b4920c79f4189da66686789"} Jun 11 11:33:41.135551 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:41.135518 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qzsk4" event={"ID":"75580ac2-a186-46af-a5c6-ab8523a85cb0","Type":"ContainerStarted","Data":"1b16df2d2bbc83f8733608d59708d3cb81e159b56d152990d37b3745af6a4e8a"} Jun 11 11:33:41.137004 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:41.136927 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hgvgn" event={"ID":"a3d40af8-b3e3-4842-b7f3-2d942702a938","Type":"ContainerStarted","Data":"b36cb2e8e9ca3e3dfa220ff5fca3790432f3aec766a654e87425a1010974ac91"} Jun 11 11:33:41.138336 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:41.138313 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-248kq" event={"ID":"9a1ee17d-116a-4dd7-8cb7-5fe10679d13f","Type":"ContainerStarted","Data":"33288a28781689ffaeae396b85c191ecbd0cc6eda3a0ca2aa32cd20c648016f9"} Jun 11 11:33:41.139880 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:41.139858 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8v8j2" event={"ID":"f2b8386f-7ce4-4da0-9810-0ff144fc4739","Type":"ContainerStarted","Data":"a5981fa852fd7ed14889eb7ed5a94b4feb3a324609073d22968453dcceba0c46"} Jun 11 11:33:41.141250 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:41.141231 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp4mh" event={"ID":"3c639b11-0c9c-4385-9ab7-1853aa425911","Type":"ContainerStarted","Data":"2720c3b5d4af23b98bf6f892eacb2890d1ec98a6816129e3921dd0e541ef8b06"} Jun 11 11:33:41.142386 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:41.142369 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" event={"ID":"21918188-202c-44b2-b12c-c7aa5dcd0cec","Type":"ContainerStarted","Data":"5712e4f3888e3ea404c57443a48a10a18347a95d1194ebed75317d263a4fab4f"} Jun 11 11:33:41.180064 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:41.180011 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qzsk4" podStartSLOduration=3.654924297 podStartE2EDuration="22.179986624s" totalImagesPullingTime="18.525062327s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 11:33:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:33:41.1662655 +0000 UTC m=+22.587215266" watchObservedRunningTime="2026-06-11 11:33:41.179986624 +0000 UTC m=+22.600936394" Jun 11 11:33:41.180171 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:41.180121 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-248kq" podStartSLOduration=4.044991185 podStartE2EDuration="22.180114341s" totalImagesPullingTime="18.135123156s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 11:33:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:33:41.179776649 +0000 UTC m=+22.600726416" watchObservedRunningTime="2026-06-11 11:33:41.180114341 +0000 UTC m=+22.601064109" Jun 11 11:33:41.196008 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:41.195955 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hq2qg" podStartSLOduration=3.666562963 podStartE2EDuration="22.1959352s" totalImagesPullingTime="18.529372237s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 11:33:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:33:41.195605028 +0000 UTC m=+22.616554797" watchObservedRunningTime="2026-06-11 11:33:41.1959352 +0000 UTC m=+22.616884995" Jun 11 11:33:41.220795 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:41.220742 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hgvgn" podStartSLOduration=4.082467781 podStartE2EDuration="22.220724075s" totalImagesPullingTime="18.138256294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:33:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:33:41.2204075 +0000 UTC m=+22.641357268" watchObservedRunningTime="2026-06-11 11:33:41.220724075 +0000 UTC m=+22.641673842" Jun 11 11:33:41.266746 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:41.266616 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8v8j2" podStartSLOduration=3.713945133 podStartE2EDuration="22.266595671s" totalImagesPullingTime="18.552650538s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 11:33:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:33:41.26625944 +0000 UTC m=+22.687209207" watchObservedRunningTime="2026-06-11 11:33:41.266595671 +0000 UTC m=+22.687545438" Jun 11 11:33:42.038656 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:42.038617 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:33:42.038830 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:42.038769 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm9jf" podUID="ab22f9ba-926c-424d-92ba-70cdae2dbd6e" Jun 11 11:33:42.131269 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:42.131233 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 11:33:42.147395 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:42.147354 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zjsjx" event={"ID":"637a52f4-ccd5-41dd-bb6d-ee7dccbd580b","Type":"ContainerStarted","Data":"67560dac3c49cda04acb66fa2003de9d569a3f19148ab0f4f7f3bf7e38b0d80c"} Jun 11 11:33:42.149425 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:42.149387 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp4mh" event={"ID":"3c639b11-0c9c-4385-9ab7-1853aa425911","Type":"ContainerStarted","Data":"591df4cabde156d90df318657b10efcae571790cf0cf30b74ed814cf0c5539a6"} Jun 11 11:33:42.152687 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:42.152667 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nntvz_8ad3e9b6-2483-4aa5-9c8c-bc31ef592342/ovn-acl-logging/0.log" Jun 11 11:33:42.153139 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:42.153115 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" event={"ID":"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342","Type":"ContainerStarted","Data":"debf4fe9c228d2896fe1ea43f8b02d54313a80e7e51be602b2dd83cdde277943"} Jun 11 11:33:42.163261 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:42.163211 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zjsjx" podStartSLOduration=5.022785694 podStartE2EDuration="23.163195872s" totalImagesPullingTime="18.140410178s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 11:33:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:33:42.162675314 +0000 UTC m=+23.583625085" watchObservedRunningTime="2026-06-11 11:33:42.163195872 +0000 UTC m=+23.584145638" Jun 11 11:33:43.035088 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:43.034976 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T11:33:42.131260183Z","UUID":"60015f40-c68a-41f9-a019-b72acaf292b1","Handler":null,"Name":"","Endpoint":""} Jun 11 11:33:43.036799 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:43.036771 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 11:33:43.036931 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:43.036817 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 11:33:43.038960 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:43.038524 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:43.038960 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:43.038583 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:33:43.038960 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:43.038721 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfgs7" podUID="93730f02-47c1-4083-b8cb-cb6bcdb611c8" Jun 11 11:33:43.038960 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:43.038809 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmt44" podUID="62cbd6f9-5887-46a3-bb97-9c6eebe11433" Jun 11 11:33:43.157795 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:43.157745 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp4mh" event={"ID":"3c639b11-0c9c-4385-9ab7-1853aa425911","Type":"ContainerStarted","Data":"0fad2b3947699c3c628fe2afc8e1764f7c0a47c9b81819e6955ad88e3a08d6f7"} Jun 11 11:33:43.178927 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:43.178875 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp4mh" podStartSLOduration=3.593741918 podStartE2EDuration="24.178853151s" totalImagesPullingTime="20.585111233s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 11:33:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:33:43.178765223 +0000 UTC m=+24.599714991" watchObservedRunningTime="2026-06-11 11:33:43.178853151 +0000 UTC m=+24.599802919" Jun 11 11:33:44.038852 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:44.038822 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:33:44.039066 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:44.038956 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm9jf" podUID="ab22f9ba-926c-424d-92ba-70cdae2dbd6e" Jun 11 11:33:44.165082 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:44.165047 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nntvz_8ad3e9b6-2483-4aa5-9c8c-bc31ef592342/ovn-acl-logging/0.log" Jun 11 11:33:44.165581 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:44.165527 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" event={"ID":"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342","Type":"ContainerStarted","Data":"215baf0f359590b94691db78ed259c79d0c76291b9d794276f624d14fb0e0ab7"} Jun 11 11:33:45.039638 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:45.039600 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:45.039829 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:45.039615 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:33:45.039829 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:45.039738 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfgs7" podUID="93730f02-47c1-4083-b8cb-cb6bcdb611c8" Jun 11 11:33:45.039944 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:45.039824 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmt44" podUID="62cbd6f9-5887-46a3-bb97-9c6eebe11433" Jun 11 11:33:46.039078 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:46.038904 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:33:46.039759 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:46.039159 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm9jf" podUID="ab22f9ba-926c-424d-92ba-70cdae2dbd6e" Jun 11 11:33:46.049043 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:46.049013 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hgvgn" Jun 11 11:33:46.049561 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:46.049541 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hgvgn" Jun 11 11:33:46.171900 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:46.171868 2580 generic.go:356] "Generic (PLEG): container finished" podID="5b82e26a-b5a2-4106-a531-52097cb4c72e" containerID="1f689e5de20e8de605042eccd52119c29c7a4342708308fac7022cd7fad53075" exitCode=0 Jun 11 11:33:46.172089 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:46.171950 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5dwmf" event={"ID":"5b82e26a-b5a2-4106-a531-52097cb4c72e","Type":"ContainerDied","Data":"1f689e5de20e8de605042eccd52119c29c7a4342708308fac7022cd7fad53075"} Jun 11 11:33:46.175353 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:46.175336 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nntvz_8ad3e9b6-2483-4aa5-9c8c-bc31ef592342/ovn-acl-logging/0.log" Jun 11 11:33:46.175800 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:46.175778 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" event={"ID":"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342","Type":"ContainerStarted","Data":"d22bcbf92b88c043906637de72ecd17bead00fb18b438088af3ca74912428168"} Jun 11 11:33:46.176137 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:46.176050 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hgvgn" Jun 11 11:33:46.176263 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:46.176242 2580 scope.go:117] "RemoveContainer" containerID="e7b9b4c048f883036058de4170ae85ad9ad9f97dbe97fdcc3e8d405e4516fbf0" Jun 11 11:33:46.176436 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:46.176413 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hgvgn" Jun 11 11:33:47.039110 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:47.039067 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:47.039529 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:47.039074 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:33:47.039529 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:47.039211 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfgs7" podUID="93730f02-47c1-4083-b8cb-cb6bcdb611c8" Jun 11 11:33:47.039529 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:47.039256 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmt44" podUID="62cbd6f9-5887-46a3-bb97-9c6eebe11433" Jun 11 11:33:47.181039 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:47.180951 2580 generic.go:356] "Generic (PLEG): container finished" podID="5b82e26a-b5a2-4106-a531-52097cb4c72e" containerID="6a00bdbba67f1668b69ac13faaa2e64fc2b285e05f270460044d353e5ea54979" exitCode=0 Jun 11 11:33:47.181039 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:47.180998 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5dwmf" event={"ID":"5b82e26a-b5a2-4106-a531-52097cb4c72e","Type":"ContainerDied","Data":"6a00bdbba67f1668b69ac13faaa2e64fc2b285e05f270460044d353e5ea54979"} Jun 11 11:33:47.188065 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:47.188036 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nntvz_8ad3e9b6-2483-4aa5-9c8c-bc31ef592342/ovn-acl-logging/0.log" Jun 11 11:33:47.188918 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:47.188595 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" event={"ID":"8ad3e9b6-2483-4aa5-9c8c-bc31ef592342","Type":"ContainerStarted","Data":"00ada321982890405e08e2d03b8c68a0573c2e2b68e5bc7bce251eb92daebec0"} Jun 11 11:33:47.188918 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:47.188732 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:47.188918 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:47.188805 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:47.188918 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:47.188877 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:47.206790 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:47.206764 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:47.206953 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:47.206896 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:33:47.229855 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:47.229810 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" podStartSLOduration=9.655576663 podStartE2EDuration="28.229791795s" totalImagesPullingTime="18.574215132s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 11:33:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:33:47.228330038 +0000 UTC m=+28.649279821" watchObservedRunningTime="2026-06-11 11:33:47.229791795 +0000 UTC m=+28.650741562" Jun 11 11:33:47.452550 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:47.452517 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fm9jf"] Jun 11 11:33:47.452731 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:47.452651 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:33:47.452772 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:47.452738 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm9jf" podUID="ab22f9ba-926c-424d-92ba-70cdae2dbd6e" Jun 11 11:33:47.454850 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:47.454810 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gfgs7"] Jun 11 11:33:47.454978 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:47.454909 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:47.455034 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:47.455012 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfgs7" podUID="93730f02-47c1-4083-b8cb-cb6bcdb611c8" Jun 11 11:33:47.464723 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:47.464696 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cmt44"] Jun 11 11:33:47.464874 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:47.464798 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:33:47.464935 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:47.464901 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmt44" podUID="62cbd6f9-5887-46a3-bb97-9c6eebe11433" Jun 11 11:33:48.193450 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:48.193412 2580 generic.go:356] "Generic (PLEG): container finished" podID="5b82e26a-b5a2-4106-a531-52097cb4c72e" containerID="9f1a2a7564006e13c8b068279ac8120430f9488010dc47e65560ea9313815fcf" exitCode=0 Jun 11 11:33:48.193835 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:48.193472 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5dwmf" event={"ID":"5b82e26a-b5a2-4106-a531-52097cb4c72e","Type":"ContainerDied","Data":"9f1a2a7564006e13c8b068279ac8120430f9488010dc47e65560ea9313815fcf"} Jun 11 11:33:49.040155 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:49.039798 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:49.040155 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:49.039893 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:33:49.040155 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:49.039939 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:33:49.040155 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:49.039950 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfgs7" podUID="93730f02-47c1-4083-b8cb-cb6bcdb611c8" Jun 11 11:33:49.040155 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:49.040034 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm9jf" podUID="ab22f9ba-926c-424d-92ba-70cdae2dbd6e" Jun 11 11:33:49.040155 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:49.040112 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmt44" podUID="62cbd6f9-5887-46a3-bb97-9c6eebe11433" Jun 11 11:33:51.039937 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:51.039700 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:51.040377 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:51.039729 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:33:51.040377 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:51.039813 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:33:51.040377 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:51.040042 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfgs7" podUID="93730f02-47c1-4083-b8cb-cb6bcdb611c8" Jun 11 11:33:51.040377 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:51.040165 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmt44" podUID="62cbd6f9-5887-46a3-bb97-9c6eebe11433" Jun 11 11:33:51.040377 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:51.040295 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm9jf" podUID="ab22f9ba-926c-424d-92ba-70cdae2dbd6e" Jun 11 11:33:52.738706 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:52.738669 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-metrics-certs\") pod \"network-metrics-daemon-fm9jf\" (UID: \"ab22f9ba-926c-424d-92ba-70cdae2dbd6e\") " pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:33:52.739164 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:52.738719 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93730f02-47c1-4083-b8cb-cb6bcdb611c8-original-pull-secret\") pod \"global-pull-secret-syncer-gfgs7\" (UID: \"93730f02-47c1-4083-b8cb-cb6bcdb611c8\") " pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:52.739164 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:52.738820 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 11:33:52.739164 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:52.738835 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 11:33:52.739164 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:52.738874 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93730f02-47c1-4083-b8cb-cb6bcdb611c8-original-pull-secret podName:93730f02-47c1-4083-b8cb-cb6bcdb611c8 nodeName:}" failed. No retries permitted until 2026-06-11 11:34:24.738860048 +0000 UTC m=+66.159809792 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/93730f02-47c1-4083-b8cb-cb6bcdb611c8-original-pull-secret") pod "global-pull-secret-syncer-gfgs7" (UID: "93730f02-47c1-4083-b8cb-cb6bcdb611c8") : object "kube-system"/"original-pull-secret" not registered Jun 11 11:33:52.739164 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:52.738907 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-metrics-certs podName:ab22f9ba-926c-424d-92ba-70cdae2dbd6e nodeName:}" failed. No retries permitted until 2026-06-11 11:34:24.738888408 +0000 UTC m=+66.159838153 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-metrics-certs") pod "network-metrics-daemon-fm9jf" (UID: "ab22f9ba-926c-424d-92ba-70cdae2dbd6e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 11:33:52.839522 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:52.839473 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w4sd\" (UniqueName: \"kubernetes.io/projected/62cbd6f9-5887-46a3-bb97-9c6eebe11433-kube-api-access-7w4sd\") pod \"network-check-target-cmt44\" (UID: \"62cbd6f9-5887-46a3-bb97-9c6eebe11433\") " pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:33:52.839723 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:52.839679 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 11:33:52.839723 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:52.839699 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 11:33:52.839723 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:52.839708 2580 projected.go:196] Error preparing data for projected volume kube-api-access-7w4sd for pod openshift-network-diagnostics/network-check-target-cmt44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 11:33:52.839836 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:52.839760 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62cbd6f9-5887-46a3-bb97-9c6eebe11433-kube-api-access-7w4sd podName:62cbd6f9-5887-46a3-bb97-9c6eebe11433 nodeName:}" failed. No retries permitted until 2026-06-11 11:34:24.839743998 +0000 UTC m=+66.260693762 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7w4sd" (UniqueName: "kubernetes.io/projected/62cbd6f9-5887-46a3-bb97-9c6eebe11433-kube-api-access-7w4sd") pod "network-check-target-cmt44" (UID: "62cbd6f9-5887-46a3-bb97-9c6eebe11433") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 11:33:53.038892 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.038799 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:53.039066 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.038960 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:33:53.039066 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:53.038960 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfgs7" podUID="93730f02-47c1-4083-b8cb-cb6bcdb611c8" Jun 11 11:33:53.039066 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.038960 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:33:53.039066 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:53.039050 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmt44" podUID="62cbd6f9-5887-46a3-bb97-9c6eebe11433" Jun 11 11:33:53.039278 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:53.039166 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm9jf" podUID="ab22f9ba-926c-424d-92ba-70cdae2dbd6e" Jun 11 11:33:53.211102 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.211070 2580 generic.go:356] "Generic (PLEG): container finished" podID="5b82e26a-b5a2-4106-a531-52097cb4c72e" containerID="f80054e54692e18797cafb78209caae403bbab56634a89d8bf7f677459720e30" exitCode=0 Jun 11 11:33:53.211255 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.211122 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5dwmf" event={"ID":"5b82e26a-b5a2-4106-a531-52097cb4c72e","Type":"ContainerDied","Data":"f80054e54692e18797cafb78209caae403bbab56634a89d8bf7f677459720e30"} Jun 11 11:33:53.411365 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.411337 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeReady" Jun 11 11:33:53.411520 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.411473 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 11:33:53.462139 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.462101 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-26k5q"] Jun 11 11:33:53.473939 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.473911 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fpp88"] Jun 11 11:33:53.474089 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.474056 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-26k5q" Jun 11 11:33:53.476671 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.476599 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 11:33:53.476671 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.476607 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hp5rt\"" Jun 11 11:33:53.477116 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.477094 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 11:33:53.485718 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.485691 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fpp88"] Jun 11 11:33:53.485718 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.485724 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-26k5q"] Jun 11 11:33:53.485872 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.485808 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fpp88" Jun 11 11:33:53.488166 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.488148 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 11:33:53.488361 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.488345 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 11:33:53.488413 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.488397 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 11:33:53.488413 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.488392 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8npjn\"" Jun 11 11:33:53.644522 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.644407 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63893922-9918-454e-a94a-211ec0539b46-metrics-tls\") pod \"dns-default-26k5q\" (UID: \"63893922-9918-454e-a94a-211ec0539b46\") " pod="openshift-dns/dns-default-26k5q" Jun 11 11:33:53.644522 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.644469 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn2rn\" (UniqueName: \"kubernetes.io/projected/78e7c710-3a05-4255-8c23-759e9bd47586-kube-api-access-fn2rn\") pod \"ingress-canary-fpp88\" (UID: \"78e7c710-3a05-4255-8c23-759e9bd47586\") " pod="openshift-ingress-canary/ingress-canary-fpp88" Jun 11 11:33:53.644720 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.644550 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78e7c710-3a05-4255-8c23-759e9bd47586-cert\") pod \"ingress-canary-fpp88\" (UID: \"78e7c710-3a05-4255-8c23-759e9bd47586\") " pod="openshift-ingress-canary/ingress-canary-fpp88" Jun 11 11:33:53.644720 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.644601 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/63893922-9918-454e-a94a-211ec0539b46-config-volume\") pod \"dns-default-26k5q\" (UID: \"63893922-9918-454e-a94a-211ec0539b46\") " pod="openshift-dns/dns-default-26k5q" Jun 11 11:33:53.644720 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.644622 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63893922-9918-454e-a94a-211ec0539b46-tmp-dir\") pod \"dns-default-26k5q\" (UID: \"63893922-9918-454e-a94a-211ec0539b46\") " pod="openshift-dns/dns-default-26k5q" Jun 11 11:33:53.644720 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.644636 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc7wd\" (UniqueName: \"kubernetes.io/projected/63893922-9918-454e-a94a-211ec0539b46-kube-api-access-bc7wd\") pod \"dns-default-26k5q\" (UID: \"63893922-9918-454e-a94a-211ec0539b46\") " pod="openshift-dns/dns-default-26k5q" Jun 11 11:33:53.745295 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.745261 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63893922-9918-454e-a94a-211ec0539b46-metrics-tls\") pod \"dns-default-26k5q\" (UID: \"63893922-9918-454e-a94a-211ec0539b46\") " pod="openshift-dns/dns-default-26k5q" Jun 11 11:33:53.745913 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.745321 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn2rn\" (UniqueName: \"kubernetes.io/projected/78e7c710-3a05-4255-8c23-759e9bd47586-kube-api-access-fn2rn\") pod \"ingress-canary-fpp88\" (UID: \"78e7c710-3a05-4255-8c23-759e9bd47586\") " pod="openshift-ingress-canary/ingress-canary-fpp88" Jun 11 11:33:53.745913 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.745356 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78e7c710-3a05-4255-8c23-759e9bd47586-cert\") pod \"ingress-canary-fpp88\" (UID: \"78e7c710-3a05-4255-8c23-759e9bd47586\") " pod="openshift-ingress-canary/ingress-canary-fpp88" Jun 11 11:33:53.745913 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.745381 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/63893922-9918-454e-a94a-211ec0539b46-config-volume\") pod \"dns-default-26k5q\" (UID: \"63893922-9918-454e-a94a-211ec0539b46\") " pod="openshift-dns/dns-default-26k5q" Jun 11 11:33:53.745913 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:53.745428 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 11:33:53.745913 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:53.745515 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63893922-9918-454e-a94a-211ec0539b46-metrics-tls podName:63893922-9918-454e-a94a-211ec0539b46 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:54.245473448 +0000 UTC m=+35.666423201 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63893922-9918-454e-a94a-211ec0539b46-metrics-tls") pod "dns-default-26k5q" (UID: "63893922-9918-454e-a94a-211ec0539b46") : secret "dns-default-metrics-tls" not found Jun 11 11:33:53.745913 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.745432 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63893922-9918-454e-a94a-211ec0539b46-tmp-dir\") pod \"dns-default-26k5q\" (UID: \"63893922-9918-454e-a94a-211ec0539b46\") " pod="openshift-dns/dns-default-26k5q" Jun 11 11:33:53.745913 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.745592 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc7wd\" (UniqueName: \"kubernetes.io/projected/63893922-9918-454e-a94a-211ec0539b46-kube-api-access-bc7wd\") pod \"dns-default-26k5q\" (UID: \"63893922-9918-454e-a94a-211ec0539b46\") " pod="openshift-dns/dns-default-26k5q" Jun 11 11:33:53.745913 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.745806 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63893922-9918-454e-a94a-211ec0539b46-tmp-dir\") pod \"dns-default-26k5q\" (UID: \"63893922-9918-454e-a94a-211ec0539b46\") " pod="openshift-dns/dns-default-26k5q" Jun 11 11:33:53.746180 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.746070 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/63893922-9918-454e-a94a-211ec0539b46-config-volume\") pod \"dns-default-26k5q\" (UID: \"63893922-9918-454e-a94a-211ec0539b46\") " pod="openshift-dns/dns-default-26k5q" Jun 11 11:33:53.749243 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.749223 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78e7c710-3a05-4255-8c23-759e9bd47586-cert\") pod \"ingress-canary-fpp88\" (UID: \"78e7c710-3a05-4255-8c23-759e9bd47586\") " pod="openshift-ingress-canary/ingress-canary-fpp88" Jun 11 11:33:53.754322 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.754289 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn2rn\" (UniqueName: \"kubernetes.io/projected/78e7c710-3a05-4255-8c23-759e9bd47586-kube-api-access-fn2rn\") pod \"ingress-canary-fpp88\" (UID: \"78e7c710-3a05-4255-8c23-759e9bd47586\") " pod="openshift-ingress-canary/ingress-canary-fpp88" Jun 11 11:33:53.754608 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.754589 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc7wd\" (UniqueName: \"kubernetes.io/projected/63893922-9918-454e-a94a-211ec0539b46-kube-api-access-bc7wd\") pod \"dns-default-26k5q\" (UID: \"63893922-9918-454e-a94a-211ec0539b46\") " pod="openshift-dns/dns-default-26k5q" Jun 11 11:33:53.794392 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.794354 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fpp88" Jun 11 11:33:53.989308 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:53.989129 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fpp88"] Jun 11 11:33:53.993156 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:53.993128 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78e7c710_3a05_4255_8c23_759e9bd47586.slice/crio-ffec32f6aa7c33eb0b021aa2884a3fb9a5b27fae0a0bee0b72ef0c772d526e56 WatchSource:0}: Error finding container ffec32f6aa7c33eb0b021aa2884a3fb9a5b27fae0a0bee0b72ef0c772d526e56: Status 404 returned error can't find the container with id ffec32f6aa7c33eb0b021aa2884a3fb9a5b27fae0a0bee0b72ef0c772d526e56 Jun 11 11:33:54.214214 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:54.214177 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fpp88" event={"ID":"78e7c710-3a05-4255-8c23-759e9bd47586","Type":"ContainerStarted","Data":"ffec32f6aa7c33eb0b021aa2884a3fb9a5b27fae0a0bee0b72ef0c772d526e56"} Jun 11 11:33:54.217229 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:54.217200 2580 generic.go:356] "Generic (PLEG): container finished" podID="5b82e26a-b5a2-4106-a531-52097cb4c72e" containerID="7abd310968cea75086e71ef7d6ef27b7b391dc8d0dfb797e8e5d9a59cf82ab23" exitCode=0 Jun 11 11:33:54.217339 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:54.217245 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5dwmf" event={"ID":"5b82e26a-b5a2-4106-a531-52097cb4c72e","Type":"ContainerDied","Data":"7abd310968cea75086e71ef7d6ef27b7b391dc8d0dfb797e8e5d9a59cf82ab23"} Jun 11 11:33:54.250196 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:54.250166 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63893922-9918-454e-a94a-211ec0539b46-metrics-tls\") pod \"dns-default-26k5q\" (UID: \"63893922-9918-454e-a94a-211ec0539b46\") " pod="openshift-dns/dns-default-26k5q" Jun 11 11:33:54.250343 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:54.250282 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 11:33:54.250343 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:54.250329 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63893922-9918-454e-a94a-211ec0539b46-metrics-tls podName:63893922-9918-454e-a94a-211ec0539b46 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:55.250315887 +0000 UTC m=+36.671265632 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63893922-9918-454e-a94a-211ec0539b46-metrics-tls") pod "dns-default-26k5q" (UID: "63893922-9918-454e-a94a-211ec0539b46") : secret "dns-default-metrics-tls" not found Jun 11 11:33:55.039288 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:55.039251 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:33:55.039949 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:55.039252 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:33:55.039949 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:55.039392 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:33:55.043047 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:55.042877 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 11:33:55.043047 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:55.042912 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 11:33:55.043047 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:55.042932 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 11:33:55.043047 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:55.042915 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-shl4d\"" Jun 11 11:33:55.043047 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:55.043002 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 11:33:55.043047 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:55.043007 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rxm4w\"" Jun 11 11:33:55.223130 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:55.223095 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5dwmf" event={"ID":"5b82e26a-b5a2-4106-a531-52097cb4c72e","Type":"ContainerStarted","Data":"4f0726f84fa5111e314b4c53c2869de0ea8b0ed63a235b351bad5766216e07f7"} Jun 11 11:33:55.244196 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:55.244147 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5dwmf" podStartSLOduration=7.931349651 podStartE2EDuration="36.244131758s" totalImagesPullingTime="28.312782107s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 11:33:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:33:55.24284346 +0000 UTC m=+36.663793227" watchObservedRunningTime="2026-06-11 11:33:55.244131758 +0000 UTC m=+36.665081524" Jun 11 11:33:55.258131 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:55.258094 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63893922-9918-454e-a94a-211ec0539b46-metrics-tls\") pod \"dns-default-26k5q\" (UID: \"63893922-9918-454e-a94a-211ec0539b46\") " pod="openshift-dns/dns-default-26k5q" Jun 11 11:33:55.258333 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:55.258258 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 11:33:55.258333 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:55.258326 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63893922-9918-454e-a94a-211ec0539b46-metrics-tls podName:63893922-9918-454e-a94a-211ec0539b46 nodeName:}" failed. No retries permitted until 2026-06-11 11:33:57.258309381 +0000 UTC m=+38.679259126 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63893922-9918-454e-a94a-211ec0539b46-metrics-tls") pod "dns-default-26k5q" (UID: "63893922-9918-454e-a94a-211ec0539b46") : secret "dns-default-metrics-tls" not found Jun 11 11:33:56.411167 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.411089 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c9b7d9db4-vhztz"] Jun 11 11:33:56.424902 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.424870 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-54c994c564-rkx7q"] Jun 11 11:33:56.425069 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.424927 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c9b7d9db4-vhztz" Jun 11 11:33:56.428948 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.428919 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 11:33:56.430187 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.430011 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-tc8px\"" Jun 11 11:33:56.430187 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.430020 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 11 11:33:56.430187 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.430050 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 11:33:56.430187 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.430054 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 11:33:56.441053 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.441025 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h"] Jun 11 11:33:56.441205 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.441138 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54c994c564-rkx7q" Jun 11 11:33:56.446352 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.446329 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 11 11:33:56.472189 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.472150 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c9b7d9db4-vhztz"] Jun 11 11:33:56.472359 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.472227 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-54c994c564-rkx7q"] Jun 11 11:33:56.472359 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.472267 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h"] Jun 11 11:33:56.472359 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.472300 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" Jun 11 11:33:56.476834 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.476802 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 11 11:33:56.476997 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.476887 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 11 11:33:56.477795 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.477773 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 11 11:33:56.477913 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.477773 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 11 11:33:56.571711 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.571673 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/95eb7be8-16f8-4817-983b-397c61906b5c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c9b7d9db4-vhztz\" (UID: \"95eb7be8-16f8-4817-983b-397c61906b5c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c9b7d9db4-vhztz" Jun 11 11:33:56.571920 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.571732 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2bw4\" (UniqueName: \"kubernetes.io/projected/95eb7be8-16f8-4817-983b-397c61906b5c-kube-api-access-n2bw4\") pod \"managed-serviceaccount-addon-agent-c9b7d9db4-vhztz\" (UID: \"95eb7be8-16f8-4817-983b-397c61906b5c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c9b7d9db4-vhztz" Jun 11 11:33:56.571920 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.571758 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/90fc0df0-cafb-4c60-8d52-a8345511863d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5fbdc4895-jg97h\" (UID: \"90fc0df0-cafb-4c60-8d52-a8345511863d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" Jun 11 11:33:56.571920 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.571786 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jddk\" (UniqueName: \"kubernetes.io/projected/3000e68f-db81-4db8-8039-4d244124678c-kube-api-access-9jddk\") pod \"klusterlet-addon-workmgr-54c994c564-rkx7q\" (UID: \"3000e68f-db81-4db8-8039-4d244124678c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54c994c564-rkx7q" Jun 11 11:33:56.571920 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.571803 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/90fc0df0-cafb-4c60-8d52-a8345511863d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5fbdc4895-jg97h\" (UID: \"90fc0df0-cafb-4c60-8d52-a8345511863d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" Jun 11 11:33:56.571920 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.571822 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/90fc0df0-cafb-4c60-8d52-a8345511863d-ca\") pod \"cluster-proxy-proxy-agent-5fbdc4895-jg97h\" (UID: \"90fc0df0-cafb-4c60-8d52-a8345511863d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" Jun 11 11:33:56.571920 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.571883 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/90fc0df0-cafb-4c60-8d52-a8345511863d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5fbdc4895-jg97h\" (UID: \"90fc0df0-cafb-4c60-8d52-a8345511863d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" Jun 11 11:33:56.572202 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.571928 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3000e68f-db81-4db8-8039-4d244124678c-klusterlet-config\") pod \"klusterlet-addon-workmgr-54c994c564-rkx7q\" (UID: \"3000e68f-db81-4db8-8039-4d244124678c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54c994c564-rkx7q" Jun 11 11:33:56.572202 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.571954 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/90fc0df0-cafb-4c60-8d52-a8345511863d-hub\") pod \"cluster-proxy-proxy-agent-5fbdc4895-jg97h\" (UID: \"90fc0df0-cafb-4c60-8d52-a8345511863d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" Jun 11 11:33:56.572202 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.572007 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3000e68f-db81-4db8-8039-4d244124678c-tmp\") pod \"klusterlet-addon-workmgr-54c994c564-rkx7q\" (UID: \"3000e68f-db81-4db8-8039-4d244124678c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54c994c564-rkx7q" Jun 11 11:33:56.572202 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.572036 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jr2r\" (UniqueName: \"kubernetes.io/projected/90fc0df0-cafb-4c60-8d52-a8345511863d-kube-api-access-7jr2r\") pod \"cluster-proxy-proxy-agent-5fbdc4895-jg97h\" (UID: \"90fc0df0-cafb-4c60-8d52-a8345511863d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" Jun 11 11:33:56.672804 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.672703 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/90fc0df0-cafb-4c60-8d52-a8345511863d-hub\") pod \"cluster-proxy-proxy-agent-5fbdc4895-jg97h\" (UID: \"90fc0df0-cafb-4c60-8d52-a8345511863d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" Jun 11 11:33:56.672804 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.672764 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3000e68f-db81-4db8-8039-4d244124678c-tmp\") pod \"klusterlet-addon-workmgr-54c994c564-rkx7q\" (UID: \"3000e68f-db81-4db8-8039-4d244124678c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54c994c564-rkx7q" Jun 11 11:33:56.673027 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.672787 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jr2r\" (UniqueName: \"kubernetes.io/projected/90fc0df0-cafb-4c60-8d52-a8345511863d-kube-api-access-7jr2r\") pod \"cluster-proxy-proxy-agent-5fbdc4895-jg97h\" (UID: \"90fc0df0-cafb-4c60-8d52-a8345511863d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" Jun 11 11:33:56.673027 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.672887 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/95eb7be8-16f8-4817-983b-397c61906b5c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c9b7d9db4-vhztz\" (UID: \"95eb7be8-16f8-4817-983b-397c61906b5c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c9b7d9db4-vhztz" Jun 11 11:33:56.673027 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.672937 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2bw4\" (UniqueName: \"kubernetes.io/projected/95eb7be8-16f8-4817-983b-397c61906b5c-kube-api-access-n2bw4\") pod \"managed-serviceaccount-addon-agent-c9b7d9db4-vhztz\" (UID: \"95eb7be8-16f8-4817-983b-397c61906b5c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c9b7d9db4-vhztz" Jun 11 11:33:56.673027 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.672960 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/90fc0df0-cafb-4c60-8d52-a8345511863d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5fbdc4895-jg97h\" (UID: \"90fc0df0-cafb-4c60-8d52-a8345511863d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" Jun 11 11:33:56.673215 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.673095 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jddk\" (UniqueName: \"kubernetes.io/projected/3000e68f-db81-4db8-8039-4d244124678c-kube-api-access-9jddk\") pod \"klusterlet-addon-workmgr-54c994c564-rkx7q\" (UID: \"3000e68f-db81-4db8-8039-4d244124678c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54c994c564-rkx7q" Jun 11 11:33:56.673215 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.673134 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/90fc0df0-cafb-4c60-8d52-a8345511863d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5fbdc4895-jg97h\" (UID: \"90fc0df0-cafb-4c60-8d52-a8345511863d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" Jun 11 11:33:56.673215 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.673169 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/90fc0df0-cafb-4c60-8d52-a8345511863d-ca\") pod \"cluster-proxy-proxy-agent-5fbdc4895-jg97h\" (UID: \"90fc0df0-cafb-4c60-8d52-a8345511863d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" Jun 11 11:33:56.673215 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.673199 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/90fc0df0-cafb-4c60-8d52-a8345511863d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5fbdc4895-jg97h\" (UID: \"90fc0df0-cafb-4c60-8d52-a8345511863d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" Jun 11 11:33:56.673387 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.673226 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3000e68f-db81-4db8-8039-4d244124678c-klusterlet-config\") pod \"klusterlet-addon-workmgr-54c994c564-rkx7q\" (UID: \"3000e68f-db81-4db8-8039-4d244124678c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54c994c564-rkx7q" Jun 11 11:33:56.673695 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.673462 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3000e68f-db81-4db8-8039-4d244124678c-tmp\") pod \"klusterlet-addon-workmgr-54c994c564-rkx7q\" (UID: \"3000e68f-db81-4db8-8039-4d244124678c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54c994c564-rkx7q" Jun 11 11:33:56.674275 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.674248 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/90fc0df0-cafb-4c60-8d52-a8345511863d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5fbdc4895-jg97h\" (UID: \"90fc0df0-cafb-4c60-8d52-a8345511863d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" Jun 11 11:33:56.676959 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.676938 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/90fc0df0-cafb-4c60-8d52-a8345511863d-ca\") pod \"cluster-proxy-proxy-agent-5fbdc4895-jg97h\" (UID: \"90fc0df0-cafb-4c60-8d52-a8345511863d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" Jun 11 11:33:56.677092 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.677073 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/90fc0df0-cafb-4c60-8d52-a8345511863d-hub\") pod \"cluster-proxy-proxy-agent-5fbdc4895-jg97h\" (UID: \"90fc0df0-cafb-4c60-8d52-a8345511863d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" Jun 11 11:33:56.677136 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.677072 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/90fc0df0-cafb-4c60-8d52-a8345511863d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5fbdc4895-jg97h\" (UID: \"90fc0df0-cafb-4c60-8d52-a8345511863d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" Jun 11 11:33:56.677193 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.677172 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/95eb7be8-16f8-4817-983b-397c61906b5c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c9b7d9db4-vhztz\" (UID: \"95eb7be8-16f8-4817-983b-397c61906b5c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c9b7d9db4-vhztz" Jun 11 11:33:56.677240 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.677224 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/90fc0df0-cafb-4c60-8d52-a8345511863d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5fbdc4895-jg97h\" (UID: \"90fc0df0-cafb-4c60-8d52-a8345511863d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" Jun 11 11:33:56.677795 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.677772 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3000e68f-db81-4db8-8039-4d244124678c-klusterlet-config\") pod \"klusterlet-addon-workmgr-54c994c564-rkx7q\" (UID: \"3000e68f-db81-4db8-8039-4d244124678c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54c994c564-rkx7q" Jun 11 11:33:56.681930 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.681906 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jr2r\" (UniqueName: \"kubernetes.io/projected/90fc0df0-cafb-4c60-8d52-a8345511863d-kube-api-access-7jr2r\") pod \"cluster-proxy-proxy-agent-5fbdc4895-jg97h\" (UID: \"90fc0df0-cafb-4c60-8d52-a8345511863d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" Jun 11 11:33:56.682018 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.681907 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2bw4\" (UniqueName: \"kubernetes.io/projected/95eb7be8-16f8-4817-983b-397c61906b5c-kube-api-access-n2bw4\") pod \"managed-serviceaccount-addon-agent-c9b7d9db4-vhztz\" (UID: \"95eb7be8-16f8-4817-983b-397c61906b5c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c9b7d9db4-vhztz" Jun 11 11:33:56.682122 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.682100 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jddk\" (UniqueName: \"kubernetes.io/projected/3000e68f-db81-4db8-8039-4d244124678c-kube-api-access-9jddk\") pod \"klusterlet-addon-workmgr-54c994c564-rkx7q\" (UID: \"3000e68f-db81-4db8-8039-4d244124678c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54c994c564-rkx7q" Jun 11 11:33:56.741575 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.741537 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c9b7d9db4-vhztz" Jun 11 11:33:56.750718 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.750686 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54c994c564-rkx7q" Jun 11 11:33:56.781093 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.781061 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" Jun 11 11:33:56.934773 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.934740 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c9b7d9db4-vhztz"] Jun 11 11:33:56.938775 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:56.938741 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95eb7be8_16f8_4817_983b_397c61906b5c.slice/crio-2ac1908c6bd2d4fc0ab36364bd94d4530ebb76de134320f4ba9009c8f8bd7d33 WatchSource:0}: Error finding container 2ac1908c6bd2d4fc0ab36364bd94d4530ebb76de134320f4ba9009c8f8bd7d33: Status 404 returned error can't find the container with id 2ac1908c6bd2d4fc0ab36364bd94d4530ebb76de134320f4ba9009c8f8bd7d33 Jun 11 11:33:56.954590 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.954558 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-54c994c564-rkx7q"] Jun 11 11:33:56.957985 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:56.957957 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3000e68f_db81_4db8_8039_4d244124678c.slice/crio-6b8acd383cfb98d831fb00cd995d212e0b7da90ab49a2ad0e33bcae4e509bf86 WatchSource:0}: Error finding container 6b8acd383cfb98d831fb00cd995d212e0b7da90ab49a2ad0e33bcae4e509bf86: Status 404 returned error can't find the container with id 6b8acd383cfb98d831fb00cd995d212e0b7da90ab49a2ad0e33bcae4e509bf86 Jun 11 11:33:56.981311 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:56.981194 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h"] Jun 11 11:33:56.986407 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:33:56.986376 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90fc0df0_cafb_4c60_8d52_a8345511863d.slice/crio-77b365fcd85461b8d2811ca34e54fe950d9d64e872a1846e0d9f53b4b39bfa81 WatchSource:0}: Error finding container 77b365fcd85461b8d2811ca34e54fe950d9d64e872a1846e0d9f53b4b39bfa81: Status 404 returned error can't find the container with id 77b365fcd85461b8d2811ca34e54fe950d9d64e872a1846e0d9f53b4b39bfa81 Jun 11 11:33:57.229047 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:57.229012 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c9b7d9db4-vhztz" event={"ID":"95eb7be8-16f8-4817-983b-397c61906b5c","Type":"ContainerStarted","Data":"2ac1908c6bd2d4fc0ab36364bd94d4530ebb76de134320f4ba9009c8f8bd7d33"} Jun 11 11:33:57.230366 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:57.230341 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fpp88" event={"ID":"78e7c710-3a05-4255-8c23-759e9bd47586","Type":"ContainerStarted","Data":"766cbe861a20d521612a9b32ccca53075b876d0174ad99e377d69a792e080d6c"} Jun 11 11:33:57.231456 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:57.231436 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" event={"ID":"90fc0df0-cafb-4c60-8d52-a8345511863d","Type":"ContainerStarted","Data":"77b365fcd85461b8d2811ca34e54fe950d9d64e872a1846e0d9f53b4b39bfa81"} Jun 11 11:33:57.232450 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:57.232430 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54c994c564-rkx7q" event={"ID":"3000e68f-db81-4db8-8039-4d244124678c","Type":"ContainerStarted","Data":"6b8acd383cfb98d831fb00cd995d212e0b7da90ab49a2ad0e33bcae4e509bf86"} Jun 11 11:33:57.245651 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:57.245594 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fpp88" podStartSLOduration=2.107417896 podStartE2EDuration="4.245571093s" totalImagesPullingTime="2.138153197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:33:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:33:57.245105111 +0000 UTC m=+38.666054879" watchObservedRunningTime="2026-06-11 11:33:57.245571093 +0000 UTC m=+38.666520853" Jun 11 11:33:57.279897 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:33:57.279865 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63893922-9918-454e-a94a-211ec0539b46-metrics-tls\") pod \"dns-default-26k5q\" (UID: \"63893922-9918-454e-a94a-211ec0539b46\") " pod="openshift-dns/dns-default-26k5q" Jun 11 11:33:57.280069 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:57.280012 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 11:33:57.280118 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:33:57.280080 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63893922-9918-454e-a94a-211ec0539b46-metrics-tls podName:63893922-9918-454e-a94a-211ec0539b46 nodeName:}" failed. No retries permitted until 2026-06-11 11:34:01.280062887 +0000 UTC m=+42.701012634 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63893922-9918-454e-a94a-211ec0539b46-metrics-tls") pod "dns-default-26k5q" (UID: "63893922-9918-454e-a94a-211ec0539b46") : secret "dns-default-metrics-tls" not found Jun 11 11:34:01.315733 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:01.315694 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63893922-9918-454e-a94a-211ec0539b46-metrics-tls\") pod \"dns-default-26k5q\" (UID: \"63893922-9918-454e-a94a-211ec0539b46\") " pod="openshift-dns/dns-default-26k5q" Jun 11 11:34:01.316649 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:34:01.315866 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 11:34:01.316649 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:34:01.315932 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63893922-9918-454e-a94a-211ec0539b46-metrics-tls podName:63893922-9918-454e-a94a-211ec0539b46 nodeName:}" failed. No retries permitted until 2026-06-11 11:34:09.31591626 +0000 UTC m=+50.736866005 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63893922-9918-454e-a94a-211ec0539b46-metrics-tls") pod "dns-default-26k5q" (UID: "63893922-9918-454e-a94a-211ec0539b46") : secret "dns-default-metrics-tls" not found Jun 11 11:34:05.255595 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:05.255555 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" event={"ID":"90fc0df0-cafb-4c60-8d52-a8345511863d","Type":"ContainerStarted","Data":"4dc5fb161d8e95de0db7b26b7fb094dd6807a753f1269fd11aabf9b37ee79c53"} Jun 11 11:34:05.256053 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:05.255609 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" event={"ID":"90fc0df0-cafb-4c60-8d52-a8345511863d","Type":"ContainerStarted","Data":"507875ab4e559072c4d49d3767729dc0821c28ea30cee7b31131d224e6022554"} Jun 11 11:34:05.256053 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:05.255624 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" event={"ID":"90fc0df0-cafb-4c60-8d52-a8345511863d","Type":"ContainerStarted","Data":"2da02b6545d023c6f7dea09b61bfd5fbce09af51c0fe1eabbb3d304825b2b5a0"} Jun 11 11:34:05.257078 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:05.257054 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54c994c564-rkx7q" event={"ID":"3000e68f-db81-4db8-8039-4d244124678c","Type":"ContainerStarted","Data":"cda5938f16ef549356b073a349101444543e25fe08bac1b524cbc62969320b9d"} Jun 11 11:34:05.257202 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:05.257101 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54c994c564-rkx7q" Jun 11 11:34:05.258789 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:05.258756 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c9b7d9db4-vhztz" event={"ID":"95eb7be8-16f8-4817-983b-397c61906b5c","Type":"ContainerStarted","Data":"ef523e9cefacaa119fea0bb9d685f3a19feece0156d1d16b6563a8415f5ffd23"} Jun 11 11:34:05.259010 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:05.258989 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54c994c564-rkx7q" Jun 11 11:34:05.276065 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:05.276010 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" podStartSLOduration=2.032091893 podStartE2EDuration="9.275994448s" totalImagesPullingTime="7.243902555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:33:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:34:05.275462884 +0000 UTC m=+46.696412650" watchObservedRunningTime="2026-06-11 11:34:05.275994448 +0000 UTC m=+46.696944247" Jun 11 11:34:05.293228 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:05.293175 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c9b7d9db4-vhztz" podStartSLOduration=2.002739317 podStartE2EDuration="9.293158612s" totalImagesPullingTime="7.290419295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:33:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:34:05.292509407 +0000 UTC m=+46.713459176" watchObservedRunningTime="2026-06-11 11:34:05.293158612 +0000 UTC m=+46.714108378" Jun 11 11:34:05.308049 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:05.307999 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54c994c564-rkx7q" podStartSLOduration=2.020899557 podStartE2EDuration="9.307983941s" totalImagesPullingTime="7.287084384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:33:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:34:05.307407887 +0000 UTC m=+46.728357653" watchObservedRunningTime="2026-06-11 11:34:05.307983941 +0000 UTC m=+46.728933707" Jun 11 11:34:09.379703 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:09.379661 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63893922-9918-454e-a94a-211ec0539b46-metrics-tls\") pod \"dns-default-26k5q\" (UID: \"63893922-9918-454e-a94a-211ec0539b46\") " pod="openshift-dns/dns-default-26k5q" Jun 11 11:34:09.380178 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:34:09.379832 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 11:34:09.380178 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:34:09.379914 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63893922-9918-454e-a94a-211ec0539b46-metrics-tls podName:63893922-9918-454e-a94a-211ec0539b46 nodeName:}" failed. No retries permitted until 2026-06-11 11:34:25.379892779 +0000 UTC m=+66.800842543 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63893922-9918-454e-a94a-211ec0539b46-metrics-tls") pod "dns-default-26k5q" (UID: "63893922-9918-454e-a94a-211ec0539b46") : secret "dns-default-metrics-tls" not found Jun 11 11:34:19.206812 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:19.206776 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nntvz" Jun 11 11:34:24.790942 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:24.790891 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93730f02-47c1-4083-b8cb-cb6bcdb611c8-original-pull-secret\") pod \"global-pull-secret-syncer-gfgs7\" (UID: \"93730f02-47c1-4083-b8cb-cb6bcdb611c8\") " pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:34:24.791523 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:24.791067 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-metrics-certs\") pod \"network-metrics-daemon-fm9jf\" (UID: \"ab22f9ba-926c-424d-92ba-70cdae2dbd6e\") " pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:34:24.793423 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:24.793389 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 11:34:24.793523 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:24.793485 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 11:34:24.801520 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:34:24.801480 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 11:34:24.801630 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:34:24.801577 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-metrics-certs podName:ab22f9ba-926c-424d-92ba-70cdae2dbd6e nodeName:}" failed. No retries permitted until 2026-06-11 11:35:28.801553423 +0000 UTC m=+130.222503181 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-metrics-certs") pod "network-metrics-daemon-fm9jf" (UID: "ab22f9ba-926c-424d-92ba-70cdae2dbd6e") : secret "metrics-daemon-secret" not found Jun 11 11:34:24.803831 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:24.803810 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93730f02-47c1-4083-b8cb-cb6bcdb611c8-original-pull-secret\") pod \"global-pull-secret-syncer-gfgs7\" (UID: \"93730f02-47c1-4083-b8cb-cb6bcdb611c8\") " pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:34:24.892319 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:24.892281 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w4sd\" (UniqueName: \"kubernetes.io/projected/62cbd6f9-5887-46a3-bb97-9c6eebe11433-kube-api-access-7w4sd\") pod \"network-check-target-cmt44\" (UID: \"62cbd6f9-5887-46a3-bb97-9c6eebe11433\") " pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:34:24.895223 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:24.895199 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 11:34:24.904587 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:24.904559 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 11:34:24.915715 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:24.915689 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w4sd\" (UniqueName: \"kubernetes.io/projected/62cbd6f9-5887-46a3-bb97-9c6eebe11433-kube-api-access-7w4sd\") pod \"network-check-target-cmt44\" (UID: \"62cbd6f9-5887-46a3-bb97-9c6eebe11433\") " pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:34:25.052771 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:25.052673 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfgs7" Jun 11 11:34:25.068993 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:25.068971 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-shl4d\"" Jun 11 11:34:25.076295 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:25.076268 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:34:25.183837 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:25.183802 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gfgs7"] Jun 11 11:34:25.187260 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:34:25.187235 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93730f02_47c1_4083_b8cb_cb6bcdb611c8.slice/crio-bf3a9bb9f3160f74f854a614a059a23b2d235d39f9048b306ae7eff22c9d96d1 WatchSource:0}: Error finding container bf3a9bb9f3160f74f854a614a059a23b2d235d39f9048b306ae7eff22c9d96d1: Status 404 returned error can't find the container with id bf3a9bb9f3160f74f854a614a059a23b2d235d39f9048b306ae7eff22c9d96d1 Jun 11 11:34:25.209747 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:25.209713 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cmt44"] Jun 11 11:34:25.212765 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:34:25.212741 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62cbd6f9_5887_46a3_bb97_9c6eebe11433.slice/crio-5f2f15820298539e5e393935c94a41f6919861439d4d7bea97d9fcaf7d2c69da WatchSource:0}: Error finding container 5f2f15820298539e5e393935c94a41f6919861439d4d7bea97d9fcaf7d2c69da: Status 404 returned error can't find the container with id 5f2f15820298539e5e393935c94a41f6919861439d4d7bea97d9fcaf7d2c69da Jun 11 11:34:25.316237 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:25.316138 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gfgs7" event={"ID":"93730f02-47c1-4083-b8cb-cb6bcdb611c8","Type":"ContainerStarted","Data":"bf3a9bb9f3160f74f854a614a059a23b2d235d39f9048b306ae7eff22c9d96d1"} Jun 11 11:34:25.317249 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:25.317220 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cmt44" event={"ID":"62cbd6f9-5887-46a3-bb97-9c6eebe11433","Type":"ContainerStarted","Data":"5f2f15820298539e5e393935c94a41f6919861439d4d7bea97d9fcaf7d2c69da"} Jun 11 11:34:25.396953 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:25.396899 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63893922-9918-454e-a94a-211ec0539b46-metrics-tls\") pod \"dns-default-26k5q\" (UID: \"63893922-9918-454e-a94a-211ec0539b46\") " pod="openshift-dns/dns-default-26k5q" Jun 11 11:34:25.397125 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:34:25.397067 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 11:34:25.397165 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:34:25.397130 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63893922-9918-454e-a94a-211ec0539b46-metrics-tls podName:63893922-9918-454e-a94a-211ec0539b46 nodeName:}" failed. No retries permitted until 2026-06-11 11:34:57.397114395 +0000 UTC m=+98.818064140 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63893922-9918-454e-a94a-211ec0539b46-metrics-tls") pod "dns-default-26k5q" (UID: "63893922-9918-454e-a94a-211ec0539b46") : secret "dns-default-metrics-tls" not found Jun 11 11:34:30.339081 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:30.339038 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cmt44" event={"ID":"62cbd6f9-5887-46a3-bb97-9c6eebe11433","Type":"ContainerStarted","Data":"f904e7f0a4d36e1a9a42366aad06b3ea72376a124fb391aaec79dd53b9e1ba54"} Jun 11 11:34:30.339665 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:30.339109 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:34:30.340409 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:30.340379 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gfgs7" event={"ID":"93730f02-47c1-4083-b8cb-cb6bcdb611c8","Type":"ContainerStarted","Data":"d09a3a81a47efe361831a98e15a294e31b9ea227666877e514c6bf133a35cf91"} Jun 11 11:34:30.355618 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:30.355560 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cmt44" podStartSLOduration=66.888824554 podStartE2EDuration="1m11.355540541s" totalImagesPullingTime="4.466715987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:33:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:34:30.354788595 +0000 UTC m=+71.775738362" watchObservedRunningTime="2026-06-11 11:34:30.355540541 +0000 UTC m=+71.776490308" Jun 11 11:34:30.370113 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:30.370064 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gfgs7" podStartSLOduration=66.874791164 podStartE2EDuration="1m11.370047563s" totalImagesPullingTime="4.495256399s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 11:33:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:34:30.369385986 +0000 UTC m=+71.790335754" watchObservedRunningTime="2026-06-11 11:34:30.370047563 +0000 UTC m=+71.790997388" Jun 11 11:34:57.428036 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:34:57.427933 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63893922-9918-454e-a94a-211ec0539b46-metrics-tls\") pod \"dns-default-26k5q\" (UID: \"63893922-9918-454e-a94a-211ec0539b46\") " pod="openshift-dns/dns-default-26k5q" Jun 11 11:34:57.428410 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:34:57.428092 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 11:34:57.428410 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:34:57.428156 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63893922-9918-454e-a94a-211ec0539b46-metrics-tls podName:63893922-9918-454e-a94a-211ec0539b46 nodeName:}" failed. No retries permitted until 2026-06-11 11:36:01.428139366 +0000 UTC m=+162.849089112 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63893922-9918-454e-a94a-211ec0539b46-metrics-tls") pod "dns-default-26k5q" (UID: "63893922-9918-454e-a94a-211ec0539b46") : secret "dns-default-metrics-tls" not found Jun 11 11:35:01.347536 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:35:01.347505 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cmt44" Jun 11 11:35:28.845979 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:35:28.845923 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-metrics-certs\") pod \"network-metrics-daemon-fm9jf\" (UID: \"ab22f9ba-926c-424d-92ba-70cdae2dbd6e\") " pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:35:28.846463 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:35:28.846073 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 11:35:28.846463 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:35:28.846138 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-metrics-certs podName:ab22f9ba-926c-424d-92ba-70cdae2dbd6e nodeName:}" failed. No retries permitted until 2026-06-11 11:37:30.846123546 +0000 UTC m=+252.267073296 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-metrics-certs") pod "network-metrics-daemon-fm9jf" (UID: "ab22f9ba-926c-424d-92ba-70cdae2dbd6e") : secret "metrics-daemon-secret" not found Jun 11 11:35:56.483706 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:35:56.483654 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-26k5q" podUID="63893922-9918-454e-a94a-211ec0539b46" Jun 11 11:35:56.594333 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:35:56.594304 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-26k5q" Jun 11 11:35:58.061699 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:35:58.061641 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-fm9jf" podUID="ab22f9ba-926c-424d-92ba-70cdae2dbd6e" Jun 11 11:36:01.477001 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:36:01.476899 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63893922-9918-454e-a94a-211ec0539b46-metrics-tls\") pod \"dns-default-26k5q\" (UID: \"63893922-9918-454e-a94a-211ec0539b46\") " pod="openshift-dns/dns-default-26k5q" Jun 11 11:36:01.477479 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:36:01.477079 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 11:36:01.477479 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:36:01.477143 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63893922-9918-454e-a94a-211ec0539b46-metrics-tls podName:63893922-9918-454e-a94a-211ec0539b46 nodeName:}" failed. No retries permitted until 2026-06-11 11:38:03.477128343 +0000 UTC m=+284.898078089 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63893922-9918-454e-a94a-211ec0539b46-metrics-tls") pod "dns-default-26k5q" (UID: "63893922-9918-454e-a94a-211ec0539b46") : secret "dns-default-metrics-tls" not found Jun 11 11:36:04.618569 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:36:04.618537 2580 generic.go:356] "Generic (PLEG): container finished" podID="3000e68f-db81-4db8-8039-4d244124678c" containerID="cda5938f16ef549356b073a349101444543e25fe08bac1b524cbc62969320b9d" exitCode=1 Jun 11 11:36:04.618990 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:36:04.618616 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54c994c564-rkx7q" event={"ID":"3000e68f-db81-4db8-8039-4d244124678c","Type":"ContainerDied","Data":"cda5938f16ef549356b073a349101444543e25fe08bac1b524cbc62969320b9d"} Jun 11 11:36:04.618990 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:36:04.618973 2580 scope.go:117] "RemoveContainer" containerID="cda5938f16ef549356b073a349101444543e25fe08bac1b524cbc62969320b9d" Jun 11 11:36:04.620033 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:36:04.620013 2580 generic.go:356] "Generic (PLEG): container finished" podID="95eb7be8-16f8-4817-983b-397c61906b5c" containerID="ef523e9cefacaa119fea0bb9d685f3a19feece0156d1d16b6563a8415f5ffd23" exitCode=255 Jun 11 11:36:04.620155 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:36:04.620058 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c9b7d9db4-vhztz" event={"ID":"95eb7be8-16f8-4817-983b-397c61906b5c","Type":"ContainerDied","Data":"ef523e9cefacaa119fea0bb9d685f3a19feece0156d1d16b6563a8415f5ffd23"} Jun 11 11:36:04.620319 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:36:04.620306 2580 scope.go:117] "RemoveContainer" containerID="ef523e9cefacaa119fea0bb9d685f3a19feece0156d1d16b6563a8415f5ffd23" Jun 11 11:36:05.258090 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:36:05.258042 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54c994c564-rkx7q" Jun 11 11:36:05.625233 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:36:05.625146 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54c994c564-rkx7q" event={"ID":"3000e68f-db81-4db8-8039-4d244124678c","Type":"ContainerStarted","Data":"fe8850ea01fde72ac95549775b73bd83d8a557a7abd5e5433c956b6fd33949fe"} Jun 11 11:36:05.625718 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:36:05.625302 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54c994c564-rkx7q" Jun 11 11:36:05.626012 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:36:05.625995 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54c994c564-rkx7q" Jun 11 11:36:05.626817 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:36:05.626798 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c9b7d9db4-vhztz" event={"ID":"95eb7be8-16f8-4817-983b-397c61906b5c","Type":"ContainerStarted","Data":"c8dcbcc4319ed3189f10c804f4a70f28634e53f834a284ed5cf8ec29db4d61bd"} Jun 11 11:36:10.038921 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:36:10.038879 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:37:10.366514 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:10.366466 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qzsk4_75580ac2-a186-46af-a5c6-ab8523a85cb0/dns-node-resolver/0.log" Jun 11 11:37:11.165688 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:11.165661 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-248kq_9a1ee17d-116a-4dd7-8cb7-5fe10679d13f/node-ca/0.log" Jun 11 11:37:12.166157 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:12.166130 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fpp88_78e7c710-3a05-4255-8c23-759e9bd47586/serve-healthcheck-canary/0.log" Jun 11 11:37:30.916646 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:30.916607 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-metrics-certs\") pod \"network-metrics-daemon-fm9jf\" (UID: \"ab22f9ba-926c-424d-92ba-70cdae2dbd6e\") " pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:37:30.918933 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:30.918906 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab22f9ba-926c-424d-92ba-70cdae2dbd6e-metrics-certs\") pod \"network-metrics-daemon-fm9jf\" (UID: \"ab22f9ba-926c-424d-92ba-70cdae2dbd6e\") " pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:37:31.042595 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:31.042564 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rxm4w\"" Jun 11 11:37:31.050913 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:31.050883 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm9jf" Jun 11 11:37:31.173203 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:31.173097 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fm9jf"] Jun 11 11:37:31.176917 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:37:31.176886 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab22f9ba_926c_424d_92ba_70cdae2dbd6e.slice/crio-a055fc412920fcf4c09c45f0e3f62da6171edb0947516971be67794aa972ae24 WatchSource:0}: Error finding container a055fc412920fcf4c09c45f0e3f62da6171edb0947516971be67794aa972ae24: Status 404 returned error can't find the container with id a055fc412920fcf4c09c45f0e3f62da6171edb0947516971be67794aa972ae24 Jun 11 11:37:31.795118 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:31.795086 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cwfgs"] Jun 11 11:37:31.797519 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:31.797478 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cwfgs" Jun 11 11:37:31.800094 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:31.800070 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 11:37:31.800219 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:31.800072 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6rv8k\"" Jun 11 11:37:31.801033 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:31.801011 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 11:37:31.801149 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:31.801015 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 11:37:31.801149 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:31.801133 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 11:37:31.817292 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:31.817264 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cwfgs"] Jun 11 11:37:31.824428 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:31.824398 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25110d9a-ed80-4ae8-937a-9bfc925fb86a-data-volume\") pod \"insights-runtime-extractor-cwfgs\" (UID: \"25110d9a-ed80-4ae8-937a-9bfc925fb86a\") " pod="openshift-insights/insights-runtime-extractor-cwfgs" Jun 11 11:37:31.824629 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:31.824442 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25110d9a-ed80-4ae8-937a-9bfc925fb86a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cwfgs\" (UID: \"25110d9a-ed80-4ae8-937a-9bfc925fb86a\") " pod="openshift-insights/insights-runtime-extractor-cwfgs" Jun 11 11:37:31.824629 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:31.824531 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxsq2\" (UniqueName: \"kubernetes.io/projected/25110d9a-ed80-4ae8-937a-9bfc925fb86a-kube-api-access-cxsq2\") pod \"insights-runtime-extractor-cwfgs\" (UID: \"25110d9a-ed80-4ae8-937a-9bfc925fb86a\") " pod="openshift-insights/insights-runtime-extractor-cwfgs" Jun 11 11:37:31.824732 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:31.824664 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25110d9a-ed80-4ae8-937a-9bfc925fb86a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cwfgs\" (UID: \"25110d9a-ed80-4ae8-937a-9bfc925fb86a\") " pod="openshift-insights/insights-runtime-extractor-cwfgs" Jun 11 11:37:31.824732 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:31.824709 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25110d9a-ed80-4ae8-937a-9bfc925fb86a-crio-socket\") pod \"insights-runtime-extractor-cwfgs\" (UID: \"25110d9a-ed80-4ae8-937a-9bfc925fb86a\") " pod="openshift-insights/insights-runtime-extractor-cwfgs" Jun 11 11:37:31.886801 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:31.886764 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fm9jf" event={"ID":"ab22f9ba-926c-424d-92ba-70cdae2dbd6e","Type":"ContainerStarted","Data":"a055fc412920fcf4c09c45f0e3f62da6171edb0947516971be67794aa972ae24"} Jun 11 11:37:31.925433 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:31.925392 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25110d9a-ed80-4ae8-937a-9bfc925fb86a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cwfgs\" (UID: \"25110d9a-ed80-4ae8-937a-9bfc925fb86a\") " pod="openshift-insights/insights-runtime-extractor-cwfgs" Jun 11 11:37:31.925916 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:31.925443 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25110d9a-ed80-4ae8-937a-9bfc925fb86a-crio-socket\") pod \"insights-runtime-extractor-cwfgs\" (UID: \"25110d9a-ed80-4ae8-937a-9bfc925fb86a\") " pod="openshift-insights/insights-runtime-extractor-cwfgs" Jun 11 11:37:31.925916 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:31.925475 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25110d9a-ed80-4ae8-937a-9bfc925fb86a-data-volume\") pod \"insights-runtime-extractor-cwfgs\" (UID: \"25110d9a-ed80-4ae8-937a-9bfc925fb86a\") " pod="openshift-insights/insights-runtime-extractor-cwfgs" Jun 11 11:37:31.925916 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:31.925521 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25110d9a-ed80-4ae8-937a-9bfc925fb86a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cwfgs\" (UID: \"25110d9a-ed80-4ae8-937a-9bfc925fb86a\") " pod="openshift-insights/insights-runtime-extractor-cwfgs" Jun 11 11:37:31.925916 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:31.925573 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxsq2\" (UniqueName: \"kubernetes.io/projected/25110d9a-ed80-4ae8-937a-9bfc925fb86a-kube-api-access-cxsq2\") pod \"insights-runtime-extractor-cwfgs\" (UID: \"25110d9a-ed80-4ae8-937a-9bfc925fb86a\") " pod="openshift-insights/insights-runtime-extractor-cwfgs" Jun 11 11:37:31.925916 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:31.925587 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25110d9a-ed80-4ae8-937a-9bfc925fb86a-crio-socket\") pod \"insights-runtime-extractor-cwfgs\" (UID: \"25110d9a-ed80-4ae8-937a-9bfc925fb86a\") " pod="openshift-insights/insights-runtime-extractor-cwfgs" Jun 11 11:37:31.926124 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:31.925926 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25110d9a-ed80-4ae8-937a-9bfc925fb86a-data-volume\") pod \"insights-runtime-extractor-cwfgs\" (UID: \"25110d9a-ed80-4ae8-937a-9bfc925fb86a\") " pod="openshift-insights/insights-runtime-extractor-cwfgs" Jun 11 11:37:31.926124 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:31.926078 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25110d9a-ed80-4ae8-937a-9bfc925fb86a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cwfgs\" (UID: \"25110d9a-ed80-4ae8-937a-9bfc925fb86a\") " pod="openshift-insights/insights-runtime-extractor-cwfgs" Jun 11 11:37:31.928155 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:31.928133 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25110d9a-ed80-4ae8-937a-9bfc925fb86a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cwfgs\" (UID: \"25110d9a-ed80-4ae8-937a-9bfc925fb86a\") " pod="openshift-insights/insights-runtime-extractor-cwfgs" Jun 11 11:37:31.984140 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:31.984101 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxsq2\" (UniqueName: \"kubernetes.io/projected/25110d9a-ed80-4ae8-937a-9bfc925fb86a-kube-api-access-cxsq2\") pod \"insights-runtime-extractor-cwfgs\" (UID: \"25110d9a-ed80-4ae8-937a-9bfc925fb86a\") " pod="openshift-insights/insights-runtime-extractor-cwfgs" Jun 11 11:37:32.109141 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:32.109116 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cwfgs" Jun 11 11:37:32.254972 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:32.254938 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cwfgs"] Jun 11 11:37:32.258814 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:37:32.258782 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25110d9a_ed80_4ae8_937a_9bfc925fb86a.slice/crio-4e832ed1489bc80dcf3faf03c5cebc0f40917c94ad8bc6745a40558378a3721a WatchSource:0}: Error finding container 4e832ed1489bc80dcf3faf03c5cebc0f40917c94ad8bc6745a40558378a3721a: Status 404 returned error can't find the container with id 4e832ed1489bc80dcf3faf03c5cebc0f40917c94ad8bc6745a40558378a3721a Jun 11 11:37:32.891210 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:32.891181 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fm9jf" event={"ID":"ab22f9ba-926c-424d-92ba-70cdae2dbd6e","Type":"ContainerStarted","Data":"6aedd7e9db4cd61643b98e371b5288433f3944f44109944a31cf0fda017f207c"} Jun 11 11:37:32.891379 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:32.891232 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fm9jf" event={"ID":"ab22f9ba-926c-424d-92ba-70cdae2dbd6e","Type":"ContainerStarted","Data":"495fbc258f555789de818d13757814275baf61a7e493798b1e4eca276aaad4e6"} Jun 11 11:37:32.892627 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:32.892606 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cwfgs" event={"ID":"25110d9a-ed80-4ae8-937a-9bfc925fb86a","Type":"ContainerStarted","Data":"1ce790ab50a7dd7cc164b47256e9371ad38339fb593a39f4063508341ca585a1"} Jun 11 11:37:32.892730 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:32.892648 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cwfgs" event={"ID":"25110d9a-ed80-4ae8-937a-9bfc925fb86a","Type":"ContainerStarted","Data":"4e832ed1489bc80dcf3faf03c5cebc0f40917c94ad8bc6745a40558378a3721a"} Jun 11 11:37:32.911463 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:32.911424 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fm9jf" podStartSLOduration=252.985961552 podStartE2EDuration="4m13.911408079s" totalImagesPullingTime="925.446527ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:33:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:37:32.910635314 +0000 UTC m=+254.331585083" watchObservedRunningTime="2026-06-11 11:37:32.911408079 +0000 UTC m=+254.332357845" Jun 11 11:37:33.898977 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:33.898937 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cwfgs" event={"ID":"25110d9a-ed80-4ae8-937a-9bfc925fb86a","Type":"ContainerStarted","Data":"32c63c66fa39dc0816a9016fea5ce34eb6dd743614bda96f8968bf5588015ed8"} Jun 11 11:37:34.907418 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:34.907324 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cwfgs" event={"ID":"25110d9a-ed80-4ae8-937a-9bfc925fb86a","Type":"ContainerStarted","Data":"f54ad45664f0d05b3ef0ee96c66f78b53857f475c8bf3bb5a6ebb3e75d2ff4d5"} Jun 11 11:37:34.926041 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:34.925968 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cwfgs" podStartSLOduration=1.827059975 podStartE2EDuration="3.925952623s" totalImagesPullingTime="2.098892648s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 11:37:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:37:34.924207025 +0000 UTC m=+256.345156794" watchObservedRunningTime="2026-06-11 11:37:34.925952623 +0000 UTC m=+256.346902389" Jun 11 11:37:40.045031 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.044993 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qm4dm"] Jun 11 11:37:40.047255 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.047237 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qm4dm" Jun 11 11:37:40.050474 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.050426 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 11:37:40.050653 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.050627 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 11:37:40.050653 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.050640 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bxb27\"" Jun 11 11:37:40.050834 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.050710 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 11:37:40.050935 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.050916 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 11:37:40.051014 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.050996 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 11:37:40.051392 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.051377 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 11:37:40.085841 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.085797 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7059d93e-8651-488d-aa7c-369bcbcd49d7-node-exporter-accelerators-collector-config\") pod \"node-exporter-qm4dm\" (UID: \"7059d93e-8651-488d-aa7c-369bcbcd49d7\") " pod="openshift-monitoring/node-exporter-qm4dm" Jun 11 11:37:40.085841 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.085846 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7059d93e-8651-488d-aa7c-369bcbcd49d7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qm4dm\" (UID: \"7059d93e-8651-488d-aa7c-369bcbcd49d7\") " pod="openshift-monitoring/node-exporter-qm4dm" Jun 11 11:37:40.086077 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.085868 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7059d93e-8651-488d-aa7c-369bcbcd49d7-node-exporter-tls\") pod \"node-exporter-qm4dm\" (UID: \"7059d93e-8651-488d-aa7c-369bcbcd49d7\") " pod="openshift-monitoring/node-exporter-qm4dm" Jun 11 11:37:40.086077 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.085929 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7059d93e-8651-488d-aa7c-369bcbcd49d7-root\") pod \"node-exporter-qm4dm\" (UID: \"7059d93e-8651-488d-aa7c-369bcbcd49d7\") " pod="openshift-monitoring/node-exporter-qm4dm" Jun 11 11:37:40.086077 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.085947 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7059d93e-8651-488d-aa7c-369bcbcd49d7-sys\") pod \"node-exporter-qm4dm\" (UID: \"7059d93e-8651-488d-aa7c-369bcbcd49d7\") " pod="openshift-monitoring/node-exporter-qm4dm" Jun 11 11:37:40.086077 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.086017 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7059d93e-8651-488d-aa7c-369bcbcd49d7-metrics-client-ca\") pod \"node-exporter-qm4dm\" (UID: \"7059d93e-8651-488d-aa7c-369bcbcd49d7\") " pod="openshift-monitoring/node-exporter-qm4dm" Jun 11 11:37:40.086077 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.086049 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2xgj\" (UniqueName: \"kubernetes.io/projected/7059d93e-8651-488d-aa7c-369bcbcd49d7-kube-api-access-l2xgj\") pod \"node-exporter-qm4dm\" (UID: \"7059d93e-8651-488d-aa7c-369bcbcd49d7\") " pod="openshift-monitoring/node-exporter-qm4dm" Jun 11 11:37:40.086077 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.086070 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7059d93e-8651-488d-aa7c-369bcbcd49d7-node-exporter-textfile\") pod \"node-exporter-qm4dm\" (UID: \"7059d93e-8651-488d-aa7c-369bcbcd49d7\") " pod="openshift-monitoring/node-exporter-qm4dm" Jun 11 11:37:40.086268 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.086089 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7059d93e-8651-488d-aa7c-369bcbcd49d7-node-exporter-wtmp\") pod \"node-exporter-qm4dm\" (UID: \"7059d93e-8651-488d-aa7c-369bcbcd49d7\") " pod="openshift-monitoring/node-exporter-qm4dm" Jun 11 11:37:40.186813 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.186773 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7059d93e-8651-488d-aa7c-369bcbcd49d7-metrics-client-ca\") pod \"node-exporter-qm4dm\" (UID: \"7059d93e-8651-488d-aa7c-369bcbcd49d7\") " pod="openshift-monitoring/node-exporter-qm4dm" Jun 11 11:37:40.186813 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.186811 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2xgj\" (UniqueName: \"kubernetes.io/projected/7059d93e-8651-488d-aa7c-369bcbcd49d7-kube-api-access-l2xgj\") pod \"node-exporter-qm4dm\" (UID: \"7059d93e-8651-488d-aa7c-369bcbcd49d7\") " pod="openshift-monitoring/node-exporter-qm4dm" Jun 11 11:37:40.187074 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.186834 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7059d93e-8651-488d-aa7c-369bcbcd49d7-node-exporter-textfile\") pod \"node-exporter-qm4dm\" (UID: \"7059d93e-8651-488d-aa7c-369bcbcd49d7\") " pod="openshift-monitoring/node-exporter-qm4dm" Jun 11 11:37:40.187074 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.186857 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7059d93e-8651-488d-aa7c-369bcbcd49d7-node-exporter-wtmp\") pod \"node-exporter-qm4dm\" (UID: \"7059d93e-8651-488d-aa7c-369bcbcd49d7\") " pod="openshift-monitoring/node-exporter-qm4dm" Jun 11 11:37:40.187074 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.186882 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7059d93e-8651-488d-aa7c-369bcbcd49d7-node-exporter-accelerators-collector-config\") pod \"node-exporter-qm4dm\" (UID: \"7059d93e-8651-488d-aa7c-369bcbcd49d7\") " pod="openshift-monitoring/node-exporter-qm4dm" Jun 11 11:37:40.187074 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.186921 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7059d93e-8651-488d-aa7c-369bcbcd49d7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qm4dm\" (UID: \"7059d93e-8651-488d-aa7c-369bcbcd49d7\") " pod="openshift-monitoring/node-exporter-qm4dm" Jun 11 11:37:40.187074 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.186948 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7059d93e-8651-488d-aa7c-369bcbcd49d7-node-exporter-tls\") pod \"node-exporter-qm4dm\" (UID: \"7059d93e-8651-488d-aa7c-369bcbcd49d7\") " pod="openshift-monitoring/node-exporter-qm4dm" Jun 11 11:37:40.187074 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.186979 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7059d93e-8651-488d-aa7c-369bcbcd49d7-root\") pod \"node-exporter-qm4dm\" (UID: \"7059d93e-8651-488d-aa7c-369bcbcd49d7\") " pod="openshift-monitoring/node-exporter-qm4dm" Jun 11 11:37:40.187074 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.187005 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7059d93e-8651-488d-aa7c-369bcbcd49d7-sys\") pod \"node-exporter-qm4dm\" (UID: \"7059d93e-8651-488d-aa7c-369bcbcd49d7\") " pod="openshift-monitoring/node-exporter-qm4dm" Jun 11 11:37:40.187074 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.187015 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7059d93e-8651-488d-aa7c-369bcbcd49d7-node-exporter-wtmp\") pod \"node-exporter-qm4dm\" (UID: \"7059d93e-8651-488d-aa7c-369bcbcd49d7\") " pod="openshift-monitoring/node-exporter-qm4dm" Jun 11 11:37:40.187426 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.187088 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7059d93e-8651-488d-aa7c-369bcbcd49d7-sys\") pod \"node-exporter-qm4dm\" (UID: \"7059d93e-8651-488d-aa7c-369bcbcd49d7\") " pod="openshift-monitoring/node-exporter-qm4dm" Jun 11 11:37:40.187426 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.187089 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7059d93e-8651-488d-aa7c-369bcbcd49d7-root\") pod \"node-exporter-qm4dm\" (UID: \"7059d93e-8651-488d-aa7c-369bcbcd49d7\") " pod="openshift-monitoring/node-exporter-qm4dm" Jun 11 11:37:40.187426 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:37:40.187097 2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 11:37:40.187426 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:37:40.187166 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7059d93e-8651-488d-aa7c-369bcbcd49d7-node-exporter-tls podName:7059d93e-8651-488d-aa7c-369bcbcd49d7 nodeName:}" failed. No retries permitted until 2026-06-11 11:37:40.687145909 +0000 UTC m=+262.108095672 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7059d93e-8651-488d-aa7c-369bcbcd49d7-node-exporter-tls") pod "node-exporter-qm4dm" (UID: "7059d93e-8651-488d-aa7c-369bcbcd49d7") : secret "node-exporter-tls" not found Jun 11 11:37:40.187426 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.187271 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7059d93e-8651-488d-aa7c-369bcbcd49d7-node-exporter-textfile\") pod \"node-exporter-qm4dm\" (UID: \"7059d93e-8651-488d-aa7c-369bcbcd49d7\") " pod="openshift-monitoring/node-exporter-qm4dm" Jun 11 11:37:40.187625 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.187520 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7059d93e-8651-488d-aa7c-369bcbcd49d7-metrics-client-ca\") pod \"node-exporter-qm4dm\" (UID: \"7059d93e-8651-488d-aa7c-369bcbcd49d7\") " pod="openshift-monitoring/node-exporter-qm4dm" Jun 11 11:37:40.187625 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.187530 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7059d93e-8651-488d-aa7c-369bcbcd49d7-node-exporter-accelerators-collector-config\") pod \"node-exporter-qm4dm\" (UID: \"7059d93e-8651-488d-aa7c-369bcbcd49d7\") " pod="openshift-monitoring/node-exporter-qm4dm" Jun 11 11:37:40.189357 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.189336 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7059d93e-8651-488d-aa7c-369bcbcd49d7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qm4dm\" (UID: \"7059d93e-8651-488d-aa7c-369bcbcd49d7\") " pod="openshift-monitoring/node-exporter-qm4dm" Jun 11 11:37:40.199999 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.199945 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2xgj\" (UniqueName: \"kubernetes.io/projected/7059d93e-8651-488d-aa7c-369bcbcd49d7-kube-api-access-l2xgj\") pod \"node-exporter-qm4dm\" (UID: \"7059d93e-8651-488d-aa7c-369bcbcd49d7\") " pod="openshift-monitoring/node-exporter-qm4dm" Jun 11 11:37:40.690323 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.690275 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7059d93e-8651-488d-aa7c-369bcbcd49d7-node-exporter-tls\") pod \"node-exporter-qm4dm\" (UID: \"7059d93e-8651-488d-aa7c-369bcbcd49d7\") " pod="openshift-monitoring/node-exporter-qm4dm" Jun 11 11:37:40.692634 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.692611 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7059d93e-8651-488d-aa7c-369bcbcd49d7-node-exporter-tls\") pod \"node-exporter-qm4dm\" (UID: \"7059d93e-8651-488d-aa7c-369bcbcd49d7\") " pod="openshift-monitoring/node-exporter-qm4dm" Jun 11 11:37:40.957570 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:40.957460 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qm4dm" Jun 11 11:37:40.968329 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:37:40.968299 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7059d93e_8651_488d_aa7c_369bcbcd49d7.slice/crio-50d9de8ab2beb5fe46b3edc0d8f6e65ad2fd15ba4e6e8f3f121ea97b97995e91 WatchSource:0}: Error finding container 50d9de8ab2beb5fe46b3edc0d8f6e65ad2fd15ba4e6e8f3f121ea97b97995e91: Status 404 returned error can't find the container with id 50d9de8ab2beb5fe46b3edc0d8f6e65ad2fd15ba4e6e8f3f121ea97b97995e91 Jun 11 11:37:41.930101 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:41.929906 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qm4dm" event={"ID":"7059d93e-8651-488d-aa7c-369bcbcd49d7","Type":"ContainerStarted","Data":"07c3af1d87a903885a2edfa514c66504d5922c08dc07a07cbfefc53b9ac93d6b"} Jun 11 11:37:41.930101 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:41.929960 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qm4dm" event={"ID":"7059d93e-8651-488d-aa7c-369bcbcd49d7","Type":"ContainerStarted","Data":"50d9de8ab2beb5fe46b3edc0d8f6e65ad2fd15ba4e6e8f3f121ea97b97995e91"} Jun 11 11:37:42.934479 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:42.934447 2580 generic.go:356] "Generic (PLEG): container finished" podID="7059d93e-8651-488d-aa7c-369bcbcd49d7" containerID="07c3af1d87a903885a2edfa514c66504d5922c08dc07a07cbfefc53b9ac93d6b" exitCode=0 Jun 11 11:37:42.934479 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:42.934483 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qm4dm" event={"ID":"7059d93e-8651-488d-aa7c-369bcbcd49d7","Type":"ContainerDied","Data":"07c3af1d87a903885a2edfa514c66504d5922c08dc07a07cbfefc53b9ac93d6b"} Jun 11 11:37:43.939382 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:43.939345 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qm4dm" event={"ID":"7059d93e-8651-488d-aa7c-369bcbcd49d7","Type":"ContainerStarted","Data":"7c79dc53882090c198d3fe112cf68f396091bc48cb8b87847867db036c35c0ba"} Jun 11 11:37:43.939883 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:43.939409 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qm4dm" event={"ID":"7059d93e-8651-488d-aa7c-369bcbcd49d7","Type":"ContainerStarted","Data":"97777f2f590220ef5644fcf25bea1891ee729f58e7fc671a482e5ffc213bf12a"} Jun 11 11:37:43.958642 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:43.958587 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qm4dm" podStartSLOduration=3.067529977 podStartE2EDuration="3.958570223s" totalImagesPullingTime="825.122126ms" totalInitContainerRuntime="65.91812ms" isStatefulPod=true podCreationTimestamp="2026-06-11 11:37:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:37:43.957292932 +0000 UTC m=+265.378242700" watchObservedRunningTime="2026-06-11 11:37:43.958570223 +0000 UTC m=+265.379519988" Jun 11 11:37:45.296992 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.296958 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-9686fbd69-z4j6n"] Jun 11 11:37:45.299025 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.299006 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" Jun 11 11:37:45.302653 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.302630 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 11 11:37:45.302873 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.302859 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-84zvn\"" Jun 11 11:37:45.303184 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.303161 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 11 11:37:45.304296 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.304276 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 11 11:37:45.305336 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.305314 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 11 11:37:45.307908 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.307881 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 11 11:37:45.313781 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.313757 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 11 11:37:45.321932 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.321903 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-9686fbd69-z4j6n"] Jun 11 11:37:45.324850 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.324821 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd-telemeter-client-tls\") pod \"telemeter-client-9686fbd69-z4j6n\" (UID: \"3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd\") " pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" Jun 11 11:37:45.324850 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.324854 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd-federate-client-tls\") pod \"telemeter-client-9686fbd69-z4j6n\" (UID: \"3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd\") " pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" Jun 11 11:37:45.325045 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.324901 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9686fbd69-z4j6n\" (UID: \"3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd\") " pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" Jun 11 11:37:45.325045 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.324939 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v86sx\" (UniqueName: \"kubernetes.io/projected/3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd-kube-api-access-v86sx\") pod \"telemeter-client-9686fbd69-z4j6n\" (UID: \"3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd\") " pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" Jun 11 11:37:45.325045 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.325013 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd-metrics-client-ca\") pod \"telemeter-client-9686fbd69-z4j6n\" (UID: \"3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd\") " pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" Jun 11 11:37:45.325200 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.325046 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd-secret-telemeter-client\") pod \"telemeter-client-9686fbd69-z4j6n\" (UID: \"3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd\") " pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" Jun 11 11:37:45.325200 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.325080 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd-serving-certs-ca-bundle\") pod \"telemeter-client-9686fbd69-z4j6n\" (UID: \"3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd\") " pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" Jun 11 11:37:45.325200 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.325108 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9686fbd69-z4j6n\" (UID: \"3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd\") " pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" Jun 11 11:37:45.426172 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.426126 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd-telemeter-client-tls\") pod \"telemeter-client-9686fbd69-z4j6n\" (UID: \"3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd\") " pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" Jun 11 11:37:45.426172 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.426168 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd-federate-client-tls\") pod \"telemeter-client-9686fbd69-z4j6n\" (UID: \"3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd\") " pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" Jun 11 11:37:45.426403 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.426214 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9686fbd69-z4j6n\" (UID: \"3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd\") " pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" Jun 11 11:37:45.426403 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.426244 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v86sx\" (UniqueName: \"kubernetes.io/projected/3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd-kube-api-access-v86sx\") pod \"telemeter-client-9686fbd69-z4j6n\" (UID: \"3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd\") " pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" Jun 11 11:37:45.426403 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.426374 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd-metrics-client-ca\") pod \"telemeter-client-9686fbd69-z4j6n\" (UID: \"3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd\") " pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" Jun 11 11:37:45.426591 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.426418 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd-secret-telemeter-client\") pod \"telemeter-client-9686fbd69-z4j6n\" (UID: \"3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd\") " pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" Jun 11 11:37:45.426591 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.426455 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd-serving-certs-ca-bundle\") pod \"telemeter-client-9686fbd69-z4j6n\" (UID: \"3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd\") " pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" Jun 11 11:37:45.426591 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.426481 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9686fbd69-z4j6n\" (UID: \"3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd\") " pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" Jun 11 11:37:45.427239 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.427209 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd-metrics-client-ca\") pod \"telemeter-client-9686fbd69-z4j6n\" (UID: \"3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd\") " pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" Jun 11 11:37:45.427371 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.427287 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9686fbd69-z4j6n\" (UID: \"3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd\") " pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" Jun 11 11:37:45.427440 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.427407 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd-serving-certs-ca-bundle\") pod \"telemeter-client-9686fbd69-z4j6n\" (UID: \"3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd\") " pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" Jun 11 11:37:45.428885 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.428854 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd-federate-client-tls\") pod \"telemeter-client-9686fbd69-z4j6n\" (UID: \"3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd\") " pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" Jun 11 11:37:45.428993 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.428967 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd-secret-telemeter-client\") pod \"telemeter-client-9686fbd69-z4j6n\" (UID: \"3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd\") " pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" Jun 11 11:37:45.429094 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.429079 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9686fbd69-z4j6n\" (UID: \"3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd\") " pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" Jun 11 11:37:45.429131 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.429104 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd-telemeter-client-tls\") pod \"telemeter-client-9686fbd69-z4j6n\" (UID: \"3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd\") " pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" Jun 11 11:37:45.435706 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.435681 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v86sx\" (UniqueName: \"kubernetes.io/projected/3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd-kube-api-access-v86sx\") pod \"telemeter-client-9686fbd69-z4j6n\" (UID: \"3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd\") " pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" Jun 11 11:37:45.610155 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.610053 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" Jun 11 11:37:45.746581 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.746547 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-9686fbd69-z4j6n"] Jun 11 11:37:45.751221 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:37:45.751173 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3014ed6a_a7a5_4fb6_b347_f7dcf77eafdd.slice/crio-815c4cd6b279f0ada1adef3ac42a31215293d08703aef86e79f57c9229948b81 WatchSource:0}: Error finding container 815c4cd6b279f0ada1adef3ac42a31215293d08703aef86e79f57c9229948b81: Status 404 returned error can't find the container with id 815c4cd6b279f0ada1adef3ac42a31215293d08703aef86e79f57c9229948b81 Jun 11 11:37:45.947754 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:45.947721 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" event={"ID":"3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd","Type":"ContainerStarted","Data":"815c4cd6b279f0ada1adef3ac42a31215293d08703aef86e79f57c9229948b81"} Jun 11 11:37:46.782884 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:46.782812 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" podUID="90fc0df0-cafb-4c60-8d52-a8345511863d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 11:37:47.956405 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:47.956375 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" event={"ID":"3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd","Type":"ContainerStarted","Data":"3961cde124280a352f70504dd4e0aa4a126dc856c85de79fe94a4e874ba311a9"} Jun 11 11:37:48.962266 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:48.962229 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" event={"ID":"3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd","Type":"ContainerStarted","Data":"f64a6881c5cb450600627eb3ae0754fb6452844cf7bf188cd067df8c817f802a"} Jun 11 11:37:48.962683 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:48.962301 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" event={"ID":"3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd","Type":"ContainerStarted","Data":"1cf8df1c172bc0a3d4d19926ff95a6908226788e885034cd7e281c855a328366"} Jun 11 11:37:48.988230 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:48.988174 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-9686fbd69-z4j6n" podStartSLOduration=0.978015506 podStartE2EDuration="3.98815567s" totalImagesPullingTime="3.010140164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:37:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:37:48.986054086 +0000 UTC m=+270.407003854" watchObservedRunningTime="2026-06-11 11:37:48.98815567 +0000 UTC m=+270.409105438" Jun 11 11:37:56.782923 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:37:56.782881 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" podUID="90fc0df0-cafb-4c60-8d52-a8345511863d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 11:37:59.595146 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:37:59.595087 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-26k5q" podUID="63893922-9918-454e-a94a-211ec0539b46" Jun 11 11:38:00.002193 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:38:00.002166 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-26k5q" Jun 11 11:38:03.556428 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:38:03.556380 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63893922-9918-454e-a94a-211ec0539b46-metrics-tls\") pod \"dns-default-26k5q\" (UID: \"63893922-9918-454e-a94a-211ec0539b46\") " pod="openshift-dns/dns-default-26k5q" Jun 11 11:38:03.558661 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:38:03.558641 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63893922-9918-454e-a94a-211ec0539b46-metrics-tls\") pod \"dns-default-26k5q\" (UID: \"63893922-9918-454e-a94a-211ec0539b46\") " pod="openshift-dns/dns-default-26k5q" Jun 11 11:38:03.605714 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:38:03.605681 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hp5rt\"" Jun 11 11:38:03.613903 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:38:03.613878 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-26k5q" Jun 11 11:38:03.744683 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:38:03.744512 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-26k5q"] Jun 11 11:38:03.747245 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:38:03.747215 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63893922_9918_454e_a94a_211ec0539b46.slice/crio-139298c4fa840dcfdb69d1dae4b3fbfbf4f0ea53f082e6771039f89ecb13b1f6 WatchSource:0}: Error finding container 139298c4fa840dcfdb69d1dae4b3fbfbf4f0ea53f082e6771039f89ecb13b1f6: Status 404 returned error can't find the container with id 139298c4fa840dcfdb69d1dae4b3fbfbf4f0ea53f082e6771039f89ecb13b1f6 Jun 11 11:38:04.016353 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:38:04.016317 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-26k5q" event={"ID":"63893922-9918-454e-a94a-211ec0539b46","Type":"ContainerStarted","Data":"139298c4fa840dcfdb69d1dae4b3fbfbf4f0ea53f082e6771039f89ecb13b1f6"} Jun 11 11:38:06.025502 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:38:06.025464 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-26k5q" event={"ID":"63893922-9918-454e-a94a-211ec0539b46","Type":"ContainerStarted","Data":"e6b44106a83f53f4b3270b2314f834be6947a6d03c2c3cad6206b7b4a0e44751"} Jun 11 11:38:06.025899 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:38:06.025536 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-26k5q" event={"ID":"63893922-9918-454e-a94a-211ec0539b46","Type":"ContainerStarted","Data":"0b7a6c8358c54da4a50af065c34570a640beb3299704dc208b46730d198dd9d4"} Jun 11 11:38:06.025899 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:38:06.025597 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-26k5q" Jun 11 11:38:06.042709 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:38:06.042660 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-26k5q" podStartSLOduration=251.463141844 podStartE2EDuration="4m13.042644147s" totalImagesPullingTime="1.579502303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:33:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:38:06.041708614 +0000 UTC m=+287.462658383" watchObservedRunningTime="2026-06-11 11:38:06.042644147 +0000 UTC m=+287.463593913" Jun 11 11:38:06.782572 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:38:06.782533 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" podUID="90fc0df0-cafb-4c60-8d52-a8345511863d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 11:38:06.782736 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:38:06.782600 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" Jun 11 11:38:06.783052 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:38:06.783024 2580 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"4dc5fb161d8e95de0db7b26b7fb094dd6807a753f1269fd11aabf9b37ee79c53"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 11 11:38:06.783089 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:38:06.783072 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" podUID="90fc0df0-cafb-4c60-8d52-a8345511863d" containerName="service-proxy" containerID="cri-o://4dc5fb161d8e95de0db7b26b7fb094dd6807a753f1269fd11aabf9b37ee79c53" gracePeriod=30 Jun 11 11:38:07.031011 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:38:07.030979 2580 generic.go:356] "Generic (PLEG): container finished" podID="90fc0df0-cafb-4c60-8d52-a8345511863d" containerID="4dc5fb161d8e95de0db7b26b7fb094dd6807a753f1269fd11aabf9b37ee79c53" exitCode=2 Jun 11 11:38:07.031429 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:38:07.031060 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" event={"ID":"90fc0df0-cafb-4c60-8d52-a8345511863d","Type":"ContainerDied","Data":"4dc5fb161d8e95de0db7b26b7fb094dd6807a753f1269fd11aabf9b37ee79c53"} Jun 11 11:38:07.031429 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:38:07.031136 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fbdc4895-jg97h" event={"ID":"90fc0df0-cafb-4c60-8d52-a8345511863d","Type":"ContainerStarted","Data":"67003e7b0508e74ef91232d34ff9316e33cc49847a66bf5777c814cf8bd4587d"} Jun 11 11:38:16.033732 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:38:16.033700 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-26k5q" Jun 11 11:38:18.525354 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:38:18.525323 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fpp88_78e7c710-3a05-4255-8c23-759e9bd47586/serve-healthcheck-canary/0.log" Jun 11 11:38:18.985512 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:38:18.985473 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nntvz_8ad3e9b6-2483-4aa5-9c8c-bc31ef592342/ovn-acl-logging/0.log" Jun 11 11:38:18.993639 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:38:18.989390 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nntvz_8ad3e9b6-2483-4aa5-9c8c-bc31ef592342/ovn-acl-logging/0.log" Jun 11 11:38:18.996429 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:38:18.996404 2580 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 11:40:44.216747 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:44.216668 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-cb4zv"] Jun 11 11:40:44.220575 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:44.220548 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-cb4zv" Jun 11 11:40:44.224429 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:44.224405 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 11:40:44.224576 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:44.224443 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 11:40:44.225225 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:44.225209 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-qntxv\"" Jun 11 11:40:44.227399 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:44.227346 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-cb4zv"] Jun 11 11:40:44.400334 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:44.400288 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34345140-27cc-4158-840d-c10c0b7524a0-bound-sa-token\") pod \"cert-manager-59c77684cc-cb4zv\" (UID: \"34345140-27cc-4158-840d-c10c0b7524a0\") " pod="cert-manager/cert-manager-59c77684cc-cb4zv" Jun 11 11:40:44.400334 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:44.400338 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv75d\" (UniqueName: \"kubernetes.io/projected/34345140-27cc-4158-840d-c10c0b7524a0-kube-api-access-tv75d\") pod \"cert-manager-59c77684cc-cb4zv\" (UID: \"34345140-27cc-4158-840d-c10c0b7524a0\") " pod="cert-manager/cert-manager-59c77684cc-cb4zv" Jun 11 11:40:44.501527 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:44.501402 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34345140-27cc-4158-840d-c10c0b7524a0-bound-sa-token\") pod \"cert-manager-59c77684cc-cb4zv\" (UID: \"34345140-27cc-4158-840d-c10c0b7524a0\") " pod="cert-manager/cert-manager-59c77684cc-cb4zv" Jun 11 11:40:44.501527 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:44.501447 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv75d\" (UniqueName: \"kubernetes.io/projected/34345140-27cc-4158-840d-c10c0b7524a0-kube-api-access-tv75d\") pod \"cert-manager-59c77684cc-cb4zv\" (UID: \"34345140-27cc-4158-840d-c10c0b7524a0\") " pod="cert-manager/cert-manager-59c77684cc-cb4zv" Jun 11 11:40:44.509958 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:44.509921 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34345140-27cc-4158-840d-c10c0b7524a0-bound-sa-token\") pod \"cert-manager-59c77684cc-cb4zv\" (UID: \"34345140-27cc-4158-840d-c10c0b7524a0\") " pod="cert-manager/cert-manager-59c77684cc-cb4zv" Jun 11 11:40:44.510073 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:44.510018 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv75d\" (UniqueName: \"kubernetes.io/projected/34345140-27cc-4158-840d-c10c0b7524a0-kube-api-access-tv75d\") pod \"cert-manager-59c77684cc-cb4zv\" (UID: \"34345140-27cc-4158-840d-c10c0b7524a0\") " pod="cert-manager/cert-manager-59c77684cc-cb4zv" Jun 11 11:40:44.530878 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:44.530845 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-cb4zv" Jun 11 11:40:44.660970 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:44.660936 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-cb4zv"] Jun 11 11:40:44.664384 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:40:44.664351 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34345140_27cc_4158_840d_c10c0b7524a0.slice/crio-db00bba841c3541318b2aa911b277867a6c0a31e57b07a768a3d4601ba7fd749 WatchSource:0}: Error finding container db00bba841c3541318b2aa911b277867a6c0a31e57b07a768a3d4601ba7fd749: Status 404 returned error can't find the container with id db00bba841c3541318b2aa911b277867a6c0a31e57b07a768a3d4601ba7fd749 Jun 11 11:40:44.666220 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:44.666204 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 11:40:45.555808 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:45.555772 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-cb4zv" event={"ID":"34345140-27cc-4158-840d-c10c0b7524a0","Type":"ContainerStarted","Data":"db00bba841c3541318b2aa911b277867a6c0a31e57b07a768a3d4601ba7fd749"} Jun 11 11:40:47.567192 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:47.567159 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-cb4zv" event={"ID":"34345140-27cc-4158-840d-c10c0b7524a0","Type":"ContainerStarted","Data":"fd77ae026da2bf4ef749c3c1b220d1e1f031eafa9a827f4836c89af6e8bb069e"} Jun 11 11:40:47.584079 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:47.584028 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-cb4zv" podStartSLOduration=1.334469303 podStartE2EDuration="3.584012662s" totalImagesPullingTime="2.249543359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:40:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:40:47.583304818 +0000 UTC m=+449.004254586" watchObservedRunningTime="2026-06-11 11:40:47.584012662 +0000 UTC m=+449.004962428" Jun 11 11:40:51.790402 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:51.790366 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-768fdc48cd-4l5cc"] Jun 11 11:40:51.793645 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:51.793622 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-768fdc48cd-4l5cc" Jun 11 11:40:51.797376 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:51.797351 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-l2ssk\"" Jun 11 11:40:51.797551 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:51.797403 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 11:40:51.797551 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:51.797411 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 11:40:51.797551 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:51.797411 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 11:40:51.797551 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:51.797461 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 11:40:51.797551 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:51.797425 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 11:40:51.802834 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:51.802806 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-768fdc48cd-4l5cc"] Jun 11 11:40:51.961125 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:51.961074 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/56c6a227-bee2-401d-a8f5-6e91fe225c4c-metrics-cert\") pod \"lws-controller-manager-768fdc48cd-4l5cc\" (UID: \"56c6a227-bee2-401d-a8f5-6e91fe225c4c\") " pod="openshift-lws-operator/lws-controller-manager-768fdc48cd-4l5cc" Jun 11 11:40:51.961125 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:51.961133 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n868j\" (UniqueName: \"kubernetes.io/projected/56c6a227-bee2-401d-a8f5-6e91fe225c4c-kube-api-access-n868j\") pod \"lws-controller-manager-768fdc48cd-4l5cc\" (UID: \"56c6a227-bee2-401d-a8f5-6e91fe225c4c\") " pod="openshift-lws-operator/lws-controller-manager-768fdc48cd-4l5cc" Jun 11 11:40:51.961353 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:51.961239 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56c6a227-bee2-401d-a8f5-6e91fe225c4c-cert\") pod \"lws-controller-manager-768fdc48cd-4l5cc\" (UID: \"56c6a227-bee2-401d-a8f5-6e91fe225c4c\") " pod="openshift-lws-operator/lws-controller-manager-768fdc48cd-4l5cc" Jun 11 11:40:51.961353 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:51.961289 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/56c6a227-bee2-401d-a8f5-6e91fe225c4c-manager-config\") pod \"lws-controller-manager-768fdc48cd-4l5cc\" (UID: \"56c6a227-bee2-401d-a8f5-6e91fe225c4c\") " pod="openshift-lws-operator/lws-controller-manager-768fdc48cd-4l5cc" Jun 11 11:40:52.062223 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:52.062130 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n868j\" (UniqueName: \"kubernetes.io/projected/56c6a227-bee2-401d-a8f5-6e91fe225c4c-kube-api-access-n868j\") pod \"lws-controller-manager-768fdc48cd-4l5cc\" (UID: \"56c6a227-bee2-401d-a8f5-6e91fe225c4c\") " pod="openshift-lws-operator/lws-controller-manager-768fdc48cd-4l5cc" Jun 11 11:40:52.062223 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:52.062191 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56c6a227-bee2-401d-a8f5-6e91fe225c4c-cert\") pod \"lws-controller-manager-768fdc48cd-4l5cc\" (UID: \"56c6a227-bee2-401d-a8f5-6e91fe225c4c\") " pod="openshift-lws-operator/lws-controller-manager-768fdc48cd-4l5cc" Jun 11 11:40:52.062223 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:52.062226 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/56c6a227-bee2-401d-a8f5-6e91fe225c4c-manager-config\") pod \"lws-controller-manager-768fdc48cd-4l5cc\" (UID: \"56c6a227-bee2-401d-a8f5-6e91fe225c4c\") " pod="openshift-lws-operator/lws-controller-manager-768fdc48cd-4l5cc" Jun 11 11:40:52.062464 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:52.062263 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/56c6a227-bee2-401d-a8f5-6e91fe225c4c-metrics-cert\") pod \"lws-controller-manager-768fdc48cd-4l5cc\" (UID: \"56c6a227-bee2-401d-a8f5-6e91fe225c4c\") " pod="openshift-lws-operator/lws-controller-manager-768fdc48cd-4l5cc" Jun 11 11:40:52.063017 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:52.062998 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/56c6a227-bee2-401d-a8f5-6e91fe225c4c-manager-config\") pod \"lws-controller-manager-768fdc48cd-4l5cc\" (UID: \"56c6a227-bee2-401d-a8f5-6e91fe225c4c\") " pod="openshift-lws-operator/lws-controller-manager-768fdc48cd-4l5cc" Jun 11 11:40:52.064735 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:52.064713 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56c6a227-bee2-401d-a8f5-6e91fe225c4c-cert\") pod \"lws-controller-manager-768fdc48cd-4l5cc\" (UID: \"56c6a227-bee2-401d-a8f5-6e91fe225c4c\") " pod="openshift-lws-operator/lws-controller-manager-768fdc48cd-4l5cc" Jun 11 11:40:52.064814 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:52.064769 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/56c6a227-bee2-401d-a8f5-6e91fe225c4c-metrics-cert\") pod \"lws-controller-manager-768fdc48cd-4l5cc\" (UID: \"56c6a227-bee2-401d-a8f5-6e91fe225c4c\") " pod="openshift-lws-operator/lws-controller-manager-768fdc48cd-4l5cc" Jun 11 11:40:52.071318 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:52.071284 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n868j\" (UniqueName: \"kubernetes.io/projected/56c6a227-bee2-401d-a8f5-6e91fe225c4c-kube-api-access-n868j\") pod \"lws-controller-manager-768fdc48cd-4l5cc\" (UID: \"56c6a227-bee2-401d-a8f5-6e91fe225c4c\") " pod="openshift-lws-operator/lws-controller-manager-768fdc48cd-4l5cc" Jun 11 11:40:52.103177 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:52.103142 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-768fdc48cd-4l5cc" Jun 11 11:40:52.240696 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:52.240663 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-768fdc48cd-4l5cc"] Jun 11 11:40:52.244842 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:40:52.244817 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56c6a227_bee2_401d_a8f5_6e91fe225c4c.slice/crio-fa36c00f77edc5f779028deb095379c777b9d666d5af895833773afbe2bdc159 WatchSource:0}: Error finding container fa36c00f77edc5f779028deb095379c777b9d666d5af895833773afbe2bdc159: Status 404 returned error can't find the container with id fa36c00f77edc5f779028deb095379c777b9d666d5af895833773afbe2bdc159 Jun 11 11:40:52.583509 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:52.583453 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-768fdc48cd-4l5cc" event={"ID":"56c6a227-bee2-401d-a8f5-6e91fe225c4c","Type":"ContainerStarted","Data":"fa36c00f77edc5f779028deb095379c777b9d666d5af895833773afbe2bdc159"} Jun 11 11:40:55.597682 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:55.597643 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-768fdc48cd-4l5cc" event={"ID":"56c6a227-bee2-401d-a8f5-6e91fe225c4c","Type":"ContainerStarted","Data":"401e1db9709d099621f091be599f4fef8df4e4ac7e651389d847cdc2895b21e3"} Jun 11 11:40:55.598052 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:55.597765 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-768fdc48cd-4l5cc" Jun 11 11:40:55.613716 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:40:55.613665 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-768fdc48cd-4l5cc" podStartSLOduration=1.3862880450000001 podStartE2EDuration="4.613648496s" totalImagesPullingTime="3.227360451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:40:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:40:55.612851995 +0000 UTC m=+457.033801765" watchObservedRunningTime="2026-06-11 11:40:55.613648496 +0000 UTC m=+457.034598263" Jun 11 11:41:00.150643 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:00.150603 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69b86f57c5-kzk28"] Jun 11 11:41:00.153567 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:00.153550 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-kzk28" Jun 11 11:41:00.157315 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:00.157290 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 11:41:00.158588 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:00.158573 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gs8j6\"" Jun 11 11:41:00.158648 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:00.158595 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 11:41:00.160939 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:00.160919 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 11:41:00.164655 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:00.164639 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 11:41:00.178680 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:00.178646 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69b86f57c5-kzk28"] Jun 11 11:41:00.221780 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:00.221743 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9f166f34-ca7a-4226-8d5d-bab24850eef9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69b86f57c5-kzk28\" (UID: \"9f166f34-ca7a-4226-8d5d-bab24850eef9\") " pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-kzk28" Jun 11 11:41:00.221780 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:00.221783 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9f166f34-ca7a-4226-8d5d-bab24850eef9-manifests\") pod \"opendatahub-operator-controller-manager-69b86f57c5-kzk28\" (UID: \"9f166f34-ca7a-4226-8d5d-bab24850eef9\") " pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-kzk28" Jun 11 11:41:00.222013 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:00.221839 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlr64\" (UniqueName: \"kubernetes.io/projected/9f166f34-ca7a-4226-8d5d-bab24850eef9-kube-api-access-zlr64\") pod \"opendatahub-operator-controller-manager-69b86f57c5-kzk28\" (UID: \"9f166f34-ca7a-4226-8d5d-bab24850eef9\") " pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-kzk28" Jun 11 11:41:00.222013 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:00.221892 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f166f34-ca7a-4226-8d5d-bab24850eef9-webhook-cert\") pod \"opendatahub-operator-controller-manager-69b86f57c5-kzk28\" (UID: \"9f166f34-ca7a-4226-8d5d-bab24850eef9\") " pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-kzk28" Jun 11 11:41:00.222013 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:00.221935 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f166f34-ca7a-4226-8d5d-bab24850eef9-tmp\") pod \"opendatahub-operator-controller-manager-69b86f57c5-kzk28\" (UID: \"9f166f34-ca7a-4226-8d5d-bab24850eef9\") " pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-kzk28" Jun 11 11:41:00.323010 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:00.322972 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f166f34-ca7a-4226-8d5d-bab24850eef9-webhook-cert\") pod \"opendatahub-operator-controller-manager-69b86f57c5-kzk28\" (UID: \"9f166f34-ca7a-4226-8d5d-bab24850eef9\") " pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-kzk28" Jun 11 11:41:00.323149 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:00.323017 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f166f34-ca7a-4226-8d5d-bab24850eef9-tmp\") pod \"opendatahub-operator-controller-manager-69b86f57c5-kzk28\" (UID: \"9f166f34-ca7a-4226-8d5d-bab24850eef9\") " pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-kzk28" Jun 11 11:41:00.323149 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:00.323055 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9f166f34-ca7a-4226-8d5d-bab24850eef9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69b86f57c5-kzk28\" (UID: \"9f166f34-ca7a-4226-8d5d-bab24850eef9\") " pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-kzk28" Jun 11 11:41:00.323149 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:00.323074 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9f166f34-ca7a-4226-8d5d-bab24850eef9-manifests\") pod \"opendatahub-operator-controller-manager-69b86f57c5-kzk28\" (UID: \"9f166f34-ca7a-4226-8d5d-bab24850eef9\") " pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-kzk28" Jun 11 11:41:00.323149 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:00.323093 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlr64\" (UniqueName: \"kubernetes.io/projected/9f166f34-ca7a-4226-8d5d-bab24850eef9-kube-api-access-zlr64\") pod \"opendatahub-operator-controller-manager-69b86f57c5-kzk28\" (UID: \"9f166f34-ca7a-4226-8d5d-bab24850eef9\") " pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-kzk28" Jun 11 11:41:00.323621 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:00.323598 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9f166f34-ca7a-4226-8d5d-bab24850eef9-manifests\") pod \"opendatahub-operator-controller-manager-69b86f57c5-kzk28\" (UID: \"9f166f34-ca7a-4226-8d5d-bab24850eef9\") " pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-kzk28" Jun 11 11:41:00.325518 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:00.325474 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f166f34-ca7a-4226-8d5d-bab24850eef9-tmp\") pod \"opendatahub-operator-controller-manager-69b86f57c5-kzk28\" (UID: \"9f166f34-ca7a-4226-8d5d-bab24850eef9\") " pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-kzk28" Jun 11 11:41:00.325738 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:00.325721 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f166f34-ca7a-4226-8d5d-bab24850eef9-webhook-cert\") pod \"opendatahub-operator-controller-manager-69b86f57c5-kzk28\" (UID: \"9f166f34-ca7a-4226-8d5d-bab24850eef9\") " pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-kzk28" Jun 11 11:41:00.325781 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:00.325724 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9f166f34-ca7a-4226-8d5d-bab24850eef9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69b86f57c5-kzk28\" (UID: \"9f166f34-ca7a-4226-8d5d-bab24850eef9\") " pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-kzk28" Jun 11 11:41:00.336364 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:00.336334 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlr64\" (UniqueName: \"kubernetes.io/projected/9f166f34-ca7a-4226-8d5d-bab24850eef9-kube-api-access-zlr64\") pod \"opendatahub-operator-controller-manager-69b86f57c5-kzk28\" (UID: \"9f166f34-ca7a-4226-8d5d-bab24850eef9\") " pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-kzk28" Jun 11 11:41:00.463414 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:00.463374 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-kzk28" Jun 11 11:41:00.602597 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:00.602555 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69b86f57c5-kzk28"] Jun 11 11:41:00.606952 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:41:00.606925 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f166f34_ca7a_4226_8d5d_bab24850eef9.slice/crio-9c68003acf385243ea85805bece4aa5e10fed861cad89689d0abfbd1a99cc787 WatchSource:0}: Error finding container 9c68003acf385243ea85805bece4aa5e10fed861cad89689d0abfbd1a99cc787: Status 404 returned error can't find the container with id 9c68003acf385243ea85805bece4aa5e10fed861cad89689d0abfbd1a99cc787 Jun 11 11:41:00.619257 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:00.619214 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-kzk28" event={"ID":"9f166f34-ca7a-4226-8d5d-bab24850eef9","Type":"ContainerStarted","Data":"9c68003acf385243ea85805bece4aa5e10fed861cad89689d0abfbd1a99cc787"} Jun 11 11:41:03.632333 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:03.632294 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-kzk28" event={"ID":"9f166f34-ca7a-4226-8d5d-bab24850eef9","Type":"ContainerStarted","Data":"751ea9d33acbfedf243b9e3bf1c4242ef0fc91e2ef2f495b2a2c42f26641f038"} Jun 11 11:41:04.637641 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:04.637609 2580 generic.go:356] "Generic (PLEG): container finished" podID="9f166f34-ca7a-4226-8d5d-bab24850eef9" containerID="751ea9d33acbfedf243b9e3bf1c4242ef0fc91e2ef2f495b2a2c42f26641f038" exitCode=0 Jun 11 11:41:04.638022 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:04.637649 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-kzk28" event={"ID":"9f166f34-ca7a-4226-8d5d-bab24850eef9","Type":"ContainerDied","Data":"751ea9d33acbfedf243b9e3bf1c4242ef0fc91e2ef2f495b2a2c42f26641f038"} Jun 11 11:41:05.643000 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:05.642957 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-kzk28" event={"ID":"9f166f34-ca7a-4226-8d5d-bab24850eef9","Type":"ContainerStarted","Data":"eb9b18d7e056841f2a34b4a1aa858c912e349bdecf71cf17f68adc79d3e22313"} Jun 11 11:41:05.643523 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:05.643125 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-kzk28" Jun 11 11:41:05.668718 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:05.668659 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-kzk28" podStartSLOduration=1.610396742 podStartE2EDuration="5.66864329s" totalImagesPullingTime="3.101704468s" totalInitContainerRuntime="956.54208ms" isStatefulPod=false podCreationTimestamp="2026-06-11 11:41:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:41:05.667595835 +0000 UTC m=+467.088545602" watchObservedRunningTime="2026-06-11 11:41:05.66864329 +0000 UTC m=+467.089593056" Jun 11 11:41:06.603562 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:06.603530 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-768fdc48cd-4l5cc" Jun 11 11:41:16.648475 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:16.648437 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-69b86f57c5-kzk28" Jun 11 11:41:18.804255 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:18.804211 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-74bc6b598d-b5tq9"] Jun 11 11:41:18.900625 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:18.900578 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-74bc6b598d-b5tq9"] Jun 11 11:41:18.900792 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:18.900719 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-74bc6b598d-b5tq9" Jun 11 11:41:18.903194 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:18.903166 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 11:41:18.903194 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:18.903184 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 11:41:18.903194 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:18.903171 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-74rtl\"" Jun 11 11:41:18.904009 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:18.903991 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 11:41:18.904099 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:18.904076 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 11:41:18.963975 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:18.963937 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d1e6001-8698-4007-aab6-af04a48a50bb-tls-certs\") pod \"kube-auth-proxy-74bc6b598d-b5tq9\" (UID: \"1d1e6001-8698-4007-aab6-af04a48a50bb\") " pod="openshift-ingress/kube-auth-proxy-74bc6b598d-b5tq9" Jun 11 11:41:18.964178 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:18.963996 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvwzx\" (UniqueName: \"kubernetes.io/projected/1d1e6001-8698-4007-aab6-af04a48a50bb-kube-api-access-qvwzx\") pod \"kube-auth-proxy-74bc6b598d-b5tq9\" (UID: \"1d1e6001-8698-4007-aab6-af04a48a50bb\") " pod="openshift-ingress/kube-auth-proxy-74bc6b598d-b5tq9" Jun 11 11:41:18.964178 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:18.964027 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d1e6001-8698-4007-aab6-af04a48a50bb-tmp\") pod \"kube-auth-proxy-74bc6b598d-b5tq9\" (UID: \"1d1e6001-8698-4007-aab6-af04a48a50bb\") " pod="openshift-ingress/kube-auth-proxy-74bc6b598d-b5tq9" Jun 11 11:41:19.064586 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:19.064477 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvwzx\" (UniqueName: \"kubernetes.io/projected/1d1e6001-8698-4007-aab6-af04a48a50bb-kube-api-access-qvwzx\") pod \"kube-auth-proxy-74bc6b598d-b5tq9\" (UID: \"1d1e6001-8698-4007-aab6-af04a48a50bb\") " pod="openshift-ingress/kube-auth-proxy-74bc6b598d-b5tq9" Jun 11 11:41:19.064586 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:19.064569 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d1e6001-8698-4007-aab6-af04a48a50bb-tmp\") pod \"kube-auth-proxy-74bc6b598d-b5tq9\" (UID: \"1d1e6001-8698-4007-aab6-af04a48a50bb\") " pod="openshift-ingress/kube-auth-proxy-74bc6b598d-b5tq9" Jun 11 11:41:19.064801 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:19.064627 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d1e6001-8698-4007-aab6-af04a48a50bb-tls-certs\") pod \"kube-auth-proxy-74bc6b598d-b5tq9\" (UID: \"1d1e6001-8698-4007-aab6-af04a48a50bb\") " pod="openshift-ingress/kube-auth-proxy-74bc6b598d-b5tq9" Jun 11 11:41:19.066798 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:19.066773 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d1e6001-8698-4007-aab6-af04a48a50bb-tmp\") pod \"kube-auth-proxy-74bc6b598d-b5tq9\" (UID: \"1d1e6001-8698-4007-aab6-af04a48a50bb\") " pod="openshift-ingress/kube-auth-proxy-74bc6b598d-b5tq9" Jun 11 11:41:19.067164 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:19.067138 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 11:41:19.074796 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:19.074766 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 11:41:19.074948 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:41:19.074866 2580 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 11 11:41:19.074948 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:41:19.074932 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d1e6001-8698-4007-aab6-af04a48a50bb-tls-certs podName:1d1e6001-8698-4007-aab6-af04a48a50bb nodeName:}" failed. No retries permitted until 2026-06-11 11:41:19.574913008 +0000 UTC m=+480.995862757 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/1d1e6001-8698-4007-aab6-af04a48a50bb-tls-certs") pod "kube-auth-proxy-74bc6b598d-b5tq9" (UID: "1d1e6001-8698-4007-aab6-af04a48a50bb") : secret "kube-auth-proxy-tls" not found Jun 11 11:41:19.084237 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:19.084209 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 11:41:19.095444 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:19.095412 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvwzx\" (UniqueName: \"kubernetes.io/projected/1d1e6001-8698-4007-aab6-af04a48a50bb-kube-api-access-qvwzx\") pod \"kube-auth-proxy-74bc6b598d-b5tq9\" (UID: \"1d1e6001-8698-4007-aab6-af04a48a50bb\") " pod="openshift-ingress/kube-auth-proxy-74bc6b598d-b5tq9" Jun 11 11:41:19.669777 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:19.669733 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d1e6001-8698-4007-aab6-af04a48a50bb-tls-certs\") pod \"kube-auth-proxy-74bc6b598d-b5tq9\" (UID: \"1d1e6001-8698-4007-aab6-af04a48a50bb\") " pod="openshift-ingress/kube-auth-proxy-74bc6b598d-b5tq9" Jun 11 11:41:19.672079 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:19.672056 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d1e6001-8698-4007-aab6-af04a48a50bb-tls-certs\") pod \"kube-auth-proxy-74bc6b598d-b5tq9\" (UID: \"1d1e6001-8698-4007-aab6-af04a48a50bb\") " pod="openshift-ingress/kube-auth-proxy-74bc6b598d-b5tq9" Jun 11 11:41:19.814265 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:19.814235 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-74rtl\"" Jun 11 11:41:19.822448 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:19.822423 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-74bc6b598d-b5tq9" Jun 11 11:41:19.958103 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:19.958074 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-74bc6b598d-b5tq9"] Jun 11 11:41:19.961189 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:41:19.961162 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d1e6001_8698_4007_aab6_af04a48a50bb.slice/crio-0bb025a0f12330f09e04d118840cdc8bbd4d13532b407e23114a2c51f9a76548 WatchSource:0}: Error finding container 0bb025a0f12330f09e04d118840cdc8bbd4d13532b407e23114a2c51f9a76548: Status 404 returned error can't find the container with id 0bb025a0f12330f09e04d118840cdc8bbd4d13532b407e23114a2c51f9a76548 Jun 11 11:41:20.696899 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:20.696855 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-74bc6b598d-b5tq9" event={"ID":"1d1e6001-8698-4007-aab6-af04a48a50bb","Type":"ContainerStarted","Data":"0bb025a0f12330f09e04d118840cdc8bbd4d13532b407e23114a2c51f9a76548"} Jun 11 11:41:22.986917 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:22.986897 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 11:41:23.708663 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:23.708624 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-74bc6b598d-b5tq9" event={"ID":"1d1e6001-8698-4007-aab6-af04a48a50bb","Type":"ContainerStarted","Data":"a4b9e9b89a0544514b04a9903e6cd53927e3d22e18968979dda4f627c3c4396a"} Jun 11 11:41:23.725260 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:41:23.725205 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-74bc6b598d-b5tq9" podStartSLOduration=2.7038144490000002 podStartE2EDuration="5.725188546s" totalImagesPullingTime="3.021374097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:41:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:41:23.724297674 +0000 UTC m=+485.145247441" watchObservedRunningTime="2026-06-11 11:41:23.725188546 +0000 UTC m=+485.146138313" Jun 11 11:43:05.182940 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:05.182902 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-c7pt8"] Jun 11 11:43:05.185920 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:05.185898 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c7pt8" Jun 11 11:43:05.188437 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:05.188415 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 11:43:05.188609 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:05.188448 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 11 11:43:05.188609 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:05.188462 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 11:43:05.188720 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:05.188692 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 11 11:43:05.189303 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:05.189287 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7r27k\"" Jun 11 11:43:05.193064 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:05.193034 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-c7pt8"] Jun 11 11:43:05.267310 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:05.267267 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbeb1a87-f913-4023-8cb4-aeffb6e7502b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-c7pt8\" (UID: \"cbeb1a87-f913-4023-8cb4-aeffb6e7502b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c7pt8" Jun 11 11:43:05.267310 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:05.267311 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qd26\" (UniqueName: \"kubernetes.io/projected/cbeb1a87-f913-4023-8cb4-aeffb6e7502b-kube-api-access-5qd26\") pod \"kuadrant-console-plugin-66b5774985-c7pt8\" (UID: \"cbeb1a87-f913-4023-8cb4-aeffb6e7502b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c7pt8" Jun 11 11:43:05.267556 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:05.267407 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cbeb1a87-f913-4023-8cb4-aeffb6e7502b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-c7pt8\" (UID: \"cbeb1a87-f913-4023-8cb4-aeffb6e7502b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c7pt8" Jun 11 11:43:05.368405 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:05.368353 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbeb1a87-f913-4023-8cb4-aeffb6e7502b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-c7pt8\" (UID: \"cbeb1a87-f913-4023-8cb4-aeffb6e7502b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c7pt8" Jun 11 11:43:05.368405 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:05.368409 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qd26\" (UniqueName: \"kubernetes.io/projected/cbeb1a87-f913-4023-8cb4-aeffb6e7502b-kube-api-access-5qd26\") pod \"kuadrant-console-plugin-66b5774985-c7pt8\" (UID: \"cbeb1a87-f913-4023-8cb4-aeffb6e7502b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c7pt8" Jun 11 11:43:05.368650 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:05.368456 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cbeb1a87-f913-4023-8cb4-aeffb6e7502b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-c7pt8\" (UID: \"cbeb1a87-f913-4023-8cb4-aeffb6e7502b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c7pt8" Jun 11 11:43:05.369127 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:05.369109 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cbeb1a87-f913-4023-8cb4-aeffb6e7502b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-c7pt8\" (UID: \"cbeb1a87-f913-4023-8cb4-aeffb6e7502b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c7pt8" Jun 11 11:43:05.370742 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:05.370721 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbeb1a87-f913-4023-8cb4-aeffb6e7502b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-c7pt8\" (UID: \"cbeb1a87-f913-4023-8cb4-aeffb6e7502b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c7pt8" Jun 11 11:43:05.375939 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:05.375910 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qd26\" (UniqueName: \"kubernetes.io/projected/cbeb1a87-f913-4023-8cb4-aeffb6e7502b-kube-api-access-5qd26\") pod \"kuadrant-console-plugin-66b5774985-c7pt8\" (UID: \"cbeb1a87-f913-4023-8cb4-aeffb6e7502b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c7pt8" Jun 11 11:43:05.495048 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:05.495002 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c7pt8" Jun 11 11:43:05.625788 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:05.625749 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-c7pt8"] Jun 11 11:43:05.628900 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:43:05.628870 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcbeb1a87_f913_4023_8cb4_aeffb6e7502b.slice/crio-d550ecb799e34d3fac934fcdd85694617abe0be3079ca6e4a3ec20804dc1a6f3 WatchSource:0}: Error finding container d550ecb799e34d3fac934fcdd85694617abe0be3079ca6e4a3ec20804dc1a6f3: Status 404 returned error can't find the container with id d550ecb799e34d3fac934fcdd85694617abe0be3079ca6e4a3ec20804dc1a6f3 Jun 11 11:43:06.076876 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:06.076837 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c7pt8" event={"ID":"cbeb1a87-f913-4023-8cb4-aeffb6e7502b","Type":"ContainerStarted","Data":"d550ecb799e34d3fac934fcdd85694617abe0be3079ca6e4a3ec20804dc1a6f3"} Jun 11 11:43:28.540548 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:28.540516 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nntvz_8ad3e9b6-2483-4aa5-9c8c-bc31ef592342/ovn-acl-logging/0.log" Jun 11 11:43:28.541508 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:28.541474 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nntvz_8ad3e9b6-2483-4aa5-9c8c-bc31ef592342/ovn-acl-logging/0.log" Jun 11 11:43:29.172188 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:29.172141 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c7pt8" event={"ID":"cbeb1a87-f913-4023-8cb4-aeffb6e7502b","Type":"ContainerStarted","Data":"92284c5c0deadeeab93aeec8800e6b782dad6e2f92368e76fb5915578c30bea8"} Jun 11 11:43:29.206458 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:29.206403 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c7pt8" podStartSLOduration=1.253466239 podStartE2EDuration="24.206382794s" totalImagesPullingTime="22.952916555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:43:29.20541379 +0000 UTC m=+610.626363554" watchObservedRunningTime="2026-06-11 11:43:29.206382794 +0000 UTC m=+610.627332561" Jun 11 11:43:48.194859 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:48.194774 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-vp8x4"] Jun 11 11:43:48.216020 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:48.215978 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-vp8x4"] Jun 11 11:43:48.216205 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:48.216076 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vp8x4" Jun 11 11:43:48.218761 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:48.218734 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hx6x9\"" Jun 11 11:43:48.327569 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:48.327520 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9wxf\" (UniqueName: \"kubernetes.io/projected/ac0c1571-d5fb-483b-a568-34e37ef04fd0-kube-api-access-g9wxf\") pod \"authorino-58cd955675-vp8x4\" (UID: \"ac0c1571-d5fb-483b-a568-34e37ef04fd0\") " pod="kuadrant-system/authorino-58cd955675-vp8x4" Jun 11 11:43:48.367154 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:48.367119 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-kk49l"] Jun 11 11:43:48.369368 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:48.369351 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kk49l" Jun 11 11:43:48.378386 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:48.378348 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kk49l"] Jun 11 11:43:48.428969 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:48.428932 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l9gp\" (UniqueName: \"kubernetes.io/projected/7eab30d9-efb8-47a8-9569-501c4c0d303b-kube-api-access-6l9gp\") pod \"authorino-75d556bd77-kk49l\" (UID: \"7eab30d9-efb8-47a8-9569-501c4c0d303b\") " pod="kuadrant-system/authorino-75d556bd77-kk49l" Jun 11 11:43:48.429157 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:48.429003 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9wxf\" (UniqueName: \"kubernetes.io/projected/ac0c1571-d5fb-483b-a568-34e37ef04fd0-kube-api-access-g9wxf\") pod \"authorino-58cd955675-vp8x4\" (UID: \"ac0c1571-d5fb-483b-a568-34e37ef04fd0\") " pod="kuadrant-system/authorino-58cd955675-vp8x4" Jun 11 11:43:48.436817 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:48.436787 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9wxf\" (UniqueName: \"kubernetes.io/projected/ac0c1571-d5fb-483b-a568-34e37ef04fd0-kube-api-access-g9wxf\") pod \"authorino-58cd955675-vp8x4\" (UID: \"ac0c1571-d5fb-483b-a568-34e37ef04fd0\") " pod="kuadrant-system/authorino-58cd955675-vp8x4" Jun 11 11:43:48.524798 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:48.524703 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vp8x4" Jun 11 11:43:48.530294 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:48.530258 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l9gp\" (UniqueName: \"kubernetes.io/projected/7eab30d9-efb8-47a8-9569-501c4c0d303b-kube-api-access-6l9gp\") pod \"authorino-75d556bd77-kk49l\" (UID: \"7eab30d9-efb8-47a8-9569-501c4c0d303b\") " pod="kuadrant-system/authorino-75d556bd77-kk49l" Jun 11 11:43:48.539310 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:48.539285 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l9gp\" (UniqueName: \"kubernetes.io/projected/7eab30d9-efb8-47a8-9569-501c4c0d303b-kube-api-access-6l9gp\") pod \"authorino-75d556bd77-kk49l\" (UID: \"7eab30d9-efb8-47a8-9569-501c4c0d303b\") " pod="kuadrant-system/authorino-75d556bd77-kk49l" Jun 11 11:43:48.650790 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:48.650755 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-vp8x4"] Jun 11 11:43:48.654131 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:43:48.654104 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac0c1571_d5fb_483b_a568_34e37ef04fd0.slice/crio-6e36a9329bb2690c4d83579ff7aa2dc026928d8db0e9c7d1b19e86e64f4c0468 WatchSource:0}: Error finding container 6e36a9329bb2690c4d83579ff7aa2dc026928d8db0e9c7d1b19e86e64f4c0468: Status 404 returned error can't find the container with id 6e36a9329bb2690c4d83579ff7aa2dc026928d8db0e9c7d1b19e86e64f4c0468 Jun 11 11:43:48.677782 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:48.677749 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kk49l" Jun 11 11:43:48.810059 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:48.809857 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kk49l"] Jun 11 11:43:48.812652 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:43:48.812628 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7eab30d9_efb8_47a8_9569_501c4c0d303b.slice/crio-b85098096f3a273e6bdd10c16d68b97217fbbd92ca38e04110123f06f3fceb82 WatchSource:0}: Error finding container b85098096f3a273e6bdd10c16d68b97217fbbd92ca38e04110123f06f3fceb82: Status 404 returned error can't find the container with id b85098096f3a273e6bdd10c16d68b97217fbbd92ca38e04110123f06f3fceb82 Jun 11 11:43:49.250110 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:49.250063 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kk49l" event={"ID":"7eab30d9-efb8-47a8-9569-501c4c0d303b","Type":"ContainerStarted","Data":"b85098096f3a273e6bdd10c16d68b97217fbbd92ca38e04110123f06f3fceb82"} Jun 11 11:43:49.251151 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:49.251127 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vp8x4" event={"ID":"ac0c1571-d5fb-483b-a568-34e37ef04fd0","Type":"ContainerStarted","Data":"6e36a9329bb2690c4d83579ff7aa2dc026928d8db0e9c7d1b19e86e64f4c0468"} Jun 11 11:43:53.272280 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:53.272238 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kk49l" event={"ID":"7eab30d9-efb8-47a8-9569-501c4c0d303b","Type":"ContainerStarted","Data":"5de1adbb49587c8805b5c7c6ea6947cf69c4b0a2ed4214f387b07ec1258e0176"} Jun 11 11:43:53.273713 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:53.273684 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vp8x4" event={"ID":"ac0c1571-d5fb-483b-a568-34e37ef04fd0","Type":"ContainerStarted","Data":"e4229bcf74f9e54d9cbc9a555364fb685fd371966641974392a5aad0c054d257"} Jun 11 11:43:53.287092 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:53.287041 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-kk49l" podStartSLOduration=1.832149402 podStartE2EDuration="5.287024024s" totalImagesPullingTime="3.454874622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:43:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:43:53.286519434 +0000 UTC m=+634.707469201" watchObservedRunningTime="2026-06-11 11:43:53.287024024 +0000 UTC m=+634.707973792" Jun 11 11:43:53.301904 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:53.301845 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-vp8x4" podStartSLOduration=1.677947541 podStartE2EDuration="5.301826235s" totalImagesPullingTime="3.623878694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:43:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:43:53.301230654 +0000 UTC m=+634.722180424" watchObservedRunningTime="2026-06-11 11:43:53.301826235 +0000 UTC m=+634.722776002" Jun 11 11:43:53.334252 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:53.334208 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-vp8x4"] Jun 11 11:43:55.281957 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:55.281915 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-vp8x4" podUID="ac0c1571-d5fb-483b-a568-34e37ef04fd0" containerName="authorino" containerID="cri-o://e4229bcf74f9e54d9cbc9a555364fb685fd371966641974392a5aad0c054d257" gracePeriod=30 Jun 11 11:43:55.534962 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:55.534896 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vp8x4" Jun 11 11:43:55.590986 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:55.590950 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9wxf\" (UniqueName: \"kubernetes.io/projected/ac0c1571-d5fb-483b-a568-34e37ef04fd0-kube-api-access-g9wxf\") pod \"ac0c1571-d5fb-483b-a568-34e37ef04fd0\" (UID: \"ac0c1571-d5fb-483b-a568-34e37ef04fd0\") " Jun 11 11:43:55.593165 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:55.593139 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac0c1571-d5fb-483b-a568-34e37ef04fd0-kube-api-access-g9wxf" (OuterVolumeSpecName: "kube-api-access-g9wxf") pod "ac0c1571-d5fb-483b-a568-34e37ef04fd0" (UID: "ac0c1571-d5fb-483b-a568-34e37ef04fd0"). InnerVolumeSpecName "kube-api-access-g9wxf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 11:43:55.691434 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:55.691393 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9wxf\" (UniqueName: \"kubernetes.io/projected/ac0c1571-d5fb-483b-a568-34e37ef04fd0-kube-api-access-g9wxf\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 11:43:56.287226 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:56.287186 2580 generic.go:356] "Generic (PLEG): container finished" podID="ac0c1571-d5fb-483b-a568-34e37ef04fd0" containerID="e4229bcf74f9e54d9cbc9a555364fb685fd371966641974392a5aad0c054d257" exitCode=0 Jun 11 11:43:56.287677 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:56.287231 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vp8x4" Jun 11 11:43:56.287677 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:56.287259 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vp8x4" event={"ID":"ac0c1571-d5fb-483b-a568-34e37ef04fd0","Type":"ContainerDied","Data":"e4229bcf74f9e54d9cbc9a555364fb685fd371966641974392a5aad0c054d257"} Jun 11 11:43:56.287677 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:56.287297 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vp8x4" event={"ID":"ac0c1571-d5fb-483b-a568-34e37ef04fd0","Type":"ContainerDied","Data":"6e36a9329bb2690c4d83579ff7aa2dc026928d8db0e9c7d1b19e86e64f4c0468"} Jun 11 11:43:56.287677 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:56.287318 2580 scope.go:117] "RemoveContainer" containerID="e4229bcf74f9e54d9cbc9a555364fb685fd371966641974392a5aad0c054d257" Jun 11 11:43:56.295577 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:56.295554 2580 scope.go:117] "RemoveContainer" containerID="e4229bcf74f9e54d9cbc9a555364fb685fd371966641974392a5aad0c054d257" Jun 11 11:43:56.295845 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:43:56.295826 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4229bcf74f9e54d9cbc9a555364fb685fd371966641974392a5aad0c054d257\": container with ID starting with e4229bcf74f9e54d9cbc9a555364fb685fd371966641974392a5aad0c054d257 not found: ID does not exist" containerID="e4229bcf74f9e54d9cbc9a555364fb685fd371966641974392a5aad0c054d257" Jun 11 11:43:56.295891 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:56.295854 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4229bcf74f9e54d9cbc9a555364fb685fd371966641974392a5aad0c054d257"} err="failed to get container status \"e4229bcf74f9e54d9cbc9a555364fb685fd371966641974392a5aad0c054d257\": rpc error: code = NotFound desc = could not find container \"e4229bcf74f9e54d9cbc9a555364fb685fd371966641974392a5aad0c054d257\": container with ID starting with e4229bcf74f9e54d9cbc9a555364fb685fd371966641974392a5aad0c054d257 not found: ID does not exist" Jun 11 11:43:56.307152 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:56.307122 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-vp8x4"] Jun 11 11:43:56.310757 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:56.310732 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-vp8x4"] Jun 11 11:43:57.043739 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:43:57.043706 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac0c1571-d5fb-483b-a568-34e37ef04fd0" path="/var/lib/kubelet/pods/ac0c1571-d5fb-483b-a568-34e37ef04fd0/volumes" Jun 11 11:44:38.915526 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:38.915473 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 11:44:38.915944 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:38.915762 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac0c1571-d5fb-483b-a568-34e37ef04fd0" containerName="authorino" Jun 11 11:44:38.915944 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:38.915773 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac0c1571-d5fb-483b-a568-34e37ef04fd0" containerName="authorino" Jun 11 11:44:38.915944 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:38.915822 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac0c1571-d5fb-483b-a568-34e37ef04fd0" containerName="authorino" Jun 11 11:44:38.917864 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:38.917845 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 11:44:38.920387 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:38.920359 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 11:44:38.920529 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:38.920411 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 11:44:38.920591 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:38.920538 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 11:44:38.921510 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:38.921473 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-6mk6m\"" Jun 11 11:44:38.927964 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:38.927939 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 11:44:38.930773 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:38.930741 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6w8c\" (UniqueName: \"kubernetes.io/projected/a312f138-8ac4-4c28-96a1-6676caa81325-kube-api-access-v6w8c\") pod \"maas-keycloak-0\" (UID: \"a312f138-8ac4-4c28-96a1-6676caa81325\") " pod="keycloak-system/maas-keycloak-0" Jun 11 11:44:39.031358 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:39.031319 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6w8c\" (UniqueName: \"kubernetes.io/projected/a312f138-8ac4-4c28-96a1-6676caa81325-kube-api-access-v6w8c\") pod \"maas-keycloak-0\" (UID: \"a312f138-8ac4-4c28-96a1-6676caa81325\") " pod="keycloak-system/maas-keycloak-0" Jun 11 11:44:39.039851 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:39.039820 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6w8c\" (UniqueName: \"kubernetes.io/projected/a312f138-8ac4-4c28-96a1-6676caa81325-kube-api-access-v6w8c\") pod \"maas-keycloak-0\" (UID: \"a312f138-8ac4-4c28-96a1-6676caa81325\") " pod="keycloak-system/maas-keycloak-0" Jun 11 11:44:39.228695 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:39.228653 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 11:44:39.369298 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:39.369264 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 11:44:39.372106 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:44:39.372072 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda312f138_8ac4_4c28_96a1_6676caa81325.slice/crio-7f94ba7f45fe96c41c5d4033928064d737ccec82d123cd4d2ccc2895c94f8f62 WatchSource:0}: Error finding container 7f94ba7f45fe96c41c5d4033928064d737ccec82d123cd4d2ccc2895c94f8f62: Status 404 returned error can't find the container with id 7f94ba7f45fe96c41c5d4033928064d737ccec82d123cd4d2ccc2895c94f8f62 Jun 11 11:44:39.458318 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:39.458277 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a312f138-8ac4-4c28-96a1-6676caa81325","Type":"ContainerStarted","Data":"7f94ba7f45fe96c41c5d4033928064d737ccec82d123cd4d2ccc2895c94f8f62"} Jun 11 11:44:44.487255 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:44.487213 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a312f138-8ac4-4c28-96a1-6676caa81325","Type":"ContainerStarted","Data":"3f86852725fce4438e95f1bdecd5646794f0b95dd70a78863205c3bab2bcfc3d"} Jun 11 11:44:44.505515 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:44.505433 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.951034486 podStartE2EDuration="6.505411946s" totalImagesPullingTime="4.55437746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:44:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:44:44.504744359 +0000 UTC m=+685.925694127" watchObservedRunningTime="2026-06-11 11:44:44.505411946 +0000 UTC m=+685.926361715" Jun 11 11:44:45.229819 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:45.229768 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 11:44:45.231375 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:45.231334 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a312f138-8ac4-4c28-96a1-6676caa81325" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.20:9000/health/started\": dial tcp 10.134.0.20:9000: connect: connection refused" Jun 11 11:44:46.229248 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:46.229191 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a312f138-8ac4-4c28-96a1-6676caa81325" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.20:9000/health/started\": dial tcp 10.134.0.20:9000: connect: connection refused" Jun 11 11:44:47.230124 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:47.230073 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a312f138-8ac4-4c28-96a1-6676caa81325" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.20:9000/health/started\": dial tcp 10.134.0.20:9000: connect: connection refused" Jun 11 11:44:48.229510 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:48.229446 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a312f138-8ac4-4c28-96a1-6676caa81325" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.20:9000/health/started\": dial tcp 10.134.0.20:9000: connect: connection refused" Jun 11 11:44:49.229645 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:49.229600 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 11:44:49.230928 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:49.229928 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a312f138-8ac4-4c28-96a1-6676caa81325" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.20:9000/health/started\": dial tcp 10.134.0.20:9000: connect: connection refused" Jun 11 11:44:50.229619 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:50.229566 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a312f138-8ac4-4c28-96a1-6676caa81325" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.20:9000/health/started\": dial tcp 10.134.0.20:9000: connect: connection refused" Jun 11 11:44:51.229921 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:51.229862 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a312f138-8ac4-4c28-96a1-6676caa81325" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.20:9000/health/started\": dial tcp 10.134.0.20:9000: connect: connection refused" Jun 11 11:44:52.229596 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:52.229547 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a312f138-8ac4-4c28-96a1-6676caa81325" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.20:9000/health/started\": dial tcp 10.134.0.20:9000: connect: connection refused" Jun 11 11:44:53.229595 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:53.229540 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a312f138-8ac4-4c28-96a1-6676caa81325" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.20:9000/health/started\": dial tcp 10.134.0.20:9000: connect: connection refused" Jun 11 11:44:54.229751 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:54.229698 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a312f138-8ac4-4c28-96a1-6676caa81325" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.20:9000/health/started\": dial tcp 10.134.0.20:9000: connect: connection refused" Jun 11 11:44:55.229545 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:55.229470 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a312f138-8ac4-4c28-96a1-6676caa81325" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.20:9000/health/started\": dial tcp 10.134.0.20:9000: connect: connection refused" Jun 11 11:44:56.229428 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:56.229379 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a312f138-8ac4-4c28-96a1-6676caa81325" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.20:9000/health/started\": dial tcp 10.134.0.20:9000: connect: connection refused" Jun 11 11:44:57.322203 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:57.322149 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 11:44:57.337414 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:44:57.337359 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="a312f138-8ac4-4c28-96a1-6676caa81325" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 11:45:07.328251 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:07.328157 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 11:45:08.243894 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:08.243863 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2shp5"] Jun 11 11:45:08.247091 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:08.247071 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2shp5" Jun 11 11:45:08.254385 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:08.254360 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2shp5"] Jun 11 11:45:08.400445 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:08.400403 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r69w\" (UniqueName: \"kubernetes.io/projected/97ef9075-7d65-4345-8290-c3500147ea32-kube-api-access-2r69w\") pod \"authorino-5d4b67c446-2shp5\" (UID: \"97ef9075-7d65-4345-8290-c3500147ea32\") " pod="kuadrant-system/authorino-5d4b67c446-2shp5" Jun 11 11:45:08.485470 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:08.485435 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2shp5"] Jun 11 11:45:08.485699 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:45:08.485677 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2r69w], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-2shp5" podUID="97ef9075-7d65-4345-8290-c3500147ea32" Jun 11 11:45:08.501472 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:08.501395 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r69w\" (UniqueName: \"kubernetes.io/projected/97ef9075-7d65-4345-8290-c3500147ea32-kube-api-access-2r69w\") pod \"authorino-5d4b67c446-2shp5\" (UID: \"97ef9075-7d65-4345-8290-c3500147ea32\") " pod="kuadrant-system/authorino-5d4b67c446-2shp5" Jun 11 11:45:08.509961 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:08.509931 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r69w\" (UniqueName: \"kubernetes.io/projected/97ef9075-7d65-4345-8290-c3500147ea32-kube-api-access-2r69w\") pod \"authorino-5d4b67c446-2shp5\" (UID: \"97ef9075-7d65-4345-8290-c3500147ea32\") " pod="kuadrant-system/authorino-5d4b67c446-2shp5" Jun 11 11:45:08.513596 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:08.513538 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7dd6479778-lwmr6"] Jun 11 11:45:08.515783 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:08.515763 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7dd6479778-lwmr6" Jun 11 11:45:08.518399 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:08.518379 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 11 11:45:08.524929 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:08.524906 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7dd6479778-lwmr6"] Jun 11 11:45:08.602290 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:08.602253 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a62271d2-f292-4fd2-85c7-cc0e549b60d4-tls-cert\") pod \"authorino-7dd6479778-lwmr6\" (UID: \"a62271d2-f292-4fd2-85c7-cc0e549b60d4\") " pod="kuadrant-system/authorino-7dd6479778-lwmr6" Jun 11 11:45:08.602568 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:08.602340 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x2zj\" (UniqueName: \"kubernetes.io/projected/a62271d2-f292-4fd2-85c7-cc0e549b60d4-kube-api-access-9x2zj\") pod \"authorino-7dd6479778-lwmr6\" (UID: \"a62271d2-f292-4fd2-85c7-cc0e549b60d4\") " pod="kuadrant-system/authorino-7dd6479778-lwmr6" Jun 11 11:45:08.611509 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:08.611469 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2shp5" Jun 11 11:45:08.617102 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:08.617080 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2shp5" Jun 11 11:45:08.702752 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:08.702716 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2r69w\" (UniqueName: \"kubernetes.io/projected/97ef9075-7d65-4345-8290-c3500147ea32-kube-api-access-2r69w\") pod \"97ef9075-7d65-4345-8290-c3500147ea32\" (UID: \"97ef9075-7d65-4345-8290-c3500147ea32\") " Jun 11 11:45:08.702911 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:08.702819 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a62271d2-f292-4fd2-85c7-cc0e549b60d4-tls-cert\") pod \"authorino-7dd6479778-lwmr6\" (UID: \"a62271d2-f292-4fd2-85c7-cc0e549b60d4\") " pod="kuadrant-system/authorino-7dd6479778-lwmr6" Jun 11 11:45:08.702911 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:08.702869 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x2zj\" (UniqueName: \"kubernetes.io/projected/a62271d2-f292-4fd2-85c7-cc0e549b60d4-kube-api-access-9x2zj\") pod \"authorino-7dd6479778-lwmr6\" (UID: \"a62271d2-f292-4fd2-85c7-cc0e549b60d4\") " pod="kuadrant-system/authorino-7dd6479778-lwmr6" Jun 11 11:45:08.705015 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:08.704990 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97ef9075-7d65-4345-8290-c3500147ea32-kube-api-access-2r69w" (OuterVolumeSpecName: "kube-api-access-2r69w") pod "97ef9075-7d65-4345-8290-c3500147ea32" (UID: "97ef9075-7d65-4345-8290-c3500147ea32"). InnerVolumeSpecName "kube-api-access-2r69w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 11:45:08.705163 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:08.705143 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a62271d2-f292-4fd2-85c7-cc0e549b60d4-tls-cert\") pod \"authorino-7dd6479778-lwmr6\" (UID: \"a62271d2-f292-4fd2-85c7-cc0e549b60d4\") " pod="kuadrant-system/authorino-7dd6479778-lwmr6" Jun 11 11:45:08.710563 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:08.710540 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x2zj\" (UniqueName: \"kubernetes.io/projected/a62271d2-f292-4fd2-85c7-cc0e549b60d4-kube-api-access-9x2zj\") pod \"authorino-7dd6479778-lwmr6\" (UID: \"a62271d2-f292-4fd2-85c7-cc0e549b60d4\") " pod="kuadrant-system/authorino-7dd6479778-lwmr6" Jun 11 11:45:08.803870 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:08.803779 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2r69w\" (UniqueName: \"kubernetes.io/projected/97ef9075-7d65-4345-8290-c3500147ea32-kube-api-access-2r69w\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 11:45:08.825713 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:08.825677 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7dd6479778-lwmr6" Jun 11 11:45:08.954271 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:08.954081 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7dd6479778-lwmr6"] Jun 11 11:45:08.956815 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:45:08.956787 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda62271d2_f292_4fd2_85c7_cc0e549b60d4.slice/crio-9b56a6e8644b0b51ec011e03370961ae0fac437a4a53d5b3917a0243b86d1522 WatchSource:0}: Error finding container 9b56a6e8644b0b51ec011e03370961ae0fac437a4a53d5b3917a0243b86d1522: Status 404 returned error can't find the container with id 9b56a6e8644b0b51ec011e03370961ae0fac437a4a53d5b3917a0243b86d1522 Jun 11 11:45:09.616731 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:09.616628 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7dd6479778-lwmr6" event={"ID":"a62271d2-f292-4fd2-85c7-cc0e549b60d4","Type":"ContainerStarted","Data":"bc33b273d1f899328235de9b6635387a04052986f2db33fc735c680c4137830a"} Jun 11 11:45:09.616731 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:09.616670 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7dd6479778-lwmr6" event={"ID":"a62271d2-f292-4fd2-85c7-cc0e549b60d4","Type":"ContainerStarted","Data":"9b56a6e8644b0b51ec011e03370961ae0fac437a4a53d5b3917a0243b86d1522"} Jun 11 11:45:09.616731 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:09.616686 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2shp5" Jun 11 11:45:09.633016 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:09.632957 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7dd6479778-lwmr6" podStartSLOduration=1.236656807 podStartE2EDuration="1.632939823s" totalImagesPullingTime="396.283016ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:45:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:45:09.63174155 +0000 UTC m=+711.052691318" watchObservedRunningTime="2026-06-11 11:45:09.632939823 +0000 UTC m=+711.053889590" Jun 11 11:45:09.654338 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:09.654302 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2shp5"] Jun 11 11:45:09.660417 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:09.660356 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2shp5"] Jun 11 11:45:09.661588 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:09.661562 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kk49l"] Jun 11 11:45:09.661782 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:09.661759 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-kk49l" podUID="7eab30d9-efb8-47a8-9569-501c4c0d303b" containerName="authorino" containerID="cri-o://5de1adbb49587c8805b5c7c6ea6947cf69c4b0a2ed4214f387b07ec1258e0176" gracePeriod=30 Jun 11 11:45:09.918915 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:09.918883 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kk49l" Jun 11 11:45:10.013333 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:10.013296 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6l9gp\" (UniqueName: \"kubernetes.io/projected/7eab30d9-efb8-47a8-9569-501c4c0d303b-kube-api-access-6l9gp\") pod \"7eab30d9-efb8-47a8-9569-501c4c0d303b\" (UID: \"7eab30d9-efb8-47a8-9569-501c4c0d303b\") " Jun 11 11:45:10.015374 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:10.015346 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7eab30d9-efb8-47a8-9569-501c4c0d303b-kube-api-access-6l9gp" (OuterVolumeSpecName: "kube-api-access-6l9gp") pod "7eab30d9-efb8-47a8-9569-501c4c0d303b" (UID: "7eab30d9-efb8-47a8-9569-501c4c0d303b"). InnerVolumeSpecName "kube-api-access-6l9gp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 11:45:10.114381 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:10.114331 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6l9gp\" (UniqueName: \"kubernetes.io/projected/7eab30d9-efb8-47a8-9569-501c4c0d303b-kube-api-access-6l9gp\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 11:45:10.621769 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:10.621735 2580 generic.go:356] "Generic (PLEG): container finished" podID="7eab30d9-efb8-47a8-9569-501c4c0d303b" containerID="5de1adbb49587c8805b5c7c6ea6947cf69c4b0a2ed4214f387b07ec1258e0176" exitCode=0 Jun 11 11:45:10.622146 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:10.621780 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kk49l" Jun 11 11:45:10.622146 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:10.621817 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kk49l" event={"ID":"7eab30d9-efb8-47a8-9569-501c4c0d303b","Type":"ContainerDied","Data":"5de1adbb49587c8805b5c7c6ea6947cf69c4b0a2ed4214f387b07ec1258e0176"} Jun 11 11:45:10.622146 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:10.621864 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kk49l" event={"ID":"7eab30d9-efb8-47a8-9569-501c4c0d303b","Type":"ContainerDied","Data":"b85098096f3a273e6bdd10c16d68b97217fbbd92ca38e04110123f06f3fceb82"} Jun 11 11:45:10.622146 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:10.621886 2580 scope.go:117] "RemoveContainer" containerID="5de1adbb49587c8805b5c7c6ea6947cf69c4b0a2ed4214f387b07ec1258e0176" Jun 11 11:45:10.630367 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:10.630348 2580 scope.go:117] "RemoveContainer" containerID="5de1adbb49587c8805b5c7c6ea6947cf69c4b0a2ed4214f387b07ec1258e0176" Jun 11 11:45:10.630649 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:45:10.630630 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5de1adbb49587c8805b5c7c6ea6947cf69c4b0a2ed4214f387b07ec1258e0176\": container with ID starting with 5de1adbb49587c8805b5c7c6ea6947cf69c4b0a2ed4214f387b07ec1258e0176 not found: ID does not exist" containerID="5de1adbb49587c8805b5c7c6ea6947cf69c4b0a2ed4214f387b07ec1258e0176" Jun 11 11:45:10.630725 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:10.630659 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5de1adbb49587c8805b5c7c6ea6947cf69c4b0a2ed4214f387b07ec1258e0176"} err="failed to get container status \"5de1adbb49587c8805b5c7c6ea6947cf69c4b0a2ed4214f387b07ec1258e0176\": rpc error: code = NotFound desc = could not find container \"5de1adbb49587c8805b5c7c6ea6947cf69c4b0a2ed4214f387b07ec1258e0176\": container with ID starting with 5de1adbb49587c8805b5c7c6ea6947cf69c4b0a2ed4214f387b07ec1258e0176 not found: ID does not exist" Jun 11 11:45:10.645457 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:10.645427 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kk49l"] Jun 11 11:45:10.649300 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:10.649272 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kk49l"] Jun 11 11:45:11.043553 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:11.043522 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7eab30d9-efb8-47a8-9569-501c4c0d303b" path="/var/lib/kubelet/pods/7eab30d9-efb8-47a8-9569-501c4c0d303b/volumes" Jun 11 11:45:11.043837 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:11.043825 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97ef9075-7d65-4345-8290-c3500147ea32" path="/var/lib/kubelet/pods/97ef9075-7d65-4345-8290-c3500147ea32/volumes" Jun 11 11:45:13.345348 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:13.345308 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-774f4f7676-mkbm2"] Jun 11 11:45:13.345748 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:13.345612 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7eab30d9-efb8-47a8-9569-501c4c0d303b" containerName="authorino" Jun 11 11:45:13.345748 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:13.345624 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7eab30d9-efb8-47a8-9569-501c4c0d303b" containerName="authorino" Jun 11 11:45:13.345748 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:13.345690 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7eab30d9-efb8-47a8-9569-501c4c0d303b" containerName="authorino" Jun 11 11:45:13.348537 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:13.348521 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-774f4f7676-mkbm2" Jun 11 11:45:13.351331 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:13.351310 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 11:45:13.351450 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:13.351317 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 11:45:13.351526 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:13.351469 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-p7vkj\"" Jun 11 11:45:13.361208 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:13.361184 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-774f4f7676-mkbm2"] Jun 11 11:45:13.444764 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:13.444728 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3af4d26-bf89-41fd-8b64-f03d959a1db4-webhook-cert\") pod \"maas-controller-774f4f7676-mkbm2\" (UID: \"b3af4d26-bf89-41fd-8b64-f03d959a1db4\") " pod="opendatahub/maas-controller-774f4f7676-mkbm2" Jun 11 11:45:13.444934 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:13.444770 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vff9z\" (UniqueName: \"kubernetes.io/projected/b3af4d26-bf89-41fd-8b64-f03d959a1db4-kube-api-access-vff9z\") pod \"maas-controller-774f4f7676-mkbm2\" (UID: \"b3af4d26-bf89-41fd-8b64-f03d959a1db4\") " pod="opendatahub/maas-controller-774f4f7676-mkbm2" Jun 11 11:45:13.545936 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:13.545899 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3af4d26-bf89-41fd-8b64-f03d959a1db4-webhook-cert\") pod \"maas-controller-774f4f7676-mkbm2\" (UID: \"b3af4d26-bf89-41fd-8b64-f03d959a1db4\") " pod="opendatahub/maas-controller-774f4f7676-mkbm2" Jun 11 11:45:13.545936 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:13.545940 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vff9z\" (UniqueName: \"kubernetes.io/projected/b3af4d26-bf89-41fd-8b64-f03d959a1db4-kube-api-access-vff9z\") pod \"maas-controller-774f4f7676-mkbm2\" (UID: \"b3af4d26-bf89-41fd-8b64-f03d959a1db4\") " pod="opendatahub/maas-controller-774f4f7676-mkbm2" Jun 11 11:45:13.546143 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:45:13.546056 2580 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 11 11:45:13.546143 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:45:13.546125 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3af4d26-bf89-41fd-8b64-f03d959a1db4-webhook-cert podName:b3af4d26-bf89-41fd-8b64-f03d959a1db4 nodeName:}" failed. No retries permitted until 2026-06-11 11:45:14.046107324 +0000 UTC m=+715.467057072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/b3af4d26-bf89-41fd-8b64-f03d959a1db4-webhook-cert") pod "maas-controller-774f4f7676-mkbm2" (UID: "b3af4d26-bf89-41fd-8b64-f03d959a1db4") : secret "maas-controller-webhook-cert" not found Jun 11 11:45:13.551474 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:13.551450 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bd4cb89bd-7hpzh"] Jun 11 11:45:13.553669 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:13.553647 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bd4cb89bd-7hpzh" Jun 11 11:45:13.557412 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:13.557381 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vff9z\" (UniqueName: \"kubernetes.io/projected/b3af4d26-bf89-41fd-8b64-f03d959a1db4-kube-api-access-vff9z\") pod \"maas-controller-774f4f7676-mkbm2\" (UID: \"b3af4d26-bf89-41fd-8b64-f03d959a1db4\") " pod="opendatahub/maas-controller-774f4f7676-mkbm2" Jun 11 11:45:13.566314 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:13.566283 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bd4cb89bd-7hpzh"] Jun 11 11:45:13.647106 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:13.647016 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26sgx\" (UniqueName: \"kubernetes.io/projected/17c30aac-894d-48ca-a0c3-2f62db53d03b-kube-api-access-26sgx\") pod \"maas-controller-bd4cb89bd-7hpzh\" (UID: \"17c30aac-894d-48ca-a0c3-2f62db53d03b\") " pod="opendatahub/maas-controller-bd4cb89bd-7hpzh" Jun 11 11:45:13.647106 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:13.647053 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17c30aac-894d-48ca-a0c3-2f62db53d03b-webhook-cert\") pod \"maas-controller-bd4cb89bd-7hpzh\" (UID: \"17c30aac-894d-48ca-a0c3-2f62db53d03b\") " pod="opendatahub/maas-controller-bd4cb89bd-7hpzh" Jun 11 11:45:13.748101 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:13.748060 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26sgx\" (UniqueName: \"kubernetes.io/projected/17c30aac-894d-48ca-a0c3-2f62db53d03b-kube-api-access-26sgx\") pod \"maas-controller-bd4cb89bd-7hpzh\" (UID: \"17c30aac-894d-48ca-a0c3-2f62db53d03b\") " pod="opendatahub/maas-controller-bd4cb89bd-7hpzh" Jun 11 11:45:13.748101 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:13.748106 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17c30aac-894d-48ca-a0c3-2f62db53d03b-webhook-cert\") pod \"maas-controller-bd4cb89bd-7hpzh\" (UID: \"17c30aac-894d-48ca-a0c3-2f62db53d03b\") " pod="opendatahub/maas-controller-bd4cb89bd-7hpzh" Jun 11 11:45:13.748315 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:45:13.748202 2580 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 11 11:45:13.748315 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:45:13.748260 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17c30aac-894d-48ca-a0c3-2f62db53d03b-webhook-cert podName:17c30aac-894d-48ca-a0c3-2f62db53d03b nodeName:}" failed. No retries permitted until 2026-06-11 11:45:14.248243127 +0000 UTC m=+715.669192873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/17c30aac-894d-48ca-a0c3-2f62db53d03b-webhook-cert") pod "maas-controller-bd4cb89bd-7hpzh" (UID: "17c30aac-894d-48ca-a0c3-2f62db53d03b") : secret "maas-controller-webhook-cert" not found Jun 11 11:45:13.758184 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:13.758152 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26sgx\" (UniqueName: \"kubernetes.io/projected/17c30aac-894d-48ca-a0c3-2f62db53d03b-kube-api-access-26sgx\") pod \"maas-controller-bd4cb89bd-7hpzh\" (UID: \"17c30aac-894d-48ca-a0c3-2f62db53d03b\") " pod="opendatahub/maas-controller-bd4cb89bd-7hpzh" Jun 11 11:45:14.050615 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:14.050568 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3af4d26-bf89-41fd-8b64-f03d959a1db4-webhook-cert\") pod \"maas-controller-774f4f7676-mkbm2\" (UID: \"b3af4d26-bf89-41fd-8b64-f03d959a1db4\") " pod="opendatahub/maas-controller-774f4f7676-mkbm2" Jun 11 11:45:14.053094 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:14.053067 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3af4d26-bf89-41fd-8b64-f03d959a1db4-webhook-cert\") pod \"maas-controller-774f4f7676-mkbm2\" (UID: \"b3af4d26-bf89-41fd-8b64-f03d959a1db4\") " pod="opendatahub/maas-controller-774f4f7676-mkbm2" Jun 11 11:45:14.252963 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:14.252919 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17c30aac-894d-48ca-a0c3-2f62db53d03b-webhook-cert\") pod \"maas-controller-bd4cb89bd-7hpzh\" (UID: \"17c30aac-894d-48ca-a0c3-2f62db53d03b\") " pod="opendatahub/maas-controller-bd4cb89bd-7hpzh" Jun 11 11:45:14.255313 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:14.255291 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17c30aac-894d-48ca-a0c3-2f62db53d03b-webhook-cert\") pod \"maas-controller-bd4cb89bd-7hpzh\" (UID: \"17c30aac-894d-48ca-a0c3-2f62db53d03b\") " pod="opendatahub/maas-controller-bd4cb89bd-7hpzh" Jun 11 11:45:14.258201 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:14.258175 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-774f4f7676-mkbm2" Jun 11 11:45:14.387013 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:14.386980 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-774f4f7676-mkbm2"] Jun 11 11:45:14.390126 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:45:14.390099 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3af4d26_bf89_41fd_8b64_f03d959a1db4.slice/crio-19d7a2fcdd23401ea4176edee9ab31e292cd46e85c00689a9e772f84038c822a WatchSource:0}: Error finding container 19d7a2fcdd23401ea4176edee9ab31e292cd46e85c00689a9e772f84038c822a: Status 404 returned error can't find the container with id 19d7a2fcdd23401ea4176edee9ab31e292cd46e85c00689a9e772f84038c822a Jun 11 11:45:14.471441 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:14.471410 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bd4cb89bd-7hpzh" Jun 11 11:45:14.602838 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:14.602811 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bd4cb89bd-7hpzh"] Jun 11 11:45:14.605473 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:45:14.605443 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17c30aac_894d_48ca_a0c3_2f62db53d03b.slice/crio-323807d2f1666765dc831b77a2f4ee09edb2f9123e57e4bf70e7b5f466f924db WatchSource:0}: Error finding container 323807d2f1666765dc831b77a2f4ee09edb2f9123e57e4bf70e7b5f466f924db: Status 404 returned error can't find the container with id 323807d2f1666765dc831b77a2f4ee09edb2f9123e57e4bf70e7b5f466f924db Jun 11 11:45:14.641506 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:14.641461 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bd4cb89bd-7hpzh" event={"ID":"17c30aac-894d-48ca-a0c3-2f62db53d03b","Type":"ContainerStarted","Data":"323807d2f1666765dc831b77a2f4ee09edb2f9123e57e4bf70e7b5f466f924db"} Jun 11 11:45:14.642459 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:14.642436 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-774f4f7676-mkbm2" event={"ID":"b3af4d26-bf89-41fd-8b64-f03d959a1db4","Type":"ContainerStarted","Data":"19d7a2fcdd23401ea4176edee9ab31e292cd46e85c00689a9e772f84038c822a"} Jun 11 11:45:17.662172 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:17.662122 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bd4cb89bd-7hpzh" event={"ID":"17c30aac-894d-48ca-a0c3-2f62db53d03b","Type":"ContainerStarted","Data":"22e7e12da5f3515b86c73e13027656c8227dba91a75b470c2a409be1588183a4"} Jun 11 11:45:17.662681 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:17.662253 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bd4cb89bd-7hpzh" Jun 11 11:45:17.663957 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:17.663930 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-774f4f7676-mkbm2" event={"ID":"b3af4d26-bf89-41fd-8b64-f03d959a1db4","Type":"ContainerStarted","Data":"b9329d2bcaa15f094c8c67765f7409e0c39ff40031e0671d4245ff6743c21c84"} Jun 11 11:45:17.664058 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:17.663989 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-774f4f7676-mkbm2" Jun 11 11:45:17.682128 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:17.682072 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-bd4cb89bd-7hpzh" podStartSLOduration=2.196158796 podStartE2EDuration="4.68205622s" totalImagesPullingTime="2.485897424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:45:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:45:17.680816109 +0000 UTC m=+719.101765876" watchObservedRunningTime="2026-06-11 11:45:17.68205622 +0000 UTC m=+719.103005964" Jun 11 11:45:17.703884 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:17.703824 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-774f4f7676-mkbm2" podStartSLOduration=1.993398403 podStartE2EDuration="4.703805504s" totalImagesPullingTime="2.710407101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:45:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:45:17.702464269 +0000 UTC m=+719.123414049" watchObservedRunningTime="2026-06-11 11:45:17.703805504 +0000 UTC m=+719.124755270" Jun 11 11:45:28.674147 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:28.674115 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bd4cb89bd-7hpzh" Jun 11 11:45:28.674657 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:28.674359 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-774f4f7676-mkbm2" Jun 11 11:45:28.732450 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:28.732414 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-774f4f7676-mkbm2"] Jun 11 11:45:28.732667 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:28.732623 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-774f4f7676-mkbm2" podUID="b3af4d26-bf89-41fd-8b64-f03d959a1db4" containerName="manager" containerID="cri-o://b9329d2bcaa15f094c8c67765f7409e0c39ff40031e0671d4245ff6743c21c84" gracePeriod=30 Jun 11 11:45:28.980011 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:28.979984 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-774f4f7676-mkbm2" Jun 11 11:45:29.074560 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:29.074521 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3af4d26-bf89-41fd-8b64-f03d959a1db4-webhook-cert\") pod \"b3af4d26-bf89-41fd-8b64-f03d959a1db4\" (UID: \"b3af4d26-bf89-41fd-8b64-f03d959a1db4\") " Jun 11 11:45:29.074763 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:29.074573 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vff9z\" (UniqueName: \"kubernetes.io/projected/b3af4d26-bf89-41fd-8b64-f03d959a1db4-kube-api-access-vff9z\") pod \"b3af4d26-bf89-41fd-8b64-f03d959a1db4\" (UID: \"b3af4d26-bf89-41fd-8b64-f03d959a1db4\") " Jun 11 11:45:29.076726 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:29.076699 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3af4d26-bf89-41fd-8b64-f03d959a1db4-kube-api-access-vff9z" (OuterVolumeSpecName: "kube-api-access-vff9z") pod "b3af4d26-bf89-41fd-8b64-f03d959a1db4" (UID: "b3af4d26-bf89-41fd-8b64-f03d959a1db4"). InnerVolumeSpecName "kube-api-access-vff9z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 11:45:29.076823 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:29.076791 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3af4d26-bf89-41fd-8b64-f03d959a1db4-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b3af4d26-bf89-41fd-8b64-f03d959a1db4" (UID: "b3af4d26-bf89-41fd-8b64-f03d959a1db4"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 11:45:29.176014 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:29.175978 2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3af4d26-bf89-41fd-8b64-f03d959a1db4-webhook-cert\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 11:45:29.176014 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:29.176009 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vff9z\" (UniqueName: \"kubernetes.io/projected/b3af4d26-bf89-41fd-8b64-f03d959a1db4-kube-api-access-vff9z\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 11:45:29.714720 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:29.714677 2580 generic.go:356] "Generic (PLEG): container finished" podID="b3af4d26-bf89-41fd-8b64-f03d959a1db4" containerID="b9329d2bcaa15f094c8c67765f7409e0c39ff40031e0671d4245ff6743c21c84" exitCode=0 Jun 11 11:45:29.715126 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:29.714735 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-774f4f7676-mkbm2" event={"ID":"b3af4d26-bf89-41fd-8b64-f03d959a1db4","Type":"ContainerDied","Data":"b9329d2bcaa15f094c8c67765f7409e0c39ff40031e0671d4245ff6743c21c84"} Jun 11 11:45:29.715126 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:29.714750 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-774f4f7676-mkbm2" Jun 11 11:45:29.715126 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:29.714820 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-774f4f7676-mkbm2" event={"ID":"b3af4d26-bf89-41fd-8b64-f03d959a1db4","Type":"ContainerDied","Data":"19d7a2fcdd23401ea4176edee9ab31e292cd46e85c00689a9e772f84038c822a"} Jun 11 11:45:29.715126 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:29.714851 2580 scope.go:117] "RemoveContainer" containerID="b9329d2bcaa15f094c8c67765f7409e0c39ff40031e0671d4245ff6743c21c84" Jun 11 11:45:29.723736 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:29.723715 2580 scope.go:117] "RemoveContainer" containerID="b9329d2bcaa15f094c8c67765f7409e0c39ff40031e0671d4245ff6743c21c84" Jun 11 11:45:29.724016 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:45:29.723995 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9329d2bcaa15f094c8c67765f7409e0c39ff40031e0671d4245ff6743c21c84\": container with ID starting with b9329d2bcaa15f094c8c67765f7409e0c39ff40031e0671d4245ff6743c21c84 not found: ID does not exist" containerID="b9329d2bcaa15f094c8c67765f7409e0c39ff40031e0671d4245ff6743c21c84" Jun 11 11:45:29.724075 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:29.724026 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9329d2bcaa15f094c8c67765f7409e0c39ff40031e0671d4245ff6743c21c84"} err="failed to get container status \"b9329d2bcaa15f094c8c67765f7409e0c39ff40031e0671d4245ff6743c21c84\": rpc error: code = NotFound desc = could not find container \"b9329d2bcaa15f094c8c67765f7409e0c39ff40031e0671d4245ff6743c21c84\": container with ID starting with b9329d2bcaa15f094c8c67765f7409e0c39ff40031e0671d4245ff6743c21c84 not found: ID does not exist" Jun 11 11:45:29.736959 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:29.736927 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-774f4f7676-mkbm2"] Jun 11 11:45:29.742428 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:29.742403 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-774f4f7676-mkbm2"] Jun 11 11:45:31.044120 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:31.044085 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3af4d26-bf89-41fd-8b64-f03d959a1db4" path="/var/lib/kubelet/pods/b3af4d26-bf89-41fd-8b64-f03d959a1db4/volumes" Jun 11 11:45:48.454056 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:48.454021 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-845d5d9dc5-8h8dx"] Jun 11 11:45:48.454433 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:48.454310 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3af4d26-bf89-41fd-8b64-f03d959a1db4" containerName="manager" Jun 11 11:45:48.454433 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:48.454321 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3af4d26-bf89-41fd-8b64-f03d959a1db4" containerName="manager" Jun 11 11:45:48.454433 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:48.454369 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3af4d26-bf89-41fd-8b64-f03d959a1db4" containerName="manager" Jun 11 11:45:48.460209 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:48.460189 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-845d5d9dc5-8h8dx" Jun 11 11:45:48.462759 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:48.462728 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 11 11:45:48.462893 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:48.462735 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-zfz67\"" Jun 11 11:45:48.465936 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:48.465901 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-845d5d9dc5-8h8dx"] Jun 11 11:45:48.537994 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:48.537961 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6fa05f1c-f5a6-4e22-a20e-dd864e194205-maas-api-tls\") pod \"maas-api-845d5d9dc5-8h8dx\" (UID: \"6fa05f1c-f5a6-4e22-a20e-dd864e194205\") " pod="opendatahub/maas-api-845d5d9dc5-8h8dx" Jun 11 11:45:48.538184 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:48.538013 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fa05f1c-f5a6-4e22-a20e-dd864e194205-openshift-service-ca\") pod \"maas-api-845d5d9dc5-8h8dx\" (UID: \"6fa05f1c-f5a6-4e22-a20e-dd864e194205\") " pod="opendatahub/maas-api-845d5d9dc5-8h8dx" Jun 11 11:45:48.538184 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:48.538110 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7nw5\" (UniqueName: \"kubernetes.io/projected/6fa05f1c-f5a6-4e22-a20e-dd864e194205-kube-api-access-x7nw5\") pod \"maas-api-845d5d9dc5-8h8dx\" (UID: \"6fa05f1c-f5a6-4e22-a20e-dd864e194205\") " pod="opendatahub/maas-api-845d5d9dc5-8h8dx" Jun 11 11:45:48.638944 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:48.638894 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fa05f1c-f5a6-4e22-a20e-dd864e194205-openshift-service-ca\") pod \"maas-api-845d5d9dc5-8h8dx\" (UID: \"6fa05f1c-f5a6-4e22-a20e-dd864e194205\") " pod="opendatahub/maas-api-845d5d9dc5-8h8dx" Jun 11 11:45:48.639125 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:48.638963 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7nw5\" (UniqueName: \"kubernetes.io/projected/6fa05f1c-f5a6-4e22-a20e-dd864e194205-kube-api-access-x7nw5\") pod \"maas-api-845d5d9dc5-8h8dx\" (UID: \"6fa05f1c-f5a6-4e22-a20e-dd864e194205\") " pod="opendatahub/maas-api-845d5d9dc5-8h8dx" Jun 11 11:45:48.639125 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:48.638984 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6fa05f1c-f5a6-4e22-a20e-dd864e194205-maas-api-tls\") pod \"maas-api-845d5d9dc5-8h8dx\" (UID: \"6fa05f1c-f5a6-4e22-a20e-dd864e194205\") " pod="opendatahub/maas-api-845d5d9dc5-8h8dx" Jun 11 11:45:48.639611 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:48.639587 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fa05f1c-f5a6-4e22-a20e-dd864e194205-openshift-service-ca\") pod \"maas-api-845d5d9dc5-8h8dx\" (UID: \"6fa05f1c-f5a6-4e22-a20e-dd864e194205\") " pod="opendatahub/maas-api-845d5d9dc5-8h8dx" Jun 11 11:45:48.641316 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:48.641300 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6fa05f1c-f5a6-4e22-a20e-dd864e194205-maas-api-tls\") pod \"maas-api-845d5d9dc5-8h8dx\" (UID: \"6fa05f1c-f5a6-4e22-a20e-dd864e194205\") " pod="opendatahub/maas-api-845d5d9dc5-8h8dx" Jun 11 11:45:48.647352 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:48.647324 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7nw5\" (UniqueName: \"kubernetes.io/projected/6fa05f1c-f5a6-4e22-a20e-dd864e194205-kube-api-access-x7nw5\") pod \"maas-api-845d5d9dc5-8h8dx\" (UID: \"6fa05f1c-f5a6-4e22-a20e-dd864e194205\") " pod="opendatahub/maas-api-845d5d9dc5-8h8dx" Jun 11 11:45:48.770992 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:48.770898 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-845d5d9dc5-8h8dx" Jun 11 11:45:48.911368 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:48.911319 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-845d5d9dc5-8h8dx"] Jun 11 11:45:48.914316 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:45:48.914281 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fa05f1c_f5a6_4e22_a20e_dd864e194205.slice/crio-e646faa299c80a06a3f87bf9875ce17e9e343fe166568ceb432f74fb90565e9d WatchSource:0}: Error finding container e646faa299c80a06a3f87bf9875ce17e9e343fe166568ceb432f74fb90565e9d: Status 404 returned error can't find the container with id e646faa299c80a06a3f87bf9875ce17e9e343fe166568ceb432f74fb90565e9d Jun 11 11:45:48.915632 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:48.915614 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 11:45:49.050122 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:49.050043 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-64hdw"] Jun 11 11:45:49.054832 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:49.054815 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-64hdw" Jun 11 11:45:49.060201 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:49.060169 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-jccbk\"" Jun 11 11:45:49.060515 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:49.060483 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 11:45:49.061911 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:49.061891 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-64hdw"] Jun 11 11:45:49.077323 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:49.077285 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-dnpbb"] Jun 11 11:45:49.081033 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:49.081010 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-dnpbb" Jun 11 11:45:49.089555 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:49.089526 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-dnpbb"] Jun 11 11:45:49.145049 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:49.145009 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcfq8\" (UniqueName: \"kubernetes.io/projected/6edd5a90-c00e-4a98-b585-0bb87e2bd397-kube-api-access-hcfq8\") pod \"payload-processing-699b6cd6c-dnpbb\" (UID: \"6edd5a90-c00e-4a98-b585-0bb87e2bd397\") " pod="openshift-ingress/payload-processing-699b6cd6c-dnpbb" Jun 11 11:45:49.145226 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:49.145090 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph9h8\" (UniqueName: \"kubernetes.io/projected/b1997c27-2246-4eca-8693-9ba93216d636-kube-api-access-ph9h8\") pod \"payload-pre-processing-579785bc64-64hdw\" (UID: \"b1997c27-2246-4eca-8693-9ba93216d636\") " pod="openshift-ingress/payload-pre-processing-579785bc64-64hdw" Jun 11 11:45:49.246253 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:49.246216 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcfq8\" (UniqueName: \"kubernetes.io/projected/6edd5a90-c00e-4a98-b585-0bb87e2bd397-kube-api-access-hcfq8\") pod \"payload-processing-699b6cd6c-dnpbb\" (UID: \"6edd5a90-c00e-4a98-b585-0bb87e2bd397\") " pod="openshift-ingress/payload-processing-699b6cd6c-dnpbb" Jun 11 11:45:49.246438 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:49.246282 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph9h8\" (UniqueName: \"kubernetes.io/projected/b1997c27-2246-4eca-8693-9ba93216d636-kube-api-access-ph9h8\") pod \"payload-pre-processing-579785bc64-64hdw\" (UID: \"b1997c27-2246-4eca-8693-9ba93216d636\") " pod="openshift-ingress/payload-pre-processing-579785bc64-64hdw" Jun 11 11:45:49.254450 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:49.254415 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcfq8\" (UniqueName: \"kubernetes.io/projected/6edd5a90-c00e-4a98-b585-0bb87e2bd397-kube-api-access-hcfq8\") pod \"payload-processing-699b6cd6c-dnpbb\" (UID: \"6edd5a90-c00e-4a98-b585-0bb87e2bd397\") " pod="openshift-ingress/payload-processing-699b6cd6c-dnpbb" Jun 11 11:45:49.254450 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:49.254431 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph9h8\" (UniqueName: \"kubernetes.io/projected/b1997c27-2246-4eca-8693-9ba93216d636-kube-api-access-ph9h8\") pod \"payload-pre-processing-579785bc64-64hdw\" (UID: \"b1997c27-2246-4eca-8693-9ba93216d636\") " pod="openshift-ingress/payload-pre-processing-579785bc64-64hdw" Jun 11 11:45:49.366633 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:49.366537 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-64hdw" Jun 11 11:45:49.390980 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:49.390946 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-dnpbb" Jun 11 11:45:49.507471 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:49.507440 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-64hdw"] Jun 11 11:45:49.509555 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:45:49.509524 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1997c27_2246_4eca_8693_9ba93216d636.slice/crio-65952b1832ff91ae9ade5b2fce275d8e2961411a412d345096cbabdaabc47490 WatchSource:0}: Error finding container 65952b1832ff91ae9ade5b2fce275d8e2961411a412d345096cbabdaabc47490: Status 404 returned error can't find the container with id 65952b1832ff91ae9ade5b2fce275d8e2961411a412d345096cbabdaabc47490 Jun 11 11:45:49.537269 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:49.537242 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-dnpbb"] Jun 11 11:45:49.539637 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:45:49.539607 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6edd5a90_c00e_4a98_b585_0bb87e2bd397.slice/crio-b27edb3f01a00e98e270fd0a1778ed2c017fdaf66b9cb5c09103fdc3603e7550 WatchSource:0}: Error finding container b27edb3f01a00e98e270fd0a1778ed2c017fdaf66b9cb5c09103fdc3603e7550: Status 404 returned error can't find the container with id b27edb3f01a00e98e270fd0a1778ed2c017fdaf66b9cb5c09103fdc3603e7550 Jun 11 11:45:49.805085 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:49.805046 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-64hdw" event={"ID":"b1997c27-2246-4eca-8693-9ba93216d636","Type":"ContainerStarted","Data":"65952b1832ff91ae9ade5b2fce275d8e2961411a412d345096cbabdaabc47490"} Jun 11 11:45:49.806220 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:49.806190 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-dnpbb" event={"ID":"6edd5a90-c00e-4a98-b585-0bb87e2bd397","Type":"ContainerStarted","Data":"b27edb3f01a00e98e270fd0a1778ed2c017fdaf66b9cb5c09103fdc3603e7550"} Jun 11 11:45:49.807349 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:49.807324 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-845d5d9dc5-8h8dx" event={"ID":"6fa05f1c-f5a6-4e22-a20e-dd864e194205","Type":"ContainerStarted","Data":"e646faa299c80a06a3f87bf9875ce17e9e343fe166568ceb432f74fb90565e9d"} Jun 11 11:45:51.819806 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:51.819768 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-845d5d9dc5-8h8dx" event={"ID":"6fa05f1c-f5a6-4e22-a20e-dd864e194205","Type":"ContainerStarted","Data":"c73a430a468ba94a9a9e86a6bc6741c9fd2121e0a25170cb17fad3ed71ad7196"} Jun 11 11:45:51.820224 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:51.819958 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-845d5d9dc5-8h8dx" Jun 11 11:45:51.837292 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:51.837237 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-845d5d9dc5-8h8dx" podStartSLOduration=1.8892221679999999 podStartE2EDuration="3.837220577s" totalImagesPullingTime="1.947998409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:45:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:45:51.835642893 +0000 UTC m=+753.256592661" watchObservedRunningTime="2026-06-11 11:45:51.837220577 +0000 UTC m=+753.258170343" Jun 11 11:45:52.826072 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:52.826031 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-dnpbb" event={"ID":"6edd5a90-c00e-4a98-b585-0bb87e2bd397","Type":"ContainerStarted","Data":"78206fd4fb448ee008c8eb07282c7888ba82e9c5747f915dfd23c509575b0ac5"} Jun 11 11:45:52.826580 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:52.826220 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-dnpbb" Jun 11 11:45:52.827588 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:52.827558 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-64hdw" event={"ID":"b1997c27-2246-4eca-8693-9ba93216d636","Type":"ContainerStarted","Data":"16cc671e527d89f069f3feb17b23995dbd6572637e5378c4bea568c61e498586"} Jun 11 11:45:52.827698 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:52.827675 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-64hdw" Jun 11 11:45:52.843965 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:52.843914 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-dnpbb" podStartSLOduration=1.316138262 podStartE2EDuration="3.843896813s" totalImagesPullingTime="2.527758551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:45:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:45:52.843168918 +0000 UTC m=+754.264118688" watchObservedRunningTime="2026-06-11 11:45:52.843896813 +0000 UTC m=+754.264846573" Jun 11 11:45:52.858450 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:52.858396 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-64hdw" podStartSLOduration=1.306715365 podStartE2EDuration="3.858378159s" totalImagesPullingTime="2.551662794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:45:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:45:52.857513171 +0000 UTC m=+754.278462935" watchObservedRunningTime="2026-06-11 11:45:52.858378159 +0000 UTC m=+754.279327918" Jun 11 11:45:57.833201 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:45:57.833171 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-845d5d9dc5-8h8dx" Jun 11 11:46:03.832978 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:46:03.832947 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-dnpbb" Jun 11 11:46:03.833475 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:46:03.833169 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-64hdw" Jun 11 11:48:02.097923 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:02.097836 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 11:48:02.098458 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:02.098067 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="a312f138-8ac4-4c28-96a1-6676caa81325" containerName="keycloak" containerID="cri-o://3f86852725fce4438e95f1bdecd5646794f0b95dd70a78863205c3bab2bcfc3d" gracePeriod=30 Jun 11 11:48:04.135298 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.135275 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 11:48:04.282295 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.282189 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6w8c\" (UniqueName: \"kubernetes.io/projected/a312f138-8ac4-4c28-96a1-6676caa81325-kube-api-access-v6w8c\") pod \"a312f138-8ac4-4c28-96a1-6676caa81325\" (UID: \"a312f138-8ac4-4c28-96a1-6676caa81325\") " Jun 11 11:48:04.284337 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.284302 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a312f138-8ac4-4c28-96a1-6676caa81325-kube-api-access-v6w8c" (OuterVolumeSpecName: "kube-api-access-v6w8c") pod "a312f138-8ac4-4c28-96a1-6676caa81325" (UID: "a312f138-8ac4-4c28-96a1-6676caa81325"). InnerVolumeSpecName "kube-api-access-v6w8c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 11:48:04.381660 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.381626 2580 generic.go:356] "Generic (PLEG): container finished" podID="a312f138-8ac4-4c28-96a1-6676caa81325" containerID="3f86852725fce4438e95f1bdecd5646794f0b95dd70a78863205c3bab2bcfc3d" exitCode=143 Jun 11 11:48:04.381826 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.381676 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 11:48:04.381826 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.381677 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a312f138-8ac4-4c28-96a1-6676caa81325","Type":"ContainerDied","Data":"3f86852725fce4438e95f1bdecd5646794f0b95dd70a78863205c3bab2bcfc3d"} Jun 11 11:48:04.381826 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.381725 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a312f138-8ac4-4c28-96a1-6676caa81325","Type":"ContainerDied","Data":"7f94ba7f45fe96c41c5d4033928064d737ccec82d123cd4d2ccc2895c94f8f62"} Jun 11 11:48:04.381826 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.381745 2580 scope.go:117] "RemoveContainer" containerID="3f86852725fce4438e95f1bdecd5646794f0b95dd70a78863205c3bab2bcfc3d" Jun 11 11:48:04.382817 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.382776 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6w8c\" (UniqueName: \"kubernetes.io/projected/a312f138-8ac4-4c28-96a1-6676caa81325-kube-api-access-v6w8c\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 11:48:04.390912 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.390891 2580 scope.go:117] "RemoveContainer" containerID="3f86852725fce4438e95f1bdecd5646794f0b95dd70a78863205c3bab2bcfc3d" Jun 11 11:48:04.391202 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:48:04.391183 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f86852725fce4438e95f1bdecd5646794f0b95dd70a78863205c3bab2bcfc3d\": container with ID starting with 3f86852725fce4438e95f1bdecd5646794f0b95dd70a78863205c3bab2bcfc3d not found: ID does not exist" containerID="3f86852725fce4438e95f1bdecd5646794f0b95dd70a78863205c3bab2bcfc3d" Jun 11 11:48:04.391248 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.391221 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f86852725fce4438e95f1bdecd5646794f0b95dd70a78863205c3bab2bcfc3d"} err="failed to get container status \"3f86852725fce4438e95f1bdecd5646794f0b95dd70a78863205c3bab2bcfc3d\": rpc error: code = NotFound desc = could not find container \"3f86852725fce4438e95f1bdecd5646794f0b95dd70a78863205c3bab2bcfc3d\": container with ID starting with 3f86852725fce4438e95f1bdecd5646794f0b95dd70a78863205c3bab2bcfc3d not found: ID does not exist" Jun 11 11:48:04.402448 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.402419 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 11:48:04.403810 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.403790 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 11:48:04.428484 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.428449 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 11:48:04.428755 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.428742 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a312f138-8ac4-4c28-96a1-6676caa81325" containerName="keycloak" Jun 11 11:48:04.428799 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.428757 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a312f138-8ac4-4c28-96a1-6676caa81325" containerName="keycloak" Jun 11 11:48:04.428833 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.428817 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a312f138-8ac4-4c28-96a1-6676caa81325" containerName="keycloak" Jun 11 11:48:04.431352 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.431336 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 11:48:04.433778 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.433748 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-6mk6m\"" Jun 11 11:48:04.433911 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.433892 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 11:48:04.433978 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.433962 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 11 11:48:04.434032 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.433896 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 11:48:04.434089 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.434061 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 11:48:04.440429 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.440404 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 11:48:04.585538 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.585406 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/9ec5ab12-c89b-4638-8983-8a35dfdb617e-test-realms\") pod \"maas-keycloak-0\" (UID: \"9ec5ab12-c89b-4638-8983-8a35dfdb617e\") " pod="keycloak-system/maas-keycloak-0" Jun 11 11:48:04.585538 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.585455 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqxrr\" (UniqueName: \"kubernetes.io/projected/9ec5ab12-c89b-4638-8983-8a35dfdb617e-kube-api-access-pqxrr\") pod \"maas-keycloak-0\" (UID: \"9ec5ab12-c89b-4638-8983-8a35dfdb617e\") " pod="keycloak-system/maas-keycloak-0" Jun 11 11:48:04.686673 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.686628 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/9ec5ab12-c89b-4638-8983-8a35dfdb617e-test-realms\") pod \"maas-keycloak-0\" (UID: \"9ec5ab12-c89b-4638-8983-8a35dfdb617e\") " pod="keycloak-system/maas-keycloak-0" Jun 11 11:48:04.686673 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.686673 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqxrr\" (UniqueName: \"kubernetes.io/projected/9ec5ab12-c89b-4638-8983-8a35dfdb617e-kube-api-access-pqxrr\") pod \"maas-keycloak-0\" (UID: \"9ec5ab12-c89b-4638-8983-8a35dfdb617e\") " pod="keycloak-system/maas-keycloak-0" Jun 11 11:48:04.687403 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.687384 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/9ec5ab12-c89b-4638-8983-8a35dfdb617e-test-realms\") pod \"maas-keycloak-0\" (UID: \"9ec5ab12-c89b-4638-8983-8a35dfdb617e\") " pod="keycloak-system/maas-keycloak-0" Jun 11 11:48:04.695237 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.695206 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqxrr\" (UniqueName: \"kubernetes.io/projected/9ec5ab12-c89b-4638-8983-8a35dfdb617e-kube-api-access-pqxrr\") pod \"maas-keycloak-0\" (UID: \"9ec5ab12-c89b-4638-8983-8a35dfdb617e\") " pod="keycloak-system/maas-keycloak-0" Jun 11 11:48:04.741251 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.741210 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 11:48:04.875412 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:04.875329 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 11:48:04.878127 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:48:04.878096 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ec5ab12_c89b_4638_8983_8a35dfdb617e.slice/crio-38d7a396b13ed2b4ddf3d80b44b03ab673e9456cfb2778f7bfde36085f30867b WatchSource:0}: Error finding container 38d7a396b13ed2b4ddf3d80b44b03ab673e9456cfb2778f7bfde36085f30867b: Status 404 returned error can't find the container with id 38d7a396b13ed2b4ddf3d80b44b03ab673e9456cfb2778f7bfde36085f30867b Jun 11 11:48:05.044175 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:05.044140 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a312f138-8ac4-4c28-96a1-6676caa81325" path="/var/lib/kubelet/pods/a312f138-8ac4-4c28-96a1-6676caa81325/volumes" Jun 11 11:48:05.388777 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:05.388726 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9ec5ab12-c89b-4638-8983-8a35dfdb617e","Type":"ContainerStarted","Data":"96d41f4492a1c197ab6a8828ed1688db52d6f8c1bfa4a8d6f20c29e153ea165a"} Jun 11 11:48:05.389196 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:05.388809 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9ec5ab12-c89b-4638-8983-8a35dfdb617e","Type":"ContainerStarted","Data":"38d7a396b13ed2b4ddf3d80b44b03ab673e9456cfb2778f7bfde36085f30867b"} Jun 11 11:48:05.407817 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:05.407753 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.098793568 podStartE2EDuration="1.40773032s" totalImagesPullingTime="308.936752ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:48:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:48:05.405697341 +0000 UTC m=+886.826647109" watchObservedRunningTime="2026-06-11 11:48:05.40773032 +0000 UTC m=+886.828680088" Jun 11 11:48:05.741455 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:05.741409 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 11:48:05.742844 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:05.742811 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9ec5ab12-c89b-4638-8983-8a35dfdb617e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 11 11:48:06.742245 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:06.742190 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9ec5ab12-c89b-4638-8983-8a35dfdb617e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 11 11:48:07.742023 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:07.741970 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9ec5ab12-c89b-4638-8983-8a35dfdb617e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 11 11:48:08.741727 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:08.741674 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9ec5ab12-c89b-4638-8983-8a35dfdb617e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 11 11:48:09.742540 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:09.742469 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9ec5ab12-c89b-4638-8983-8a35dfdb617e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 11 11:48:10.741884 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:10.741833 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9ec5ab12-c89b-4638-8983-8a35dfdb617e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 11 11:48:11.742602 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:11.742560 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9ec5ab12-c89b-4638-8983-8a35dfdb617e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 11 11:48:12.741946 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:12.741892 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9ec5ab12-c89b-4638-8983-8a35dfdb617e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 11 11:48:13.742506 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:13.742435 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9ec5ab12-c89b-4638-8983-8a35dfdb617e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 11 11:48:14.742304 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:14.742258 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 11:48:14.742581 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:14.742552 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9ec5ab12-c89b-4638-8983-8a35dfdb617e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 11 11:48:15.742401 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:15.742342 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9ec5ab12-c89b-4638-8983-8a35dfdb617e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 11 11:48:16.741798 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:16.741734 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9ec5ab12-c89b-4638-8983-8a35dfdb617e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 11 11:48:17.742505 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:17.742448 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9ec5ab12-c89b-4638-8983-8a35dfdb617e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 11 11:48:18.856604 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:18.856554 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 11:48:18.871507 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:18.871427 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="9ec5ab12-c89b-4638-8983-8a35dfdb617e" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 11:48:28.574851 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:28.574807 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nntvz_8ad3e9b6-2483-4aa5-9c8c-bc31ef592342/ovn-acl-logging/0.log" Jun 11 11:48:28.576438 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:28.576413 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nntvz_8ad3e9b6-2483-4aa5-9c8c-bc31ef592342/ovn-acl-logging/0.log" Jun 11 11:48:28.861053 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:28.860958 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="9ec5ab12-c89b-4638-8983-8a35dfdb617e" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 11:48:38.862916 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:38.862883 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 11:48:49.579709 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:49.579666 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-566c75d948-swxhr"] Jun 11 11:48:49.582113 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:49.582096 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-566c75d948-swxhr" Jun 11 11:48:49.584732 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:49.584708 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 11 11:48:49.597951 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:49.597921 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-566c75d948-swxhr"] Jun 11 11:48:49.663649 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:49.663612 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9c6130ce-d71a-4bc9-8f20-f3e669311f1c-oidc-ca\") pod \"authorino-566c75d948-swxhr\" (UID: \"9c6130ce-d71a-4bc9-8f20-f3e669311f1c\") " pod="kuadrant-system/authorino-566c75d948-swxhr" Jun 11 11:48:49.663649 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:49.663660 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9c6130ce-d71a-4bc9-8f20-f3e669311f1c-tls-cert\") pod \"authorino-566c75d948-swxhr\" (UID: \"9c6130ce-d71a-4bc9-8f20-f3e669311f1c\") " pod="kuadrant-system/authorino-566c75d948-swxhr" Jun 11 11:48:49.663886 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:49.663691 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlt5l\" (UniqueName: \"kubernetes.io/projected/9c6130ce-d71a-4bc9-8f20-f3e669311f1c-kube-api-access-xlt5l\") pod \"authorino-566c75d948-swxhr\" (UID: \"9c6130ce-d71a-4bc9-8f20-f3e669311f1c\") " pod="kuadrant-system/authorino-566c75d948-swxhr" Jun 11 11:48:49.764735 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:49.764690 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9c6130ce-d71a-4bc9-8f20-f3e669311f1c-oidc-ca\") pod \"authorino-566c75d948-swxhr\" (UID: \"9c6130ce-d71a-4bc9-8f20-f3e669311f1c\") " pod="kuadrant-system/authorino-566c75d948-swxhr" Jun 11 11:48:49.764939 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:49.764748 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9c6130ce-d71a-4bc9-8f20-f3e669311f1c-tls-cert\") pod \"authorino-566c75d948-swxhr\" (UID: \"9c6130ce-d71a-4bc9-8f20-f3e669311f1c\") " pod="kuadrant-system/authorino-566c75d948-swxhr" Jun 11 11:48:49.764939 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:49.764788 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlt5l\" (UniqueName: \"kubernetes.io/projected/9c6130ce-d71a-4bc9-8f20-f3e669311f1c-kube-api-access-xlt5l\") pod \"authorino-566c75d948-swxhr\" (UID: \"9c6130ce-d71a-4bc9-8f20-f3e669311f1c\") " pod="kuadrant-system/authorino-566c75d948-swxhr" Jun 11 11:48:49.765446 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:49.765425 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9c6130ce-d71a-4bc9-8f20-f3e669311f1c-oidc-ca\") pod \"authorino-566c75d948-swxhr\" (UID: \"9c6130ce-d71a-4bc9-8f20-f3e669311f1c\") " pod="kuadrant-system/authorino-566c75d948-swxhr" Jun 11 11:48:49.767229 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:49.767211 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9c6130ce-d71a-4bc9-8f20-f3e669311f1c-tls-cert\") pod \"authorino-566c75d948-swxhr\" (UID: \"9c6130ce-d71a-4bc9-8f20-f3e669311f1c\") " pod="kuadrant-system/authorino-566c75d948-swxhr" Jun 11 11:48:49.772560 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:49.772533 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlt5l\" (UniqueName: \"kubernetes.io/projected/9c6130ce-d71a-4bc9-8f20-f3e669311f1c-kube-api-access-xlt5l\") pod \"authorino-566c75d948-swxhr\" (UID: \"9c6130ce-d71a-4bc9-8f20-f3e669311f1c\") " pod="kuadrant-system/authorino-566c75d948-swxhr" Jun 11 11:48:49.890952 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:49.890852 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-566c75d948-swxhr" Jun 11 11:48:50.021267 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:50.021095 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-566c75d948-swxhr"] Jun 11 11:48:50.023956 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:48:50.023921 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c6130ce_d71a_4bc9_8f20_f3e669311f1c.slice/crio-8eb816acbd1cd9ca278164c7ba9a28cae9d3d2d9c70b88b0c0d2d1715b0f7873 WatchSource:0}: Error finding container 8eb816acbd1cd9ca278164c7ba9a28cae9d3d2d9c70b88b0c0d2d1715b0f7873: Status 404 returned error can't find the container with id 8eb816acbd1cd9ca278164c7ba9a28cae9d3d2d9c70b88b0c0d2d1715b0f7873 Jun 11 11:48:50.630292 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:50.630248 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-566c75d948-swxhr" event={"ID":"9c6130ce-d71a-4bc9-8f20-f3e669311f1c","Type":"ContainerStarted","Data":"5d57dbfb63fbd1d680d899d20392e1d872cb82a20b864ee65d97879bb8db8f4a"} Jun 11 11:48:50.630292 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:50.630300 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-566c75d948-swxhr" event={"ID":"9c6130ce-d71a-4bc9-8f20-f3e669311f1c","Type":"ContainerStarted","Data":"8eb816acbd1cd9ca278164c7ba9a28cae9d3d2d9c70b88b0c0d2d1715b0f7873"} Jun 11 11:48:50.646862 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:50.646803 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-566c75d948-swxhr" podStartSLOduration=1.185784195 podStartE2EDuration="1.64678541s" totalImagesPullingTime="461.001215ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:48:50.645008023 +0000 UTC m=+932.065957789" watchObservedRunningTime="2026-06-11 11:48:50.64678541 +0000 UTC m=+932.067735176" Jun 11 11:48:50.677420 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:50.677377 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7dd6479778-lwmr6"] Jun 11 11:48:50.677618 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:50.677590 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7dd6479778-lwmr6" podUID="a62271d2-f292-4fd2-85c7-cc0e549b60d4" containerName="authorino" containerID="cri-o://bc33b273d1f899328235de9b6635387a04052986f2db33fc735c680c4137830a" gracePeriod=30 Jun 11 11:48:50.927865 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:50.927838 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7dd6479778-lwmr6" Jun 11 11:48:50.975751 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:50.975711 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9x2zj\" (UniqueName: \"kubernetes.io/projected/a62271d2-f292-4fd2-85c7-cc0e549b60d4-kube-api-access-9x2zj\") pod \"a62271d2-f292-4fd2-85c7-cc0e549b60d4\" (UID: \"a62271d2-f292-4fd2-85c7-cc0e549b60d4\") " Jun 11 11:48:50.975939 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:50.975794 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a62271d2-f292-4fd2-85c7-cc0e549b60d4-tls-cert\") pod \"a62271d2-f292-4fd2-85c7-cc0e549b60d4\" (UID: \"a62271d2-f292-4fd2-85c7-cc0e549b60d4\") " Jun 11 11:48:50.977869 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:50.977830 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a62271d2-f292-4fd2-85c7-cc0e549b60d4-kube-api-access-9x2zj" (OuterVolumeSpecName: "kube-api-access-9x2zj") pod "a62271d2-f292-4fd2-85c7-cc0e549b60d4" (UID: "a62271d2-f292-4fd2-85c7-cc0e549b60d4"). InnerVolumeSpecName "kube-api-access-9x2zj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 11:48:50.985402 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:50.985374 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a62271d2-f292-4fd2-85c7-cc0e549b60d4-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a62271d2-f292-4fd2-85c7-cc0e549b60d4" (UID: "a62271d2-f292-4fd2-85c7-cc0e549b60d4"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 11:48:51.076363 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:51.076323 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9x2zj\" (UniqueName: \"kubernetes.io/projected/a62271d2-f292-4fd2-85c7-cc0e549b60d4-kube-api-access-9x2zj\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 11:48:51.076363 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:51.076357 2580 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a62271d2-f292-4fd2-85c7-cc0e549b60d4-tls-cert\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 11:48:51.635905 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:51.635875 2580 generic.go:356] "Generic (PLEG): container finished" podID="a62271d2-f292-4fd2-85c7-cc0e549b60d4" containerID="bc33b273d1f899328235de9b6635387a04052986f2db33fc735c680c4137830a" exitCode=0 Jun 11 11:48:51.636366 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:51.635919 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7dd6479778-lwmr6" Jun 11 11:48:51.636366 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:51.635955 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7dd6479778-lwmr6" event={"ID":"a62271d2-f292-4fd2-85c7-cc0e549b60d4","Type":"ContainerDied","Data":"bc33b273d1f899328235de9b6635387a04052986f2db33fc735c680c4137830a"} Jun 11 11:48:51.636366 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:51.635993 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7dd6479778-lwmr6" event={"ID":"a62271d2-f292-4fd2-85c7-cc0e549b60d4","Type":"ContainerDied","Data":"9b56a6e8644b0b51ec011e03370961ae0fac437a4a53d5b3917a0243b86d1522"} Jun 11 11:48:51.636366 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:51.636009 2580 scope.go:117] "RemoveContainer" containerID="bc33b273d1f899328235de9b6635387a04052986f2db33fc735c680c4137830a" Jun 11 11:48:51.644481 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:51.644465 2580 scope.go:117] "RemoveContainer" containerID="bc33b273d1f899328235de9b6635387a04052986f2db33fc735c680c4137830a" Jun 11 11:48:51.644791 ip-10-0-130-170 kubenswrapper[2580]: E0611 11:48:51.644770 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc33b273d1f899328235de9b6635387a04052986f2db33fc735c680c4137830a\": container with ID starting with bc33b273d1f899328235de9b6635387a04052986f2db33fc735c680c4137830a not found: ID does not exist" containerID="bc33b273d1f899328235de9b6635387a04052986f2db33fc735c680c4137830a" Jun 11 11:48:51.644848 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:51.644800 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc33b273d1f899328235de9b6635387a04052986f2db33fc735c680c4137830a"} err="failed to get container status \"bc33b273d1f899328235de9b6635387a04052986f2db33fc735c680c4137830a\": rpc error: code = NotFound desc = could not find container \"bc33b273d1f899328235de9b6635387a04052986f2db33fc735c680c4137830a\": container with ID starting with bc33b273d1f899328235de9b6635387a04052986f2db33fc735c680c4137830a not found: ID does not exist" Jun 11 11:48:51.652287 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:51.652260 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7dd6479778-lwmr6"] Jun 11 11:48:51.655832 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:51.655808 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7dd6479778-lwmr6"] Jun 11 11:48:53.044336 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:48:53.044303 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a62271d2-f292-4fd2-85c7-cc0e549b60d4" path="/var/lib/kubelet/pods/a62271d2-f292-4fd2-85c7-cc0e549b60d4/volumes" Jun 11 11:49:02.130540 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.130482 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm"] Jun 11 11:49:02.130935 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.130826 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a62271d2-f292-4fd2-85c7-cc0e549b60d4" containerName="authorino" Jun 11 11:49:02.130935 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.130839 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a62271d2-f292-4fd2-85c7-cc0e549b60d4" containerName="authorino" Jun 11 11:49:02.130935 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.130898 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a62271d2-f292-4fd2-85c7-cc0e549b60d4" containerName="authorino" Jun 11 11:49:02.133838 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.133816 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm" Jun 11 11:49:02.137351 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.137324 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 11:49:02.137513 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.137358 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 11:49:02.137513 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.137332 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2v4q9\"" Jun 11 11:49:02.137513 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.137338 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 11 11:49:02.144606 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.144570 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm"] Jun 11 11:49:02.272742 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.272707 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzc67\" (UniqueName: \"kubernetes.io/projected/a1a90d02-5095-4fa6-a943-be2f2008b032-kube-api-access-dzc67\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm\" (UID: \"a1a90d02-5095-4fa6-a943-be2f2008b032\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm" Jun 11 11:49:02.272922 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.272752 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1a90d02-5095-4fa6-a943-be2f2008b032-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm\" (UID: \"a1a90d02-5095-4fa6-a943-be2f2008b032\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm" Jun 11 11:49:02.272922 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.272774 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a1a90d02-5095-4fa6-a943-be2f2008b032-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm\" (UID: \"a1a90d02-5095-4fa6-a943-be2f2008b032\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm" Jun 11 11:49:02.272922 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.272850 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1a90d02-5095-4fa6-a943-be2f2008b032-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm\" (UID: \"a1a90d02-5095-4fa6-a943-be2f2008b032\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm" Jun 11 11:49:02.272922 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.272905 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1a90d02-5095-4fa6-a943-be2f2008b032-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm\" (UID: \"a1a90d02-5095-4fa6-a943-be2f2008b032\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm" Jun 11 11:49:02.273061 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.272931 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1a90d02-5095-4fa6-a943-be2f2008b032-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm\" (UID: \"a1a90d02-5095-4fa6-a943-be2f2008b032\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm" Jun 11 11:49:02.374215 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.374170 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1a90d02-5095-4fa6-a943-be2f2008b032-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm\" (UID: \"a1a90d02-5095-4fa6-a943-be2f2008b032\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm" Jun 11 11:49:02.374215 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.374219 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1a90d02-5095-4fa6-a943-be2f2008b032-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm\" (UID: \"a1a90d02-5095-4fa6-a943-be2f2008b032\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm" Jun 11 11:49:02.374465 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.374267 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzc67\" (UniqueName: \"kubernetes.io/projected/a1a90d02-5095-4fa6-a943-be2f2008b032-kube-api-access-dzc67\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm\" (UID: \"a1a90d02-5095-4fa6-a943-be2f2008b032\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm" Jun 11 11:49:02.374465 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.374301 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1a90d02-5095-4fa6-a943-be2f2008b032-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm\" (UID: \"a1a90d02-5095-4fa6-a943-be2f2008b032\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm" Jun 11 11:49:02.374465 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.374332 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a1a90d02-5095-4fa6-a943-be2f2008b032-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm\" (UID: \"a1a90d02-5095-4fa6-a943-be2f2008b032\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm" Jun 11 11:49:02.374465 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.374361 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1a90d02-5095-4fa6-a943-be2f2008b032-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm\" (UID: \"a1a90d02-5095-4fa6-a943-be2f2008b032\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm" Jun 11 11:49:02.374704 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.374674 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1a90d02-5095-4fa6-a943-be2f2008b032-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm\" (UID: \"a1a90d02-5095-4fa6-a943-be2f2008b032\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm" Jun 11 11:49:02.374762 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.374724 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1a90d02-5095-4fa6-a943-be2f2008b032-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm\" (UID: \"a1a90d02-5095-4fa6-a943-be2f2008b032\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm" Jun 11 11:49:02.374815 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.374775 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a1a90d02-5095-4fa6-a943-be2f2008b032-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm\" (UID: \"a1a90d02-5095-4fa6-a943-be2f2008b032\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm" Jun 11 11:49:02.376609 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.376592 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1a90d02-5095-4fa6-a943-be2f2008b032-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm\" (UID: \"a1a90d02-5095-4fa6-a943-be2f2008b032\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm" Jun 11 11:49:02.376964 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.376947 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1a90d02-5095-4fa6-a943-be2f2008b032-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm\" (UID: \"a1a90d02-5095-4fa6-a943-be2f2008b032\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm" Jun 11 11:49:02.383404 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.383349 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzc67\" (UniqueName: \"kubernetes.io/projected/a1a90d02-5095-4fa6-a943-be2f2008b032-kube-api-access-dzc67\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm\" (UID: \"a1a90d02-5095-4fa6-a943-be2f2008b032\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm" Jun 11 11:49:02.446213 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.446178 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm" Jun 11 11:49:02.591845 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.591758 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm"] Jun 11 11:49:02.595196 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:49:02.595167 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1a90d02_5095_4fa6_a943_be2f2008b032.slice/crio-0010236be4cd2fed9e2012eeb37fb87f89b5cfc9519314439cb3a6f34d5afa45 WatchSource:0}: Error finding container 0010236be4cd2fed9e2012eeb37fb87f89b5cfc9519314439cb3a6f34d5afa45: Status 404 returned error can't find the container with id 0010236be4cd2fed9e2012eeb37fb87f89b5cfc9519314439cb3a6f34d5afa45 Jun 11 11:49:02.685238 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:02.685145 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm" event={"ID":"a1a90d02-5095-4fa6-a943-be2f2008b032","Type":"ContainerStarted","Data":"0010236be4cd2fed9e2012eeb37fb87f89b5cfc9519314439cb3a6f34d5afa45"} Jun 11 11:49:06.705689 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:06.705651 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm" event={"ID":"a1a90d02-5095-4fa6-a943-be2f2008b032","Type":"ContainerStarted","Data":"022f14c8ce1a8b4fa9197ba1170fca9b9e53698e57a23f5e3ad4b163347dc7bd"} Jun 11 11:49:08.716249 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:08.716216 2580 generic.go:356] "Generic (PLEG): container finished" podID="a1a90d02-5095-4fa6-a943-be2f2008b032" containerID="022f14c8ce1a8b4fa9197ba1170fca9b9e53698e57a23f5e3ad4b163347dc7bd" exitCode=0 Jun 11 11:49:08.716672 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:08.716263 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm" event={"ID":"a1a90d02-5095-4fa6-a943-be2f2008b032","Type":"ContainerDied","Data":"022f14c8ce1a8b4fa9197ba1170fca9b9e53698e57a23f5e3ad4b163347dc7bd"} Jun 11 11:49:10.728256 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:10.728220 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm" event={"ID":"a1a90d02-5095-4fa6-a943-be2f2008b032","Type":"ContainerStarted","Data":"90d9b639d7cc729a39ae0abb1dffcd2b42c4c7cdbd82bfada0558a5a9ca1835d"} Jun 11 11:49:10.749293 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:10.749240 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm" podStartSLOduration=2.192705202 podStartE2EDuration="8.749222575s" totalImagesPullingTime="5.052840369s" totalInitContainerRuntime="1.503677004s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:49:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:49:10.747811454 +0000 UTC m=+952.168761222" watchObservedRunningTime="2026-06-11 11:49:10.749222575 +0000 UTC m=+952.170172467" Jun 11 11:49:12.446623 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:12.446575 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm" Jun 11 11:49:12.447024 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:12.446660 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm" Jun 11 11:49:12.459429 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:12.459394 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm" Jun 11 11:49:12.748239 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:12.748160 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm" Jun 11 11:49:15.521167 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:15.521135 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt"] Jun 11 11:49:15.528076 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:15.528049 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt" Jun 11 11:49:15.530419 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:15.530392 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 11 11:49:15.536517 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:15.536479 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt"] Jun 11 11:49:15.599908 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:15.599864 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e7f9515-8645-4aa3-87cd-0b3c3298c31b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt\" (UID: \"9e7f9515-8645-4aa3-87cd-0b3c3298c31b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt" Jun 11 11:49:15.599908 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:15.599909 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtrnn\" (UniqueName: \"kubernetes.io/projected/9e7f9515-8645-4aa3-87cd-0b3c3298c31b-kube-api-access-rtrnn\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt\" (UID: \"9e7f9515-8645-4aa3-87cd-0b3c3298c31b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt" Jun 11 11:49:15.600125 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:15.599928 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e7f9515-8645-4aa3-87cd-0b3c3298c31b-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt\" (UID: \"9e7f9515-8645-4aa3-87cd-0b3c3298c31b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt" Jun 11 11:49:15.600125 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:15.600002 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9e7f9515-8645-4aa3-87cd-0b3c3298c31b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt\" (UID: \"9e7f9515-8645-4aa3-87cd-0b3c3298c31b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt" Jun 11 11:49:15.600125 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:15.600060 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e7f9515-8645-4aa3-87cd-0b3c3298c31b-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt\" (UID: \"9e7f9515-8645-4aa3-87cd-0b3c3298c31b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt" Jun 11 11:49:15.600125 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:15.600082 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e7f9515-8645-4aa3-87cd-0b3c3298c31b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt\" (UID: \"9e7f9515-8645-4aa3-87cd-0b3c3298c31b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt" Jun 11 11:49:15.700850 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:15.700809 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9e7f9515-8645-4aa3-87cd-0b3c3298c31b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt\" (UID: \"9e7f9515-8645-4aa3-87cd-0b3c3298c31b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt" Jun 11 11:49:15.701042 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:15.700876 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e7f9515-8645-4aa3-87cd-0b3c3298c31b-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt\" (UID: \"9e7f9515-8645-4aa3-87cd-0b3c3298c31b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt" Jun 11 11:49:15.701042 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:15.700906 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e7f9515-8645-4aa3-87cd-0b3c3298c31b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt\" (UID: \"9e7f9515-8645-4aa3-87cd-0b3c3298c31b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt" Jun 11 11:49:15.701042 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:15.700944 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e7f9515-8645-4aa3-87cd-0b3c3298c31b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt\" (UID: \"9e7f9515-8645-4aa3-87cd-0b3c3298c31b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt" Jun 11 11:49:15.701215 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:15.701074 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtrnn\" (UniqueName: \"kubernetes.io/projected/9e7f9515-8645-4aa3-87cd-0b3c3298c31b-kube-api-access-rtrnn\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt\" (UID: \"9e7f9515-8645-4aa3-87cd-0b3c3298c31b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt" Jun 11 11:49:15.701215 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:15.701138 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e7f9515-8645-4aa3-87cd-0b3c3298c31b-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt\" (UID: \"9e7f9515-8645-4aa3-87cd-0b3c3298c31b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt" Jun 11 11:49:15.701320 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:15.701269 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9e7f9515-8645-4aa3-87cd-0b3c3298c31b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt\" (UID: \"9e7f9515-8645-4aa3-87cd-0b3c3298c31b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt" Jun 11 11:49:15.701373 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:15.701322 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e7f9515-8645-4aa3-87cd-0b3c3298c31b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt\" (UID: \"9e7f9515-8645-4aa3-87cd-0b3c3298c31b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt" Jun 11 11:49:15.701425 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:15.701371 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e7f9515-8645-4aa3-87cd-0b3c3298c31b-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt\" (UID: \"9e7f9515-8645-4aa3-87cd-0b3c3298c31b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt" Jun 11 11:49:15.703267 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:15.703244 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e7f9515-8645-4aa3-87cd-0b3c3298c31b-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt\" (UID: \"9e7f9515-8645-4aa3-87cd-0b3c3298c31b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt" Jun 11 11:49:15.703566 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:15.703548 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e7f9515-8645-4aa3-87cd-0b3c3298c31b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt\" (UID: \"9e7f9515-8645-4aa3-87cd-0b3c3298c31b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt" Jun 11 11:49:15.709742 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:15.709717 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtrnn\" (UniqueName: \"kubernetes.io/projected/9e7f9515-8645-4aa3-87cd-0b3c3298c31b-kube-api-access-rtrnn\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt\" (UID: \"9e7f9515-8645-4aa3-87cd-0b3c3298c31b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt" Jun 11 11:49:15.840253 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:15.840154 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt" Jun 11 11:49:15.972238 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:15.972209 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt"] Jun 11 11:49:15.974667 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:49:15.974640 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e7f9515_8645_4aa3_87cd_0b3c3298c31b.slice/crio-f778fa3beaa7863f1a901d54c886f55916c96cca1ed0a97f7141dfdb8f2d55ac WatchSource:0}: Error finding container f778fa3beaa7863f1a901d54c886f55916c96cca1ed0a97f7141dfdb8f2d55ac: Status 404 returned error can't find the container with id f778fa3beaa7863f1a901d54c886f55916c96cca1ed0a97f7141dfdb8f2d55ac Jun 11 11:49:16.762737 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:16.762695 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt" event={"ID":"9e7f9515-8645-4aa3-87cd-0b3c3298c31b","Type":"ContainerStarted","Data":"f360f8f1e6d1249c2b9583ff995a5f4af08739269eb858ad3c45fbed95190504"} Jun 11 11:49:16.763166 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:16.762783 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt" event={"ID":"9e7f9515-8645-4aa3-87cd-0b3c3298c31b","Type":"ContainerStarted","Data":"f778fa3beaa7863f1a901d54c886f55916c96cca1ed0a97f7141dfdb8f2d55ac"} Jun 11 11:49:48.737859 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:48.737768 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf"] Jun 11 11:49:48.741287 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:48.741264 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf" Jun 11 11:49:48.743952 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:48.743932 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 11 11:49:48.751458 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:48.751435 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf"] Jun 11 11:49:48.883273 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:48.883242 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a26d024d-a846-48ef-aff0-f6faa39248ac-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf\" (UID: \"a26d024d-a846-48ef-aff0-f6faa39248ac\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf" Jun 11 11:49:48.883436 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:48.883283 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a26d024d-a846-48ef-aff0-f6faa39248ac-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf\" (UID: \"a26d024d-a846-48ef-aff0-f6faa39248ac\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf" Jun 11 11:49:48.883436 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:48.883343 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a26d024d-a846-48ef-aff0-f6faa39248ac-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf\" (UID: \"a26d024d-a846-48ef-aff0-f6faa39248ac\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf" Jun 11 11:49:48.883436 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:48.883369 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjrh7\" (UniqueName: \"kubernetes.io/projected/a26d024d-a846-48ef-aff0-f6faa39248ac-kube-api-access-vjrh7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf\" (UID: \"a26d024d-a846-48ef-aff0-f6faa39248ac\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf" Jun 11 11:49:48.883565 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:48.883451 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a26d024d-a846-48ef-aff0-f6faa39248ac-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf\" (UID: \"a26d024d-a846-48ef-aff0-f6faa39248ac\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf" Jun 11 11:49:48.883565 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:48.883511 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a26d024d-a846-48ef-aff0-f6faa39248ac-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf\" (UID: \"a26d024d-a846-48ef-aff0-f6faa39248ac\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf" Jun 11 11:49:48.984921 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:48.984877 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a26d024d-a846-48ef-aff0-f6faa39248ac-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf\" (UID: \"a26d024d-a846-48ef-aff0-f6faa39248ac\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf" Jun 11 11:49:48.985161 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:48.984933 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a26d024d-a846-48ef-aff0-f6faa39248ac-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf\" (UID: \"a26d024d-a846-48ef-aff0-f6faa39248ac\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf" Jun 11 11:49:48.985161 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:48.984958 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a26d024d-a846-48ef-aff0-f6faa39248ac-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf\" (UID: \"a26d024d-a846-48ef-aff0-f6faa39248ac\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf" Jun 11 11:49:48.985161 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:48.984980 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a26d024d-a846-48ef-aff0-f6faa39248ac-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf\" (UID: \"a26d024d-a846-48ef-aff0-f6faa39248ac\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf" Jun 11 11:49:48.985161 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:48.985003 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjrh7\" (UniqueName: \"kubernetes.io/projected/a26d024d-a846-48ef-aff0-f6faa39248ac-kube-api-access-vjrh7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf\" (UID: \"a26d024d-a846-48ef-aff0-f6faa39248ac\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf" Jun 11 11:49:48.985161 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:48.985031 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a26d024d-a846-48ef-aff0-f6faa39248ac-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf\" (UID: \"a26d024d-a846-48ef-aff0-f6faa39248ac\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf" Jun 11 11:49:48.985677 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:48.985637 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a26d024d-a846-48ef-aff0-f6faa39248ac-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf\" (UID: \"a26d024d-a846-48ef-aff0-f6faa39248ac\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf" Jun 11 11:49:48.985828 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:48.985723 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a26d024d-a846-48ef-aff0-f6faa39248ac-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf\" (UID: \"a26d024d-a846-48ef-aff0-f6faa39248ac\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf" Jun 11 11:49:48.991569 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:48.986056 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a26d024d-a846-48ef-aff0-f6faa39248ac-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf\" (UID: \"a26d024d-a846-48ef-aff0-f6faa39248ac\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf" Jun 11 11:49:48.991569 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:48.988678 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a26d024d-a846-48ef-aff0-f6faa39248ac-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf\" (UID: \"a26d024d-a846-48ef-aff0-f6faa39248ac\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf" Jun 11 11:49:48.992313 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:48.992288 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a26d024d-a846-48ef-aff0-f6faa39248ac-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf\" (UID: \"a26d024d-a846-48ef-aff0-f6faa39248ac\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf" Jun 11 11:49:49.000955 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:49.000926 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjrh7\" (UniqueName: \"kubernetes.io/projected/a26d024d-a846-48ef-aff0-f6faa39248ac-kube-api-access-vjrh7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf\" (UID: \"a26d024d-a846-48ef-aff0-f6faa39248ac\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf" Jun 11 11:49:49.052092 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:49.052058 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf" Jun 11 11:49:49.192443 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:49.192409 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf"] Jun 11 11:49:49.195405 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:49:49.195369 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda26d024d_a846_48ef_aff0_f6faa39248ac.slice/crio-fe00019c30bf495566a78e1313030322923c4c9e5c233d3187cb7d5bc2dd35d1 WatchSource:0}: Error finding container fe00019c30bf495566a78e1313030322923c4c9e5c233d3187cb7d5bc2dd35d1: Status 404 returned error can't find the container with id fe00019c30bf495566a78e1313030322923c4c9e5c233d3187cb7d5bc2dd35d1 Jun 11 11:49:49.903714 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:49.903674 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf" event={"ID":"a26d024d-a846-48ef-aff0-f6faa39248ac","Type":"ContainerStarted","Data":"3b5899c23628af7cdce058229f28d80584e8bca7f601293e6d82753aa56f65e3"} Jun 11 11:49:49.904184 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:49:49.903739 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf" event={"ID":"a26d024d-a846-48ef-aff0-f6faa39248ac","Type":"ContainerStarted","Data":"fe00019c30bf495566a78e1313030322923c4c9e5c233d3187cb7d5bc2dd35d1"} Jun 11 11:50:09.720300 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:09.720262 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx"] Jun 11 11:50:09.723591 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:09.723574 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx" Jun 11 11:50:09.726219 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:09.726198 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 11 11:50:09.733544 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:09.733521 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx"] Jun 11 11:50:09.766411 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:09.766373 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8v8c\" (UniqueName: \"kubernetes.io/projected/f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9-kube-api-access-t8v8c\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tvwmx\" (UID: \"f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx" Jun 11 11:50:09.766609 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:09.766418 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tvwmx\" (UID: \"f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx" Jun 11 11:50:09.766609 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:09.766444 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tvwmx\" (UID: \"f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx" Jun 11 11:50:09.766609 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:09.766544 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tvwmx\" (UID: \"f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx" Jun 11 11:50:09.766609 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:09.766577 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tvwmx\" (UID: \"f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx" Jun 11 11:50:09.766609 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:09.766605 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tvwmx\" (UID: \"f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx" Jun 11 11:50:09.867035 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:09.866993 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tvwmx\" (UID: \"f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx" Jun 11 11:50:09.867035 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:09.867037 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tvwmx\" (UID: \"f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx" Jun 11 11:50:09.867281 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:09.867059 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tvwmx\" (UID: \"f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx" Jun 11 11:50:09.867281 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:09.867086 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8v8c\" (UniqueName: \"kubernetes.io/projected/f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9-kube-api-access-t8v8c\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tvwmx\" (UID: \"f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx" Jun 11 11:50:09.867281 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:09.867127 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tvwmx\" (UID: \"f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx" Jun 11 11:50:09.867281 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:09.867169 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tvwmx\" (UID: \"f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx" Jun 11 11:50:09.867486 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:09.867439 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tvwmx\" (UID: \"f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx" Jun 11 11:50:09.867684 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:09.867659 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tvwmx\" (UID: \"f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx" Jun 11 11:50:09.867724 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:09.867676 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tvwmx\" (UID: \"f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx" Jun 11 11:50:09.869392 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:09.869370 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tvwmx\" (UID: \"f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx" Jun 11 11:50:09.869632 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:09.869616 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tvwmx\" (UID: \"f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx" Jun 11 11:50:09.875228 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:09.875201 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8v8c\" (UniqueName: \"kubernetes.io/projected/f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9-kube-api-access-t8v8c\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tvwmx\" (UID: \"f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx" Jun 11 11:50:10.033039 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:10.032953 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx" Jun 11 11:50:10.171770 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:10.171717 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx"] Jun 11 11:50:10.174239 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:50:10.174211 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf80cc6a9_d21b_4589_9bcd_09c9fa92c0c9.slice/crio-f1a6d638c9f524876ab0c4af4bd0c1885b855ac6b7f1d570979c4a6cb3b0887d WatchSource:0}: Error finding container f1a6d638c9f524876ab0c4af4bd0c1885b855ac6b7f1d570979c4a6cb3b0887d: Status 404 returned error can't find the container with id f1a6d638c9f524876ab0c4af4bd0c1885b855ac6b7f1d570979c4a6cb3b0887d Jun 11 11:50:10.999762 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:10.999720 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx" event={"ID":"f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9","Type":"ContainerStarted","Data":"131a804ddf670e7b78937474612c224c8601d87e0a766432aee12af7ca376580"} Jun 11 11:50:10.999762 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:10.999771 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx" event={"ID":"f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9","Type":"ContainerStarted","Data":"f1a6d638c9f524876ab0c4af4bd0c1885b855ac6b7f1d570979c4a6cb3b0887d"} Jun 11 11:50:11.001328 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:11.001301 2580 generic.go:356] "Generic (PLEG): container finished" podID="9e7f9515-8645-4aa3-87cd-0b3c3298c31b" containerID="f360f8f1e6d1249c2b9583ff995a5f4af08739269eb858ad3c45fbed95190504" exitCode=0 Jun 11 11:50:11.001470 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:11.001351 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt" event={"ID":"9e7f9515-8645-4aa3-87cd-0b3c3298c31b","Type":"ContainerDied","Data":"f360f8f1e6d1249c2b9583ff995a5f4af08739269eb858ad3c45fbed95190504"} Jun 11 11:50:12.010420 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:12.010388 2580 generic.go:356] "Generic (PLEG): container finished" podID="f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9" containerID="131a804ddf670e7b78937474612c224c8601d87e0a766432aee12af7ca376580" exitCode=0 Jun 11 11:50:12.010927 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:12.010479 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx" event={"ID":"f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9","Type":"ContainerDied","Data":"131a804ddf670e7b78937474612c224c8601d87e0a766432aee12af7ca376580"} Jun 11 11:50:12.012482 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:12.012456 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt" event={"ID":"9e7f9515-8645-4aa3-87cd-0b3c3298c31b","Type":"ContainerStarted","Data":"497170ec8b56a3821da807617023e900f33d23bbc86a1e1130747c29d6aec2b8"} Jun 11 11:50:12.045456 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:12.045397 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt" podStartSLOduration=2.643933013 podStartE2EDuration="57.045379878s" totalImagesPullingTime="201.141959ms" totalInitContainerRuntime="54.200304906s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:49:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:50:12.044023749 +0000 UTC m=+1013.464973518" watchObservedRunningTime="2026-06-11 11:50:12.045379878 +0000 UTC m=+1013.466329644" Jun 11 11:50:13.019077 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:13.019040 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx" event={"ID":"f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9","Type":"ContainerStarted","Data":"3f870e1948766bf1bd085a8377f0fe875faf2084bfcacdba27b1193b1f4efcab"} Jun 11 11:50:13.042608 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:13.042559 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx" podStartSLOduration=2.07544598 podStartE2EDuration="4.04253654s" totalImagesPullingTime="258.761704ms" totalInitContainerRuntime="1.708328856s" isStatefulPod=false podCreationTimestamp="2026-06-11 11:50:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:50:13.04012233 +0000 UTC m=+1014.461072100" watchObservedRunningTime="2026-06-11 11:50:13.04253654 +0000 UTC m=+1014.463486310" Jun 11 11:50:15.841205 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:15.841168 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt" Jun 11 11:50:15.841605 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:15.841237 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt" Jun 11 11:50:15.853675 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:15.853644 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt" Jun 11 11:50:16.044797 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:16.044768 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt" Jun 11 11:50:20.034179 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:20.034135 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx" Jun 11 11:50:20.034709 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:20.034200 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx" Jun 11 11:50:20.047368 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:20.047332 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx" Jun 11 11:50:20.066414 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:50:20.066384 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tvwmx" Jun 11 11:53:28.608728 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:53:28.608700 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nntvz_8ad3e9b6-2483-4aa5-9c8c-bc31ef592342/ovn-acl-logging/0.log" Jun 11 11:53:28.610374 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:53:28.610348 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nntvz_8ad3e9b6-2483-4aa5-9c8c-bc31ef592342/ovn-acl-logging/0.log" Jun 11 11:53:56.286790 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:53:56.286760 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-566c75d948-swxhr_9c6130ce-d71a-4bc9-8f20-f3e669311f1c/authorino/0.log" Jun 11 11:54:01.470934 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:01.470856 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-845d5d9dc5-8h8dx_6fa05f1c-f5a6-4e22-a20e-dd864e194205/maas-api/0.log" Jun 11 11:54:01.592946 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:01.592913 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-bd4cb89bd-7hpzh_17c30aac-894d-48ca-a0c3-2f62db53d03b/manager/0.log" Jun 11 11:54:02.215620 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:02.215585 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69b86f57c5-kzk28_9f166f34-ca7a-4226-8d5d-bab24850eef9/copy-manifests/0.log" Jun 11 11:54:02.223004 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:02.222982 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69b86f57c5-kzk28_9f166f34-ca7a-4226-8d5d-bab24850eef9/manager/0.log" Jun 11 11:54:03.637431 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:03.637389 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-566c75d948-swxhr_9c6130ce-d71a-4bc9-8f20-f3e669311f1c/authorino/0.log" Jun 11 11:54:03.983381 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:03.983353 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-c7pt8_cbeb1a87-f913-4023-8cb4-aeffb6e7502b/kuadrant-console-plugin/0.log" Jun 11 11:54:05.116474 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:05.116447 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74bc6b598d-b5tq9_1d1e6001-8698-4007-aab6-af04a48a50bb/kube-auth-proxy/0.log" Jun 11 11:54:05.469085 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:05.469054 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-64hdw_b1997c27-2246-4eca-8693-9ba93216d636/payload-pre-processing/0.log" Jun 11 11:54:05.588871 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:05.588838 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-dnpbb_6edd5a90-c00e-4a98-b585-0bb87e2bd397/payload-processing/0.log" Jun 11 11:54:06.059592 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:06.059562 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm_a1a90d02-5095-4fa6-a943-be2f2008b032/storage-initializer/0.log" Jun 11 11:54:06.067418 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:06.067399 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-zdrsm_a1a90d02-5095-4fa6-a943-be2f2008b032/main/0.log" Jun 11 11:54:06.316040 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:06.315960 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt_9e7f9515-8645-4aa3-87cd-0b3c3298c31b/main/0.log" Jun 11 11:54:06.322970 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:06.322945 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-dl9qt_9e7f9515-8645-4aa3-87cd-0b3c3298c31b/storage-initializer/0.log" Jun 11 11:54:06.437711 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:06.437685 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd9bnf_a26d024d-a846-48ef-aff0-f6faa39248ac/storage-initializer/0.log" Jun 11 11:54:06.675302 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:06.675228 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-tvwmx_f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9/storage-initializer/0.log" Jun 11 11:54:06.683465 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:06.683441 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-tvwmx_f80cc6a9-d21b-4589-9bcd-09c9fa92c0c9/main/0.log" Jun 11 11:54:13.595625 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:13.595594 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gfgs7_93730f02-47c1-4083-b8cb-cb6bcdb611c8/global-pull-secret-syncer/0.log" Jun 11 11:54:13.746596 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:13.746563 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hgvgn_a3d40af8-b3e3-4842-b7f3-2d942702a938/konnectivity-agent/0.log" Jun 11 11:54:13.790272 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:13.790240 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-170.ec2.internal_ac99beb55fe5d8ad12db0962dadfdf0d/haproxy/0.log" Jun 11 11:54:18.718164 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:18.718132 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-566c75d948-swxhr_9c6130ce-d71a-4bc9-8f20-f3e669311f1c/authorino/0.log" Jun 11 11:54:18.813858 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:18.813825 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-c7pt8_cbeb1a87-f913-4023-8cb4-aeffb6e7502b/kuadrant-console-plugin/0.log" Jun 11 11:54:21.438798 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:21.438765 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qm4dm_7059d93e-8651-488d-aa7c-369bcbcd49d7/node-exporter/0.log" Jun 11 11:54:21.478664 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:21.478632 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qm4dm_7059d93e-8651-488d-aa7c-369bcbcd49d7/kube-rbac-proxy/0.log" Jun 11 11:54:21.523511 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:21.523463 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qm4dm_7059d93e-8651-488d-aa7c-369bcbcd49d7/init-textfile/0.log" Jun 11 11:54:22.063396 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:22.063364 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9686fbd69-z4j6n_3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd/telemeter-client/0.log" Jun 11 11:54:22.089796 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:22.089763 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9686fbd69-z4j6n_3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd/reload/0.log" Jun 11 11:54:22.115023 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:22.114995 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9686fbd69-z4j6n_3014ed6a-a7a5-4fb6-b347-f7dcf77eafdd/kube-rbac-proxy/0.log" Jun 11 11:54:23.784401 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:23.784361 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tz7zj/perf-node-gather-daemonset-wk42d"] Jun 11 11:54:23.787442 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:23.787425 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-wk42d" Jun 11 11:54:23.791434 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:23.791402 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tz7zj\"/\"openshift-service-ca.crt\"" Jun 11 11:54:23.791587 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:23.791557 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tz7zj\"/\"default-dockercfg-g9d68\"" Jun 11 11:54:23.794505 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:23.794473 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tz7zj\"/\"kube-root-ca.crt\"" Jun 11 11:54:23.804811 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:23.804784 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tz7zj/perf-node-gather-daemonset-wk42d"] Jun 11 11:54:23.961285 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:23.961244 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7fsc\" (UniqueName: \"kubernetes.io/projected/05d7543f-64f9-4c71-b45b-efd5ce9ec787-kube-api-access-d7fsc\") pod \"perf-node-gather-daemonset-wk42d\" (UID: \"05d7543f-64f9-4c71-b45b-efd5ce9ec787\") " pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-wk42d" Jun 11 11:54:23.961480 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:23.961295 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05d7543f-64f9-4c71-b45b-efd5ce9ec787-sys\") pod \"perf-node-gather-daemonset-wk42d\" (UID: \"05d7543f-64f9-4c71-b45b-efd5ce9ec787\") " pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-wk42d" Jun 11 11:54:23.961480 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:23.961370 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/05d7543f-64f9-4c71-b45b-efd5ce9ec787-proc\") pod \"perf-node-gather-daemonset-wk42d\" (UID: \"05d7543f-64f9-4c71-b45b-efd5ce9ec787\") " pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-wk42d" Jun 11 11:54:23.961480 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:23.961410 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/05d7543f-64f9-4c71-b45b-efd5ce9ec787-podres\") pod \"perf-node-gather-daemonset-wk42d\" (UID: \"05d7543f-64f9-4c71-b45b-efd5ce9ec787\") " pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-wk42d" Jun 11 11:54:23.961480 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:23.961434 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05d7543f-64f9-4c71-b45b-efd5ce9ec787-lib-modules\") pod \"perf-node-gather-daemonset-wk42d\" (UID: \"05d7543f-64f9-4c71-b45b-efd5ce9ec787\") " pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-wk42d" Jun 11 11:54:24.062851 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:24.062736 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05d7543f-64f9-4c71-b45b-efd5ce9ec787-lib-modules\") pod \"perf-node-gather-daemonset-wk42d\" (UID: \"05d7543f-64f9-4c71-b45b-efd5ce9ec787\") " pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-wk42d" Jun 11 11:54:24.062851 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:24.062828 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7fsc\" (UniqueName: \"kubernetes.io/projected/05d7543f-64f9-4c71-b45b-efd5ce9ec787-kube-api-access-d7fsc\") pod \"perf-node-gather-daemonset-wk42d\" (UID: \"05d7543f-64f9-4c71-b45b-efd5ce9ec787\") " pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-wk42d" Jun 11 11:54:24.063078 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:24.062878 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05d7543f-64f9-4c71-b45b-efd5ce9ec787-sys\") pod \"perf-node-gather-daemonset-wk42d\" (UID: \"05d7543f-64f9-4c71-b45b-efd5ce9ec787\") " pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-wk42d" Jun 11 11:54:24.063078 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:24.062920 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/05d7543f-64f9-4c71-b45b-efd5ce9ec787-proc\") pod \"perf-node-gather-daemonset-wk42d\" (UID: \"05d7543f-64f9-4c71-b45b-efd5ce9ec787\") " pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-wk42d" Jun 11 11:54:24.063078 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:24.062929 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05d7543f-64f9-4c71-b45b-efd5ce9ec787-lib-modules\") pod \"perf-node-gather-daemonset-wk42d\" (UID: \"05d7543f-64f9-4c71-b45b-efd5ce9ec787\") " pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-wk42d" Jun 11 11:54:24.063078 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:24.062951 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/05d7543f-64f9-4c71-b45b-efd5ce9ec787-podres\") pod \"perf-node-gather-daemonset-wk42d\" (UID: \"05d7543f-64f9-4c71-b45b-efd5ce9ec787\") " pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-wk42d" Jun 11 11:54:24.063078 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:24.063001 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05d7543f-64f9-4c71-b45b-efd5ce9ec787-sys\") pod \"perf-node-gather-daemonset-wk42d\" (UID: \"05d7543f-64f9-4c71-b45b-efd5ce9ec787\") " pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-wk42d" Jun 11 11:54:24.063078 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:24.063011 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/05d7543f-64f9-4c71-b45b-efd5ce9ec787-proc\") pod \"perf-node-gather-daemonset-wk42d\" (UID: \"05d7543f-64f9-4c71-b45b-efd5ce9ec787\") " pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-wk42d" Jun 11 11:54:24.063078 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:24.063065 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/05d7543f-64f9-4c71-b45b-efd5ce9ec787-podres\") pod \"perf-node-gather-daemonset-wk42d\" (UID: \"05d7543f-64f9-4c71-b45b-efd5ce9ec787\") " pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-wk42d" Jun 11 11:54:24.075238 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:24.075208 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7fsc\" (UniqueName: \"kubernetes.io/projected/05d7543f-64f9-4c71-b45b-efd5ce9ec787-kube-api-access-d7fsc\") pod \"perf-node-gather-daemonset-wk42d\" (UID: \"05d7543f-64f9-4c71-b45b-efd5ce9ec787\") " pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-wk42d" Jun 11 11:54:24.097571 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:24.097538 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-wk42d" Jun 11 11:54:24.233798 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:24.233734 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tz7zj/perf-node-gather-daemonset-wk42d"] Jun 11 11:54:24.236256 ip-10-0-130-170 kubenswrapper[2580]: W0611 11:54:24.236224 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod05d7543f_64f9_4c71_b45b_efd5ce9ec787.slice/crio-4396093fb389579293ab60d4ff2ac3237b6c62d22f9333192bc9afe5a9682788 WatchSource:0}: Error finding container 4396093fb389579293ab60d4ff2ac3237b6c62d22f9333192bc9afe5a9682788: Status 404 returned error can't find the container with id 4396093fb389579293ab60d4ff2ac3237b6c62d22f9333192bc9afe5a9682788 Jun 11 11:54:25.102799 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:25.102762 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-wk42d" event={"ID":"05d7543f-64f9-4c71-b45b-efd5ce9ec787","Type":"ContainerStarted","Data":"2a852061284fe8209f5ca97336a71dbc99710327c201d7a2698c8ee9bb181f52"} Jun 11 11:54:25.103225 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:25.102819 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-wk42d" event={"ID":"05d7543f-64f9-4c71-b45b-efd5ce9ec787","Type":"ContainerStarted","Data":"4396093fb389579293ab60d4ff2ac3237b6c62d22f9333192bc9afe5a9682788"} Jun 11 11:54:25.103225 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:25.102862 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-wk42d" Jun 11 11:54:25.130109 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:25.130058 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-wk42d" podStartSLOduration=2.130039407 podStartE2EDuration="2.130039407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 11:54:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 11:54:25.12853476 +0000 UTC m=+1266.549484525" watchObservedRunningTime="2026-06-11 11:54:25.130039407 +0000 UTC m=+1266.550989177" Jun 11 11:54:26.981080 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:26.981035 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-26k5q_63893922-9918-454e-a94a-211ec0539b46/dns/0.log" Jun 11 11:54:27.010280 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:27.010251 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-26k5q_63893922-9918-454e-a94a-211ec0539b46/kube-rbac-proxy/0.log" Jun 11 11:54:27.161685 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:27.161658 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qzsk4_75580ac2-a186-46af-a5c6-ab8523a85cb0/dns-node-resolver/0.log" Jun 11 11:54:27.857556 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:27.857527 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-248kq_9a1ee17d-116a-4dd7-8cb7-5fe10679d13f/node-ca/0.log" Jun 11 11:54:28.974726 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:28.974695 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74bc6b598d-b5tq9_1d1e6001-8698-4007-aab6-af04a48a50bb/kube-auth-proxy/0.log" Jun 11 11:54:29.051922 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:29.051888 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-64hdw_b1997c27-2246-4eca-8693-9ba93216d636/payload-pre-processing/0.log" Jun 11 11:54:29.077975 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:29.077942 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-dnpbb_6edd5a90-c00e-4a98-b585-0bb87e2bd397/payload-processing/0.log" Jun 11 11:54:29.744153 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:29.744119 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fpp88_78e7c710-3a05-4255-8c23-759e9bd47586/serve-healthcheck-canary/0.log" Jun 11 11:54:30.406475 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:30.406449 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cwfgs_25110d9a-ed80-4ae8-937a-9bfc925fb86a/kube-rbac-proxy/0.log" Jun 11 11:54:30.452619 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:30.452589 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cwfgs_25110d9a-ed80-4ae8-937a-9bfc925fb86a/exporter/0.log" Jun 11 11:54:30.485232 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:30.485205 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cwfgs_25110d9a-ed80-4ae8-937a-9bfc925fb86a/extractor/0.log" Jun 11 11:54:31.117629 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:31.117602 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tz7zj/perf-node-gather-daemonset-wk42d" Jun 11 11:54:33.281545 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:33.281514 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-845d5d9dc5-8h8dx_6fa05f1c-f5a6-4e22-a20e-dd864e194205/maas-api/0.log" Jun 11 11:54:33.313390 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:33.313356 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-bd4cb89bd-7hpzh_17c30aac-894d-48ca-a0c3-2f62db53d03b/manager/0.log" Jun 11 11:54:33.567457 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:33.567379 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69b86f57c5-kzk28_9f166f34-ca7a-4226-8d5d-bab24850eef9/manager/0.log" Jun 11 11:54:33.592365 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:33.592334 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69b86f57c5-kzk28_9f166f34-ca7a-4226-8d5d-bab24850eef9/copy-manifests/0.log" Jun 11 11:54:35.181075 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:35.181049 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-768fdc48cd-4l5cc_56c6a227-bee2-401d-a8f5-6e91fe225c4c/manager/0.log" Jun 11 11:54:39.085287 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:39.085256 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74bc6b598d-b5tq9_1d1e6001-8698-4007-aab6-af04a48a50bb/kube-auth-proxy/0.log" Jun 11 11:54:39.136202 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:39.136169 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-64hdw_b1997c27-2246-4eca-8693-9ba93216d636/payload-pre-processing/0.log" Jun 11 11:54:39.153069 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:39.153027 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-dnpbb_6edd5a90-c00e-4a98-b585-0bb87e2bd397/payload-processing/0.log" Jun 11 11:54:40.285706 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:40.285677 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74bc6b598d-b5tq9_1d1e6001-8698-4007-aab6-af04a48a50bb/kube-auth-proxy/0.log" Jun 11 11:54:40.338470 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:40.338438 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-64hdw_b1997c27-2246-4eca-8693-9ba93216d636/payload-pre-processing/0.log" Jun 11 11:54:40.354154 ip-10-0-130-170 kubenswrapper[2580]: I0611 11:54:40.354129 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-dnpbb_6edd5a90-c00e-4a98-b585-0bb87e2bd397/payload-processing/0.log"