Jun 11 16:31:11.814476 ip-10-0-135-188 systemd[1]: Starting Kubernetes Kubelet... Jun 11 16:31:12.196930 ip-10-0-135-188 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:31:12.196930 ip-10-0-135-188 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 16:31:12.196930 ip-10-0-135-188 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:31:12.196930 ip-10-0-135-188 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 16:31:12.196930 ip-10-0-135-188 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:31:12.199390 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.199288 2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 16:31:12.203302 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203284 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:31:12.203302 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203302 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:31:12.203375 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203306 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:31:12.203375 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203310 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:31:12.203375 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203313 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:31:12.203375 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203316 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:31:12.203375 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203319 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:31:12.203375 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203322 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:31:12.203375 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203325 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:31:12.203375 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203328 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:31:12.203375 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203330 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:31:12.203375 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203339 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:31:12.203375 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203344 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:31:12.203375 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203348 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:31:12.203375 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203352 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:31:12.203375 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203354 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:31:12.203375 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203357 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:31:12.203375 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203360 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:31:12.203375 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203363 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:31:12.203375 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203366 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:31:12.203375 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203368 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:31:12.203375 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203371 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:31:12.203924 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203374 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:31:12.203924 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203376 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:31:12.203924 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203379 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:31:12.203924 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203382 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:31:12.203924 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203387 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:31:12.203924 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203389 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:31:12.203924 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203392 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:31:12.203924 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203395 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:31:12.203924 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203398 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:31:12.203924 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203401 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:31:12.203924 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203404 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:31:12.203924 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203407 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:31:12.203924 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203410 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:31:12.203924 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203412 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:31:12.203924 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203415 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:31:12.203924 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203418 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:31:12.203924 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203421 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:31:12.203924 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203426 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:31:12.203924 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203429 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:31:12.204457 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203432 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:31:12.204457 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203434 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:31:12.204457 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203437 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:31:12.204457 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203440 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:31:12.204457 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203442 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:31:12.204457 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203445 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:31:12.204457 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203448 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:31:12.204457 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203450 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:31:12.204457 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203453 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:31:12.204457 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203458 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:31:12.204457 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203462 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:31:12.204457 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203465 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:31:12.204457 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203468 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:31:12.204457 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203470 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:31:12.204457 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203474 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:31:12.204457 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203477 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:31:12.204457 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203480 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:31:12.204457 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203483 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:31:12.204457 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203486 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:31:12.205014 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203489 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:31:12.205014 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203491 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:31:12.205014 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203494 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:31:12.205014 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203497 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:31:12.205014 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203500 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:31:12.205014 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203503 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:31:12.205014 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203505 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:31:12.205014 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203508 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:31:12.205014 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203511 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:31:12.205014 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203513 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:31:12.205014 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203516 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:31:12.205014 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203520 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:31:12.205014 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203523 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:31:12.205014 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203526 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:31:12.205014 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203529 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:31:12.205014 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203531 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:31:12.205014 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203534 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:31:12.205014 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203537 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:31:12.205014 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203540 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:31:12.205014 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203542 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:31:12.205598 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203545 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:31:12.205598 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203548 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:31:12.205598 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203550 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:31:12.205598 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203553 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:31:12.205598 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203556 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:31:12.205598 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203559 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:31:12.205598 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203562 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:31:12.205598 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203565 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:31:12.205598 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203568 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:31:12.205598 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203571 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:31:12.205598 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203574 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:31:12.205598 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203576 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:31:12.205598 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203579 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:31:12.205598 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203582 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:31:12.205598 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203585 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:31:12.205598 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203587 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:31:12.205598 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203590 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:31:12.205598 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203593 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:31:12.205598 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.203595 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:31:12.205598 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204425 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:31:12.206188 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204433 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:31:12.206188 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204437 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:31:12.206188 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204440 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:31:12.206188 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204443 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:31:12.206188 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204447 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:31:12.206188 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204450 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:31:12.206188 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204453 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:31:12.206188 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204456 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:31:12.206188 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204459 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:31:12.206188 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204462 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:31:12.206188 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204466 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:31:12.206188 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204469 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:31:12.206188 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204472 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:31:12.206188 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204474 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:31:12.206188 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204477 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:31:12.206188 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204480 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:31:12.206188 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204483 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:31:12.206188 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204487 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:31:12.206188 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204490 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:31:12.206188 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204493 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:31:12.206771 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204497 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:31:12.206771 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204502 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:31:12.206771 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204505 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:31:12.206771 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204508 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:31:12.206771 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204511 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:31:12.206771 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204514 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:31:12.206771 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204517 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:31:12.206771 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204520 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:31:12.206771 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204523 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:31:12.206771 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204526 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:31:12.206771 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204528 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:31:12.206771 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204531 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:31:12.206771 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204534 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:31:12.206771 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204537 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:31:12.206771 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204539 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:31:12.206771 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204542 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:31:12.206771 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204545 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:31:12.206771 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204548 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:31:12.206771 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204551 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:31:12.207339 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204554 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:31:12.207339 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204557 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:31:12.207339 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204560 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:31:12.207339 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204562 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:31:12.207339 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204565 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:31:12.207339 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204567 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:31:12.207339 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204570 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:31:12.207339 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204573 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:31:12.207339 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204575 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:31:12.207339 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204578 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:31:12.207339 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204581 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:31:12.207339 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204584 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:31:12.207339 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204587 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:31:12.207339 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204590 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:31:12.207339 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204593 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:31:12.207339 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204596 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:31:12.207339 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204601 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:31:12.207339 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204606 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:31:12.207339 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204609 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:31:12.207339 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204612 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:31:12.207896 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204614 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:31:12.207896 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204617 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:31:12.207896 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204621 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:31:12.207896 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204623 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:31:12.207896 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204626 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:31:12.207896 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204629 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:31:12.207896 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204631 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:31:12.207896 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204634 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:31:12.207896 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204637 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:31:12.207896 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204640 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:31:12.207896 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204643 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:31:12.207896 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204646 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:31:12.207896 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204649 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:31:12.207896 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204652 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:31:12.207896 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204656 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:31:12.207896 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204658 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:31:12.207896 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204661 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:31:12.207896 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204664 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:31:12.207896 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204666 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:31:12.208453 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204669 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:31:12.208453 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204672 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:31:12.208453 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204675 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:31:12.208453 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204688 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:31:12.208453 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204691 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:31:12.208453 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204694 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:31:12.208453 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204697 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:31:12.208453 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204702 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:31:12.208453 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204705 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:31:12.208453 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204708 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:31:12.208453 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204712 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:31:12.208453 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204715 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:31:12.208453 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204718 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:31:12.208453 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204721 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:31:12.208453 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204724 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:31:12.208453 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204727 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:31:12.208453 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204729 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:31:12.208453 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204732 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:31:12.208453 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204735 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:31:12.208979 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.204738 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:31:12.208979 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205147 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:31:12.208979 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205152 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:31:12.208979 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205155 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:31:12.208979 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205158 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:31:12.208979 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205163 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:31:12.208979 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205168 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:31:12.208979 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205172 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:31:12.208979 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205176 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:31:12.208979 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205179 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:31:12.208979 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205182 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:31:12.208979 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205185 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:31:12.208979 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205188 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:31:12.208979 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205193 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:31:12.208979 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205197 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:31:12.208979 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205199 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:31:12.208979 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205204 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:31:12.208979 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205207 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:31:12.208979 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205210 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:31:12.209568 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205214 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:31:12.209568 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205217 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:31:12.209568 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205219 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:31:12.209568 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205222 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:31:12.209568 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205225 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:31:12.209568 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205228 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:31:12.209568 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205231 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:31:12.209568 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205233 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:31:12.209568 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205236 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:31:12.209568 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205239 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:31:12.209568 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205242 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:31:12.209568 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205245 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:31:12.209568 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205247 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:31:12.209568 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205250 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:31:12.209568 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205253 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:31:12.209568 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205256 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:31:12.209568 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205259 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:31:12.209568 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205261 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:31:12.209568 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205264 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:31:12.209568 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205269 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:31:12.210164 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205271 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:31:12.210164 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205274 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:31:12.210164 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205277 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:31:12.210164 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205279 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:31:12.210164 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205282 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:31:12.210164 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205284 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:31:12.210164 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205290 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:31:12.210164 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205294 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:31:12.210164 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205297 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:31:12.210164 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205301 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:31:12.210164 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205304 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:31:12.210164 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205307 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:31:12.210164 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205309 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:31:12.210164 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205312 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:31:12.210164 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205315 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:31:12.210164 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205318 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:31:12.210164 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205321 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:31:12.210164 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205323 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:31:12.210164 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205326 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:31:12.210701 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205328 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:31:12.210701 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205331 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:31:12.210701 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205334 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:31:12.210701 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205336 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:31:12.210701 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205339 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:31:12.210701 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205342 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:31:12.210701 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205345 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:31:12.210701 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205347 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:31:12.210701 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205351 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:31:12.210701 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205354 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:31:12.210701 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205356 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:31:12.210701 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205359 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:31:12.210701 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205361 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:31:12.210701 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205365 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:31:12.210701 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205367 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:31:12.210701 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205370 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:31:12.210701 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205372 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:31:12.210701 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205375 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:31:12.210701 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205378 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:31:12.210701 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205383 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:31:12.211302 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205386 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:31:12.211302 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205390 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:31:12.211302 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205394 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:31:12.211302 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205397 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:31:12.211302 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205399 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:31:12.211302 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205402 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:31:12.211302 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205405 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:31:12.211302 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205408 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:31:12.211302 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205411 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:31:12.211302 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205413 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:31:12.211302 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205416 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:31:12.211302 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205419 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:31:12.211302 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205421 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:31:12.211302 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205424 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:31:12.211302 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205426 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:31:12.211302 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205429 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:31:12.211302 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205432 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:31:12.211302 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205434 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:31:12.211302 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205437 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:31:12.211302 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205440 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:31:12.211895 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205442 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:31:12.211895 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.205445 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:31:12.211895 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205526 2569 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 16:31:12.211895 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205534 2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 16:31:12.211895 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205541 2569 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 16:31:12.211895 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205546 2569 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 16:31:12.211895 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205551 2569 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 16:31:12.211895 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205555 2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 16:31:12.211895 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205559 2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 16:31:12.211895 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205563 2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 16:31:12.211895 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205567 2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 16:31:12.211895 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205573 2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 16:31:12.211895 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205576 2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 16:31:12.211895 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205580 2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 16:31:12.211895 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205584 2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 16:31:12.211895 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205587 2569 flags.go:64] FLAG: --cgroup-root="" Jun 11 16:31:12.211895 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205590 2569 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 16:31:12.211895 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205593 2569 flags.go:64] FLAG: --client-ca-file="" Jun 11 16:31:12.211895 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205596 2569 flags.go:64] FLAG: --cloud-provider="external" Jun 11 16:31:12.211895 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205600 2569 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 16:31:12.211895 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205604 2569 flags.go:64] FLAG: --cluster-domain="" Jun 11 16:31:12.211895 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205607 2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 16:31:12.211895 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205611 2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 16:31:12.211895 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205614 2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 16:31:12.212574 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205618 2569 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 16:31:12.212574 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205622 2569 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 16:31:12.212574 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205625 2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 16:31:12.212574 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205628 2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 16:31:12.212574 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205631 2569 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 16:31:12.212574 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205635 2569 flags.go:64] FLAG: --contention-profiling="false" Jun 11 16:31:12.212574 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205638 2569 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 16:31:12.212574 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205641 2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 16:31:12.212574 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205644 2569 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 16:31:12.212574 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205647 2569 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 16:31:12.212574 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205652 2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 16:31:12.212574 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205655 2569 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 16:31:12.212574 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205658 2569 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 16:31:12.212574 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205661 2569 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 16:31:12.212574 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205664 2569 flags.go:64] FLAG: --enable-server="true" Jun 11 16:31:12.212574 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205668 2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 16:31:12.212574 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205673 2569 flags.go:64] FLAG: --event-burst="100" Jun 11 16:31:12.212574 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205677 2569 flags.go:64] FLAG: --event-qps="50" Jun 11 16:31:12.212574 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205680 2569 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 16:31:12.212574 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205684 2569 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 16:31:12.212574 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205687 2569 flags.go:64] FLAG: --eviction-hard="" Jun 11 16:31:12.212574 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205691 2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 16:31:12.212574 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205696 2569 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 16:31:12.212574 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205699 2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 16:31:12.212574 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205702 2569 flags.go:64] FLAG: --eviction-soft="" Jun 11 16:31:12.213332 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205705 2569 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 16:31:12.213332 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205708 2569 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 16:31:12.213332 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205712 2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 16:31:12.213332 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205715 2569 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 16:31:12.213332 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205717 2569 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 16:31:12.213332 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205720 2569 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 16:31:12.213332 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205723 2569 flags.go:64] FLAG: --feature-gates="" Jun 11 16:31:12.213332 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205727 2569 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 16:31:12.213332 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205730 2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 16:31:12.213332 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205734 2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 16:31:12.213332 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205737 2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 16:31:12.213332 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205740 2569 flags.go:64] FLAG: --healthz-port="10248" Jun 11 16:31:12.213332 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205743 2569 flags.go:64] FLAG: --help="false" Jun 11 16:31:12.213332 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205746 2569 flags.go:64] FLAG: --hostname-override="ip-10-0-135-188.ec2.internal" Jun 11 16:31:12.213332 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205749 2569 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 16:31:12.213332 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205753 2569 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 16:31:12.213332 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205756 2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 16:31:12.213332 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205759 2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 16:31:12.213332 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205763 2569 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 16:31:12.213332 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205766 2569 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 16:31:12.213332 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205769 2569 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 16:31:12.213332 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205772 2569 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 16:31:12.213332 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205775 2569 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 16:31:12.214027 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205779 2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 16:31:12.214027 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205782 2569 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 16:31:12.214027 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205785 2569 flags.go:64] FLAG: --kube-reserved="" Jun 11 16:31:12.214027 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205789 2569 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 16:31:12.214027 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205792 2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 16:31:12.214027 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205795 2569 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 16:31:12.214027 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205800 2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 16:31:12.214027 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205802 2569 flags.go:64] FLAG: --lock-file="" Jun 11 16:31:12.214027 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205805 2569 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 16:31:12.214027 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205809 2569 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 16:31:12.214027 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205812 2569 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 16:31:12.214027 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205818 2569 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 16:31:12.214027 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205821 2569 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 16:31:12.214027 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205823 2569 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 16:31:12.214027 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205826 2569 flags.go:64] FLAG: --logging-format="text" Jun 11 16:31:12.214027 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205829 2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 16:31:12.214027 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205833 2569 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 16:31:12.214027 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205836 2569 flags.go:64] FLAG: --manifest-url="" Jun 11 16:31:12.214027 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205839 2569 flags.go:64] FLAG: --manifest-url-header="" Jun 11 16:31:12.214027 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205844 2569 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 16:31:12.214027 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205847 2569 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 16:31:12.214027 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205851 2569 flags.go:64] FLAG: --max-pods="110" Jun 11 16:31:12.214027 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205854 2569 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 16:31:12.214027 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205857 2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 16:31:12.214027 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205860 2569 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 16:31:12.214768 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205863 2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 16:31:12.214768 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205867 2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 16:31:12.214768 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205870 2569 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 16:31:12.214768 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205873 2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 16:31:12.214768 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205880 2569 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 16:31:12.214768 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205883 2569 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 16:31:12.214768 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205886 2569 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 16:31:12.214768 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205889 2569 flags.go:64] FLAG: --pod-cidr="" Jun 11 16:31:12.214768 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205893 2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 16:31:12.214768 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205899 2569 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 16:31:12.214768 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205902 2569 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 16:31:12.214768 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205906 2569 flags.go:64] FLAG: --pods-per-core="0" Jun 11 16:31:12.214768 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205909 2569 flags.go:64] FLAG: --port="10250" Jun 11 16:31:12.214768 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205914 2569 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 16:31:12.214768 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205917 2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b9a20ee30f122b37" Jun 11 16:31:12.214768 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205921 2569 flags.go:64] FLAG: --qos-reserved="" Jun 11 16:31:12.214768 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205924 2569 flags.go:64] FLAG: --read-only-port="10255" Jun 11 16:31:12.214768 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205927 2569 flags.go:64] FLAG: --register-node="true" Jun 11 16:31:12.214768 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205930 2569 flags.go:64] FLAG: --register-with-taints="" Jun 11 16:31:12.214768 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205934 2569 flags.go:64] FLAG: --registry-burst="10" Jun 11 16:31:12.214768 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205937 2569 flags.go:64] FLAG: --registry-qps="5" Jun 11 16:31:12.214768 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205940 2569 flags.go:64] FLAG: --reserved-cpus="" Jun 11 16:31:12.214768 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205943 2569 flags.go:64] FLAG: --reserved-memory="" Jun 11 16:31:12.214768 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205947 2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 16:31:12.214768 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205950 2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 16:31:12.215623 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205953 2569 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 16:31:12.215623 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205956 2569 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 16:31:12.215623 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205959 2569 flags.go:64] FLAG: --runonce="false" Jun 11 16:31:12.215623 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205962 2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 16:31:12.215623 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205966 2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 16:31:12.215623 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205969 2569 flags.go:64] FLAG: --seccomp-default="false" Jun 11 16:31:12.215623 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205971 2569 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 16:31:12.215623 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205974 2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 16:31:12.215623 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205977 2569 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 16:31:12.215623 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205981 2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 16:31:12.215623 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205984 2569 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 16:31:12.215623 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205987 2569 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 16:31:12.215623 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205990 2569 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 16:31:12.215623 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205992 2569 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 16:31:12.215623 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205996 2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 16:31:12.215623 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.205999 2569 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 16:31:12.215623 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.206003 2569 flags.go:64] FLAG: --system-cgroups="" Jun 11 16:31:12.215623 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.206006 2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 16:31:12.215623 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.206012 2569 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 16:31:12.215623 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.206015 2569 flags.go:64] FLAG: --tls-cert-file="" Jun 11 16:31:12.215623 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.206019 2569 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 16:31:12.215623 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.206024 2569 flags.go:64] FLAG: --tls-min-version="" Jun 11 16:31:12.215623 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.206026 2569 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 16:31:12.215623 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.206029 2569 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 16:31:12.215623 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.206032 2569 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 16:31:12.216343 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.206035 2569 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 16:31:12.216343 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.206038 2569 flags.go:64] FLAG: --v="2" Jun 11 16:31:12.216343 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.206042 2569 flags.go:64] FLAG: --version="false" Jun 11 16:31:12.216343 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.206046 2569 flags.go:64] FLAG: --vmodule="" Jun 11 16:31:12.216343 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.206050 2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 16:31:12.216343 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.206053 2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 16:31:12.216343 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206187 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:31:12.216343 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206191 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:31:12.216343 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206194 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:31:12.216343 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206197 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:31:12.216343 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206200 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:31:12.216343 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206203 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:31:12.216343 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206206 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:31:12.216343 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206208 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:31:12.216343 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206211 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:31:12.216343 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206214 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:31:12.216343 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206216 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:31:12.216343 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206219 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:31:12.216343 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206222 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:31:12.216343 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206225 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:31:12.216343 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206228 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:31:12.217023 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206230 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:31:12.217023 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206233 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:31:12.217023 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206235 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:31:12.217023 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206239 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:31:12.217023 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206242 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:31:12.217023 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206245 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:31:12.217023 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206250 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:31:12.217023 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206253 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:31:12.217023 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206255 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:31:12.217023 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206258 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:31:12.217023 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206261 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:31:12.217023 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206264 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:31:12.217023 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206266 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:31:12.217023 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206269 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:31:12.217023 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206271 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:31:12.217023 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206274 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:31:12.217023 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206277 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:31:12.217023 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206279 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:31:12.217023 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206282 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:31:12.217023 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206284 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:31:12.217649 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206287 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:31:12.217649 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206290 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:31:12.217649 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206292 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:31:12.217649 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206295 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:31:12.217649 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206298 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:31:12.217649 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206300 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:31:12.217649 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206303 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:31:12.217649 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206305 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:31:12.217649 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206308 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:31:12.217649 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206310 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:31:12.217649 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206313 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:31:12.217649 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206315 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:31:12.217649 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206318 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:31:12.217649 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206321 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:31:12.217649 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206323 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:31:12.217649 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206326 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:31:12.217649 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206329 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:31:12.217649 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206332 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:31:12.217649 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206336 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:31:12.217649 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206339 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:31:12.218248 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206341 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:31:12.218248 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206344 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:31:12.218248 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206348 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:31:12.218248 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206352 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:31:12.218248 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206355 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:31:12.218248 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206358 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:31:12.218248 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206361 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:31:12.218248 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206363 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:31:12.218248 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206366 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:31:12.218248 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206369 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:31:12.218248 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206373 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:31:12.218248 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206376 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:31:12.218248 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206379 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:31:12.218248 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206382 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:31:12.218248 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206385 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:31:12.218248 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206388 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:31:12.218248 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206391 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:31:12.218248 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206394 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:31:12.218248 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206397 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:31:12.218795 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206400 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:31:12.218795 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206403 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:31:12.218795 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206406 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:31:12.218795 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206409 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:31:12.218795 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206413 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:31:12.218795 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206416 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:31:12.218795 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206419 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:31:12.218795 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206422 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:31:12.218795 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206424 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:31:12.218795 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206427 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:31:12.218795 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206430 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:31:12.218795 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206435 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:31:12.218795 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206437 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:31:12.218795 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206440 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:31:12.218795 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206442 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:31:12.218795 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206445 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:31:12.218795 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206447 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:31:12.218795 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206450 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:31:12.218795 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206452 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:31:12.219422 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206456 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:31:12.219422 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206458 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:31:12.219422 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206461 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:31:12.219422 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206463 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:31:12.219422 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206466 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:31:12.219422 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.206469 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:31:12.219422 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.207160 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:31:12.219422 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.214654 2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 16:31:12.219422 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.214779 2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 16:31:12.219422 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.214802 2569 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 16:31:12.219422 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.214808 2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 16:31:12.219422 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214871 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:31:12.219422 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214876 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:31:12.219422 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214880 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:31:12.219422 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214883 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:31:12.219845 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214886 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:31:12.219845 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214889 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:31:12.219845 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214892 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:31:12.219845 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214895 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:31:12.219845 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214898 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:31:12.219845 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214901 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:31:12.219845 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214904 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:31:12.219845 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214906 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:31:12.219845 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214910 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:31:12.219845 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214913 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:31:12.219845 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214916 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:31:12.219845 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214918 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:31:12.219845 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214921 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:31:12.219845 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214924 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:31:12.219845 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214926 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:31:12.219845 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214929 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:31:12.219845 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214932 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:31:12.219845 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214934 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:31:12.219845 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214937 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:31:12.219845 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214940 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:31:12.220416 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214942 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:31:12.220416 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214945 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:31:12.220416 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214948 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:31:12.220416 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214950 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:31:12.220416 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214953 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:31:12.220416 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214957 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:31:12.220416 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214960 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:31:12.220416 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214963 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:31:12.220416 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214967 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:31:12.220416 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214973 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:31:12.220416 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214978 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:31:12.220416 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214982 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:31:12.220416 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214986 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:31:12.220416 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214988 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:31:12.220416 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214991 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:31:12.220416 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214994 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:31:12.220416 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214997 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:31:12.220416 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.214999 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:31:12.220416 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215003 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:31:12.220939 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215005 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:31:12.220939 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215008 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:31:12.220939 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215012 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:31:12.220939 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215015 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:31:12.220939 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215018 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:31:12.220939 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215020 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:31:12.220939 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215023 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:31:12.220939 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215026 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:31:12.220939 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215028 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:31:12.220939 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215031 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:31:12.220939 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215034 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:31:12.220939 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215037 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:31:12.220939 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215039 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:31:12.220939 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215042 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:31:12.220939 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215045 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:31:12.220939 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215048 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:31:12.220939 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215051 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:31:12.220939 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215053 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:31:12.220939 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215057 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:31:12.220939 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215060 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:31:12.220939 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215063 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:31:12.221536 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215066 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:31:12.221536 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215069 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:31:12.221536 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215071 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:31:12.221536 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215074 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:31:12.221536 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215077 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:31:12.221536 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215079 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:31:12.221536 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215082 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:31:12.221536 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215085 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:31:12.221536 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215087 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:31:12.221536 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215090 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:31:12.221536 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215093 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:31:12.221536 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215095 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:31:12.221536 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215098 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:31:12.221536 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215101 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:31:12.221536 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215104 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:31:12.221536 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215107 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:31:12.221536 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215109 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:31:12.221536 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215112 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:31:12.221536 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215114 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:31:12.221536 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215117 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:31:12.222140 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215120 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:31:12.222140 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215122 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:31:12.222140 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215144 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:31:12.222140 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215147 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:31:12.222140 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215150 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:31:12.222140 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215152 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:31:12.222140 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215155 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:31:12.222140 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215158 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:31:12.222140 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215160 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:31:12.222140 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215165 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:31:12.222140 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215169 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:31:12.222140 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215172 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:31:12.222140 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215175 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:31:12.222140 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215178 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:31:12.222140 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215182 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:31:12.222559 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.215187 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:31:12.222559 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215309 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:31:12.222559 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215314 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:31:12.222559 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215317 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:31:12.222559 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215321 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:31:12.222559 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215325 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:31:12.222559 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215329 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:31:12.222559 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215332 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:31:12.222559 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215335 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:31:12.222559 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215338 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:31:12.222559 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215341 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:31:12.222559 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215343 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:31:12.222559 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215346 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:31:12.222559 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215349 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:31:12.222954 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215352 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:31:12.222954 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215354 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:31:12.222954 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215357 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:31:12.222954 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215360 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:31:12.222954 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215362 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:31:12.222954 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215365 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:31:12.222954 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215367 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:31:12.222954 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215370 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:31:12.222954 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215373 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:31:12.222954 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215376 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:31:12.222954 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215378 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:31:12.222954 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215381 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:31:12.222954 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215384 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:31:12.222954 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215387 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:31:12.222954 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215390 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:31:12.222954 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215393 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:31:12.222954 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215395 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:31:12.222954 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215398 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:31:12.222954 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215400 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:31:12.222954 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215403 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:31:12.223841 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215406 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:31:12.223841 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215410 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:31:12.223841 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215412 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:31:12.223841 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215415 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:31:12.223841 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215418 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:31:12.223841 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215421 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:31:12.223841 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215423 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:31:12.223841 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215426 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:31:12.223841 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215429 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:31:12.223841 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215431 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:31:12.223841 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215434 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:31:12.223841 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215437 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:31:12.223841 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215440 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:31:12.223841 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215442 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:31:12.223841 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215445 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:31:12.223841 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215449 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:31:12.223841 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215452 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:31:12.223841 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215455 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:31:12.223841 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215458 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:31:12.224807 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215460 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:31:12.224807 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215463 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:31:12.224807 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215465 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:31:12.224807 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215468 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:31:12.224807 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215471 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:31:12.224807 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215474 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:31:12.224807 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215476 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:31:12.224807 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215479 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:31:12.224807 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215482 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:31:12.224807 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215484 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:31:12.224807 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215488 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:31:12.224807 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215490 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:31:12.224807 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215493 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:31:12.224807 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215495 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:31:12.224807 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215498 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:31:12.224807 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215501 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:31:12.224807 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215504 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:31:12.224807 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215506 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:31:12.224807 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215509 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:31:12.224807 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215511 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:31:12.225350 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215514 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:31:12.225350 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215517 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:31:12.225350 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215520 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:31:12.225350 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215522 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:31:12.225350 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215525 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:31:12.225350 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215528 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:31:12.225350 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215531 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:31:12.225350 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215533 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:31:12.225350 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215536 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:31:12.225350 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215539 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:31:12.225350 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215541 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:31:12.225350 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215544 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:31:12.225350 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215546 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:31:12.225350 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215549 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:31:12.225350 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215552 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:31:12.225350 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215557 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:31:12.225350 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215560 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:31:12.225350 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215562 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:31:12.225350 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215565 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:31:12.225350 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215567 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:31:12.225895 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215570 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:31:12.225895 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215572 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:31:12.225895 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215575 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:31:12.225895 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215578 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:31:12.225895 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215581 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:31:12.225895 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215583 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:31:12.225895 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:12.215586 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:31:12.225895 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.215592 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:31:12.225895 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.215708 2569 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 16:31:12.225895 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.218005 2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 16:31:12.225895 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.219444 2569 server.go:1019] "Starting client certificate rotation" Jun 11 16:31:12.225895 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.219555 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 16:31:12.225895 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.219596 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 16:31:12.226502 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.222148 2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 16:31:12.229454 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.229433 2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 16:31:12.238443 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.238427 2569 log.go:25] "Validated CRI v1 runtime API" Jun 11 16:31:12.241809 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.241792 2569 log.go:25] "Validated CRI v1 image API" Jun 11 16:31:12.242631 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.242613 2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 16:31:12.244781 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.244762 2569 fs.go:135] Filesystem UUIDs: map[1ec2c694-6d2a-483e-94be-0a589d98c05a:/dev/nvme0n1p4 4fc15c09-2113-4a0c-9622-8b9a48539adb:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 11 16:31:12.244841 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.244781 2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 16:31:12.247693 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.247675 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 16:31:12.250072 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.249953 2569 manager.go:216] Machine: {Timestamp:2026-06-11 16:31:12.248576577 +0000 UTC m=+0.316846603 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3121523 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28f2be56ba1ca0f8d9127cc9237ac9 SystemUUID:ec28f2be-56ba-1ca0-f8d9-127cc9237ac9 BootID:d179a076-da44-4faa-adbc-91dad7a30416 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:08:3f:b2:42:6d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:08:3f:b2:42:6d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:18:f9:cd:dc:01 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 16:31:12.250130 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.250073 2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 16:31:12.250199 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.250187 2569 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 16:31:12.253019 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.252997 2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 16:31:12.253162 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.253021 2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-188.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 16:31:12.253742 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.253733 2569 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 16:31:12.253777 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.253745 2569 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 16:31:12.253777 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.253752 2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 16:31:12.254414 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.254404 2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 16:31:12.255386 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.255377 2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 16:31:12.258453 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.258441 2569 state_mem.go:36] "Initialized new in-memory state store" Jun 11 16:31:12.258566 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.258557 2569 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 16:31:12.258602 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.258594 2569 kubelet.go:486] "Attempting to sync node with API server" Jun 11 16:31:12.258630 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.258611 2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 16:31:12.258630 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.258628 2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 16:31:12.258682 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.258639 2569 kubelet.go:398] "Adding apiserver pod source" Jun 11 16:31:12.258682 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.258648 2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 16:31:12.258956 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.258945 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 16:31:12.259012 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.258961 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 16:31:12.260969 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.260953 2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 16:31:12.263932 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.263915 2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 16:31:12.264006 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.263949 2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 16:31:12.265255 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.265241 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 16:31:12.265307 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.265260 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 16:31:12.265307 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.265268 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 16:31:12.265307 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.265274 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 16:31:12.265307 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.265283 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 16:31:12.265307 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.265290 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 16:31:12.265307 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.265299 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 16:31:12.265307 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.265305 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 16:31:12.265479 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.265313 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 16:31:12.265479 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.265320 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 16:31:12.265479 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.265336 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 16:31:12.265479 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.265342 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 16:31:12.266053 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.266044 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 16:31:12.266109 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.266068 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 16:31:12.269237 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.269221 2569 server.go:1268] "Started kubelet" Jun 11 16:31:12.269337 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.269279 2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 16:31:12.269398 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.269309 2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 16:31:12.269454 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.269406 2569 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 16:31:12.270228 ip-10-0-135-188 systemd[1]: Started Kubernetes Kubelet. Jun 11 16:31:12.270728 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.270365 2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-188.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 16:31:12.271020 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:12.270970 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 16:31:12.271020 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:12.270976 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-188.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 16:31:12.271236 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.271177 2569 server.go:310] "Adding debug handlers to kubelet server" Jun 11 16:31:12.271297 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.271282 2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 16:31:12.275505 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.275482 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4d2mm" Jun 11 16:31:12.276431 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:12.276408 2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 16:31:12.277372 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.277332 2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 16:31:12.277372 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.277337 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 16:31:12.277775 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:12.277735 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-188.ec2.internal\" not found" Jun 11 16:31:12.278178 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.278163 2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 16:31:12.278293 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.278257 2569 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 16:31:12.278293 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.278278 2569 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 16:31:12.278472 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.278458 2569 reconstruct.go:97] "Volume reconstruction finished" Jun 11 16:31:12.278472 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.278471 2569 reconciler.go:29] "Reconciler: start to sync state" Jun 11 16:31:12.278584 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.278566 2569 factory.go:55] Registering systemd factory Jun 11 16:31:12.278584 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.278582 2569 factory.go:223] Registration of the systemd container factory successfully Jun 11 16:31:12.278826 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.278813 2569 factory.go:153] Registering CRI-O factory Jun 11 16:31:12.278945 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.278829 2569 factory.go:223] Registration of the crio container factory successfully Jun 11 16:31:12.278945 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.278880 2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 16:31:12.278945 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.278901 2569 factory.go:103] Registering Raw factory Jun 11 16:31:12.278945 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.278916 2569 manager.go:1196] Started watching for new ooms in manager Jun 11 16:31:12.279362 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.279349 2569 manager.go:349] Starting recovery of all containers Jun 11 16:31:12.279810 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:12.278613 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-188.ec2.internal.18b813d84823b13a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-188.ec2.internal,UID:ip-10-0-135-188.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-188.ec2.internal,},FirstTimestamp:2026-06-11 16:31:12.26919353 +0000 UTC m=+0.337463557,LastTimestamp:2026-06-11 16:31:12.26919353 +0000 UTC m=+0.337463557,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-188.ec2.internal,}" Jun 11 16:31:12.281107 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.281089 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4d2mm" Jun 11 16:31:12.284730 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:12.284697 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 16:31:12.285121 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:12.285089 2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-188.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 16:31:12.291291 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.291273 2569 manager.go:354] Recovery completed Jun 11 16:31:12.295836 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.295821 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:31:12.297770 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.297751 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-188.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:31:12.297839 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.297781 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-188.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:31:12.297839 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.297792 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-188.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:31:12.298372 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.298354 2569 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 16:31:12.298372 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.298367 2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 16:31:12.298477 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.298380 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:31:12.298477 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.298385 2569 state_mem.go:36] "Initialized new in-memory state store" Jun 11 16:31:12.299523 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.299505 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-188.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:31:12.299595 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.299533 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-188.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:31:12.299595 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.299543 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-188.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:31:12.299733 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.299718 2569 policy_none.go:49] "None policy: Start" Jun 11 16:31:12.299784 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.299740 2569 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 16:31:12.299784 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.299755 2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 16:31:12.300863 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.300850 2569 policy_none.go:47] "Start" Jun 11 16:31:12.332662 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.332645 2569 manager.go:337] "Starting Device Plugin manager" Jun 11 16:31:12.332761 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:12.332677 2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 16:31:12.332761 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.332686 2569 server.go:87] "Starting device plugin registration server" Jun 11 16:31:12.332958 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.332946 2569 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 16:31:12.332994 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.332959 2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 16:31:12.333119 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.333097 2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 16:31:12.333263 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.333176 2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 16:31:12.333263 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.333186 2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 16:31:12.333762 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:12.333737 2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 16:31:12.333834 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:12.333798 2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-188.ec2.internal\" not found" Jun 11 16:31:12.353546 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.353507 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 16:31:12.354881 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.354860 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 16:31:12.354988 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.354903 2569 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 16:31:12.354988 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.354926 2569 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 16:31:12.355112 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:12.355026 2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 16:31:12.357105 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.357086 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:31:12.433429 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.433405 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:31:12.434853 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.434832 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-188.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:31:12.434957 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.434865 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-188.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:31:12.434957 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.434878 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-188.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:31:12.434957 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.434913 2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-188.ec2.internal" Jun 11 16:31:12.442929 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.442909 2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-188.ec2.internal" Jun 11 16:31:12.443005 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:12.442934 2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-188.ec2.internal\": node \"ip-10-0-135-188.ec2.internal\" not found" Jun 11 16:31:12.455330 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.455258 2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-188.ec2.internal"] Jun 11 16:31:12.455330 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.455329 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:31:12.456288 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.456272 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-188.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:31:12.456374 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.456303 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-188.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:31:12.456374 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.456316 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-188.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:31:12.457685 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:12.457660 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-188.ec2.internal\" not found" Jun 11 16:31:12.457787 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.457692 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:31:12.457914 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.457898 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.ec2.internal" Jun 11 16:31:12.457972 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.457934 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:31:12.458475 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.458458 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-188.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:31:12.458548 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.458462 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-188.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:31:12.458548 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.458503 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-188.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:31:12.458548 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.458515 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-188.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:31:12.458548 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.458484 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-188.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:31:12.458682 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.458561 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-188.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:31:12.459962 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.459946 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-188.ec2.internal" Jun 11 16:31:12.460046 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.459969 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:31:12.460933 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.460915 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-188.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:31:12.461025 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.460942 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-188.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:31:12.461025 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.460957 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-188.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:31:12.479270 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.479248 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/39f5ba962028041c64db3920f82c6d5e-config\") pod \"kube-apiserver-proxy-ip-10-0-135-188.ec2.internal\" (UID: \"39f5ba962028041c64db3920f82c6d5e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-188.ec2.internal" Jun 11 16:31:12.490735 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:12.490712 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-188.ec2.internal\" not found" node="ip-10-0-135-188.ec2.internal" Jun 11 16:31:12.495218 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:12.495203 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-188.ec2.internal\" not found" node="ip-10-0-135-188.ec2.internal" Jun 11 16:31:12.557828 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:12.557796 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-188.ec2.internal\" not found" Jun 11 16:31:12.579455 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.579431 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/39f5ba962028041c64db3920f82c6d5e-config\") pod \"kube-apiserver-proxy-ip-10-0-135-188.ec2.internal\" (UID: \"39f5ba962028041c64db3920f82c6d5e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-188.ec2.internal" Jun 11 16:31:12.579455 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.579436 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/39f5ba962028041c64db3920f82c6d5e-config\") pod \"kube-apiserver-proxy-ip-10-0-135-188.ec2.internal\" (UID: \"39f5ba962028041c64db3920f82c6d5e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-188.ec2.internal" Jun 11 16:31:12.579559 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.579475 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8d32b9be67804624fdd87ae52fa473dd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-188.ec2.internal\" (UID: \"8d32b9be67804624fdd87ae52fa473dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.ec2.internal" Jun 11 16:31:12.579559 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.579495 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d32b9be67804624fdd87ae52fa473dd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-188.ec2.internal\" (UID: \"8d32b9be67804624fdd87ae52fa473dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.ec2.internal" Jun 11 16:31:12.658102 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:12.658067 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-188.ec2.internal\" not found" Jun 11 16:31:12.680564 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.680536 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8d32b9be67804624fdd87ae52fa473dd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-188.ec2.internal\" (UID: \"8d32b9be67804624fdd87ae52fa473dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.ec2.internal" Jun 11 16:31:12.680628 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.680568 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d32b9be67804624fdd87ae52fa473dd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-188.ec2.internal\" (UID: \"8d32b9be67804624fdd87ae52fa473dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.ec2.internal" Jun 11 16:31:12.680628 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.680619 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d32b9be67804624fdd87ae52fa473dd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-188.ec2.internal\" (UID: \"8d32b9be67804624fdd87ae52fa473dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.ec2.internal" Jun 11 16:31:12.680697 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.680623 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8d32b9be67804624fdd87ae52fa473dd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-188.ec2.internal\" (UID: \"8d32b9be67804624fdd87ae52fa473dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.ec2.internal" Jun 11 16:31:12.759257 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:12.759176 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-188.ec2.internal\" not found" Jun 11 16:31:12.795767 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.795737 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.ec2.internal" Jun 11 16:31:12.800724 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:12.800704 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-188.ec2.internal" Jun 11 16:31:12.860160 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:12.860124 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-188.ec2.internal\" not found" Jun 11 16:31:12.961150 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:12.961102 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-188.ec2.internal\" not found" Jun 11 16:31:13.062003 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:13.061922 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-188.ec2.internal\" not found" Jun 11 16:31:13.163063 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:13.163032 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-188.ec2.internal\" not found" Jun 11 16:31:13.210870 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.210840 2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:31:13.218714 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.218677 2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 16:31:13.218842 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.218821 2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 16:31:13.218880 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.218851 2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 16:31:13.259030 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.258999 2569 apiserver.go:52] "Watching apiserver" Jun 11 16:31:13.278218 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.278176 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 16:31:13.278218 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.278177 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-188.ec2.internal" Jun 11 16:31:13.285560 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.284978 2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 16:31:13.285560 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.285441 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-86g9g","kube-system/global-pull-secret-syncer-qxtrm","openshift-multus/multus-additional-cni-plugins-829vm","openshift-network-operator/iptables-alerter-qd4kp","openshift-ovn-kubernetes/ovnkube-node-dctg2","kube-system/konnectivity-agent-sdlpn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9b4fn","openshift-cluster-node-tuning-operator/tuned-dnvld","openshift-dns/node-resolver-8h74q","openshift-image-registry/node-ca-lvfpt","openshift-multus/multus-7vskf","openshift-multus/network-metrics-daemon-6k5sj"] Jun 11 16:31:13.286736 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.286709 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 16:26:12 +0000 UTC" deadline="2028-01-18 13:55:06.072008167 +0000 UTC" Jun 11 16:31:13.286736 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.286733 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14061h23m52.785277262s" Jun 11 16:31:13.287028 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.287017 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:31:13.287148 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:13.287124 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86g9g" podUID="660244a3-e67d-45a0-9d14-c3fcb18359a0" Jun 11 16:31:13.288244 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.288228 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:13.288324 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:13.288293 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxtrm" podUID="ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55" Jun 11 16:31:13.289417 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.289399 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-829vm" Jun 11 16:31:13.290540 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.290522 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qd4kp" Jun 11 16:31:13.293264 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.291037 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 16:31:13.293264 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.291126 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.ec2.internal" Jun 11 16:31:13.293264 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.292361 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.293264 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.292894 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 16:31:13.293264 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.293137 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 16:31:13.293547 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.293342 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 16:31:13.293547 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.293502 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 16:31:13.293690 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.293672 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 16:31:13.293932 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.293842 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:31:13.293932 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.293911 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-b252c\"" Jun 11 16:31:13.294129 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.294116 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sdlpn" Jun 11 16:31:13.294329 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.294310 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 16:31:13.294458 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.294352 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xt8lr\"" Jun 11 16:31:13.294624 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.294612 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 16:31:13.295284 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.295273 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 16:31:13.295381 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.295303 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 16:31:13.295565 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.295540 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9b4fn" Jun 11 16:31:13.295706 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.295692 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 16:31:13.295925 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.295886 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 16:31:13.295925 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.295908 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 16:31:13.296071 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.295959 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-g5btl\"" Jun 11 16:31:13.296071 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.295977 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 16:31:13.296527 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.296513 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 16:31:13.296647 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.296628 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bjzh7\"" Jun 11 16:31:13.296707 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.296692 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 16:31:13.296757 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.296731 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 16:31:13.297121 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.297104 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.297639 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.297623 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 16:31:13.297980 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.297965 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 16:31:13.298108 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.297970 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 16:31:13.298357 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.298342 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8h74q" Jun 11 16:31:13.299661 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.299646 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lvfpt" Jun 11 16:31:13.300226 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.300045 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zmr2m\"" Jun 11 16:31:13.300338 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.300311 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 16:31:13.300673 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.300526 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:31:13.301340 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.301322 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kzc4c\"" Jun 11 16:31:13.301540 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.301514 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vs5sz\"" Jun 11 16:31:13.301635 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.301606 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 16:31:13.301726 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.301712 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 16:31:13.301877 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.301858 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 16:31:13.303236 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.303186 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 16:31:13.303351 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.303263 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.303583 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.303522 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 16:31:13.303823 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.303799 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 16:31:13.303945 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.303923 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dndnq\"" Jun 11 16:31:13.305345 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.305323 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-188.ec2.internal"] Jun 11 16:31:13.305435 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.305378 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.ec2.internal"] Jun 11 16:31:13.305435 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.305391 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:31:13.305533 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:13.305466 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6k5sj" podUID="941f2a27-1f4c-400e-a50e-8a541e5fb4a7" Jun 11 16:31:13.305739 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.305724 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sbvg5\"" Jun 11 16:31:13.306131 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.306118 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 16:31:13.321150 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.321108 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rjg84" Jun 11 16:31:13.328316 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.328296 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rjg84" Jun 11 16:31:13.354353 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:13.354326 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39f5ba962028041c64db3920f82c6d5e.slice/crio-e18ddfe23974eb1482c38410747d628f77637436983ec1d16deb2e3cd8234cd1 WatchSource:0}: Error finding container e18ddfe23974eb1482c38410747d628f77637436983ec1d16deb2e3cd8234cd1: Status 404 returned error can't find the container with id e18ddfe23974eb1482c38410747d628f77637436983ec1d16deb2e3cd8234cd1 Jun 11 16:31:13.354571 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:13.354553 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d32b9be67804624fdd87ae52fa473dd.slice/crio-2769c509bf48db9f74d4cb4fedc0135b264ff459b7690b3564e0c4e2d93966f2 WatchSource:0}: Error finding container 2769c509bf48db9f74d4cb4fedc0135b264ff459b7690b3564e0c4e2d93966f2: Status 404 returned error can't find the container with id 2769c509bf48db9f74d4cb4fedc0135b264ff459b7690b3564e0c4e2d93966f2 Jun 11 16:31:13.360525 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.360509 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:31:13.379087 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.379045 2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 16:31:13.386002 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.385985 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-multus-daemon-config\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.386110 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386009 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-lib-modules\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.386110 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386026 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2ac98822-4208-4aec-9b86-0bc5aecbd145-serviceca\") pod \"node-ca-lvfpt\" (UID: \"2ac98822-4208-4aec-9b86-0bc5aecbd145\") " pod="openshift-image-registry/node-ca-lvfpt" Jun 11 16:31:13.386110 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386042 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/05d7ab71-df16-4a99-b2a4-079bf348f7fc-socket-dir\") pod \"aws-ebs-csi-driver-node-9b4fn\" (UID: \"05d7ab71-df16-4a99-b2a4-079bf348f7fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9b4fn" Jun 11 16:31:13.386110 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386072 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/05d7ab71-df16-4a99-b2a4-079bf348f7fc-sys-fs\") pod \"aws-ebs-csi-driver-node-9b4fn\" (UID: \"05d7ab71-df16-4a99-b2a4-079bf348f7fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9b4fn" Jun 11 16:31:13.386110 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386089 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-etc-openvswitch\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.386311 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386115 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9719af52-db4f-4e83-83e9-070c2ed86687-ovn-node-metrics-cert\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.386311 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386138 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-etc-sysctl-d\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.386311 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386159 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55-dbus\") pod \"global-pull-secret-syncer-qxtrm\" (UID: \"ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55\") " pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:13.386311 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386177 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dac311a1-e919-4bbe-825a-621ae8045c7c-agent-certs\") pod \"konnectivity-agent-sdlpn\" (UID: \"dac311a1-e919-4bbe-825a-621ae8045c7c\") " pod="kube-system/konnectivity-agent-sdlpn" Jun 11 16:31:13.386311 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386203 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-etc-sysctl-conf\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.386311 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386223 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-os-release\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.386311 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386273 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-etc-kubernetes\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.386311 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386308 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-etc-kubernetes\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.386600 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386333 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-hostroot\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.386600 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386357 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-metrics-certs\") pod \"network-metrics-daemon-6k5sj\" (UID: \"941f2a27-1f4c-400e-a50e-8a541e5fb4a7\") " pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:31:13.386600 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386380 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/06cfb41e-30d2-4adf-b24d-84281d21e078-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-829vm\" (UID: \"06cfb41e-30d2-4adf-b24d-84281d21e078\") " pod="openshift-multus/multus-additional-cni-plugins-829vm" Jun 11 16:31:13.386600 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386405 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xhq8\" (UniqueName: \"kubernetes.io/projected/06cfb41e-30d2-4adf-b24d-84281d21e078-kube-api-access-8xhq8\") pod \"multus-additional-cni-plugins-829vm\" (UID: \"06cfb41e-30d2-4adf-b24d-84281d21e078\") " pod="openshift-multus/multus-additional-cni-plugins-829vm" Jun 11 16:31:13.386600 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386428 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-run-ovn\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.386600 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386460 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-host-var-lib-cni-bin\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.386600 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386491 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-run-systemd\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.386600 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386512 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/66a0433d-006a-4974-960f-30704fb9949d-hosts-file\") pod \"node-resolver-8h74q\" (UID: \"66a0433d-006a-4974-960f-30704fb9949d\") " pod="openshift-dns/node-resolver-8h74q" Jun 11 16:31:13.386600 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386528 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9719af52-db4f-4e83-83e9-070c2ed86687-ovnkube-config\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.386600 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386558 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-etc-systemd\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.386600 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386587 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpvh7\" (UniqueName: \"kubernetes.io/projected/05d7ab71-df16-4a99-b2a4-079bf348f7fc-kube-api-access-kpvh7\") pod \"aws-ebs-csi-driver-node-9b4fn\" (UID: \"05d7ab71-df16-4a99-b2a4-079bf348f7fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9b4fn" Jun 11 16:31:13.386600 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386603 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66a0433d-006a-4974-960f-30704fb9949d-tmp-dir\") pod \"node-resolver-8h74q\" (UID: \"66a0433d-006a-4974-960f-30704fb9949d\") " pod="openshift-dns/node-resolver-8h74q" Jun 11 16:31:13.387040 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386617 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-multus-cni-dir\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.387040 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386643 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-cnibin\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.387040 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386657 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-host-var-lib-kubelet\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.387040 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386671 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-log-socket\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.387040 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386684 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-host-cni-bin\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.387040 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386699 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06cfb41e-30d2-4adf-b24d-84281d21e078-cnibin\") pod \"multus-additional-cni-plugins-829vm\" (UID: \"06cfb41e-30d2-4adf-b24d-84281d21e078\") " pod="openshift-multus/multus-additional-cni-plugins-829vm" Jun 11 16:31:13.387040 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386721 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-var-lib-openvswitch\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.387040 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386737 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.387040 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386752 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-host\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.387040 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386771 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/05d7ab71-df16-4a99-b2a4-079bf348f7fc-registration-dir\") pod \"aws-ebs-csi-driver-node-9b4fn\" (UID: \"05d7ab71-df16-4a99-b2a4-079bf348f7fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9b4fn" Jun 11 16:31:13.387040 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386809 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55-kubelet-config\") pod \"global-pull-secret-syncer-qxtrm\" (UID: \"ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55\") " pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:13.387040 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386836 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06cfb41e-30d2-4adf-b24d-84281d21e078-tuning-conf-dir\") pod \"multus-additional-cni-plugins-829vm\" (UID: \"06cfb41e-30d2-4adf-b24d-84281d21e078\") " pod="openshift-multus/multus-additional-cni-plugins-829vm" Jun 11 16:31:13.387040 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386869 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ba7c0e9d-aed3-4fd4-89ba-3f1bbb7f5867-iptables-alerter-script\") pod \"iptables-alerter-qd4kp\" (UID: \"ba7c0e9d-aed3-4fd4-89ba-3f1bbb7f5867\") " pod="openshift-network-operator/iptables-alerter-qd4kp" Jun 11 16:31:13.387040 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386902 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkqpv\" (UniqueName: \"kubernetes.io/projected/9719af52-db4f-4e83-83e9-070c2ed86687-kube-api-access-dkqpv\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.387040 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386932 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-host-run-multus-certs\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.387040 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386955 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42dfl\" (UniqueName: \"kubernetes.io/projected/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-kube-api-access-42dfl\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.387671 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.386979 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06cfb41e-30d2-4adf-b24d-84281d21e078-system-cni-dir\") pod \"multus-additional-cni-plugins-829vm\" (UID: \"06cfb41e-30d2-4adf-b24d-84281d21e078\") " pod="openshift-multus/multus-additional-cni-plugins-829vm" Jun 11 16:31:13.387671 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387007 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06cfb41e-30d2-4adf-b24d-84281d21e078-cni-binary-copy\") pod \"multus-additional-cni-plugins-829vm\" (UID: \"06cfb41e-30d2-4adf-b24d-84281d21e078\") " pod="openshift-multus/multus-additional-cni-plugins-829vm" Jun 11 16:31:13.387671 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387032 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/06cfb41e-30d2-4adf-b24d-84281d21e078-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-829vm\" (UID: \"06cfb41e-30d2-4adf-b24d-84281d21e078\") " pod="openshift-multus/multus-additional-cni-plugins-829vm" Jun 11 16:31:13.387671 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387071 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-host-kubelet\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.387671 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387093 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-run-openvswitch\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.387671 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387116 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwk9m\" (UniqueName: \"kubernetes.io/projected/2ac98822-4208-4aec-9b86-0bc5aecbd145-kube-api-access-wwk9m\") pod \"node-ca-lvfpt\" (UID: \"2ac98822-4208-4aec-9b86-0bc5aecbd145\") " pod="openshift-image-registry/node-ca-lvfpt" Jun 11 16:31:13.387671 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387139 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tspws\" (UniqueName: \"kubernetes.io/projected/660244a3-e67d-45a0-9d14-c3fcb18359a0-kube-api-access-tspws\") pod \"network-check-target-86g9g\" (UID: \"660244a3-e67d-45a0-9d14-c3fcb18359a0\") " pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:31:13.387671 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387167 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/05d7ab71-df16-4a99-b2a4-079bf348f7fc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9b4fn\" (UID: \"05d7ab71-df16-4a99-b2a4-079bf348f7fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9b4fn" Jun 11 16:31:13.387671 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387189 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-host-cni-netd\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.387671 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387213 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-etc-sysconfig\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.387671 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387237 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/05d7ab71-df16-4a99-b2a4-079bf348f7fc-device-dir\") pod \"aws-ebs-csi-driver-node-9b4fn\" (UID: \"05d7ab71-df16-4a99-b2a4-079bf348f7fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9b4fn" Jun 11 16:31:13.387671 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387259 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/05d7ab71-df16-4a99-b2a4-079bf348f7fc-etc-selinux\") pod \"aws-ebs-csi-driver-node-9b4fn\" (UID: \"05d7ab71-df16-4a99-b2a4-079bf348f7fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9b4fn" Jun 11 16:31:13.387671 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387296 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-system-cni-dir\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.387671 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387317 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-cni-binary-copy\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.387671 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387347 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-host-run-k8s-cni-cncf-io\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.387671 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387378 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-host-run-netns\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.388162 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387411 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba7c0e9d-aed3-4fd4-89ba-3f1bbb7f5867-host-slash\") pod \"iptables-alerter-qd4kp\" (UID: \"ba7c0e9d-aed3-4fd4-89ba-3f1bbb7f5867\") " pod="openshift-network-operator/iptables-alerter-qd4kp" Jun 11 16:31:13.388162 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387428 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f85t4\" (UniqueName: \"kubernetes.io/projected/ba7c0e9d-aed3-4fd4-89ba-3f1bbb7f5867-kube-api-access-f85t4\") pod \"iptables-alerter-qd4kp\" (UID: \"ba7c0e9d-aed3-4fd4-89ba-3f1bbb7f5867\") " pod="openshift-network-operator/iptables-alerter-qd4kp" Jun 11 16:31:13.388162 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387443 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-etc-modprobe-d\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.388162 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387457 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-var-lib-kubelet\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.388162 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387471 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-multus-conf-dir\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.388162 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387485 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9719af52-db4f-4e83-83e9-070c2ed86687-ovnkube-script-lib\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.388162 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387511 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dac311a1-e919-4bbe-825a-621ae8045c7c-konnectivity-ca\") pod \"konnectivity-agent-sdlpn\" (UID: \"dac311a1-e919-4bbe-825a-621ae8045c7c\") " pod="kube-system/konnectivity-agent-sdlpn" Jun 11 16:31:13.388162 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387525 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-sys\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.388162 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387538 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ac98822-4208-4aec-9b86-0bc5aecbd145-host\") pod \"node-ca-lvfpt\" (UID: \"2ac98822-4208-4aec-9b86-0bc5aecbd145\") " pod="openshift-image-registry/node-ca-lvfpt" Jun 11 16:31:13.388162 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387554 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbfgq\" (UniqueName: \"kubernetes.io/projected/66a0433d-006a-4974-960f-30704fb9949d-kube-api-access-nbfgq\") pod \"node-resolver-8h74q\" (UID: \"66a0433d-006a-4974-960f-30704fb9949d\") " pod="openshift-dns/node-resolver-8h74q" Jun 11 16:31:13.388162 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387568 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-multus-socket-dir-parent\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.388162 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387584 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-host-var-lib-cni-multus\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.388162 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387599 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55-original-pull-secret\") pod \"global-pull-secret-syncer-qxtrm\" (UID: \"ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55\") " pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:13.388162 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387613 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-systemd-units\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.388162 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387627 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-host-slash\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.388162 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387644 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-host-run-ovn-kubernetes\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.388687 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387674 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9719af52-db4f-4e83-83e9-070c2ed86687-env-overrides\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.388687 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387688 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3808b309-e3c4-4a93-925e-e03168b6a441-tmp\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.388687 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387703 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v64lr\" (UniqueName: \"kubernetes.io/projected/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-kube-api-access-v64lr\") pod \"network-metrics-daemon-6k5sj\" (UID: \"941f2a27-1f4c-400e-a50e-8a541e5fb4a7\") " pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:31:13.388687 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387719 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06cfb41e-30d2-4adf-b24d-84281d21e078-os-release\") pod \"multus-additional-cni-plugins-829vm\" (UID: \"06cfb41e-30d2-4adf-b24d-84281d21e078\") " pod="openshift-multus/multus-additional-cni-plugins-829vm" Jun 11 16:31:13.388687 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387739 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-host-run-netns\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.388687 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387765 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-node-log\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.388687 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387801 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-run\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.388687 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387819 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3808b309-e3c4-4a93-925e-e03168b6a441-etc-tuned\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.388687 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.387837 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tt7x\" (UniqueName: \"kubernetes.io/projected/3808b309-e3c4-4a93-925e-e03168b6a441-kube-api-access-2tt7x\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.488518 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.488487 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-etc-openvswitch\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.488518 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.488516 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9719af52-db4f-4e83-83e9-070c2ed86687-ovn-node-metrics-cert\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.488748 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.488533 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-etc-sysctl-d\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.488748 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.488548 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55-dbus\") pod \"global-pull-secret-syncer-qxtrm\" (UID: \"ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55\") " pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:13.488748 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.488563 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dac311a1-e919-4bbe-825a-621ae8045c7c-agent-certs\") pod \"konnectivity-agent-sdlpn\" (UID: \"dac311a1-e919-4bbe-825a-621ae8045c7c\") " pod="kube-system/konnectivity-agent-sdlpn" Jun 11 16:31:13.488748 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.488590 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-etc-openvswitch\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.488748 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.488649 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-etc-sysctl-conf\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.488748 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.488681 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-os-release\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.488748 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.488686 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-etc-sysctl-d\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.488748 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.488696 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-etc-kubernetes\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.488748 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.488691 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55-dbus\") pod \"global-pull-secret-syncer-qxtrm\" (UID: \"ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55\") " pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:13.488748 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.488712 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-etc-kubernetes\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.488748 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.488743 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-hostroot\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.488748 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.488755 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-etc-kubernetes\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.489322 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.488761 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-metrics-certs\") pod \"network-metrics-daemon-6k5sj\" (UID: \"941f2a27-1f4c-400e-a50e-8a541e5fb4a7\") " pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:31:13.489322 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.488779 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/06cfb41e-30d2-4adf-b24d-84281d21e078-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-829vm\" (UID: \"06cfb41e-30d2-4adf-b24d-84281d21e078\") " pod="openshift-multus/multus-additional-cni-plugins-829vm" Jun 11 16:31:13.489322 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.488800 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xhq8\" (UniqueName: \"kubernetes.io/projected/06cfb41e-30d2-4adf-b24d-84281d21e078-kube-api-access-8xhq8\") pod \"multus-additional-cni-plugins-829vm\" (UID: \"06cfb41e-30d2-4adf-b24d-84281d21e078\") " pod="openshift-multus/multus-additional-cni-plugins-829vm" Jun 11 16:31:13.489322 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.488806 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-etc-sysctl-conf\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.489322 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.488781 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-etc-kubernetes\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.489322 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.488824 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-os-release\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.489322 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.488866 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-hostroot\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.489322 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.488898 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-run-ovn\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.489322 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.488928 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-host-var-lib-cni-bin\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.489322 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.488955 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-run-systemd\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.489322 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:13.488959 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:31:13.489322 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.488977 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-run-ovn\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.489322 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.488981 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/66a0433d-006a-4974-960f-30704fb9949d-hosts-file\") pod \"node-resolver-8h74q\" (UID: \"66a0433d-006a-4974-960f-30704fb9949d\") " pod="openshift-dns/node-resolver-8h74q" Jun 11 16:31:13.489322 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489005 2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 16:31:13.489322 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489015 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9719af52-db4f-4e83-83e9-070c2ed86687-ovnkube-config\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.489322 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489019 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/66a0433d-006a-4974-960f-30704fb9949d-hosts-file\") pod \"node-resolver-8h74q\" (UID: \"66a0433d-006a-4974-960f-30704fb9949d\") " pod="openshift-dns/node-resolver-8h74q" Jun 11 16:31:13.489322 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:13.489032 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-metrics-certs podName:941f2a27-1f4c-400e-a50e-8a541e5fb4a7 nodeName:}" failed. No retries permitted until 2026-06-11 16:31:13.989010477 +0000 UTC m=+2.057280497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-metrics-certs") pod "network-metrics-daemon-6k5sj" (UID: "941f2a27-1f4c-400e-a50e-8a541e5fb4a7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:31:13.489322 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489034 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-host-var-lib-cni-bin\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.490184 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489081 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-run-systemd\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.490184 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489115 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-etc-systemd\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.490184 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489143 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpvh7\" (UniqueName: \"kubernetes.io/projected/05d7ab71-df16-4a99-b2a4-079bf348f7fc-kube-api-access-kpvh7\") pod \"aws-ebs-csi-driver-node-9b4fn\" (UID: \"05d7ab71-df16-4a99-b2a4-079bf348f7fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9b4fn" Jun 11 16:31:13.490184 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489179 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66a0433d-006a-4974-960f-30704fb9949d-tmp-dir\") pod \"node-resolver-8h74q\" (UID: \"66a0433d-006a-4974-960f-30704fb9949d\") " pod="openshift-dns/node-resolver-8h74q" Jun 11 16:31:13.490184 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489212 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-multus-cni-dir\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.490184 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489253 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-cnibin\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.490184 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489276 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-host-var-lib-kubelet\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.490184 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489317 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-log-socket\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.490184 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489339 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-host-cni-bin\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.490184 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489363 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06cfb41e-30d2-4adf-b24d-84281d21e078-cnibin\") pod \"multus-additional-cni-plugins-829vm\" (UID: \"06cfb41e-30d2-4adf-b24d-84281d21e078\") " pod="openshift-multus/multus-additional-cni-plugins-829vm" Jun 11 16:31:13.490184 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489380 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-etc-systemd\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.490184 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489405 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-var-lib-openvswitch\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.490184 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489430 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-host-var-lib-kubelet\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.490184 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489438 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.490184 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489455 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66a0433d-006a-4974-960f-30704fb9949d-tmp-dir\") pod \"node-resolver-8h74q\" (UID: \"66a0433d-006a-4974-960f-30704fb9949d\") " pod="openshift-dns/node-resolver-8h74q" Jun 11 16:31:13.490184 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489479 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-cnibin\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.490184 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489482 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-multus-cni-dir\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.490184 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489480 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-host\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.490986 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489430 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/06cfb41e-30d2-4adf-b24d-84281d21e078-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-829vm\" (UID: \"06cfb41e-30d2-4adf-b24d-84281d21e078\") " pod="openshift-multus/multus-additional-cni-plugins-829vm" Jun 11 16:31:13.490986 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489517 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/05d7ab71-df16-4a99-b2a4-079bf348f7fc-registration-dir\") pod \"aws-ebs-csi-driver-node-9b4fn\" (UID: \"05d7ab71-df16-4a99-b2a4-079bf348f7fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9b4fn" Jun 11 16:31:13.490986 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489534 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-host-cni-bin\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.490986 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489552 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.490986 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489554 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55-kubelet-config\") pod \"global-pull-secret-syncer-qxtrm\" (UID: \"ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55\") " pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:13.490986 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489564 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9719af52-db4f-4e83-83e9-070c2ed86687-ovnkube-config\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.490986 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489575 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-var-lib-openvswitch\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.490986 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489557 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/05d7ab71-df16-4a99-b2a4-079bf348f7fc-registration-dir\") pod \"aws-ebs-csi-driver-node-9b4fn\" (UID: \"05d7ab71-df16-4a99-b2a4-079bf348f7fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9b4fn" Jun 11 16:31:13.490986 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489592 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55-kubelet-config\") pod \"global-pull-secret-syncer-qxtrm\" (UID: \"ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55\") " pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:13.490986 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489593 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06cfb41e-30d2-4adf-b24d-84281d21e078-cnibin\") pod \"multus-additional-cni-plugins-829vm\" (UID: \"06cfb41e-30d2-4adf-b24d-84281d21e078\") " pod="openshift-multus/multus-additional-cni-plugins-829vm" Jun 11 16:31:13.490986 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489613 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-log-socket\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.490986 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489587 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06cfb41e-30d2-4adf-b24d-84281d21e078-tuning-conf-dir\") pod \"multus-additional-cni-plugins-829vm\" (UID: \"06cfb41e-30d2-4adf-b24d-84281d21e078\") " pod="openshift-multus/multus-additional-cni-plugins-829vm" Jun 11 16:31:13.490986 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489651 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ba7c0e9d-aed3-4fd4-89ba-3f1bbb7f5867-iptables-alerter-script\") pod \"iptables-alerter-qd4kp\" (UID: \"ba7c0e9d-aed3-4fd4-89ba-3f1bbb7f5867\") " pod="openshift-network-operator/iptables-alerter-qd4kp" Jun 11 16:31:13.490986 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489673 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-host\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.490986 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489679 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkqpv\" (UniqueName: \"kubernetes.io/projected/9719af52-db4f-4e83-83e9-070c2ed86687-kube-api-access-dkqpv\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.490986 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489714 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-host-run-multus-certs\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.490986 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489743 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42dfl\" (UniqueName: \"kubernetes.io/projected/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-kube-api-access-42dfl\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.491850 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489782 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06cfb41e-30d2-4adf-b24d-84281d21e078-tuning-conf-dir\") pod \"multus-additional-cni-plugins-829vm\" (UID: \"06cfb41e-30d2-4adf-b24d-84281d21e078\") " pod="openshift-multus/multus-additional-cni-plugins-829vm" Jun 11 16:31:13.491850 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489782 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06cfb41e-30d2-4adf-b24d-84281d21e078-system-cni-dir\") pod \"multus-additional-cni-plugins-829vm\" (UID: \"06cfb41e-30d2-4adf-b24d-84281d21e078\") " pod="openshift-multus/multus-additional-cni-plugins-829vm" Jun 11 16:31:13.491850 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489828 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06cfb41e-30d2-4adf-b24d-84281d21e078-cni-binary-copy\") pod \"multus-additional-cni-plugins-829vm\" (UID: \"06cfb41e-30d2-4adf-b24d-84281d21e078\") " pod="openshift-multus/multus-additional-cni-plugins-829vm" Jun 11 16:31:13.491850 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489853 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/06cfb41e-30d2-4adf-b24d-84281d21e078-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-829vm\" (UID: \"06cfb41e-30d2-4adf-b24d-84281d21e078\") " pod="openshift-multus/multus-additional-cni-plugins-829vm" Jun 11 16:31:13.491850 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489895 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-host-kubelet\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.491850 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489918 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-run-openvswitch\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.491850 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489921 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06cfb41e-30d2-4adf-b24d-84281d21e078-system-cni-dir\") pod \"multus-additional-cni-plugins-829vm\" (UID: \"06cfb41e-30d2-4adf-b24d-84281d21e078\") " pod="openshift-multus/multus-additional-cni-plugins-829vm" Jun 11 16:31:13.491850 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489854 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-host-run-multus-certs\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.491850 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489964 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-host-kubelet\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.491850 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489970 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-run-openvswitch\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.491850 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.489992 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwk9m\" (UniqueName: \"kubernetes.io/projected/2ac98822-4208-4aec-9b86-0bc5aecbd145-kube-api-access-wwk9m\") pod \"node-ca-lvfpt\" (UID: \"2ac98822-4208-4aec-9b86-0bc5aecbd145\") " pod="openshift-image-registry/node-ca-lvfpt" Jun 11 16:31:13.491850 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490040 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tspws\" (UniqueName: \"kubernetes.io/projected/660244a3-e67d-45a0-9d14-c3fcb18359a0-kube-api-access-tspws\") pod \"network-check-target-86g9g\" (UID: \"660244a3-e67d-45a0-9d14-c3fcb18359a0\") " pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:31:13.491850 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490084 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/05d7ab71-df16-4a99-b2a4-079bf348f7fc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9b4fn\" (UID: \"05d7ab71-df16-4a99-b2a4-079bf348f7fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9b4fn" Jun 11 16:31:13.491850 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490108 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-host-cni-netd\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.491850 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490133 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-etc-sysconfig\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.491850 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490158 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/05d7ab71-df16-4a99-b2a4-079bf348f7fc-device-dir\") pod \"aws-ebs-csi-driver-node-9b4fn\" (UID: \"05d7ab71-df16-4a99-b2a4-079bf348f7fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9b4fn" Jun 11 16:31:13.491850 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490187 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/05d7ab71-df16-4a99-b2a4-079bf348f7fc-etc-selinux\") pod \"aws-ebs-csi-driver-node-9b4fn\" (UID: \"05d7ab71-df16-4a99-b2a4-079bf348f7fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9b4fn" Jun 11 16:31:13.492834 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490193 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ba7c0e9d-aed3-4fd4-89ba-3f1bbb7f5867-iptables-alerter-script\") pod \"iptables-alerter-qd4kp\" (UID: \"ba7c0e9d-aed3-4fd4-89ba-3f1bbb7f5867\") " pod="openshift-network-operator/iptables-alerter-qd4kp" Jun 11 16:31:13.492834 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490212 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-system-cni-dir\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.492834 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490253 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-host-cni-netd\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.492834 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490236 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-cni-binary-copy\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.492834 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490296 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-host-run-k8s-cni-cncf-io\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.492834 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490350 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-host-run-netns\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.492834 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490366 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06cfb41e-30d2-4adf-b24d-84281d21e078-cni-binary-copy\") pod \"multus-additional-cni-plugins-829vm\" (UID: \"06cfb41e-30d2-4adf-b24d-84281d21e078\") " pod="openshift-multus/multus-additional-cni-plugins-829vm" Jun 11 16:31:13.492834 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490377 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba7c0e9d-aed3-4fd4-89ba-3f1bbb7f5867-host-slash\") pod \"iptables-alerter-qd4kp\" (UID: \"ba7c0e9d-aed3-4fd4-89ba-3f1bbb7f5867\") " pod="openshift-network-operator/iptables-alerter-qd4kp" Jun 11 16:31:13.492834 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490405 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/05d7ab71-df16-4a99-b2a4-079bf348f7fc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9b4fn\" (UID: \"05d7ab71-df16-4a99-b2a4-079bf348f7fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9b4fn" Jun 11 16:31:13.492834 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490425 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f85t4\" (UniqueName: \"kubernetes.io/projected/ba7c0e9d-aed3-4fd4-89ba-3f1bbb7f5867-kube-api-access-f85t4\") pod \"iptables-alerter-qd4kp\" (UID: \"ba7c0e9d-aed3-4fd4-89ba-3f1bbb7f5867\") " pod="openshift-network-operator/iptables-alerter-qd4kp" Jun 11 16:31:13.492834 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490430 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/05d7ab71-df16-4a99-b2a4-079bf348f7fc-device-dir\") pod \"aws-ebs-csi-driver-node-9b4fn\" (UID: \"05d7ab71-df16-4a99-b2a4-079bf348f7fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9b4fn" Jun 11 16:31:13.492834 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490451 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-etc-modprobe-d\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.492834 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490457 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-etc-sysconfig\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.492834 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490484 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/05d7ab71-df16-4a99-b2a4-079bf348f7fc-etc-selinux\") pod \"aws-ebs-csi-driver-node-9b4fn\" (UID: \"05d7ab71-df16-4a99-b2a4-079bf348f7fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9b4fn" Jun 11 16:31:13.492834 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490487 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-var-lib-kubelet\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.492834 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490513 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-multus-conf-dir\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.492834 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490521 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-host-run-netns\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.493648 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490525 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/06cfb41e-30d2-4adf-b24d-84281d21e078-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-829vm\" (UID: \"06cfb41e-30d2-4adf-b24d-84281d21e078\") " pod="openshift-multus/multus-additional-cni-plugins-829vm" Jun 11 16:31:13.493648 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490537 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9719af52-db4f-4e83-83e9-070c2ed86687-ovnkube-script-lib\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.493648 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490540 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-etc-modprobe-d\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.493648 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490555 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-host-run-k8s-cni-cncf-io\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.493648 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490562 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dac311a1-e919-4bbe-825a-621ae8045c7c-konnectivity-ca\") pod \"konnectivity-agent-sdlpn\" (UID: \"dac311a1-e919-4bbe-825a-621ae8045c7c\") " pod="kube-system/konnectivity-agent-sdlpn" Jun 11 16:31:13.493648 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490592 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-multus-conf-dir\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.493648 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490609 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba7c0e9d-aed3-4fd4-89ba-3f1bbb7f5867-host-slash\") pod \"iptables-alerter-qd4kp\" (UID: \"ba7c0e9d-aed3-4fd4-89ba-3f1bbb7f5867\") " pod="openshift-network-operator/iptables-alerter-qd4kp" Jun 11 16:31:13.493648 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490610 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-system-cni-dir\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.493648 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490634 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-var-lib-kubelet\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.493648 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490649 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-sys\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.493648 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490677 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ac98822-4208-4aec-9b86-0bc5aecbd145-host\") pod \"node-ca-lvfpt\" (UID: \"2ac98822-4208-4aec-9b86-0bc5aecbd145\") " pod="openshift-image-registry/node-ca-lvfpt" Jun 11 16:31:13.493648 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490699 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-sys\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.493648 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490720 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbfgq\" (UniqueName: \"kubernetes.io/projected/66a0433d-006a-4974-960f-30704fb9949d-kube-api-access-nbfgq\") pod \"node-resolver-8h74q\" (UID: \"66a0433d-006a-4974-960f-30704fb9949d\") " pod="openshift-dns/node-resolver-8h74q" Jun 11 16:31:13.493648 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490741 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ac98822-4208-4aec-9b86-0bc5aecbd145-host\") pod \"node-ca-lvfpt\" (UID: \"2ac98822-4208-4aec-9b86-0bc5aecbd145\") " pod="openshift-image-registry/node-ca-lvfpt" Jun 11 16:31:13.493648 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490747 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-multus-socket-dir-parent\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.493648 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490765 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-cni-binary-copy\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.493648 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490816 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-multus-socket-dir-parent\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.493648 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490895 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-host-var-lib-cni-multus\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.494169 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490944 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55-original-pull-secret\") pod \"global-pull-secret-syncer-qxtrm\" (UID: \"ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55\") " pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:13.494169 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490971 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-systemd-units\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.494169 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490979 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-host-var-lib-cni-multus\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.494169 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.490995 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-host-slash\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.494169 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.491019 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-host-run-ovn-kubernetes\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.494169 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.491045 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9719af52-db4f-4e83-83e9-070c2ed86687-env-overrides\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.494169 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.491074 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9719af52-db4f-4e83-83e9-070c2ed86687-ovnkube-script-lib\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.494169 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.491092 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3808b309-e3c4-4a93-925e-e03168b6a441-tmp\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.494169 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.491113 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dac311a1-e919-4bbe-825a-621ae8045c7c-konnectivity-ca\") pod \"konnectivity-agent-sdlpn\" (UID: \"dac311a1-e919-4bbe-825a-621ae8045c7c\") " pod="kube-system/konnectivity-agent-sdlpn" Jun 11 16:31:13.494169 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.491119 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-host-slash\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.494169 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.491118 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v64lr\" (UniqueName: \"kubernetes.io/projected/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-kube-api-access-v64lr\") pod \"network-metrics-daemon-6k5sj\" (UID: \"941f2a27-1f4c-400e-a50e-8a541e5fb4a7\") " pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:31:13.494169 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.491140 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-host-run-ovn-kubernetes\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.494169 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.491165 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06cfb41e-30d2-4adf-b24d-84281d21e078-os-release\") pod \"multus-additional-cni-plugins-829vm\" (UID: \"06cfb41e-30d2-4adf-b24d-84281d21e078\") " pod="openshift-multus/multus-additional-cni-plugins-829vm" Jun 11 16:31:13.494169 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.491190 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-host-run-netns\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.494169 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.491212 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-node-log\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.494169 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.491234 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-run\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.494169 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:13.491250 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:31:13.494169 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.491258 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3808b309-e3c4-4a93-925e-e03168b6a441-etc-tuned\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.494649 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:13.491301 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55-original-pull-secret podName:ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55 nodeName:}" failed. No retries permitted until 2026-06-11 16:31:13.991283568 +0000 UTC m=+2.059553595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55-original-pull-secret") pod "global-pull-secret-syncer-qxtrm" (UID: "ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:31:13.494649 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.491323 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tt7x\" (UniqueName: \"kubernetes.io/projected/3808b309-e3c4-4a93-925e-e03168b6a441-kube-api-access-2tt7x\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.494649 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.491380 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-multus-daemon-config\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.494649 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.491407 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-lib-modules\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.494649 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.491448 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2ac98822-4208-4aec-9b86-0bc5aecbd145-serviceca\") pod \"node-ca-lvfpt\" (UID: \"2ac98822-4208-4aec-9b86-0bc5aecbd145\") " pod="openshift-image-registry/node-ca-lvfpt" Jun 11 16:31:13.494649 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.491460 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-systemd-units\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.494649 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.491473 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/05d7ab71-df16-4a99-b2a4-079bf348f7fc-socket-dir\") pod \"aws-ebs-csi-driver-node-9b4fn\" (UID: \"05d7ab71-df16-4a99-b2a4-079bf348f7fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9b4fn" Jun 11 16:31:13.494649 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.491462 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9719af52-db4f-4e83-83e9-070c2ed86687-env-overrides\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.494649 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.491509 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/05d7ab71-df16-4a99-b2a4-079bf348f7fc-sys-fs\") pod \"aws-ebs-csi-driver-node-9b4fn\" (UID: \"05d7ab71-df16-4a99-b2a4-079bf348f7fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9b4fn" Jun 11 16:31:13.494649 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.491578 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-run\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.494649 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.491651 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3808b309-e3c4-4a93-925e-e03168b6a441-lib-modules\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.494649 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.491655 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/05d7ab71-df16-4a99-b2a4-079bf348f7fc-socket-dir\") pod \"aws-ebs-csi-driver-node-9b4fn\" (UID: \"05d7ab71-df16-4a99-b2a4-079bf348f7fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9b4fn" Jun 11 16:31:13.494649 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.491680 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/05d7ab71-df16-4a99-b2a4-079bf348f7fc-sys-fs\") pod \"aws-ebs-csi-driver-node-9b4fn\" (UID: \"05d7ab71-df16-4a99-b2a4-079bf348f7fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9b4fn" Jun 11 16:31:13.494649 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.491697 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-node-log\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.494649 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.491730 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9719af52-db4f-4e83-83e9-070c2ed86687-host-run-netns\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.494649 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.491850 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06cfb41e-30d2-4adf-b24d-84281d21e078-os-release\") pod \"multus-additional-cni-plugins-829vm\" (UID: \"06cfb41e-30d2-4adf-b24d-84281d21e078\") " pod="openshift-multus/multus-additional-cni-plugins-829vm" Jun 11 16:31:13.494649 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.492036 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2ac98822-4208-4aec-9b86-0bc5aecbd145-serviceca\") pod \"node-ca-lvfpt\" (UID: \"2ac98822-4208-4aec-9b86-0bc5aecbd145\") " pod="openshift-image-registry/node-ca-lvfpt" Jun 11 16:31:13.495134 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.492422 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-multus-daemon-config\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.495134 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.492990 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9719af52-db4f-4e83-83e9-070c2ed86687-ovn-node-metrics-cert\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.495134 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.493105 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dac311a1-e919-4bbe-825a-621ae8045c7c-agent-certs\") pod \"konnectivity-agent-sdlpn\" (UID: \"dac311a1-e919-4bbe-825a-621ae8045c7c\") " pod="kube-system/konnectivity-agent-sdlpn" Jun 11 16:31:13.495134 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.493639 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3808b309-e3c4-4a93-925e-e03168b6a441-tmp\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.495134 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.493757 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3808b309-e3c4-4a93-925e-e03168b6a441-etc-tuned\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.504753 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:13.504658 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:31:13.504753 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:13.504680 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:31:13.504753 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:13.504690 2569 projected.go:196] Error preparing data for projected volume kube-api-access-tspws for pod openshift-network-diagnostics/network-check-target-86g9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:31:13.504753 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:13.504752 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/660244a3-e67d-45a0-9d14-c3fcb18359a0-kube-api-access-tspws podName:660244a3-e67d-45a0-9d14-c3fcb18359a0 nodeName:}" failed. No retries permitted until 2026-06-11 16:31:14.004738535 +0000 UTC m=+2.073008568 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tspws" (UniqueName: "kubernetes.io/projected/660244a3-e67d-45a0-9d14-c3fcb18359a0-kube-api-access-tspws") pod "network-check-target-86g9g" (UID: "660244a3-e67d-45a0-9d14-c3fcb18359a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:31:13.507367 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.507338 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xhq8\" (UniqueName: \"kubernetes.io/projected/06cfb41e-30d2-4adf-b24d-84281d21e078-kube-api-access-8xhq8\") pod \"multus-additional-cni-plugins-829vm\" (UID: \"06cfb41e-30d2-4adf-b24d-84281d21e078\") " pod="openshift-multus/multus-additional-cni-plugins-829vm" Jun 11 16:31:13.507367 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.507347 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v64lr\" (UniqueName: \"kubernetes.io/projected/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-kube-api-access-v64lr\") pod \"network-metrics-daemon-6k5sj\" (UID: \"941f2a27-1f4c-400e-a50e-8a541e5fb4a7\") " pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:31:13.507561 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.507416 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tt7x\" (UniqueName: \"kubernetes.io/projected/3808b309-e3c4-4a93-925e-e03168b6a441-kube-api-access-2tt7x\") pod \"tuned-dnvld\" (UID: \"3808b309-e3c4-4a93-925e-e03168b6a441\") " pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.507808 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.507785 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpvh7\" (UniqueName: \"kubernetes.io/projected/05d7ab71-df16-4a99-b2a4-079bf348f7fc-kube-api-access-kpvh7\") pod \"aws-ebs-csi-driver-node-9b4fn\" (UID: \"05d7ab71-df16-4a99-b2a4-079bf348f7fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9b4fn" Jun 11 16:31:13.508301 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.508283 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f85t4\" (UniqueName: \"kubernetes.io/projected/ba7c0e9d-aed3-4fd4-89ba-3f1bbb7f5867-kube-api-access-f85t4\") pod \"iptables-alerter-qd4kp\" (UID: \"ba7c0e9d-aed3-4fd4-89ba-3f1bbb7f5867\") " pod="openshift-network-operator/iptables-alerter-qd4kp" Jun 11 16:31:13.508664 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.508643 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwk9m\" (UniqueName: \"kubernetes.io/projected/2ac98822-4208-4aec-9b86-0bc5aecbd145-kube-api-access-wwk9m\") pod \"node-ca-lvfpt\" (UID: \"2ac98822-4208-4aec-9b86-0bc5aecbd145\") " pod="openshift-image-registry/node-ca-lvfpt" Jun 11 16:31:13.509358 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.509339 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42dfl\" (UniqueName: \"kubernetes.io/projected/faa4a854-0eca-4d38-9ce1-5fcf03623d6b-kube-api-access-42dfl\") pod \"multus-7vskf\" (UID: \"faa4a854-0eca-4d38-9ce1-5fcf03623d6b\") " pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.509601 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.509585 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbfgq\" (UniqueName: \"kubernetes.io/projected/66a0433d-006a-4974-960f-30704fb9949d-kube-api-access-nbfgq\") pod \"node-resolver-8h74q\" (UID: \"66a0433d-006a-4974-960f-30704fb9949d\") " pod="openshift-dns/node-resolver-8h74q" Jun 11 16:31:13.509887 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.509868 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkqpv\" (UniqueName: \"kubernetes.io/projected/9719af52-db4f-4e83-83e9-070c2ed86687-kube-api-access-dkqpv\") pod \"ovnkube-node-dctg2\" (UID: \"9719af52-db4f-4e83-83e9-070c2ed86687\") " pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.610277 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.610145 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-829vm" Jun 11 16:31:13.618767 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:13.618737 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06cfb41e_30d2_4adf_b24d_84281d21e078.slice/crio-7be326a840dc04620b9769b43c7d775ce04d9e4590a9f9879bdbc6147a0ab4e2 WatchSource:0}: Error finding container 7be326a840dc04620b9769b43c7d775ce04d9e4590a9f9879bdbc6147a0ab4e2: Status 404 returned error can't find the container with id 7be326a840dc04620b9769b43c7d775ce04d9e4590a9f9879bdbc6147a0ab4e2 Jun 11 16:31:13.623079 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.623044 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qd4kp" Jun 11 16:31:13.630533 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:13.630507 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba7c0e9d_aed3_4fd4_89ba_3f1bbb7f5867.slice/crio-bad3136941dfc501dab6aece85ae1d4b6649f4aa7e0b35f5af32d38b77af37cd WatchSource:0}: Error finding container bad3136941dfc501dab6aece85ae1d4b6649f4aa7e0b35f5af32d38b77af37cd: Status 404 returned error can't find the container with id bad3136941dfc501dab6aece85ae1d4b6649f4aa7e0b35f5af32d38b77af37cd Jun 11 16:31:13.641746 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.641723 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:13.650720 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:13.650696 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9719af52_db4f_4e83_83e9_070c2ed86687.slice/crio-e278e660698de2c7739e83b340b78513c76220f6f2df227a87ab359c2610fbb1 WatchSource:0}: Error finding container e278e660698de2c7739e83b340b78513c76220f6f2df227a87ab359c2610fbb1: Status 404 returned error can't find the container with id e278e660698de2c7739e83b340b78513c76220f6f2df227a87ab359c2610fbb1 Jun 11 16:31:13.655345 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.655328 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sdlpn" Jun 11 16:31:13.662138 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.662116 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9b4fn" Jun 11 16:31:13.663201 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:13.663179 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddac311a1_e919_4bbe_825a_621ae8045c7c.slice/crio-bc98ff10d888a805291ee0011fa99abb27617ba51877200a6dc29934c759abce WatchSource:0}: Error finding container bc98ff10d888a805291ee0011fa99abb27617ba51877200a6dc29934c759abce: Status 404 returned error can't find the container with id bc98ff10d888a805291ee0011fa99abb27617ba51877200a6dc29934c759abce Jun 11 16:31:13.669449 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.669428 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dnvld" Jun 11 16:31:13.669706 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:13.669671 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05d7ab71_df16_4a99_b2a4_079bf348f7fc.slice/crio-3bcd511c86b3158f0b076d71f42b606bc893578634a1b2823aece036bbf0822a WatchSource:0}: Error finding container 3bcd511c86b3158f0b076d71f42b606bc893578634a1b2823aece036bbf0822a: Status 404 returned error can't find the container with id 3bcd511c86b3158f0b076d71f42b606bc893578634a1b2823aece036bbf0822a Jun 11 16:31:13.676069 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.676023 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8h74q" Jun 11 16:31:13.676718 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:13.676696 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3808b309_e3c4_4a93_925e_e03168b6a441.slice/crio-69e91643fcca953aa0c77f7c2a7f76e6ea7edc32437f188f23c8138ece3dac4c WatchSource:0}: Error finding container 69e91643fcca953aa0c77f7c2a7f76e6ea7edc32437f188f23c8138ece3dac4c: Status 404 returned error can't find the container with id 69e91643fcca953aa0c77f7c2a7f76e6ea7edc32437f188f23c8138ece3dac4c Jun 11 16:31:13.680795 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.680774 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lvfpt" Jun 11 16:31:13.684552 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:13.684527 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66a0433d_006a_4974_960f_30704fb9949d.slice/crio-6dcafd7c11bfdeb5466394bf6bccf61c8e9fab6a9986cc4b2fba7dc75dd13a94 WatchSource:0}: Error finding container 6dcafd7c11bfdeb5466394bf6bccf61c8e9fab6a9986cc4b2fba7dc75dd13a94: Status 404 returned error can't find the container with id 6dcafd7c11bfdeb5466394bf6bccf61c8e9fab6a9986cc4b2fba7dc75dd13a94 Jun 11 16:31:13.685251 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.685234 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7vskf" Jun 11 16:31:13.688871 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:13.688850 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ac98822_4208_4aec_9b86_0bc5aecbd145.slice/crio-4e0755a5f288fa3575e93d89bc78b190ba0bea207bd150951de0909f3242462c WatchSource:0}: Error finding container 4e0755a5f288fa3575e93d89bc78b190ba0bea207bd150951de0909f3242462c: Status 404 returned error can't find the container with id 4e0755a5f288fa3575e93d89bc78b190ba0bea207bd150951de0909f3242462c Jun 11 16:31:13.692903 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:13.692884 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaa4a854_0eca_4d38_9ce1_5fcf03623d6b.slice/crio-46d572f09c18bc5cfdb2f9982737764d5ecb6bf3bd7746aa78f7dd4536a088c4 WatchSource:0}: Error finding container 46d572f09c18bc5cfdb2f9982737764d5ecb6bf3bd7746aa78f7dd4536a088c4: Status 404 returned error can't find the container with id 46d572f09c18bc5cfdb2f9982737764d5ecb6bf3bd7746aa78f7dd4536a088c4 Jun 11 16:31:13.771654 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.771628 2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:31:13.817277 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.817245 2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:31:13.995742 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.995702 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55-original-pull-secret\") pod \"global-pull-secret-syncer-qxtrm\" (UID: \"ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55\") " pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:13.995923 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:13.995769 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-metrics-certs\") pod \"network-metrics-daemon-6k5sj\" (UID: \"941f2a27-1f4c-400e-a50e-8a541e5fb4a7\") " pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:31:13.995923 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:13.995874 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:31:13.995923 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:13.995919 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-metrics-certs podName:941f2a27-1f4c-400e-a50e-8a541e5fb4a7 nodeName:}" failed. No retries permitted until 2026-06-11 16:31:14.995905519 +0000 UTC m=+3.064175534 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-metrics-certs") pod "network-metrics-daemon-6k5sj" (UID: "941f2a27-1f4c-400e-a50e-8a541e5fb4a7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:31:13.996180 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:13.996160 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:31:13.996248 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:13.996220 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55-original-pull-secret podName:ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55 nodeName:}" failed. No retries permitted until 2026-06-11 16:31:14.996203298 +0000 UTC m=+3.064473312 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55-original-pull-secret") pod "global-pull-secret-syncer-qxtrm" (UID: "ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:31:14.096227 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:14.096040 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tspws\" (UniqueName: \"kubernetes.io/projected/660244a3-e67d-45a0-9d14-c3fcb18359a0-kube-api-access-tspws\") pod \"network-check-target-86g9g\" (UID: \"660244a3-e67d-45a0-9d14-c3fcb18359a0\") " pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:31:14.096398 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:14.096254 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:31:14.096398 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:14.096274 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:31:14.096398 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:14.096287 2569 projected.go:196] Error preparing data for projected volume kube-api-access-tspws for pod openshift-network-diagnostics/network-check-target-86g9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:31:14.096398 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:14.096344 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/660244a3-e67d-45a0-9d14-c3fcb18359a0-kube-api-access-tspws podName:660244a3-e67d-45a0-9d14-c3fcb18359a0 nodeName:}" failed. No retries permitted until 2026-06-11 16:31:15.096325925 +0000 UTC m=+3.164595960 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tspws" (UniqueName: "kubernetes.io/projected/660244a3-e67d-45a0-9d14-c3fcb18359a0-kube-api-access-tspws") pod "network-check-target-86g9g" (UID: "660244a3-e67d-45a0-9d14-c3fcb18359a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:31:14.330795 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:14.330613 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 16:26:13 +0000 UTC" deadline="2028-03-29 06:58:40.523062164 +0000 UTC" Jun 11 16:31:14.330795 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:14.330680 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15758h27m26.192386374s" Jun 11 16:31:14.386780 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:14.386631 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dnvld" event={"ID":"3808b309-e3c4-4a93-925e-e03168b6a441","Type":"ContainerStarted","Data":"69e91643fcca953aa0c77f7c2a7f76e6ea7edc32437f188f23c8138ece3dac4c"} Jun 11 16:31:14.397625 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:14.397591 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9b4fn" event={"ID":"05d7ab71-df16-4a99-b2a4-079bf348f7fc","Type":"ContainerStarted","Data":"3bcd511c86b3158f0b076d71f42b606bc893578634a1b2823aece036bbf0822a"} Jun 11 16:31:14.415144 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:14.415109 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qd4kp" event={"ID":"ba7c0e9d-aed3-4fd4-89ba-3f1bbb7f5867","Type":"ContainerStarted","Data":"bad3136941dfc501dab6aece85ae1d4b6649f4aa7e0b35f5af32d38b77af37cd"} Jun 11 16:31:14.432406 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:14.432366 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.ec2.internal" event={"ID":"8d32b9be67804624fdd87ae52fa473dd","Type":"ContainerStarted","Data":"2769c509bf48db9f74d4cb4fedc0135b264ff459b7690b3564e0c4e2d93966f2"} Jun 11 16:31:14.436578 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:14.436521 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lvfpt" event={"ID":"2ac98822-4208-4aec-9b86-0bc5aecbd145","Type":"ContainerStarted","Data":"4e0755a5f288fa3575e93d89bc78b190ba0bea207bd150951de0909f3242462c"} Jun 11 16:31:14.442440 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:14.442408 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8h74q" event={"ID":"66a0433d-006a-4974-960f-30704fb9949d","Type":"ContainerStarted","Data":"6dcafd7c11bfdeb5466394bf6bccf61c8e9fab6a9986cc4b2fba7dc75dd13a94"} Jun 11 16:31:14.453125 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:14.453099 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sdlpn" event={"ID":"dac311a1-e919-4bbe-825a-621ae8045c7c","Type":"ContainerStarted","Data":"bc98ff10d888a805291ee0011fa99abb27617ba51877200a6dc29934c759abce"} Jun 11 16:31:14.473515 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:14.473476 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" event={"ID":"9719af52-db4f-4e83-83e9-070c2ed86687","Type":"ContainerStarted","Data":"e278e660698de2c7739e83b340b78513c76220f6f2df227a87ab359c2610fbb1"} Jun 11 16:31:14.505966 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:14.505665 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-829vm" event={"ID":"06cfb41e-30d2-4adf-b24d-84281d21e078","Type":"ContainerStarted","Data":"7be326a840dc04620b9769b43c7d775ce04d9e4590a9f9879bdbc6147a0ab4e2"} Jun 11 16:31:14.529819 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:14.529378 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-188.ec2.internal" event={"ID":"39f5ba962028041c64db3920f82c6d5e","Type":"ContainerStarted","Data":"e18ddfe23974eb1482c38410747d628f77637436983ec1d16deb2e3cd8234cd1"} Jun 11 16:31:14.563220 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:14.562494 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7vskf" event={"ID":"faa4a854-0eca-4d38-9ce1-5fcf03623d6b","Type":"ContainerStarted","Data":"46d572f09c18bc5cfdb2f9982737764d5ecb6bf3bd7746aa78f7dd4536a088c4"} Jun 11 16:31:14.664411 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:14.664269 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:31:14.983957 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:14.983927 2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:31:15.003966 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:15.003929 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55-original-pull-secret\") pod \"global-pull-secret-syncer-qxtrm\" (UID: \"ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55\") " pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:15.004158 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:15.003995 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-metrics-certs\") pod \"network-metrics-daemon-6k5sj\" (UID: \"941f2a27-1f4c-400e-a50e-8a541e5fb4a7\") " pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:31:15.004226 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:15.004196 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:31:15.004280 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:15.004269 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-metrics-certs podName:941f2a27-1f4c-400e-a50e-8a541e5fb4a7 nodeName:}" failed. No retries permitted until 2026-06-11 16:31:17.00424921 +0000 UTC m=+5.072519239 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-metrics-certs") pod "network-metrics-daemon-6k5sj" (UID: "941f2a27-1f4c-400e-a50e-8a541e5fb4a7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:31:15.004730 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:15.004708 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:31:15.004839 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:15.004763 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55-original-pull-secret podName:ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55 nodeName:}" failed. No retries permitted until 2026-06-11 16:31:17.004748941 +0000 UTC m=+5.073018969 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55-original-pull-secret") pod "global-pull-secret-syncer-qxtrm" (UID: "ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:31:15.105361 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:15.104682 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tspws\" (UniqueName: \"kubernetes.io/projected/660244a3-e67d-45a0-9d14-c3fcb18359a0-kube-api-access-tspws\") pod \"network-check-target-86g9g\" (UID: \"660244a3-e67d-45a0-9d14-c3fcb18359a0\") " pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:31:15.105361 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:15.104865 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:31:15.105361 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:15.104886 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:31:15.105361 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:15.104899 2569 projected.go:196] Error preparing data for projected volume kube-api-access-tspws for pod openshift-network-diagnostics/network-check-target-86g9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:31:15.105361 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:15.104956 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/660244a3-e67d-45a0-9d14-c3fcb18359a0-kube-api-access-tspws podName:660244a3-e67d-45a0-9d14-c3fcb18359a0 nodeName:}" failed. No retries permitted until 2026-06-11 16:31:17.104938818 +0000 UTC m=+5.173208853 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tspws" (UniqueName: "kubernetes.io/projected/660244a3-e67d-45a0-9d14-c3fcb18359a0-kube-api-access-tspws") pod "network-check-target-86g9g" (UID: "660244a3-e67d-45a0-9d14-c3fcb18359a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:31:15.331566 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:15.331470 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 16:26:13 +0000 UTC" deadline="2028-02-19 19:01:20.567291492 +0000 UTC" Jun 11 16:31:15.331566 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:15.331517 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14834h30m5.235779297s" Jun 11 16:31:15.356098 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:15.356073 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:31:15.356241 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:15.356195 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86g9g" podUID="660244a3-e67d-45a0-9d14-c3fcb18359a0" Jun 11 16:31:15.356648 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:15.356626 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:31:15.356750 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:15.356730 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6k5sj" podUID="941f2a27-1f4c-400e-a50e-8a541e5fb4a7" Jun 11 16:31:15.356811 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:15.356795 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:15.356882 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:15.356864 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxtrm" podUID="ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55" Jun 11 16:31:17.024270 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:17.024233 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55-original-pull-secret\") pod \"global-pull-secret-syncer-qxtrm\" (UID: \"ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55\") " pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:17.024820 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:17.024321 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-metrics-certs\") pod \"network-metrics-daemon-6k5sj\" (UID: \"941f2a27-1f4c-400e-a50e-8a541e5fb4a7\") " pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:31:17.024820 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:17.024424 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:31:17.024820 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:17.024459 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:31:17.024820 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:17.024496 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55-original-pull-secret podName:ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55 nodeName:}" failed. No retries permitted until 2026-06-11 16:31:21.024476913 +0000 UTC m=+9.092746930 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55-original-pull-secret") pod "global-pull-secret-syncer-qxtrm" (UID: "ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:31:17.024820 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:17.024515 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-metrics-certs podName:941f2a27-1f4c-400e-a50e-8a541e5fb4a7 nodeName:}" failed. No retries permitted until 2026-06-11 16:31:21.024506067 +0000 UTC m=+9.092776085 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-metrics-certs") pod "network-metrics-daemon-6k5sj" (UID: "941f2a27-1f4c-400e-a50e-8a541e5fb4a7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:31:17.125707 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:17.125659 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tspws\" (UniqueName: \"kubernetes.io/projected/660244a3-e67d-45a0-9d14-c3fcb18359a0-kube-api-access-tspws\") pod \"network-check-target-86g9g\" (UID: \"660244a3-e67d-45a0-9d14-c3fcb18359a0\") " pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:31:17.125922 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:17.125903 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:31:17.126042 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:17.125928 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:31:17.126042 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:17.125941 2569 projected.go:196] Error preparing data for projected volume kube-api-access-tspws for pod openshift-network-diagnostics/network-check-target-86g9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:31:17.126042 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:17.126018 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/660244a3-e67d-45a0-9d14-c3fcb18359a0-kube-api-access-tspws podName:660244a3-e67d-45a0-9d14-c3fcb18359a0 nodeName:}" failed. No retries permitted until 2026-06-11 16:31:21.12600105 +0000 UTC m=+9.194271069 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tspws" (UniqueName: "kubernetes.io/projected/660244a3-e67d-45a0-9d14-c3fcb18359a0-kube-api-access-tspws") pod "network-check-target-86g9g" (UID: "660244a3-e67d-45a0-9d14-c3fcb18359a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:31:17.355475 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:17.355398 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:17.355475 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:17.355429 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:31:17.355475 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:17.355438 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:31:17.355713 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:17.355543 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxtrm" podUID="ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55" Jun 11 16:31:17.355713 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:17.355640 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86g9g" podUID="660244a3-e67d-45a0-9d14-c3fcb18359a0" Jun 11 16:31:17.355784 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:17.355747 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6k5sj" podUID="941f2a27-1f4c-400e-a50e-8a541e5fb4a7" Jun 11 16:31:19.355913 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:19.355876 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:31:19.356388 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:19.356005 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86g9g" podUID="660244a3-e67d-45a0-9d14-c3fcb18359a0" Jun 11 16:31:19.356466 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:19.356454 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:31:19.356593 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:19.356563 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6k5sj" podUID="941f2a27-1f4c-400e-a50e-8a541e5fb4a7" Jun 11 16:31:19.356715 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:19.356625 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:19.356715 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:19.356697 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxtrm" podUID="ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55" Jun 11 16:31:21.061772 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:21.061733 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55-original-pull-secret\") pod \"global-pull-secret-syncer-qxtrm\" (UID: \"ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55\") " pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:21.062266 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:21.061799 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-metrics-certs\") pod \"network-metrics-daemon-6k5sj\" (UID: \"941f2a27-1f4c-400e-a50e-8a541e5fb4a7\") " pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:31:21.062266 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:21.061948 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:31:21.062266 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:21.062009 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-metrics-certs podName:941f2a27-1f4c-400e-a50e-8a541e5fb4a7 nodeName:}" failed. No retries permitted until 2026-06-11 16:31:29.06198927 +0000 UTC m=+17.130259289 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-metrics-certs") pod "network-metrics-daemon-6k5sj" (UID: "941f2a27-1f4c-400e-a50e-8a541e5fb4a7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:31:21.062266 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:21.062162 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:31:21.062266 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:21.062219 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55-original-pull-secret podName:ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55 nodeName:}" failed. No retries permitted until 2026-06-11 16:31:29.062204295 +0000 UTC m=+17.130474312 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55-original-pull-secret") pod "global-pull-secret-syncer-qxtrm" (UID: "ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:31:21.163011 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:21.162964 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tspws\" (UniqueName: \"kubernetes.io/projected/660244a3-e67d-45a0-9d14-c3fcb18359a0-kube-api-access-tspws\") pod \"network-check-target-86g9g\" (UID: \"660244a3-e67d-45a0-9d14-c3fcb18359a0\") " pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:31:21.163212 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:21.163164 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:31:21.163212 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:21.163187 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:31:21.163212 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:21.163202 2569 projected.go:196] Error preparing data for projected volume kube-api-access-tspws for pod openshift-network-diagnostics/network-check-target-86g9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:31:21.163374 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:21.163257 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/660244a3-e67d-45a0-9d14-c3fcb18359a0-kube-api-access-tspws podName:660244a3-e67d-45a0-9d14-c3fcb18359a0 nodeName:}" failed. No retries permitted until 2026-06-11 16:31:29.163239246 +0000 UTC m=+17.231509266 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tspws" (UniqueName: "kubernetes.io/projected/660244a3-e67d-45a0-9d14-c3fcb18359a0-kube-api-access-tspws") pod "network-check-target-86g9g" (UID: "660244a3-e67d-45a0-9d14-c3fcb18359a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:31:21.355430 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:21.355353 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:21.355430 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:21.355383 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:31:21.355676 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:21.355494 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxtrm" podUID="ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55" Jun 11 16:31:21.355676 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:21.355569 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86g9g" podUID="660244a3-e67d-45a0-9d14-c3fcb18359a0" Jun 11 16:31:21.355676 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:21.355602 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:31:21.355794 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:21.355710 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6k5sj" podUID="941f2a27-1f4c-400e-a50e-8a541e5fb4a7" Jun 11 16:31:23.355733 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:23.355693 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:31:23.356194 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:23.355816 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86g9g" podUID="660244a3-e67d-45a0-9d14-c3fcb18359a0" Jun 11 16:31:23.356194 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:23.355894 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:31:23.356194 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:23.355972 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6k5sj" podUID="941f2a27-1f4c-400e-a50e-8a541e5fb4a7" Jun 11 16:31:23.356194 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:23.356009 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:23.356194 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:23.356076 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxtrm" podUID="ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55" Jun 11 16:31:25.356040 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:25.356003 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:25.356506 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:25.356122 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:31:25.356506 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:25.356157 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:31:25.356506 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:25.356134 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxtrm" podUID="ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55" Jun 11 16:31:25.356506 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:25.356284 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86g9g" podUID="660244a3-e67d-45a0-9d14-c3fcb18359a0" Jun 11 16:31:25.356506 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:25.356396 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6k5sj" podUID="941f2a27-1f4c-400e-a50e-8a541e5fb4a7" Jun 11 16:31:27.355800 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:27.355767 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:31:27.356257 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:27.355767 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:27.356257 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:27.355880 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6k5sj" podUID="941f2a27-1f4c-400e-a50e-8a541e5fb4a7" Jun 11 16:31:27.356257 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:27.355967 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxtrm" podUID="ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55" Jun 11 16:31:27.356257 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:27.355767 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:31:27.356257 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:27.356063 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86g9g" podUID="660244a3-e67d-45a0-9d14-c3fcb18359a0" Jun 11 16:31:29.122596 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:29.122560 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55-original-pull-secret\") pod \"global-pull-secret-syncer-qxtrm\" (UID: \"ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55\") " pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:29.123046 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:29.122616 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-metrics-certs\") pod \"network-metrics-daemon-6k5sj\" (UID: \"941f2a27-1f4c-400e-a50e-8a541e5fb4a7\") " pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:31:29.123046 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:29.122708 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:31:29.123046 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:29.122765 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55-original-pull-secret podName:ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55 nodeName:}" failed. No retries permitted until 2026-06-11 16:31:45.122750403 +0000 UTC m=+33.191020419 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55-original-pull-secret") pod "global-pull-secret-syncer-qxtrm" (UID: "ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:31:29.123046 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:29.122708 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:31:29.123046 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:29.122799 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-metrics-certs podName:941f2a27-1f4c-400e-a50e-8a541e5fb4a7 nodeName:}" failed. No retries permitted until 2026-06-11 16:31:45.122791298 +0000 UTC m=+33.191061315 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-metrics-certs") pod "network-metrics-daemon-6k5sj" (UID: "941f2a27-1f4c-400e-a50e-8a541e5fb4a7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:31:29.223625 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:29.223584 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tspws\" (UniqueName: \"kubernetes.io/projected/660244a3-e67d-45a0-9d14-c3fcb18359a0-kube-api-access-tspws\") pod \"network-check-target-86g9g\" (UID: \"660244a3-e67d-45a0-9d14-c3fcb18359a0\") " pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:31:29.223830 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:29.223809 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:31:29.223874 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:29.223838 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:31:29.223874 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:29.223853 2569 projected.go:196] Error preparing data for projected volume kube-api-access-tspws for pod openshift-network-diagnostics/network-check-target-86g9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:31:29.223973 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:29.223912 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/660244a3-e67d-45a0-9d14-c3fcb18359a0-kube-api-access-tspws podName:660244a3-e67d-45a0-9d14-c3fcb18359a0 nodeName:}" failed. No retries permitted until 2026-06-11 16:31:45.223893233 +0000 UTC m=+33.292163256 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tspws" (UniqueName: "kubernetes.io/projected/660244a3-e67d-45a0-9d14-c3fcb18359a0-kube-api-access-tspws") pod "network-check-target-86g9g" (UID: "660244a3-e67d-45a0-9d14-c3fcb18359a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:31:29.355952 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:29.355917 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:29.355952 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:29.355945 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:31:29.356243 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:29.356044 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxtrm" podUID="ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55" Jun 11 16:31:29.356243 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:29.356100 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:31:29.356243 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:29.356226 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6k5sj" podUID="941f2a27-1f4c-400e-a50e-8a541e5fb4a7" Jun 11 16:31:29.356379 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:29.356311 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86g9g" podUID="660244a3-e67d-45a0-9d14-c3fcb18359a0" Jun 11 16:31:31.356487 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:31.355804 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:31.356487 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:31.355843 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:31:31.356487 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:31.355857 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:31:31.356487 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:31.355936 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxtrm" podUID="ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55" Jun 11 16:31:31.356487 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:31.356018 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86g9g" podUID="660244a3-e67d-45a0-9d14-c3fcb18359a0" Jun 11 16:31:31.356487 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:31.356441 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6k5sj" podUID="941f2a27-1f4c-400e-a50e-8a541e5fb4a7" Jun 11 16:31:33.355188 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:33.355154 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:31:33.355729 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:33.355154 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:31:33.355729 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:33.355280 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6k5sj" podUID="941f2a27-1f4c-400e-a50e-8a541e5fb4a7" Jun 11 16:31:33.355729 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:33.355313 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86g9g" podUID="660244a3-e67d-45a0-9d14-c3fcb18359a0" Jun 11 16:31:33.355729 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:33.355169 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:33.355729 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:33.355392 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxtrm" podUID="ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55" Jun 11 16:31:34.610781 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:34.610638 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" event={"ID":"9719af52-db4f-4e83-83e9-070c2ed86687","Type":"ContainerStarted","Data":"b24eb56360fe85ed79a8041d0b2a8972fefe007cc9bc8efe8bd9de08a3fe67bf"} Jun 11 16:31:34.613279 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:34.613124 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-188.ec2.internal" event={"ID":"39f5ba962028041c64db3920f82c6d5e","Type":"ContainerStarted","Data":"454e30e641e80b106a893c8cdef2c12de943d1ee9cab2c2b5238085a25442266"} Jun 11 16:31:34.618755 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:34.618491 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7vskf" event={"ID":"faa4a854-0eca-4d38-9ce1-5fcf03623d6b","Type":"ContainerStarted","Data":"fa1d46003ac24d6f88f1c42dfae6d8395482e165e0ae94a339a9c28b53ce3c77"} Jun 11 16:31:34.624552 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:34.624518 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dnvld" event={"ID":"3808b309-e3c4-4a93-925e-e03168b6a441","Type":"ContainerStarted","Data":"835af2fc8f254797e5c982a3ed0f5e7fb761a8ac24c0b266724ef5a1e9fb5364"} Jun 11 16:31:34.630865 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:34.630807 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-188.ec2.internal" podStartSLOduration=21.630790312 podStartE2EDuration="21.630790312s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:31:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:31:34.626356322 +0000 UTC m=+22.694626357" watchObservedRunningTime="2026-06-11 16:31:34.630790312 +0000 UTC m=+22.699060381" Jun 11 16:31:34.642740 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:34.642648 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dnvld" podStartSLOduration=2.033253087 podStartE2EDuration="22.642636596s" totalImagesPullingTime="20.609383509s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:31:34.642598103 +0000 UTC m=+22.710868138" watchObservedRunningTime="2026-06-11 16:31:34.642636596 +0000 UTC m=+22.710906633" Jun 11 16:31:35.356240 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:35.355965 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:31:35.356454 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:35.355977 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:35.356454 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:35.356277 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6k5sj" podUID="941f2a27-1f4c-400e-a50e-8a541e5fb4a7" Jun 11 16:31:35.356454 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:35.356014 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:31:35.356454 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:35.356375 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxtrm" podUID="ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55" Jun 11 16:31:35.356454 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:35.356428 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86g9g" podUID="660244a3-e67d-45a0-9d14-c3fcb18359a0" Jun 11 16:31:35.628645 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:35.628547 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lvfpt" event={"ID":"2ac98822-4208-4aec-9b86-0bc5aecbd145","Type":"ContainerStarted","Data":"f9a93c992ebcdb04a29d7e430a44a9e7ede8746b42fd290aa82047f8a7a4122c"} Jun 11 16:31:35.630117 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:35.630076 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8h74q" event={"ID":"66a0433d-006a-4974-960f-30704fb9949d","Type":"ContainerStarted","Data":"b36f17cf027b2484a56aaff2b522cee096be11912094e2ac945bf1f73c71ea6a"} Jun 11 16:31:35.631715 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:35.631689 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sdlpn" event={"ID":"dac311a1-e919-4bbe-825a-621ae8045c7c","Type":"ContainerStarted","Data":"3c29c07e8e3db4b5cbe7d4387e910cc5b8b5a682daaecb80bcaf3783cdd9e3ec"} Jun 11 16:31:35.634985 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:35.634950 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" event={"ID":"9719af52-db4f-4e83-83e9-070c2ed86687","Type":"ContainerStarted","Data":"4593ec5c28d7123e9af0e074a67ee5f04455d01a9c9a32d958ac02c80f585f5a"} Jun 11 16:31:35.635119 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:35.635018 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" event={"ID":"9719af52-db4f-4e83-83e9-070c2ed86687","Type":"ContainerStarted","Data":"52572152f937cf7ac76edabcc7f789c802576a1b8cb13584987da08be0417247"} Jun 11 16:31:35.635119 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:35.635076 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" event={"ID":"9719af52-db4f-4e83-83e9-070c2ed86687","Type":"ContainerStarted","Data":"ceb287990aed2abb7767ea14aaaea7ade30143c8295263d43460417b5acc9ac7"} Jun 11 16:31:35.635119 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:35.635119 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" event={"ID":"9719af52-db4f-4e83-83e9-070c2ed86687","Type":"ContainerStarted","Data":"8b3f79e143a5a3b262f7a7a081d40b3627fda87bc87fe05f492440bca8ae8df2"} Jun 11 16:31:35.635274 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:35.635149 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" event={"ID":"9719af52-db4f-4e83-83e9-070c2ed86687","Type":"ContainerStarted","Data":"77534b44c51716992494373adb5a775226fc3a9448559e569af2dc124ce137f9"} Jun 11 16:31:35.636746 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:35.636714 2569 generic.go:356] "Generic (PLEG): container finished" podID="06cfb41e-30d2-4adf-b24d-84281d21e078" containerID="32deb2bbc7b81b0d8262009e36ca7a46474d2fb378e8254feeb152a600cb384c" exitCode=0 Jun 11 16:31:35.636839 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:35.636797 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-829vm" event={"ID":"06cfb41e-30d2-4adf-b24d-84281d21e078","Type":"ContainerDied","Data":"32deb2bbc7b81b0d8262009e36ca7a46474d2fb378e8254feeb152a600cb384c"} Jun 11 16:31:35.638460 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:35.638413 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9b4fn" event={"ID":"05d7ab71-df16-4a99-b2a4-079bf348f7fc","Type":"ContainerStarted","Data":"f2c54b08477e6894243b4f5c238e9d53187bfee3a9b4cab182a1b980e6e48a8f"} Jun 11 16:31:35.640106 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:35.640086 2569 generic.go:356] "Generic (PLEG): container finished" podID="8d32b9be67804624fdd87ae52fa473dd" containerID="ba9b6ab78a5896066e59f762b266e2792027fe03ff6f48a95892c217e0462b59" exitCode=0 Jun 11 16:31:35.640219 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:35.640179 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.ec2.internal" event={"ID":"8d32b9be67804624fdd87ae52fa473dd","Type":"ContainerDied","Data":"ba9b6ab78a5896066e59f762b266e2792027fe03ff6f48a95892c217e0462b59"} Jun 11 16:31:35.645508 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:35.645473 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lvfpt" podStartSLOduration=3.048551295 podStartE2EDuration="23.64546137s" totalImagesPullingTime="20.596910075s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:31:35.645202968 +0000 UTC m=+23.713473005" watchObservedRunningTime="2026-06-11 16:31:35.64546137 +0000 UTC m=+23.713731406" Jun 11 16:31:35.645598 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:35.645535 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7vskf" podStartSLOduration=2.920870628 podStartE2EDuration="23.645531784s" totalImagesPullingTime="20.724661156s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:31:34.662327177 +0000 UTC m=+22.730597212" watchObservedRunningTime="2026-06-11 16:31:35.645531784 +0000 UTC m=+23.713801819" Jun 11 16:31:35.658771 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:35.658734 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sdlpn" podStartSLOduration=2.9712822169999997 podStartE2EDuration="23.658719368s" totalImagesPullingTime="20.687437151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:31:35.658694876 +0000 UTC m=+23.726964912" watchObservedRunningTime="2026-06-11 16:31:35.658719368 +0000 UTC m=+23.726989398" Jun 11 16:31:35.673162 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:35.673124 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8h74q" podStartSLOduration=2.9976158699999997 podStartE2EDuration="23.673110421s" totalImagesPullingTime="20.675494551s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:31:35.672630953 +0000 UTC m=+23.740900988" watchObservedRunningTime="2026-06-11 16:31:35.673110421 +0000 UTC m=+23.741380457" Jun 11 16:31:35.956789 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:35.956619 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sdlpn" Jun 11 16:31:35.957331 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:35.957310 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sdlpn" Jun 11 16:31:36.230432 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:36.230390 2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 16:31:36.346380 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:36.346280 2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T16:31:36.230414976Z","UUID":"f24ef218-6ade-4a36-9ead-d6bdef4775ca","Handler":null,"Name":"","Endpoint":""} Jun 11 16:31:36.348013 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:36.347992 2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 16:31:36.348013 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:36.348029 2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 16:31:36.644967 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:36.644929 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.ec2.internal" event={"ID":"8d32b9be67804624fdd87ae52fa473dd","Type":"ContainerStarted","Data":"991f3f6bedc6bc6d0ae7b79fbf312f075978cc9383b6c31f457ffcc1d61f3e51"} Jun 11 16:31:36.647402 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:36.647376 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9b4fn" event={"ID":"05d7ab71-df16-4a99-b2a4-079bf348f7fc","Type":"ContainerStarted","Data":"b0c8e10e60b25f485dc1662cdec264c58776870463cfcbd7d8a968db812f06ca"} Jun 11 16:31:36.650373 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:36.650173 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qd4kp" event={"ID":"ba7c0e9d-aed3-4fd4-89ba-3f1bbb7f5867","Type":"ContainerStarted","Data":"c1c32c12ac691a9260e8a739adc0435bc249b568fbfdf4a342ac0147c1a1174d"} Jun 11 16:31:36.650769 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:36.650747 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sdlpn" Jun 11 16:31:36.650886 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:36.650800 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sdlpn" Jun 11 16:31:36.660218 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:36.660178 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-188.ec2.internal" podStartSLOduration=23.660164752 podStartE2EDuration="23.660164752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:31:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:31:36.659323028 +0000 UTC m=+24.727593067" watchObservedRunningTime="2026-06-11 16:31:36.660164752 +0000 UTC m=+24.728434789" Jun 11 16:31:36.672750 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:36.672709 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qd4kp" podStartSLOduration=3.952712601 podStartE2EDuration="24.672697769s" totalImagesPullingTime="20.719985168s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:31:36.672354297 +0000 UTC m=+24.740624332" watchObservedRunningTime="2026-06-11 16:31:36.672697769 +0000 UTC m=+24.740967804" Jun 11 16:31:37.355570 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:37.355535 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:37.355570 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:37.355573 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:31:37.355797 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:37.355535 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:31:37.355797 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:37.355673 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxtrm" podUID="ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55" Jun 11 16:31:37.355797 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:37.355761 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6k5sj" podUID="941f2a27-1f4c-400e-a50e-8a541e5fb4a7" Jun 11 16:31:37.355912 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:37.355838 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86g9g" podUID="660244a3-e67d-45a0-9d14-c3fcb18359a0" Jun 11 16:31:37.653265 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:37.653231 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9b4fn" event={"ID":"05d7ab71-df16-4a99-b2a4-079bf348f7fc","Type":"ContainerStarted","Data":"e0d0e72a67e8c839677b87cef16e59ea69ee2d3441e0092cd6b78bdfd6a8191c"} Jun 11 16:31:37.656474 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:37.656446 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" event={"ID":"9719af52-db4f-4e83-83e9-070c2ed86687","Type":"ContainerStarted","Data":"cdb0ae14628e561a10f65a5a5bb510f8e940723fe8be48d4a047fee1b9f726d8"} Jun 11 16:31:37.675321 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:37.675266 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9b4fn" podStartSLOduration=3.079061784 podStartE2EDuration="25.675251872s" totalImagesPullingTime="22.596190088s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:31:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:31:37.674755859 +0000 UTC m=+25.743025902" watchObservedRunningTime="2026-06-11 16:31:37.675251872 +0000 UTC m=+25.743521946" Jun 11 16:31:39.355551 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:39.355518 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:31:39.356253 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:39.355559 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:31:39.356253 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:39.355632 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86g9g" podUID="660244a3-e67d-45a0-9d14-c3fcb18359a0" Jun 11 16:31:39.356253 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:39.355706 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:39.356253 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:39.355813 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6k5sj" podUID="941f2a27-1f4c-400e-a50e-8a541e5fb4a7" Jun 11 16:31:39.356253 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:39.355892 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxtrm" podUID="ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55" Jun 11 16:31:41.355669 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:41.355431 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:31:41.356151 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:41.355434 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:41.356151 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:41.355727 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86g9g" podUID="660244a3-e67d-45a0-9d14-c3fcb18359a0" Jun 11 16:31:41.356151 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:41.355463 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:31:41.356151 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:41.355792 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxtrm" podUID="ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55" Jun 11 16:31:41.356151 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:41.355870 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6k5sj" podUID="941f2a27-1f4c-400e-a50e-8a541e5fb4a7" Jun 11 16:31:41.668348 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:41.668322 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" event={"ID":"9719af52-db4f-4e83-83e9-070c2ed86687","Type":"ContainerStarted","Data":"f2b4df27e4dae381b9d919a1c05e17bdd1665b320d4faefb0ba90c470ac14c6e"} Jun 11 16:31:41.668572 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:41.668554 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:41.670195 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:41.670161 2569 generic.go:356] "Generic (PLEG): container finished" podID="06cfb41e-30d2-4adf-b24d-84281d21e078" containerID="3d901189f3b50b7ffb3af1b1fed86ee0b6d8c2935e875a7539916be2b2c7e034" exitCode=0 Jun 11 16:31:41.670303 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:41.670208 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-829vm" event={"ID":"06cfb41e-30d2-4adf-b24d-84281d21e078","Type":"ContainerDied","Data":"3d901189f3b50b7ffb3af1b1fed86ee0b6d8c2935e875a7539916be2b2c7e034"} Jun 11 16:31:41.686067 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:41.686032 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:41.695031 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:41.694986 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" podStartSLOduration=8.974925847 podStartE2EDuration="29.694972937s" totalImagesPullingTime="20.72004709s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:31:41.694798688 +0000 UTC m=+29.763068720" watchObservedRunningTime="2026-06-11 16:31:41.694972937 +0000 UTC m=+29.763242973" Jun 11 16:31:42.675644 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:42.675433 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-829vm" event={"ID":"06cfb41e-30d2-4adf-b24d-84281d21e078","Type":"ContainerStarted","Data":"3307f1893d9fa2a9217acaf268666d12881e44877549cd7744b096892ac0be42"} Jun 11 16:31:42.676325 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:42.675699 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:42.676325 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:42.676217 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:42.691801 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:42.691780 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:31:42.832081 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:42.831975 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qxtrm"] Jun 11 16:31:42.832228 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:42.832141 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:42.832278 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:42.832223 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxtrm" podUID="ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55" Jun 11 16:31:42.834696 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:42.834660 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-86g9g"] Jun 11 16:31:42.834829 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:42.834773 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:31:42.834898 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:42.834859 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86g9g" podUID="660244a3-e67d-45a0-9d14-c3fcb18359a0" Jun 11 16:31:42.835489 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:42.835461 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6k5sj"] Jun 11 16:31:42.835645 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:42.835583 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:31:42.835708 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:42.835692 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6k5sj" podUID="941f2a27-1f4c-400e-a50e-8a541e5fb4a7" Jun 11 16:31:43.679301 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:43.679267 2569 generic.go:356] "Generic (PLEG): container finished" podID="06cfb41e-30d2-4adf-b24d-84281d21e078" containerID="3307f1893d9fa2a9217acaf268666d12881e44877549cd7744b096892ac0be42" exitCode=0 Jun 11 16:31:43.679759 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:43.679350 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-829vm" event={"ID":"06cfb41e-30d2-4adf-b24d-84281d21e078","Type":"ContainerDied","Data":"3307f1893d9fa2a9217acaf268666d12881e44877549cd7744b096892ac0be42"} Jun 11 16:31:44.358241 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:44.358167 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:44.358376 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:44.358171 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:31:44.358376 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:44.358263 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxtrm" podUID="ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55" Jun 11 16:31:44.358376 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:44.358171 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:31:44.358376 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:44.358348 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6k5sj" podUID="941f2a27-1f4c-400e-a50e-8a541e5fb4a7" Jun 11 16:31:44.358522 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:44.358399 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86g9g" podUID="660244a3-e67d-45a0-9d14-c3fcb18359a0" Jun 11 16:31:45.152461 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:45.152426 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-metrics-certs\") pod \"network-metrics-daemon-6k5sj\" (UID: \"941f2a27-1f4c-400e-a50e-8a541e5fb4a7\") " pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:31:45.152944 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:45.152533 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55-original-pull-secret\") pod \"global-pull-secret-syncer-qxtrm\" (UID: \"ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55\") " pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:45.152944 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:45.152563 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:31:45.152944 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:45.152624 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-metrics-certs podName:941f2a27-1f4c-400e-a50e-8a541e5fb4a7 nodeName:}" failed. No retries permitted until 2026-06-11 16:32:17.152610012 +0000 UTC m=+65.220880025 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-metrics-certs") pod "network-metrics-daemon-6k5sj" (UID: "941f2a27-1f4c-400e-a50e-8a541e5fb4a7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:31:45.152944 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:45.152645 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:31:45.152944 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:45.152708 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55-original-pull-secret podName:ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55 nodeName:}" failed. No retries permitted until 2026-06-11 16:32:17.152692924 +0000 UTC m=+65.220962958 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55-original-pull-secret") pod "global-pull-secret-syncer-qxtrm" (UID: "ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:31:45.253344 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:45.253168 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tspws\" (UniqueName: \"kubernetes.io/projected/660244a3-e67d-45a0-9d14-c3fcb18359a0-kube-api-access-tspws\") pod \"network-check-target-86g9g\" (UID: \"660244a3-e67d-45a0-9d14-c3fcb18359a0\") " pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:31:45.253501 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:45.253321 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:31:45.253501 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:45.253407 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:31:45.253501 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:45.253418 2569 projected.go:196] Error preparing data for projected volume kube-api-access-tspws for pod openshift-network-diagnostics/network-check-target-86g9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:31:45.253501 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:45.253464 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/660244a3-e67d-45a0-9d14-c3fcb18359a0-kube-api-access-tspws podName:660244a3-e67d-45a0-9d14-c3fcb18359a0 nodeName:}" failed. No retries permitted until 2026-06-11 16:32:17.25345188 +0000 UTC m=+65.321721895 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tspws" (UniqueName: "kubernetes.io/projected/660244a3-e67d-45a0-9d14-c3fcb18359a0-kube-api-access-tspws") pod "network-check-target-86g9g" (UID: "660244a3-e67d-45a0-9d14-c3fcb18359a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:31:45.688956 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:45.688920 2569 generic.go:356] "Generic (PLEG): container finished" podID="06cfb41e-30d2-4adf-b24d-84281d21e078" containerID="ae4fbd0fb4f49ba20e2a5d19b57680d1a2a0acbc1664c9b3ca6a9c1ba78e9aa5" exitCode=0 Jun 11 16:31:45.689144 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:45.688985 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-829vm" event={"ID":"06cfb41e-30d2-4adf-b24d-84281d21e078","Type":"ContainerDied","Data":"ae4fbd0fb4f49ba20e2a5d19b57680d1a2a0acbc1664c9b3ca6a9c1ba78e9aa5"} Jun 11 16:31:46.355913 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:46.355865 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:31:46.356367 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:46.355874 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:46.356367 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:46.356013 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:31:46.356367 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:46.356013 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6k5sj" podUID="941f2a27-1f4c-400e-a50e-8a541e5fb4a7" Jun 11 16:31:46.356367 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:46.356155 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxtrm" podUID="ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55" Jun 11 16:31:46.356367 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:46.356225 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86g9g" podUID="660244a3-e67d-45a0-9d14-c3fcb18359a0" Jun 11 16:31:47.273276 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.273167 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-188.ec2.internal" event="NodeReady" Jun 11 16:31:47.273432 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.273323 2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 16:31:47.320224 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.320175 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lxkqq"] Jun 11 16:31:47.323205 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.323156 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-s2gvs"] Jun 11 16:31:47.323363 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.323252 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lxkqq" Jun 11 16:31:47.325819 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.325796 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 16:31:47.325968 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.325824 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 16:31:47.326086 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.326070 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hsnw5\"" Jun 11 16:31:47.326759 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.326739 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s2gvs" Jun 11 16:31:47.329159 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.329135 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 16:31:47.329305 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.329168 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 16:31:47.329305 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.329206 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 16:31:47.329305 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.329226 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6xqml\"" Jun 11 16:31:47.332164 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.331952 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s2gvs"] Jun 11 16:31:47.335319 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.335289 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lxkqq"] Jun 11 16:31:47.470598 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.470566 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-config-volume\") pod \"dns-default-lxkqq\" (UID: \"305a9021-ddf2-4eca-8df5-2fbe025ac9bd\") " pod="openshift-dns/dns-default-lxkqq" Jun 11 16:31:47.470598 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.470601 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8rwm\" (UniqueName: \"kubernetes.io/projected/6ba18fd1-dd09-45d8-81c7-8796fde2340e-kube-api-access-k8rwm\") pod \"ingress-canary-s2gvs\" (UID: \"6ba18fd1-dd09-45d8-81c7-8796fde2340e\") " pod="openshift-ingress-canary/ingress-canary-s2gvs" Jun 11 16:31:47.471074 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.470627 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-metrics-tls\") pod \"dns-default-lxkqq\" (UID: \"305a9021-ddf2-4eca-8df5-2fbe025ac9bd\") " pod="openshift-dns/dns-default-lxkqq" Jun 11 16:31:47.471074 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.470651 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-tmp-dir\") pod \"dns-default-lxkqq\" (UID: \"305a9021-ddf2-4eca-8df5-2fbe025ac9bd\") " pod="openshift-dns/dns-default-lxkqq" Jun 11 16:31:47.471074 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.470674 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwwvb\" (UniqueName: \"kubernetes.io/projected/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-kube-api-access-hwwvb\") pod \"dns-default-lxkqq\" (UID: \"305a9021-ddf2-4eca-8df5-2fbe025ac9bd\") " pod="openshift-dns/dns-default-lxkqq" Jun 11 16:31:47.471074 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.470714 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ba18fd1-dd09-45d8-81c7-8796fde2340e-cert\") pod \"ingress-canary-s2gvs\" (UID: \"6ba18fd1-dd09-45d8-81c7-8796fde2340e\") " pod="openshift-ingress-canary/ingress-canary-s2gvs" Jun 11 16:31:47.571415 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.571323 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8rwm\" (UniqueName: \"kubernetes.io/projected/6ba18fd1-dd09-45d8-81c7-8796fde2340e-kube-api-access-k8rwm\") pod \"ingress-canary-s2gvs\" (UID: \"6ba18fd1-dd09-45d8-81c7-8796fde2340e\") " pod="openshift-ingress-canary/ingress-canary-s2gvs" Jun 11 16:31:47.571415 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.571389 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-metrics-tls\") pod \"dns-default-lxkqq\" (UID: \"305a9021-ddf2-4eca-8df5-2fbe025ac9bd\") " pod="openshift-dns/dns-default-lxkqq" Jun 11 16:31:47.571639 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.571424 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-tmp-dir\") pod \"dns-default-lxkqq\" (UID: \"305a9021-ddf2-4eca-8df5-2fbe025ac9bd\") " pod="openshift-dns/dns-default-lxkqq" Jun 11 16:31:47.571639 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.571449 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwwvb\" (UniqueName: \"kubernetes.io/projected/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-kube-api-access-hwwvb\") pod \"dns-default-lxkqq\" (UID: \"305a9021-ddf2-4eca-8df5-2fbe025ac9bd\") " pod="openshift-dns/dns-default-lxkqq" Jun 11 16:31:47.571639 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.571473 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ba18fd1-dd09-45d8-81c7-8796fde2340e-cert\") pod \"ingress-canary-s2gvs\" (UID: \"6ba18fd1-dd09-45d8-81c7-8796fde2340e\") " pod="openshift-ingress-canary/ingress-canary-s2gvs" Jun 11 16:31:47.571639 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:47.571573 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:31:47.571760 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.571638 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-config-volume\") pod \"dns-default-lxkqq\" (UID: \"305a9021-ddf2-4eca-8df5-2fbe025ac9bd\") " pod="openshift-dns/dns-default-lxkqq" Jun 11 16:31:47.571760 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:47.571662 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-metrics-tls podName:305a9021-ddf2-4eca-8df5-2fbe025ac9bd nodeName:}" failed. No retries permitted until 2026-06-11 16:31:48.071638942 +0000 UTC m=+36.139908957 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-metrics-tls") pod "dns-default-lxkqq" (UID: "305a9021-ddf2-4eca-8df5-2fbe025ac9bd") : secret "dns-default-metrics-tls" not found Jun 11 16:31:47.571837 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.571807 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-tmp-dir\") pod \"dns-default-lxkqq\" (UID: \"305a9021-ddf2-4eca-8df5-2fbe025ac9bd\") " pod="openshift-dns/dns-default-lxkqq" Jun 11 16:31:47.572228 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.572206 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-config-volume\") pod \"dns-default-lxkqq\" (UID: \"305a9021-ddf2-4eca-8df5-2fbe025ac9bd\") " pod="openshift-dns/dns-default-lxkqq" Jun 11 16:31:47.577158 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.577129 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ba18fd1-dd09-45d8-81c7-8796fde2340e-cert\") pod \"ingress-canary-s2gvs\" (UID: \"6ba18fd1-dd09-45d8-81c7-8796fde2340e\") " pod="openshift-ingress-canary/ingress-canary-s2gvs" Jun 11 16:31:47.584980 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.584953 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwwvb\" (UniqueName: \"kubernetes.io/projected/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-kube-api-access-hwwvb\") pod \"dns-default-lxkqq\" (UID: \"305a9021-ddf2-4eca-8df5-2fbe025ac9bd\") " pod="openshift-dns/dns-default-lxkqq" Jun 11 16:31:47.586250 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.586224 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8rwm\" (UniqueName: \"kubernetes.io/projected/6ba18fd1-dd09-45d8-81c7-8796fde2340e-kube-api-access-k8rwm\") pod \"ingress-canary-s2gvs\" (UID: \"6ba18fd1-dd09-45d8-81c7-8796fde2340e\") " pod="openshift-ingress-canary/ingress-canary-s2gvs" Jun 11 16:31:47.643379 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.643342 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s2gvs" Jun 11 16:31:47.809067 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:47.809018 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s2gvs"] Jun 11 16:31:47.814012 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:31:47.813983 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ba18fd1_dd09_45d8_81c7_8796fde2340e.slice/crio-b843e86ce9e2b89bad763087f509777d61d9b9f62369c6a17dce1f3fb37af6bd WatchSource:0}: Error finding container b843e86ce9e2b89bad763087f509777d61d9b9f62369c6a17dce1f3fb37af6bd: Status 404 returned error can't find the container with id b843e86ce9e2b89bad763087f509777d61d9b9f62369c6a17dce1f3fb37af6bd Jun 11 16:31:48.076429 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:48.076396 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-metrics-tls\") pod \"dns-default-lxkqq\" (UID: \"305a9021-ddf2-4eca-8df5-2fbe025ac9bd\") " pod="openshift-dns/dns-default-lxkqq" Jun 11 16:31:48.076601 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:48.076533 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:31:48.076601 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:48.076593 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-metrics-tls podName:305a9021-ddf2-4eca-8df5-2fbe025ac9bd nodeName:}" failed. No retries permitted until 2026-06-11 16:31:49.076579941 +0000 UTC m=+37.144849958 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-metrics-tls") pod "dns-default-lxkqq" (UID: "305a9021-ddf2-4eca-8df5-2fbe025ac9bd") : secret "dns-default-metrics-tls" not found Jun 11 16:31:48.355926 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:48.355833 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:31:48.355926 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:48.355871 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:31:48.356191 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:48.355833 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:31:48.359823 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:48.359795 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 16:31:48.360086 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:48.360048 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 16:31:48.361626 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:48.361227 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6jw82\"" Jun 11 16:31:48.361626 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:48.361467 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 16:31:48.361810 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:48.361735 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l4qlb\"" Jun 11 16:31:48.362363 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:48.362260 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 16:31:48.699113 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:48.699073 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s2gvs" event={"ID":"6ba18fd1-dd09-45d8-81c7-8796fde2340e","Type":"ContainerStarted","Data":"b843e86ce9e2b89bad763087f509777d61d9b9f62369c6a17dce1f3fb37af6bd"} Jun 11 16:31:49.084360 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:49.084268 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-metrics-tls\") pod \"dns-default-lxkqq\" (UID: \"305a9021-ddf2-4eca-8df5-2fbe025ac9bd\") " pod="openshift-dns/dns-default-lxkqq" Jun 11 16:31:49.084521 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:49.084466 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:31:49.084572 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:49.084535 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-metrics-tls podName:305a9021-ddf2-4eca-8df5-2fbe025ac9bd nodeName:}" failed. No retries permitted until 2026-06-11 16:31:51.084517107 +0000 UTC m=+39.152787124 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-metrics-tls") pod "dns-default-lxkqq" (UID: "305a9021-ddf2-4eca-8df5-2fbe025ac9bd") : secret "dns-default-metrics-tls" not found Jun 11 16:31:50.711800 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:50.711535 2569 generic.go:356] "Generic (PLEG): container finished" podID="06cfb41e-30d2-4adf-b24d-84281d21e078" containerID="71fef614cfb1dba1aa81ebe08a7a6d78d2f83fd8fdb25ecf221ac1380dcfdc5d" exitCode=0 Jun 11 16:31:50.711800 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:50.711588 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-829vm" event={"ID":"06cfb41e-30d2-4adf-b24d-84281d21e078","Type":"ContainerDied","Data":"71fef614cfb1dba1aa81ebe08a7a6d78d2f83fd8fdb25ecf221ac1380dcfdc5d"} Jun 11 16:31:51.098121 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:51.098092 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-metrics-tls\") pod \"dns-default-lxkqq\" (UID: \"305a9021-ddf2-4eca-8df5-2fbe025ac9bd\") " pod="openshift-dns/dns-default-lxkqq" Jun 11 16:31:51.098256 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:51.098238 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:31:51.098306 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:51.098296 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-metrics-tls podName:305a9021-ddf2-4eca-8df5-2fbe025ac9bd nodeName:}" failed. No retries permitted until 2026-06-11 16:31:55.098281176 +0000 UTC m=+43.166551190 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-metrics-tls") pod "dns-default-lxkqq" (UID: "305a9021-ddf2-4eca-8df5-2fbe025ac9bd") : secret "dns-default-metrics-tls" not found Jun 11 16:31:51.715042 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:51.715009 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s2gvs" event={"ID":"6ba18fd1-dd09-45d8-81c7-8796fde2340e","Type":"ContainerStarted","Data":"47ed915232582bc1a9d09e6cd4a1ceee911e5ba7b08a71e12a5a8912bdbbf5b6"} Jun 11 16:31:51.717858 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:51.717831 2569 generic.go:356] "Generic (PLEG): container finished" podID="06cfb41e-30d2-4adf-b24d-84281d21e078" containerID="52f4481956116620a710deed55ab90063e9d231681df6a7f59c661a7cb0c6669" exitCode=0 Jun 11 16:31:51.717977 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:51.717871 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-829vm" event={"ID":"06cfb41e-30d2-4adf-b24d-84281d21e078","Type":"ContainerDied","Data":"52f4481956116620a710deed55ab90063e9d231681df6a7f59c661a7cb0c6669"} Jun 11 16:31:51.730456 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:51.730407 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-s2gvs" podStartSLOduration=1.463558061 podStartE2EDuration="4.730392336s" totalImagesPullingTime="3.266834275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:31:51.729560757 +0000 UTC m=+39.797830790" watchObservedRunningTime="2026-06-11 16:31:51.730392336 +0000 UTC m=+39.798662372" Jun 11 16:31:52.724843 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:52.724661 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-829vm" event={"ID":"06cfb41e-30d2-4adf-b24d-84281d21e078","Type":"ContainerStarted","Data":"937566fdc97062163b4b2eb7be2ba3aa3853a324ac3d607b2fc19ed2cf899bda"} Jun 11 16:31:52.750633 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:52.750559 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-829vm" podStartSLOduration=8.528348403 podStartE2EDuration="40.7505396s" totalImagesPullingTime="32.222191197s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:31:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:31:52.74917876 +0000 UTC m=+40.817448796" watchObservedRunningTime="2026-06-11 16:31:52.7505396 +0000 UTC m=+40.818809614" Jun 11 16:31:55.128251 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:31:55.128211 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-metrics-tls\") pod \"dns-default-lxkqq\" (UID: \"305a9021-ddf2-4eca-8df5-2fbe025ac9bd\") " pod="openshift-dns/dns-default-lxkqq" Jun 11 16:31:55.128611 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:55.128367 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:31:55.128611 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:31:55.128433 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-metrics-tls podName:305a9021-ddf2-4eca-8df5-2fbe025ac9bd nodeName:}" failed. No retries permitted until 2026-06-11 16:32:03.128418826 +0000 UTC m=+51.196688843 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-metrics-tls") pod "dns-default-lxkqq" (UID: "305a9021-ddf2-4eca-8df5-2fbe025ac9bd") : secret "dns-default-metrics-tls" not found Jun 11 16:32:03.188484 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:03.188444 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-metrics-tls\") pod \"dns-default-lxkqq\" (UID: \"305a9021-ddf2-4eca-8df5-2fbe025ac9bd\") " pod="openshift-dns/dns-default-lxkqq" Jun 11 16:32:03.189011 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:32:03.188580 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:32:03.189011 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:32:03.188641 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-metrics-tls podName:305a9021-ddf2-4eca-8df5-2fbe025ac9bd nodeName:}" failed. No retries permitted until 2026-06-11 16:32:19.18862734 +0000 UTC m=+67.256897354 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-metrics-tls") pod "dns-default-lxkqq" (UID: "305a9021-ddf2-4eca-8df5-2fbe025ac9bd") : secret "dns-default-metrics-tls" not found Jun 11 16:32:05.148543 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.148503 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw"] Jun 11 16:32:05.172451 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.172413 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw"] Jun 11 16:32:05.172603 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.172517 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" Jun 11 16:32:05.175329 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.175301 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 11 16:32:05.175329 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.175317 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 16:32:05.176538 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.176512 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 11 16:32:05.176538 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.176526 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 16:32:05.176730 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.176543 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 16:32:05.176730 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.176562 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 11 16:32:05.176730 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.176525 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 11 16:32:05.200146 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.200119 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c4be3a2a-f816-4acf-9282-bb9a9e378c0c-ca\") pod \"cluster-proxy-proxy-agent-59546b75df-s87bw\" (UID: \"c4be3a2a-f816-4acf-9282-bb9a9e378c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" Jun 11 16:32:05.200328 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.200179 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c4be3a2a-f816-4acf-9282-bb9a9e378c0c-hub\") pod \"cluster-proxy-proxy-agent-59546b75df-s87bw\" (UID: \"c4be3a2a-f816-4acf-9282-bb9a9e378c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" Jun 11 16:32:05.200328 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.200238 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c4be3a2a-f816-4acf-9282-bb9a9e378c0c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-59546b75df-s87bw\" (UID: \"c4be3a2a-f816-4acf-9282-bb9a9e378c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" Jun 11 16:32:05.200328 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.200258 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnk7c\" (UniqueName: \"kubernetes.io/projected/c4be3a2a-f816-4acf-9282-bb9a9e378c0c-kube-api-access-tnk7c\") pod \"cluster-proxy-proxy-agent-59546b75df-s87bw\" (UID: \"c4be3a2a-f816-4acf-9282-bb9a9e378c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" Jun 11 16:32:05.200486 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.200339 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c4be3a2a-f816-4acf-9282-bb9a9e378c0c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-59546b75df-s87bw\" (UID: \"c4be3a2a-f816-4acf-9282-bb9a9e378c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" Jun 11 16:32:05.200486 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.200398 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4be3a2a-f816-4acf-9282-bb9a9e378c0c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-59546b75df-s87bw\" (UID: \"c4be3a2a-f816-4acf-9282-bb9a9e378c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" Jun 11 16:32:05.301514 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.301476 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c4be3a2a-f816-4acf-9282-bb9a9e378c0c-hub\") pod \"cluster-proxy-proxy-agent-59546b75df-s87bw\" (UID: \"c4be3a2a-f816-4acf-9282-bb9a9e378c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" Jun 11 16:32:05.301678 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.301541 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c4be3a2a-f816-4acf-9282-bb9a9e378c0c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-59546b75df-s87bw\" (UID: \"c4be3a2a-f816-4acf-9282-bb9a9e378c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" Jun 11 16:32:05.301678 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.301567 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnk7c\" (UniqueName: \"kubernetes.io/projected/c4be3a2a-f816-4acf-9282-bb9a9e378c0c-kube-api-access-tnk7c\") pod \"cluster-proxy-proxy-agent-59546b75df-s87bw\" (UID: \"c4be3a2a-f816-4acf-9282-bb9a9e378c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" Jun 11 16:32:05.301678 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.301595 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c4be3a2a-f816-4acf-9282-bb9a9e378c0c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-59546b75df-s87bw\" (UID: \"c4be3a2a-f816-4acf-9282-bb9a9e378c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" Jun 11 16:32:05.301678 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.301632 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4be3a2a-f816-4acf-9282-bb9a9e378c0c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-59546b75df-s87bw\" (UID: \"c4be3a2a-f816-4acf-9282-bb9a9e378c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" Jun 11 16:32:05.301678 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.301668 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c4be3a2a-f816-4acf-9282-bb9a9e378c0c-ca\") pod \"cluster-proxy-proxy-agent-59546b75df-s87bw\" (UID: \"c4be3a2a-f816-4acf-9282-bb9a9e378c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" Jun 11 16:32:05.302324 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.302298 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4be3a2a-f816-4acf-9282-bb9a9e378c0c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-59546b75df-s87bw\" (UID: \"c4be3a2a-f816-4acf-9282-bb9a9e378c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" Jun 11 16:32:05.305399 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.305368 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c4be3a2a-f816-4acf-9282-bb9a9e378c0c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-59546b75df-s87bw\" (UID: \"c4be3a2a-f816-4acf-9282-bb9a9e378c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" Jun 11 16:32:05.305495 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.305437 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c4be3a2a-f816-4acf-9282-bb9a9e378c0c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-59546b75df-s87bw\" (UID: \"c4be3a2a-f816-4acf-9282-bb9a9e378c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" Jun 11 16:32:05.305495 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.305455 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c4be3a2a-f816-4acf-9282-bb9a9e378c0c-ca\") pod \"cluster-proxy-proxy-agent-59546b75df-s87bw\" (UID: \"c4be3a2a-f816-4acf-9282-bb9a9e378c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" Jun 11 16:32:05.305567 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.305535 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c4be3a2a-f816-4acf-9282-bb9a9e378c0c-hub\") pod \"cluster-proxy-proxy-agent-59546b75df-s87bw\" (UID: \"c4be3a2a-f816-4acf-9282-bb9a9e378c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" Jun 11 16:32:05.309712 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.309694 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnk7c\" (UniqueName: \"kubernetes.io/projected/c4be3a2a-f816-4acf-9282-bb9a9e378c0c-kube-api-access-tnk7c\") pod \"cluster-proxy-proxy-agent-59546b75df-s87bw\" (UID: \"c4be3a2a-f816-4acf-9282-bb9a9e378c0c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" Jun 11 16:32:05.490274 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.490247 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" Jun 11 16:32:05.639542 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.639502 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw"] Jun 11 16:32:05.653895 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:32:05.653866 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4be3a2a_f816_4acf_9282_bb9a9e378c0c.slice/crio-6116fc7d7a351ea3158375e1045071d0e6d113ad9e0031cc1342702c8b6530c3 WatchSource:0}: Error finding container 6116fc7d7a351ea3158375e1045071d0e6d113ad9e0031cc1342702c8b6530c3: Status 404 returned error can't find the container with id 6116fc7d7a351ea3158375e1045071d0e6d113ad9e0031cc1342702c8b6530c3 Jun 11 16:32:05.753917 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:05.753827 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" event={"ID":"c4be3a2a-f816-4acf-9282-bb9a9e378c0c","Type":"ContainerStarted","Data":"6116fc7d7a351ea3158375e1045071d0e6d113ad9e0031cc1342702c8b6530c3"} Jun 11 16:32:09.766264 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:09.766219 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" event={"ID":"c4be3a2a-f816-4acf-9282-bb9a9e378c0c","Type":"ContainerStarted","Data":"4e0ea7eb6c36c3080443a401c88bac2f3cc5d3ebc0f7185711e61d0b56c74d93"} Jun 11 16:32:09.766633 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:09.766277 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" event={"ID":"c4be3a2a-f816-4acf-9282-bb9a9e378c0c","Type":"ContainerStarted","Data":"cf9fe4502cfa1d7887bcdaa9d07bd943a7e9826dfe09367194fa93f3233f5423"} Jun 11 16:32:09.766633 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:09.766298 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" event={"ID":"c4be3a2a-f816-4acf-9282-bb9a9e378c0c","Type":"ContainerStarted","Data":"2c7a3be921a26cbacabd5cad720d43bdade9412517e4315b1a1290c742ff330f"} Jun 11 16:32:09.789205 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:09.789160 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" podStartSLOduration=1.209441048 podStartE2EDuration="4.789146052s" totalImagesPullingTime="3.579705004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:32:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:32:09.787883093 +0000 UTC m=+57.856153124" watchObservedRunningTime="2026-06-11 16:32:09.789146052 +0000 UTC m=+57.857416088" Jun 11 16:32:14.693379 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:14.693352 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dctg2" Jun 11 16:32:17.191170 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:17.191126 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-metrics-certs\") pod \"network-metrics-daemon-6k5sj\" (UID: \"941f2a27-1f4c-400e-a50e-8a541e5fb4a7\") " pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:32:17.191628 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:17.191202 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55-original-pull-secret\") pod \"global-pull-secret-syncer-qxtrm\" (UID: \"ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55\") " pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:32:17.193869 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:17.193852 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 16:32:17.193916 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:17.193862 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 16:32:17.202068 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:32:17.202034 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 16:32:17.202178 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:32:17.202114 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-metrics-certs podName:941f2a27-1f4c-400e-a50e-8a541e5fb4a7 nodeName:}" failed. No retries permitted until 2026-06-11 16:33:21.202097682 +0000 UTC m=+129.270367700 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-metrics-certs") pod "network-metrics-daemon-6k5sj" (UID: "941f2a27-1f4c-400e-a50e-8a541e5fb4a7") : secret "metrics-daemon-secret" not found Jun 11 16:32:17.204325 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:17.204296 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55-original-pull-secret\") pod \"global-pull-secret-syncer-qxtrm\" (UID: \"ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55\") " pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:32:17.292179 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:17.292124 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tspws\" (UniqueName: \"kubernetes.io/projected/660244a3-e67d-45a0-9d14-c3fcb18359a0-kube-api-access-tspws\") pod \"network-check-target-86g9g\" (UID: \"660244a3-e67d-45a0-9d14-c3fcb18359a0\") " pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:32:17.295256 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:17.295237 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 16:32:17.304941 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:17.304921 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 16:32:17.316000 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:17.315976 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tspws\" (UniqueName: \"kubernetes.io/projected/660244a3-e67d-45a0-9d14-c3fcb18359a0-kube-api-access-tspws\") pod \"network-check-target-86g9g\" (UID: \"660244a3-e67d-45a0-9d14-c3fcb18359a0\") " pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:32:17.473543 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:17.473437 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxtrm" Jun 11 16:32:17.484479 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:17.484460 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6jw82\"" Jun 11 16:32:17.492766 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:17.492742 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:32:17.626823 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:17.626787 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qxtrm"] Jun 11 16:32:17.630760 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:32:17.630734 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae57bac1_3c7a_4bd9_8f95_98cb5f6bad55.slice/crio-d1f6b3f6b6aa7ef233d5d4cfe22147600a5fdef9c9bdc0ff7c2114c8f4761fb3 WatchSource:0}: Error finding container d1f6b3f6b6aa7ef233d5d4cfe22147600a5fdef9c9bdc0ff7c2114c8f4761fb3: Status 404 returned error can't find the container with id d1f6b3f6b6aa7ef233d5d4cfe22147600a5fdef9c9bdc0ff7c2114c8f4761fb3 Jun 11 16:32:17.645908 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:17.645874 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-86g9g"] Jun 11 16:32:17.649437 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:32:17.649411 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod660244a3_e67d_45a0_9d14_c3fcb18359a0.slice/crio-1004cd796a015a24738bad0c4e6167303f4f569ed0efc1d0c7892c25f438bd74 WatchSource:0}: Error finding container 1004cd796a015a24738bad0c4e6167303f4f569ed0efc1d0c7892c25f438bd74: Status 404 returned error can't find the container with id 1004cd796a015a24738bad0c4e6167303f4f569ed0efc1d0c7892c25f438bd74 Jun 11 16:32:17.787468 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:17.787376 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-86g9g" event={"ID":"660244a3-e67d-45a0-9d14-c3fcb18359a0","Type":"ContainerStarted","Data":"1004cd796a015a24738bad0c4e6167303f4f569ed0efc1d0c7892c25f438bd74"} Jun 11 16:32:17.788422 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:17.788398 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qxtrm" event={"ID":"ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55","Type":"ContainerStarted","Data":"d1f6b3f6b6aa7ef233d5d4cfe22147600a5fdef9c9bdc0ff7c2114c8f4761fb3"} Jun 11 16:32:19.208956 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:19.208910 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-metrics-tls\") pod \"dns-default-lxkqq\" (UID: \"305a9021-ddf2-4eca-8df5-2fbe025ac9bd\") " pod="openshift-dns/dns-default-lxkqq" Jun 11 16:32:19.209442 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:32:19.209070 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:32:19.209442 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:32:19.209149 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-metrics-tls podName:305a9021-ddf2-4eca-8df5-2fbe025ac9bd nodeName:}" failed. No retries permitted until 2026-06-11 16:32:51.209129711 +0000 UTC m=+99.277399727 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-metrics-tls") pod "dns-default-lxkqq" (UID: "305a9021-ddf2-4eca-8df5-2fbe025ac9bd") : secret "dns-default-metrics-tls" not found Jun 11 16:32:22.806576 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:22.806536 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-86g9g" event={"ID":"660244a3-e67d-45a0-9d14-c3fcb18359a0","Type":"ContainerStarted","Data":"d678ef0b9544130b7e8475551bb4ac46024d8404ae0e3470e2bf8b58089fd6fd"} Jun 11 16:32:22.807005 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:22.806661 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:32:22.808121 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:22.808101 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qxtrm" event={"ID":"ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55","Type":"ContainerStarted","Data":"25bac72734dd1c8477b55252c956b450f26b03f07c4db115da3ad93c1ebfe70c"} Jun 11 16:32:22.822348 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:22.822302 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-86g9g" podStartSLOduration=66.380730936 podStartE2EDuration="1m10.822289013s" totalImagesPullingTime="4.441558077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:32:22.820872517 +0000 UTC m=+70.889142555" watchObservedRunningTime="2026-06-11 16:32:22.822289013 +0000 UTC m=+70.890559048" Jun 11 16:32:22.835246 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:22.835119 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qxtrm" podStartSLOduration=66.370418248 podStartE2EDuration="1m10.835100364s" totalImagesPullingTime="4.464682116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:32:22.834915704 +0000 UTC m=+70.903185739" watchObservedRunningTime="2026-06-11 16:32:22.835100364 +0000 UTC m=+70.903370400" Jun 11 16:32:51.234834 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:51.234714 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-metrics-tls\") pod \"dns-default-lxkqq\" (UID: \"305a9021-ddf2-4eca-8df5-2fbe025ac9bd\") " pod="openshift-dns/dns-default-lxkqq" Jun 11 16:32:51.235294 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:32:51.234851 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:32:51.235294 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:32:51.234921 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-metrics-tls podName:305a9021-ddf2-4eca-8df5-2fbe025ac9bd nodeName:}" failed. No retries permitted until 2026-06-11 16:33:55.2349045 +0000 UTC m=+163.303174517 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-metrics-tls") pod "dns-default-lxkqq" (UID: "305a9021-ddf2-4eca-8df5-2fbe025ac9bd") : secret "dns-default-metrics-tls" not found Jun 11 16:32:53.813763 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:32:53.813726 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-86g9g" Jun 11 16:33:21.245792 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:33:21.245739 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-metrics-certs\") pod \"network-metrics-daemon-6k5sj\" (UID: \"941f2a27-1f4c-400e-a50e-8a541e5fb4a7\") " pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:33:21.246347 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:33:21.245900 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 16:33:21.246347 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:33:21.245963 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-metrics-certs podName:941f2a27-1f4c-400e-a50e-8a541e5fb4a7 nodeName:}" failed. No retries permitted until 2026-06-11 16:35:23.245946667 +0000 UTC m=+251.314216680 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-metrics-certs") pod "network-metrics-daemon-6k5sj" (UID: "941f2a27-1f4c-400e-a50e-8a541e5fb4a7") : secret "metrics-daemon-secret" not found Jun 11 16:33:50.339660 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:33:50.336798 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lxkqq" podUID="305a9021-ddf2-4eca-8df5-2fbe025ac9bd" Jun 11 16:33:51.051530 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:33:51.051495 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lxkqq" Jun 11 16:33:51.388182 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:33:51.388090 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-6k5sj" podUID="941f2a27-1f4c-400e-a50e-8a541e5fb4a7" Jun 11 16:33:55.283323 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:33:55.283280 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-metrics-tls\") pod \"dns-default-lxkqq\" (UID: \"305a9021-ddf2-4eca-8df5-2fbe025ac9bd\") " pod="openshift-dns/dns-default-lxkqq" Jun 11 16:33:55.283840 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:33:55.283417 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:33:55.283840 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:33:55.283502 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-metrics-tls podName:305a9021-ddf2-4eca-8df5-2fbe025ac9bd nodeName:}" failed. No retries permitted until 2026-06-11 16:35:57.283482011 +0000 UTC m=+285.351752038 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-metrics-tls") pod "dns-default-lxkqq" (UID: "305a9021-ddf2-4eca-8df5-2fbe025ac9bd") : secret "dns-default-metrics-tls" not found Jun 11 16:34:02.356191 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:02.356099 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:34:26.420721 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:26.420687 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-gf2qf"] Jun 11 16:34:26.423563 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:26.423546 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gf2qf" Jun 11 16:34:26.426023 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:26.426002 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 11 16:34:26.426220 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:26.426203 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 11 16:34:26.427270 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:26.427255 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wf6wg\"" Jun 11 16:34:26.434252 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:26.434231 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-gf2qf"] Jun 11 16:34:26.498246 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:26.498205 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c68b7331-ae32-4a9e-9687-1321770eab37-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-gf2qf\" (UID: \"c68b7331-ae32-4a9e-9687-1321770eab37\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gf2qf" Jun 11 16:34:26.498436 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:26.498278 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c68b7331-ae32-4a9e-9687-1321770eab37-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-gf2qf\" (UID: \"c68b7331-ae32-4a9e-9687-1321770eab37\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gf2qf" Jun 11 16:34:26.598937 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:26.598902 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c68b7331-ae32-4a9e-9687-1321770eab37-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-gf2qf\" (UID: \"c68b7331-ae32-4a9e-9687-1321770eab37\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gf2qf" Jun 11 16:34:26.599112 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:26.598962 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c68b7331-ae32-4a9e-9687-1321770eab37-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-gf2qf\" (UID: \"c68b7331-ae32-4a9e-9687-1321770eab37\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gf2qf" Jun 11 16:34:26.599112 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:34:26.599079 2569 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 16:34:26.599193 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:34:26.599155 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c68b7331-ae32-4a9e-9687-1321770eab37-networking-console-plugin-cert podName:c68b7331-ae32-4a9e-9687-1321770eab37 nodeName:}" failed. No retries permitted until 2026-06-11 16:34:27.099137989 +0000 UTC m=+195.167408022 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c68b7331-ae32-4a9e-9687-1321770eab37-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-gf2qf" (UID: "c68b7331-ae32-4a9e-9687-1321770eab37") : secret "networking-console-plugin-cert" not found Jun 11 16:34:26.599558 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:26.599541 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c68b7331-ae32-4a9e-9687-1321770eab37-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-gf2qf\" (UID: \"c68b7331-ae32-4a9e-9687-1321770eab37\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gf2qf" Jun 11 16:34:27.102567 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:27.102527 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c68b7331-ae32-4a9e-9687-1321770eab37-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-gf2qf\" (UID: \"c68b7331-ae32-4a9e-9687-1321770eab37\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gf2qf" Jun 11 16:34:27.102745 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:34:27.102690 2569 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 16:34:27.102792 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:34:27.102763 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c68b7331-ae32-4a9e-9687-1321770eab37-networking-console-plugin-cert podName:c68b7331-ae32-4a9e-9687-1321770eab37 nodeName:}" failed. No retries permitted until 2026-06-11 16:34:28.102742576 +0000 UTC m=+196.171012606 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c68b7331-ae32-4a9e-9687-1321770eab37-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-gf2qf" (UID: "c68b7331-ae32-4a9e-9687-1321770eab37") : secret "networking-console-plugin-cert" not found Jun 11 16:34:28.108832 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:28.108774 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c68b7331-ae32-4a9e-9687-1321770eab37-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-gf2qf\" (UID: \"c68b7331-ae32-4a9e-9687-1321770eab37\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gf2qf" Jun 11 16:34:28.109271 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:34:28.108944 2569 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 16:34:28.109271 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:34:28.109012 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c68b7331-ae32-4a9e-9687-1321770eab37-networking-console-plugin-cert podName:c68b7331-ae32-4a9e-9687-1321770eab37 nodeName:}" failed. No retries permitted until 2026-06-11 16:34:30.108996339 +0000 UTC m=+198.177266353 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c68b7331-ae32-4a9e-9687-1321770eab37-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-gf2qf" (UID: "c68b7331-ae32-4a9e-9687-1321770eab37") : secret "networking-console-plugin-cert" not found Jun 11 16:34:30.121804 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:30.121743 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c68b7331-ae32-4a9e-9687-1321770eab37-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-gf2qf\" (UID: \"c68b7331-ae32-4a9e-9687-1321770eab37\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gf2qf" Jun 11 16:34:30.122230 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:34:30.121899 2569 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 16:34:30.122230 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:34:30.121977 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c68b7331-ae32-4a9e-9687-1321770eab37-networking-console-plugin-cert podName:c68b7331-ae32-4a9e-9687-1321770eab37 nodeName:}" failed. No retries permitted until 2026-06-11 16:34:34.121961411 +0000 UTC m=+202.190231426 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c68b7331-ae32-4a9e-9687-1321770eab37-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-gf2qf" (UID: "c68b7331-ae32-4a9e-9687-1321770eab37") : secret "networking-console-plugin-cert" not found Jun 11 16:34:33.299647 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:33.299613 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8h74q_66a0433d-006a-4974-960f-30704fb9949d/dns-node-resolver/0.log" Jun 11 16:34:34.101231 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:34.101205 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lvfpt_2ac98822-4208-4aec-9b86-0bc5aecbd145/node-ca/0.log" Jun 11 16:34:34.149233 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:34.149199 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c68b7331-ae32-4a9e-9687-1321770eab37-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-gf2qf\" (UID: \"c68b7331-ae32-4a9e-9687-1321770eab37\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gf2qf" Jun 11 16:34:34.149396 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:34:34.149314 2569 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 16:34:34.149396 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:34:34.149376 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c68b7331-ae32-4a9e-9687-1321770eab37-networking-console-plugin-cert podName:c68b7331-ae32-4a9e-9687-1321770eab37 nodeName:}" failed. No retries permitted until 2026-06-11 16:34:42.149362061 +0000 UTC m=+210.217632080 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c68b7331-ae32-4a9e-9687-1321770eab37-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-gf2qf" (UID: "c68b7331-ae32-4a9e-9687-1321770eab37") : secret "networking-console-plugin-cert" not found Jun 11 16:34:35.101326 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:35.101295 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s2gvs_6ba18fd1-dd09-45d8-81c7-8796fde2340e/serve-healthcheck-canary/0.log" Jun 11 16:34:42.204937 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:42.204894 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c68b7331-ae32-4a9e-9687-1321770eab37-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-gf2qf\" (UID: \"c68b7331-ae32-4a9e-9687-1321770eab37\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gf2qf" Jun 11 16:34:42.205421 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:34:42.205045 2569 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 16:34:42.205421 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:34:42.205179 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c68b7331-ae32-4a9e-9687-1321770eab37-networking-console-plugin-cert podName:c68b7331-ae32-4a9e-9687-1321770eab37 nodeName:}" failed. No retries permitted until 2026-06-11 16:34:58.20516074 +0000 UTC m=+226.273430754 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c68b7331-ae32-4a9e-9687-1321770eab37-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-gf2qf" (UID: "c68b7331-ae32-4a9e-9687-1321770eab37") : secret "networking-console-plugin-cert" not found Jun 11 16:34:45.491707 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:45.491661 2569 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" podUID="c4be3a2a-f816-4acf-9282-bb9a9e378c0c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 16:34:53.877550 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:53.877517 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cmls4"] Jun 11 16:34:53.880931 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:53.880907 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cmls4" Jun 11 16:34:53.884999 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:53.884977 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4c7sw\"" Jun 11 16:34:53.885163 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:53.884999 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 16:34:53.885287 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:53.885271 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 16:34:53.885336 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:53.885305 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 16:34:53.885413 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:53.885395 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 16:34:53.891390 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:53.891364 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cmls4"] Jun 11 16:34:53.996621 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:53.996580 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/32ab30e6-d587-4805-b34f-ddc36849d83f-crio-socket\") pod \"insights-runtime-extractor-cmls4\" (UID: \"32ab30e6-d587-4805-b34f-ddc36849d83f\") " pod="openshift-insights/insights-runtime-extractor-cmls4" Jun 11 16:34:53.996621 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:53.996618 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/32ab30e6-d587-4805-b34f-ddc36849d83f-data-volume\") pod \"insights-runtime-extractor-cmls4\" (UID: \"32ab30e6-d587-4805-b34f-ddc36849d83f\") " pod="openshift-insights/insights-runtime-extractor-cmls4" Jun 11 16:34:53.996845 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:53.996638 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32ab30e6-d587-4805-b34f-ddc36849d83f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmls4\" (UID: \"32ab30e6-d587-4805-b34f-ddc36849d83f\") " pod="openshift-insights/insights-runtime-extractor-cmls4" Jun 11 16:34:53.996845 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:53.996665 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32ab30e6-d587-4805-b34f-ddc36849d83f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmls4\" (UID: \"32ab30e6-d587-4805-b34f-ddc36849d83f\") " pod="openshift-insights/insights-runtime-extractor-cmls4" Jun 11 16:34:53.996845 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:53.996738 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc62g\" (UniqueName: \"kubernetes.io/projected/32ab30e6-d587-4805-b34f-ddc36849d83f-kube-api-access-dc62g\") pod \"insights-runtime-extractor-cmls4\" (UID: \"32ab30e6-d587-4805-b34f-ddc36849d83f\") " pod="openshift-insights/insights-runtime-extractor-cmls4" Jun 11 16:34:54.097932 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:54.097891 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/32ab30e6-d587-4805-b34f-ddc36849d83f-crio-socket\") pod \"insights-runtime-extractor-cmls4\" (UID: \"32ab30e6-d587-4805-b34f-ddc36849d83f\") " pod="openshift-insights/insights-runtime-extractor-cmls4" Jun 11 16:34:54.097932 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:54.097934 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/32ab30e6-d587-4805-b34f-ddc36849d83f-data-volume\") pod \"insights-runtime-extractor-cmls4\" (UID: \"32ab30e6-d587-4805-b34f-ddc36849d83f\") " pod="openshift-insights/insights-runtime-extractor-cmls4" Jun 11 16:34:54.098204 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:54.097957 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32ab30e6-d587-4805-b34f-ddc36849d83f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmls4\" (UID: \"32ab30e6-d587-4805-b34f-ddc36849d83f\") " pod="openshift-insights/insights-runtime-extractor-cmls4" Jun 11 16:34:54.098204 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:54.097983 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32ab30e6-d587-4805-b34f-ddc36849d83f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmls4\" (UID: \"32ab30e6-d587-4805-b34f-ddc36849d83f\") " pod="openshift-insights/insights-runtime-extractor-cmls4" Jun 11 16:34:54.098204 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:54.098027 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc62g\" (UniqueName: \"kubernetes.io/projected/32ab30e6-d587-4805-b34f-ddc36849d83f-kube-api-access-dc62g\") pod \"insights-runtime-extractor-cmls4\" (UID: \"32ab30e6-d587-4805-b34f-ddc36849d83f\") " pod="openshift-insights/insights-runtime-extractor-cmls4" Jun 11 16:34:54.098204 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:54.098034 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/32ab30e6-d587-4805-b34f-ddc36849d83f-crio-socket\") pod \"insights-runtime-extractor-cmls4\" (UID: \"32ab30e6-d587-4805-b34f-ddc36849d83f\") " pod="openshift-insights/insights-runtime-extractor-cmls4" Jun 11 16:34:54.098392 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:54.098300 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/32ab30e6-d587-4805-b34f-ddc36849d83f-data-volume\") pod \"insights-runtime-extractor-cmls4\" (UID: \"32ab30e6-d587-4805-b34f-ddc36849d83f\") " pod="openshift-insights/insights-runtime-extractor-cmls4" Jun 11 16:34:54.098562 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:54.098544 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32ab30e6-d587-4805-b34f-ddc36849d83f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmls4\" (UID: \"32ab30e6-d587-4805-b34f-ddc36849d83f\") " pod="openshift-insights/insights-runtime-extractor-cmls4" Jun 11 16:34:54.100429 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:54.100411 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32ab30e6-d587-4805-b34f-ddc36849d83f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmls4\" (UID: \"32ab30e6-d587-4805-b34f-ddc36849d83f\") " pod="openshift-insights/insights-runtime-extractor-cmls4" Jun 11 16:34:54.106597 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:54.106573 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc62g\" (UniqueName: \"kubernetes.io/projected/32ab30e6-d587-4805-b34f-ddc36849d83f-kube-api-access-dc62g\") pod \"insights-runtime-extractor-cmls4\" (UID: \"32ab30e6-d587-4805-b34f-ddc36849d83f\") " pod="openshift-insights/insights-runtime-extractor-cmls4" Jun 11 16:34:54.189625 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:54.189594 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cmls4" Jun 11 16:34:54.321441 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:54.321395 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cmls4"] Jun 11 16:34:54.325944 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:34:54.325914 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32ab30e6_d587_4805_b34f_ddc36849d83f.slice/crio-7cc85a3c4dbbb2a9657e9b3ae39e89ac4554ee20f58c2eefd24c3c0d28b64aec WatchSource:0}: Error finding container 7cc85a3c4dbbb2a9657e9b3ae39e89ac4554ee20f58c2eefd24c3c0d28b64aec: Status 404 returned error can't find the container with id 7cc85a3c4dbbb2a9657e9b3ae39e89ac4554ee20f58c2eefd24c3c0d28b64aec Jun 11 16:34:55.234589 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:55.234499 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cmls4" event={"ID":"32ab30e6-d587-4805-b34f-ddc36849d83f","Type":"ContainerStarted","Data":"f925cff563c3067a8fbfa2a6abc5dfc1dd4d93cc4d3dfd5ff9b8d1892d2fe65d"} Jun 11 16:34:55.234589 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:55.234559 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cmls4" event={"ID":"32ab30e6-d587-4805-b34f-ddc36849d83f","Type":"ContainerStarted","Data":"d5a9f2496d165317a439deca6d9c715962560a3cc4f83a14a3f01b5b5d10dfa3"} Jun 11 16:34:55.234589 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:55.234583 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cmls4" event={"ID":"32ab30e6-d587-4805-b34f-ddc36849d83f","Type":"ContainerStarted","Data":"7cc85a3c4dbbb2a9657e9b3ae39e89ac4554ee20f58c2eefd24c3c0d28b64aec"} Jun 11 16:34:55.491731 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:55.491648 2569 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" podUID="c4be3a2a-f816-4acf-9282-bb9a9e378c0c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 16:34:57.242355 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:57.242319 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cmls4" event={"ID":"32ab30e6-d587-4805-b34f-ddc36849d83f","Type":"ContainerStarted","Data":"ec5872cc84c6caa60abfdc0c3fdd7a1f3b901f189725812553c2ccb6cf0e8817"} Jun 11 16:34:58.233794 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:58.233730 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c68b7331-ae32-4a9e-9687-1321770eab37-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-gf2qf\" (UID: \"c68b7331-ae32-4a9e-9687-1321770eab37\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gf2qf" Jun 11 16:34:58.236249 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:58.236227 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c68b7331-ae32-4a9e-9687-1321770eab37-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-gf2qf\" (UID: \"c68b7331-ae32-4a9e-9687-1321770eab37\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gf2qf" Jun 11 16:34:58.532144 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:58.532038 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gf2qf" Jun 11 16:34:58.659230 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:58.659167 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cmls4" podStartSLOduration=3.597572029 podStartE2EDuration="5.659144934s" totalImagesPullingTime="2.061572905s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:34:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:34:57.260345493 +0000 UTC m=+225.328615541" watchObservedRunningTime="2026-06-11 16:34:58.659144934 +0000 UTC m=+226.727414950" Jun 11 16:34:58.659542 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:58.659526 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-gf2qf"] Jun 11 16:34:58.662318 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:34:58.662279 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc68b7331_ae32_4a9e_9687_1321770eab37.slice/crio-ecf031562a6a5012bb64b24ac57f576cb4396cd55b9c9fc1c7c6c47807c41d23 WatchSource:0}: Error finding container ecf031562a6a5012bb64b24ac57f576cb4396cd55b9c9fc1c7c6c47807c41d23: Status 404 returned error can't find the container with id ecf031562a6a5012bb64b24ac57f576cb4396cd55b9c9fc1c7c6c47807c41d23 Jun 11 16:34:59.249172 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:34:59.249131 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gf2qf" event={"ID":"c68b7331-ae32-4a9e-9687-1321770eab37","Type":"ContainerStarted","Data":"ecf031562a6a5012bb64b24ac57f576cb4396cd55b9c9fc1c7c6c47807c41d23"} Jun 11 16:35:00.254035 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:00.254002 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gf2qf" event={"ID":"c68b7331-ae32-4a9e-9687-1321770eab37","Type":"ContainerStarted","Data":"88c9f4a9ebc5468ea85c93615bd7f6ecc0328bc433b7901f967b2949d695b382"} Jun 11 16:35:00.271467 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:00.271416 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-gf2qf" podStartSLOduration=33.107047873 podStartE2EDuration="34.271398907s" totalImagesPullingTime="1.164351034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:35:00.270438796 +0000 UTC m=+228.338708844" watchObservedRunningTime="2026-06-11 16:35:00.271398907 +0000 UTC m=+228.339668943" Jun 11 16:35:00.956141 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:00.956111 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vf2mk"] Jun 11 16:35:00.959032 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:00.959016 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vf2mk" Jun 11 16:35:00.961646 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:00.961624 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 11 16:35:00.961787 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:00.961632 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-5k52q\"" Jun 11 16:35:00.967667 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:00.967639 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vf2mk"] Jun 11 16:35:01.053599 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:01.053558 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f6878e6f-105f-4b95-a976-67173395f4d1-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-vf2mk\" (UID: \"f6878e6f-105f-4b95-a976-67173395f4d1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vf2mk" Jun 11 16:35:01.154855 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:01.154810 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f6878e6f-105f-4b95-a976-67173395f4d1-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-vf2mk\" (UID: \"f6878e6f-105f-4b95-a976-67173395f4d1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vf2mk" Jun 11 16:35:01.154980 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:35:01.154936 2569 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 11 16:35:01.155032 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:35:01.155008 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6878e6f-105f-4b95-a976-67173395f4d1-tls-certificates podName:f6878e6f-105f-4b95-a976-67173395f4d1 nodeName:}" failed. No retries permitted until 2026-06-11 16:35:01.654993077 +0000 UTC m=+229.723263091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/f6878e6f-105f-4b95-a976-67173395f4d1-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-vf2mk" (UID: "f6878e6f-105f-4b95-a976-67173395f4d1") : secret "prometheus-operator-admission-webhook-tls" not found Jun 11 16:35:01.657845 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:01.657796 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f6878e6f-105f-4b95-a976-67173395f4d1-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-vf2mk\" (UID: \"f6878e6f-105f-4b95-a976-67173395f4d1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vf2mk" Jun 11 16:35:01.660403 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:01.660380 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f6878e6f-105f-4b95-a976-67173395f4d1-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-vf2mk\" (UID: \"f6878e6f-105f-4b95-a976-67173395f4d1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vf2mk" Jun 11 16:35:01.868163 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:01.868114 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vf2mk" Jun 11 16:35:02.001621 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:02.001586 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vf2mk"] Jun 11 16:35:02.004788 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:35:02.004761 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6878e6f_105f_4b95_a976_67173395f4d1.slice/crio-d9fbfbbeeb7c9d5c4e850a2bab7dee0bbb3b72e82c822479f1493ac93a2d9f63 WatchSource:0}: Error finding container d9fbfbbeeb7c9d5c4e850a2bab7dee0bbb3b72e82c822479f1493ac93a2d9f63: Status 404 returned error can't find the container with id d9fbfbbeeb7c9d5c4e850a2bab7dee0bbb3b72e82c822479f1493ac93a2d9f63 Jun 11 16:35:02.260246 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:02.260211 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vf2mk" event={"ID":"f6878e6f-105f-4b95-a976-67173395f4d1","Type":"ContainerStarted","Data":"d9fbfbbeeb7c9d5c4e850a2bab7dee0bbb3b72e82c822479f1493ac93a2d9f63"} Jun 11 16:35:03.265371 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:03.265282 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vf2mk" event={"ID":"f6878e6f-105f-4b95-a976-67173395f4d1","Type":"ContainerStarted","Data":"9a23053664b1702f824c7c00416110dea363ad0d2b2b3f6d6d05898b2c4a41e2"} Jun 11 16:35:03.265735 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:03.265483 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vf2mk" Jun 11 16:35:03.270086 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:03.270038 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vf2mk" Jun 11 16:35:03.280346 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:03.280307 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-vf2mk" podStartSLOduration=2.332377764 podStartE2EDuration="3.280294006s" totalImagesPullingTime="947.916242ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:35:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:35:03.280019284 +0000 UTC m=+231.348289321" watchObservedRunningTime="2026-06-11 16:35:03.280294006 +0000 UTC m=+231.348564041" Jun 11 16:35:04.016063 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:04.016016 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-gptdq"] Jun 11 16:35:04.019122 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:04.019105 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-gptdq" Jun 11 16:35:04.021862 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:04.021839 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 16:35:04.023015 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:04.022995 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 11 16:35:04.023139 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:04.023015 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 16:35:04.023270 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:04.023253 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 11 16:35:04.023335 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:04.023282 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-q8g8h\"" Jun 11 16:35:04.023335 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:04.023330 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 16:35:04.028671 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:04.028648 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-gptdq"] Jun 11 16:35:04.177509 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:04.177458 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-gptdq\" (UID: \"d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gptdq" Jun 11 16:35:04.177509 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:04.177514 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-gptdq\" (UID: \"d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gptdq" Jun 11 16:35:04.177744 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:04.177633 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-gptdq\" (UID: \"d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gptdq" Jun 11 16:35:04.177744 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:04.177661 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzbjr\" (UniqueName: \"kubernetes.io/projected/d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4-kube-api-access-bzbjr\") pod \"prometheus-operator-7f7d445d84-gptdq\" (UID: \"d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gptdq" Jun 11 16:35:04.278343 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:04.278254 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-gptdq\" (UID: \"d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gptdq" Jun 11 16:35:04.278343 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:04.278286 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-gptdq\" (UID: \"d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gptdq" Jun 11 16:35:04.278343 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:04.278329 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-gptdq\" (UID: \"d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gptdq" Jun 11 16:35:04.278854 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:04.278453 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzbjr\" (UniqueName: \"kubernetes.io/projected/d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4-kube-api-access-bzbjr\") pod \"prometheus-operator-7f7d445d84-gptdq\" (UID: \"d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gptdq" Jun 11 16:35:04.278919 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:04.278898 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-gptdq\" (UID: \"d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gptdq" Jun 11 16:35:04.280792 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:04.280769 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-gptdq\" (UID: \"d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gptdq" Jun 11 16:35:04.280946 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:04.280930 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-gptdq\" (UID: \"d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gptdq" Jun 11 16:35:04.287719 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:04.287689 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzbjr\" (UniqueName: \"kubernetes.io/projected/d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4-kube-api-access-bzbjr\") pod \"prometheus-operator-7f7d445d84-gptdq\" (UID: \"d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gptdq" Jun 11 16:35:04.328679 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:04.328644 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-gptdq" Jun 11 16:35:04.457527 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:04.457495 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-gptdq"] Jun 11 16:35:04.461467 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:35:04.461440 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1ec7efd_6cca_4b4c_816e_4a6c0e34e5e4.slice/crio-f749f43079a20583ea1d4522dfbb4cc90d00817032a7a45116123eff9d59353c WatchSource:0}: Error finding container f749f43079a20583ea1d4522dfbb4cc90d00817032a7a45116123eff9d59353c: Status 404 returned error can't find the container with id f749f43079a20583ea1d4522dfbb4cc90d00817032a7a45116123eff9d59353c Jun 11 16:35:05.272579 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:05.272543 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-gptdq" event={"ID":"d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4","Type":"ContainerStarted","Data":"f749f43079a20583ea1d4522dfbb4cc90d00817032a7a45116123eff9d59353c"} Jun 11 16:35:05.492045 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:05.491994 2569 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" podUID="c4be3a2a-f816-4acf-9282-bb9a9e378c0c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 16:35:05.492464 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:05.492099 2569 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" Jun 11 16:35:05.492666 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:05.492637 2569 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"4e0ea7eb6c36c3080443a401c88bac2f3cc5d3ebc0f7185711e61d0b56c74d93"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 11 16:35:05.492707 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:05.492691 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" podUID="c4be3a2a-f816-4acf-9282-bb9a9e378c0c" containerName="service-proxy" containerID="cri-o://4e0ea7eb6c36c3080443a401c88bac2f3cc5d3ebc0f7185711e61d0b56c74d93" gracePeriod=30 Jun 11 16:35:06.277893 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:06.277859 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-gptdq" event={"ID":"d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4","Type":"ContainerStarted","Data":"b295991ca85e45865a21055877b17cee7696fe64e1b45be9be833d2b1bca67ca"} Jun 11 16:35:06.278117 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:06.277921 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-gptdq" event={"ID":"d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4","Type":"ContainerStarted","Data":"b1161e68ce11d858ba735ce41e57c713d1607941fae191a60bdfe0d1bc68649f"} Jun 11 16:35:06.280085 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:06.280038 2569 generic.go:356] "Generic (PLEG): container finished" podID="c4be3a2a-f816-4acf-9282-bb9a9e378c0c" containerID="4e0ea7eb6c36c3080443a401c88bac2f3cc5d3ebc0f7185711e61d0b56c74d93" exitCode=2 Jun 11 16:35:06.280189 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:06.280085 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" event={"ID":"c4be3a2a-f816-4acf-9282-bb9a9e378c0c","Type":"ContainerDied","Data":"4e0ea7eb6c36c3080443a401c88bac2f3cc5d3ebc0f7185711e61d0b56c74d93"} Jun 11 16:35:06.280189 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:06.280122 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59546b75df-s87bw" event={"ID":"c4be3a2a-f816-4acf-9282-bb9a9e378c0c","Type":"ContainerStarted","Data":"39b1507f85bc8092e29a19fb734f84bc3d0112ed9f08806ee1df72d25edc1bd4"} Jun 11 16:35:06.294920 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:06.294867 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-gptdq" podStartSLOduration=1.160669127 podStartE2EDuration="2.294852884s" totalImagesPullingTime="1.134183757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:35:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:35:06.293925752 +0000 UTC m=+234.362195788" watchObservedRunningTime="2026-06-11 16:35:06.294852884 +0000 UTC m=+234.363122920" Jun 11 16:35:08.380979 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.380938 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pzjft"] Jun 11 16:35:08.384425 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.384401 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pzjft" Jun 11 16:35:08.386919 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.386898 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 16:35:08.387033 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.386897 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 16:35:08.387033 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.386923 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q2fj7\"" Jun 11 16:35:08.387238 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.387223 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 16:35:08.512549 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.512520 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5ae726b-5718-439a-a58d-d26a0dd8c442-metrics-client-ca\") pod \"node-exporter-pzjft\" (UID: \"f5ae726b-5718-439a-a58d-d26a0dd8c442\") " pod="openshift-monitoring/node-exporter-pzjft" Jun 11 16:35:08.512549 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.512561 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqqjn\" (UniqueName: \"kubernetes.io/projected/f5ae726b-5718-439a-a58d-d26a0dd8c442-kube-api-access-nqqjn\") pod \"node-exporter-pzjft\" (UID: \"f5ae726b-5718-439a-a58d-d26a0dd8c442\") " pod="openshift-monitoring/node-exporter-pzjft" Jun 11 16:35:08.512830 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.512662 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5ae726b-5718-439a-a58d-d26a0dd8c442-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pzjft\" (UID: \"f5ae726b-5718-439a-a58d-d26a0dd8c442\") " pod="openshift-monitoring/node-exporter-pzjft" Jun 11 16:35:08.512830 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.512708 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f5ae726b-5718-439a-a58d-d26a0dd8c442-root\") pod \"node-exporter-pzjft\" (UID: \"f5ae726b-5718-439a-a58d-d26a0dd8c442\") " pod="openshift-monitoring/node-exporter-pzjft" Jun 11 16:35:08.512830 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.512736 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f5ae726b-5718-439a-a58d-d26a0dd8c442-node-exporter-tls\") pod \"node-exporter-pzjft\" (UID: \"f5ae726b-5718-439a-a58d-d26a0dd8c442\") " pod="openshift-monitoring/node-exporter-pzjft" Jun 11 16:35:08.512830 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.512762 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5ae726b-5718-439a-a58d-d26a0dd8c442-sys\") pod \"node-exporter-pzjft\" (UID: \"f5ae726b-5718-439a-a58d-d26a0dd8c442\") " pod="openshift-monitoring/node-exporter-pzjft" Jun 11 16:35:08.512830 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.512808 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f5ae726b-5718-439a-a58d-d26a0dd8c442-node-exporter-accelerators-collector-config\") pod \"node-exporter-pzjft\" (UID: \"f5ae726b-5718-439a-a58d-d26a0dd8c442\") " pod="openshift-monitoring/node-exporter-pzjft" Jun 11 16:35:08.513131 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.512864 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f5ae726b-5718-439a-a58d-d26a0dd8c442-node-exporter-textfile\") pod \"node-exporter-pzjft\" (UID: \"f5ae726b-5718-439a-a58d-d26a0dd8c442\") " pod="openshift-monitoring/node-exporter-pzjft" Jun 11 16:35:08.513131 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.512885 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f5ae726b-5718-439a-a58d-d26a0dd8c442-node-exporter-wtmp\") pod \"node-exporter-pzjft\" (UID: \"f5ae726b-5718-439a-a58d-d26a0dd8c442\") " pod="openshift-monitoring/node-exporter-pzjft" Jun 11 16:35:08.614198 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.614164 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5ae726b-5718-439a-a58d-d26a0dd8c442-metrics-client-ca\") pod \"node-exporter-pzjft\" (UID: \"f5ae726b-5718-439a-a58d-d26a0dd8c442\") " pod="openshift-monitoring/node-exporter-pzjft" Jun 11 16:35:08.614380 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.614208 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqqjn\" (UniqueName: \"kubernetes.io/projected/f5ae726b-5718-439a-a58d-d26a0dd8c442-kube-api-access-nqqjn\") pod \"node-exporter-pzjft\" (UID: \"f5ae726b-5718-439a-a58d-d26a0dd8c442\") " pod="openshift-monitoring/node-exporter-pzjft" Jun 11 16:35:08.614380 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.614265 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5ae726b-5718-439a-a58d-d26a0dd8c442-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pzjft\" (UID: \"f5ae726b-5718-439a-a58d-d26a0dd8c442\") " pod="openshift-monitoring/node-exporter-pzjft" Jun 11 16:35:08.614380 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.614297 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f5ae726b-5718-439a-a58d-d26a0dd8c442-root\") pod \"node-exporter-pzjft\" (UID: \"f5ae726b-5718-439a-a58d-d26a0dd8c442\") " pod="openshift-monitoring/node-exporter-pzjft" Jun 11 16:35:08.614380 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.614323 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f5ae726b-5718-439a-a58d-d26a0dd8c442-node-exporter-tls\") pod \"node-exporter-pzjft\" (UID: \"f5ae726b-5718-439a-a58d-d26a0dd8c442\") " pod="openshift-monitoring/node-exporter-pzjft" Jun 11 16:35:08.614380 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.614346 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5ae726b-5718-439a-a58d-d26a0dd8c442-sys\") pod \"node-exporter-pzjft\" (UID: \"f5ae726b-5718-439a-a58d-d26a0dd8c442\") " pod="openshift-monitoring/node-exporter-pzjft" Jun 11 16:35:08.614380 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.614373 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f5ae726b-5718-439a-a58d-d26a0dd8c442-node-exporter-accelerators-collector-config\") pod \"node-exporter-pzjft\" (UID: \"f5ae726b-5718-439a-a58d-d26a0dd8c442\") " pod="openshift-monitoring/node-exporter-pzjft" Jun 11 16:35:08.614683 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.614391 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f5ae726b-5718-439a-a58d-d26a0dd8c442-root\") pod \"node-exporter-pzjft\" (UID: \"f5ae726b-5718-439a-a58d-d26a0dd8c442\") " pod="openshift-monitoring/node-exporter-pzjft" Jun 11 16:35:08.614683 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.614411 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f5ae726b-5718-439a-a58d-d26a0dd8c442-node-exporter-textfile\") pod \"node-exporter-pzjft\" (UID: \"f5ae726b-5718-439a-a58d-d26a0dd8c442\") " pod="openshift-monitoring/node-exporter-pzjft" Jun 11 16:35:08.614683 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.614462 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f5ae726b-5718-439a-a58d-d26a0dd8c442-node-exporter-wtmp\") pod \"node-exporter-pzjft\" (UID: \"f5ae726b-5718-439a-a58d-d26a0dd8c442\") " pod="openshift-monitoring/node-exporter-pzjft" Jun 11 16:35:08.614683 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.614621 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f5ae726b-5718-439a-a58d-d26a0dd8c442-node-exporter-wtmp\") pod \"node-exporter-pzjft\" (UID: \"f5ae726b-5718-439a-a58d-d26a0dd8c442\") " pod="openshift-monitoring/node-exporter-pzjft" Jun 11 16:35:08.614893 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.614846 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f5ae726b-5718-439a-a58d-d26a0dd8c442-node-exporter-textfile\") pod \"node-exporter-pzjft\" (UID: \"f5ae726b-5718-439a-a58d-d26a0dd8c442\") " pod="openshift-monitoring/node-exporter-pzjft" Jun 11 16:35:08.614893 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.614873 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5ae726b-5718-439a-a58d-d26a0dd8c442-metrics-client-ca\") pod \"node-exporter-pzjft\" (UID: \"f5ae726b-5718-439a-a58d-d26a0dd8c442\") " pod="openshift-monitoring/node-exporter-pzjft" Jun 11 16:35:08.615044 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.615014 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f5ae726b-5718-439a-a58d-d26a0dd8c442-node-exporter-accelerators-collector-config\") pod \"node-exporter-pzjft\" (UID: \"f5ae726b-5718-439a-a58d-d26a0dd8c442\") " pod="openshift-monitoring/node-exporter-pzjft" Jun 11 16:35:08.615044 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.615034 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5ae726b-5718-439a-a58d-d26a0dd8c442-sys\") pod \"node-exporter-pzjft\" (UID: \"f5ae726b-5718-439a-a58d-d26a0dd8c442\") " pod="openshift-monitoring/node-exporter-pzjft" Jun 11 16:35:08.616757 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.616739 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5ae726b-5718-439a-a58d-d26a0dd8c442-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pzjft\" (UID: \"f5ae726b-5718-439a-a58d-d26a0dd8c442\") " pod="openshift-monitoring/node-exporter-pzjft" Jun 11 16:35:08.616841 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.616820 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f5ae726b-5718-439a-a58d-d26a0dd8c442-node-exporter-tls\") pod \"node-exporter-pzjft\" (UID: \"f5ae726b-5718-439a-a58d-d26a0dd8c442\") " pod="openshift-monitoring/node-exporter-pzjft" Jun 11 16:35:08.628874 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.628844 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqqjn\" (UniqueName: \"kubernetes.io/projected/f5ae726b-5718-439a-a58d-d26a0dd8c442-kube-api-access-nqqjn\") pod \"node-exporter-pzjft\" (UID: \"f5ae726b-5718-439a-a58d-d26a0dd8c442\") " pod="openshift-monitoring/node-exporter-pzjft" Jun 11 16:35:08.694076 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:08.694024 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pzjft" Jun 11 16:35:08.705397 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:35:08.705368 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5ae726b_5718_439a_a58d_d26a0dd8c442.slice/crio-ee8527172cb98034a58ad837ae803b34f332beadc53de26ca1135f7fb7ee648a WatchSource:0}: Error finding container ee8527172cb98034a58ad837ae803b34f332beadc53de26ca1135f7fb7ee648a: Status 404 returned error can't find the container with id ee8527172cb98034a58ad837ae803b34f332beadc53de26ca1135f7fb7ee648a Jun 11 16:35:09.295015 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.294982 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pzjft" event={"ID":"f5ae726b-5718-439a-a58d-d26a0dd8c442","Type":"ContainerStarted","Data":"ee8527172cb98034a58ad837ae803b34f332beadc53de26ca1135f7fb7ee648a"} Jun 11 16:35:09.449757 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.449725 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 16:35:09.456584 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.456551 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.459421 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.459387 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 16:35:09.459562 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.459429 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 16:35:09.459562 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.459469 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 16:35:09.459781 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.459764 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 16:35:09.460255 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.459887 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 16:35:09.460255 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.460033 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 16:35:09.460255 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.460025 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 16:35:09.460255 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.460131 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 16:35:09.460255 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.460169 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-78c6g\"" Jun 11 16:35:09.460255 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.460176 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 16:35:09.469443 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.469408 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 16:35:09.624282 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.624252 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/17703228-ab40-4328-a712-59c9c78901e1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.624442 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.624289 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-web-config\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.624442 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.624316 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17703228-ab40-4328-a712-59c9c78901e1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.624442 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.624394 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-config-volume\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.624442 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.624429 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/17703228-ab40-4328-a712-59c9c78901e1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.624670 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.624447 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.624670 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.624476 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17703228-ab40-4328-a712-59c9c78901e1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.624670 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.624495 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.624670 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.624557 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.624670 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.624597 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/17703228-ab40-4328-a712-59c9c78901e1-config-out\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.624670 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.624612 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.624863 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.624672 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptrwh\" (UniqueName: \"kubernetes.io/projected/17703228-ab40-4328-a712-59c9c78901e1-kube-api-access-ptrwh\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.624863 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.624722 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.725489 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.725457 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/17703228-ab40-4328-a712-59c9c78901e1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.725489 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.725497 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-web-config\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.725733 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.725515 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17703228-ab40-4328-a712-59c9c78901e1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.725733 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.725535 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-config-volume\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.725733 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.725552 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/17703228-ab40-4328-a712-59c9c78901e1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.725733 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.725575 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.725733 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.725606 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17703228-ab40-4328-a712-59c9c78901e1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.725733 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.725628 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.725733 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.725670 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.725733 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.725719 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/17703228-ab40-4328-a712-59c9c78901e1-config-out\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.726144 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.725744 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.726144 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:35:09.725766 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17703228-ab40-4328-a712-59c9c78901e1-alertmanager-trusted-ca-bundle podName:17703228-ab40-4328-a712-59c9c78901e1 nodeName:}" failed. No retries permitted until 2026-06-11 16:35:10.225746135 +0000 UTC m=+238.294016149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/17703228-ab40-4328-a712-59c9c78901e1-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "17703228-ab40-4328-a712-59c9c78901e1") : configmap references non-existent config key: ca-bundle.crt Jun 11 16:35:09.726144 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.725823 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptrwh\" (UniqueName: \"kubernetes.io/projected/17703228-ab40-4328-a712-59c9c78901e1-kube-api-access-ptrwh\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.726144 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.725865 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.726503 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.726212 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/17703228-ab40-4328-a712-59c9c78901e1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.726694 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.726638 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17703228-ab40-4328-a712-59c9c78901e1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.728917 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.728887 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-config-volume\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.729186 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.729138 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/17703228-ab40-4328-a712-59c9c78901e1-config-out\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.729324 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.729302 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-web-config\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.729453 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.729431 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/17703228-ab40-4328-a712-59c9c78901e1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.729504 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.729446 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.729504 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.729439 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.729609 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.729588 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.729974 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.729959 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.730606 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.730591 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:09.742176 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:09.742145 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptrwh\" (UniqueName: \"kubernetes.io/projected/17703228-ab40-4328-a712-59c9c78901e1-kube-api-access-ptrwh\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:10.230035 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.229995 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17703228-ab40-4328-a712-59c9c78901e1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:10.230751 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.230729 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17703228-ab40-4328-a712-59c9c78901e1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:10.299679 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.299637 2569 generic.go:356] "Generic (PLEG): container finished" podID="f5ae726b-5718-439a-a58d-d26a0dd8c442" containerID="8f9ba1f30a824ba0dec45fd5985047d6bb5222eabb373e3b0883a500a2f0632c" exitCode=0 Jun 11 16:35:10.299863 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.299726 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pzjft" event={"ID":"f5ae726b-5718-439a-a58d-d26a0dd8c442","Type":"ContainerDied","Data":"8f9ba1f30a824ba0dec45fd5985047d6bb5222eabb373e3b0883a500a2f0632c"} Jun 11 16:35:10.360324 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.360293 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-689b7c9588-474jg"] Jun 11 16:35:10.363766 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.363739 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" Jun 11 16:35:10.366515 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.366486 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 11 16:35:10.366638 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.366601 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 11 16:35:10.366706 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.366664 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 11 16:35:10.367266 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.367248 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 11 16:35:10.367377 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.367254 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bq7mueh5s8sff\"" Jun 11 16:35:10.367515 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.367499 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-b5s2n\"" Jun 11 16:35:10.367588 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.367517 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 11 16:35:10.368870 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.368852 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:35:10.376629 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.376602 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-689b7c9588-474jg"] Jun 11 16:35:10.521807 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.521715 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 16:35:10.524802 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:35:10.524776 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17703228_ab40_4328_a712_59c9c78901e1.slice/crio-9cf940ce5920c202b8a10b34d4ca6f1e3852f583a0a270e7e77a1544a4bf2cc3 WatchSource:0}: Error finding container 9cf940ce5920c202b8a10b34d4ca6f1e3852f583a0a270e7e77a1544a4bf2cc3: Status 404 returned error can't find the container with id 9cf940ce5920c202b8a10b34d4ca6f1e3852f583a0a270e7e77a1544a4bf2cc3 Jun 11 16:35:10.532097 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.532033 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fb4efb1d-c77a-4ce2-a5b3-8cc963f72508-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-689b7c9588-474jg\" (UID: \"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508\") " pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" Jun 11 16:35:10.532198 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.532111 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fb4efb1d-c77a-4ce2-a5b3-8cc963f72508-secret-thanos-querier-tls\") pod \"thanos-querier-689b7c9588-474jg\" (UID: \"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508\") " pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" Jun 11 16:35:10.532198 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.532135 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb4efb1d-c77a-4ce2-a5b3-8cc963f72508-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-689b7c9588-474jg\" (UID: \"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508\") " pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" Jun 11 16:35:10.532198 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.532155 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb4efb1d-c77a-4ce2-a5b3-8cc963f72508-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-689b7c9588-474jg\" (UID: \"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508\") " pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" Jun 11 16:35:10.532198 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.532191 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb4efb1d-c77a-4ce2-a5b3-8cc963f72508-metrics-client-ca\") pod \"thanos-querier-689b7c9588-474jg\" (UID: \"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508\") " pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" Jun 11 16:35:10.532349 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.532243 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fb4efb1d-c77a-4ce2-a5b3-8cc963f72508-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-689b7c9588-474jg\" (UID: \"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508\") " pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" Jun 11 16:35:10.532349 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.532258 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fb4efb1d-c77a-4ce2-a5b3-8cc963f72508-secret-grpc-tls\") pod \"thanos-querier-689b7c9588-474jg\" (UID: \"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508\") " pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" Jun 11 16:35:10.532349 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.532333 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swhvj\" (UniqueName: \"kubernetes.io/projected/fb4efb1d-c77a-4ce2-a5b3-8cc963f72508-kube-api-access-swhvj\") pod \"thanos-querier-689b7c9588-474jg\" (UID: \"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508\") " pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" Jun 11 16:35:10.632974 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.632940 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fb4efb1d-c77a-4ce2-a5b3-8cc963f72508-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-689b7c9588-474jg\" (UID: \"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508\") " pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" Jun 11 16:35:10.632974 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.632979 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fb4efb1d-c77a-4ce2-a5b3-8cc963f72508-secret-thanos-querier-tls\") pod \"thanos-querier-689b7c9588-474jg\" (UID: \"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508\") " pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" Jun 11 16:35:10.633240 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.632999 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb4efb1d-c77a-4ce2-a5b3-8cc963f72508-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-689b7c9588-474jg\" (UID: \"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508\") " pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" Jun 11 16:35:10.633240 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.633134 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb4efb1d-c77a-4ce2-a5b3-8cc963f72508-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-689b7c9588-474jg\" (UID: \"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508\") " pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" Jun 11 16:35:10.633240 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.633227 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb4efb1d-c77a-4ce2-a5b3-8cc963f72508-metrics-client-ca\") pod \"thanos-querier-689b7c9588-474jg\" (UID: \"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508\") " pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" Jun 11 16:35:10.633367 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.633276 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fb4efb1d-c77a-4ce2-a5b3-8cc963f72508-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-689b7c9588-474jg\" (UID: \"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508\") " pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" Jun 11 16:35:10.633367 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.633302 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fb4efb1d-c77a-4ce2-a5b3-8cc963f72508-secret-grpc-tls\") pod \"thanos-querier-689b7c9588-474jg\" (UID: \"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508\") " pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" Jun 11 16:35:10.633367 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.633358 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swhvj\" (UniqueName: \"kubernetes.io/projected/fb4efb1d-c77a-4ce2-a5b3-8cc963f72508-kube-api-access-swhvj\") pod \"thanos-querier-689b7c9588-474jg\" (UID: \"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508\") " pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" Jun 11 16:35:10.634239 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.634204 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb4efb1d-c77a-4ce2-a5b3-8cc963f72508-metrics-client-ca\") pod \"thanos-querier-689b7c9588-474jg\" (UID: \"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508\") " pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" Jun 11 16:35:10.635876 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.635846 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb4efb1d-c77a-4ce2-a5b3-8cc963f72508-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-689b7c9588-474jg\" (UID: \"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508\") " pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" Jun 11 16:35:10.636008 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.635989 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fb4efb1d-c77a-4ce2-a5b3-8cc963f72508-secret-thanos-querier-tls\") pod \"thanos-querier-689b7c9588-474jg\" (UID: \"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508\") " pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" Jun 11 16:35:10.636243 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.636215 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fb4efb1d-c77a-4ce2-a5b3-8cc963f72508-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-689b7c9588-474jg\" (UID: \"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508\") " pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" Jun 11 16:35:10.636434 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.636310 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fb4efb1d-c77a-4ce2-a5b3-8cc963f72508-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-689b7c9588-474jg\" (UID: \"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508\") " pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" Jun 11 16:35:10.636507 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.636460 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb4efb1d-c77a-4ce2-a5b3-8cc963f72508-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-689b7c9588-474jg\" (UID: \"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508\") " pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" Jun 11 16:35:10.636592 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.636570 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fb4efb1d-c77a-4ce2-a5b3-8cc963f72508-secret-grpc-tls\") pod \"thanos-querier-689b7c9588-474jg\" (UID: \"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508\") " pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" Jun 11 16:35:10.644897 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.644869 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swhvj\" (UniqueName: \"kubernetes.io/projected/fb4efb1d-c77a-4ce2-a5b3-8cc963f72508-kube-api-access-swhvj\") pod \"thanos-querier-689b7c9588-474jg\" (UID: \"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508\") " pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" Jun 11 16:35:10.674762 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.674733 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" Jun 11 16:35:10.812392 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:10.812311 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-689b7c9588-474jg"] Jun 11 16:35:10.815908 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:35:10.815884 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb4efb1d_c77a_4ce2_a5b3_8cc963f72508.slice/crio-11494a49f840c9949eec3ead11fb49095ab166344d0484ba46b6159680f647db WatchSource:0}: Error finding container 11494a49f840c9949eec3ead11fb49095ab166344d0484ba46b6159680f647db: Status 404 returned error can't find the container with id 11494a49f840c9949eec3ead11fb49095ab166344d0484ba46b6159680f647db Jun 11 16:35:11.308541 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:11.308500 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pzjft" event={"ID":"f5ae726b-5718-439a-a58d-d26a0dd8c442","Type":"ContainerStarted","Data":"2080a4ec9302d5a1c7b60011b00afd0bf71127ba074e296ef1be18e70ad676bb"} Jun 11 16:35:11.308739 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:11.308569 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pzjft" event={"ID":"f5ae726b-5718-439a-a58d-d26a0dd8c442","Type":"ContainerStarted","Data":"725766534d38d4a016afe3f2b7187b299bf657d8b1495d70269f1677f59b3589"} Jun 11 16:35:11.309794 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:11.309768 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" event={"ID":"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508","Type":"ContainerStarted","Data":"11494a49f840c9949eec3ead11fb49095ab166344d0484ba46b6159680f647db"} Jun 11 16:35:11.311256 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:11.311228 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"17703228-ab40-4328-a712-59c9c78901e1","Type":"ContainerStarted","Data":"9cf940ce5920c202b8a10b34d4ca6f1e3852f583a0a270e7e77a1544a4bf2cc3"} Jun 11 16:35:11.330361 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:11.330307 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pzjft" podStartSLOduration=2.422198565 podStartE2EDuration="3.330288298s" totalImagesPullingTime="830.683645ms" totalInitContainerRuntime="77.406088ms" isStatefulPod=true podCreationTimestamp="2026-06-11 16:35:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:35:11.328670107 +0000 UTC m=+239.396940144" watchObservedRunningTime="2026-06-11 16:35:11.330288298 +0000 UTC m=+239.398558364" Jun 11 16:35:12.318032 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:12.317998 2569 generic.go:356] "Generic (PLEG): container finished" podID="17703228-ab40-4328-a712-59c9c78901e1" containerID="16d532316e5b75f39a7ebe7b8326752e0999ae198cfd5b4470be2bfbc4c64f16" exitCode=0 Jun 11 16:35:12.318469 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:12.318099 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"17703228-ab40-4328-a712-59c9c78901e1","Type":"ContainerDied","Data":"16d532316e5b75f39a7ebe7b8326752e0999ae198cfd5b4470be2bfbc4c64f16"} Jun 11 16:35:13.153889 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:13.153861 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-6pnqb"] Jun 11 16:35:13.157238 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:13.157202 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-6pnqb" Jun 11 16:35:13.159992 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:13.159909 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 11 16:35:13.159992 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:13.159982 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-8kkzm\"" Jun 11 16:35:13.165123 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:13.165028 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-6pnqb"] Jun 11 16:35:13.255447 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:13.255360 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2bec74cd-b2ee-432c-a68c-eee82ac4b08a-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-6pnqb\" (UID: \"2bec74cd-b2ee-432c-a68c-eee82ac4b08a\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-6pnqb" Jun 11 16:35:13.255447 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:13.255410 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9z2j\" (UniqueName: \"kubernetes.io/projected/2bec74cd-b2ee-432c-a68c-eee82ac4b08a-kube-api-access-b9z2j\") pod \"monitoring-plugin-76b68cc874-6pnqb\" (UID: \"2bec74cd-b2ee-432c-a68c-eee82ac4b08a\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-6pnqb" Jun 11 16:35:13.323417 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:13.323383 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" event={"ID":"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508","Type":"ContainerStarted","Data":"55300f149933a248b781ab1ef0a75fef604d0d44552db824b6f10dd4590176ef"} Jun 11 16:35:13.323783 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:13.323449 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" event={"ID":"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508","Type":"ContainerStarted","Data":"4a0986fae6f08e8d96e49856d8aec3ab27d5bcb7389824fb516932946f49f27a"} Jun 11 16:35:13.323783 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:13.323476 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" event={"ID":"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508","Type":"ContainerStarted","Data":"d2271cb573c087ee1c77960c44c58619cd780f7b1dc8c1080fcdc33a4cb59ab9"} Jun 11 16:35:13.356196 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:13.356160 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2bec74cd-b2ee-432c-a68c-eee82ac4b08a-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-6pnqb\" (UID: \"2bec74cd-b2ee-432c-a68c-eee82ac4b08a\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-6pnqb" Jun 11 16:35:13.356387 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:13.356217 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9z2j\" (UniqueName: \"kubernetes.io/projected/2bec74cd-b2ee-432c-a68c-eee82ac4b08a-kube-api-access-b9z2j\") pod \"monitoring-plugin-76b68cc874-6pnqb\" (UID: \"2bec74cd-b2ee-432c-a68c-eee82ac4b08a\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-6pnqb" Jun 11 16:35:13.356387 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:35:13.356317 2569 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 11 16:35:13.356497 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:35:13.356397 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bec74cd-b2ee-432c-a68c-eee82ac4b08a-monitoring-plugin-cert podName:2bec74cd-b2ee-432c-a68c-eee82ac4b08a nodeName:}" failed. No retries permitted until 2026-06-11 16:35:13.8563762 +0000 UTC m=+241.924646219 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/2bec74cd-b2ee-432c-a68c-eee82ac4b08a-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-6pnqb" (UID: "2bec74cd-b2ee-432c-a68c-eee82ac4b08a") : secret "monitoring-plugin-cert" not found Jun 11 16:35:13.367419 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:13.367392 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9z2j\" (UniqueName: \"kubernetes.io/projected/2bec74cd-b2ee-432c-a68c-eee82ac4b08a-kube-api-access-b9z2j\") pod \"monitoring-plugin-76b68cc874-6pnqb\" (UID: \"2bec74cd-b2ee-432c-a68c-eee82ac4b08a\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-6pnqb" Jun 11 16:35:13.860906 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:13.860865 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2bec74cd-b2ee-432c-a68c-eee82ac4b08a-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-6pnqb\" (UID: \"2bec74cd-b2ee-432c-a68c-eee82ac4b08a\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-6pnqb" Jun 11 16:35:13.864117 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:13.864087 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2bec74cd-b2ee-432c-a68c-eee82ac4b08a-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-6pnqb\" (UID: \"2bec74cd-b2ee-432c-a68c-eee82ac4b08a\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-6pnqb" Jun 11 16:35:14.071473 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.071434 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-6pnqb" Jun 11 16:35:14.245293 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.245108 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-6pnqb"] Jun 11 16:35:14.247986 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:35:14.247954 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bec74cd_b2ee_432c_a68c_eee82ac4b08a.slice/crio-4bd3f48ba16c6af6d47aacb7b53ef3e6750dd8faebd52c08696f98421080dd99 WatchSource:0}: Error finding container 4bd3f48ba16c6af6d47aacb7b53ef3e6750dd8faebd52c08696f98421080dd99: Status 404 returned error can't find the container with id 4bd3f48ba16c6af6d47aacb7b53ef3e6750dd8faebd52c08696f98421080dd99 Jun 11 16:35:14.330773 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.330697 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" event={"ID":"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508","Type":"ContainerStarted","Data":"6deb866cb3f0fe9a1b5017a3027edcd2a0a9543493251719d9c2cd2e2a7087ed"} Jun 11 16:35:14.331181 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.330773 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" event={"ID":"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508","Type":"ContainerStarted","Data":"39e2085021b4cf3f36e9390318ceebbcd6d35e389e683b9ef9e60b236ff41612"} Jun 11 16:35:14.331181 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.330842 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" event={"ID":"fb4efb1d-c77a-4ce2-a5b3-8cc963f72508","Type":"ContainerStarted","Data":"3cfef0753bd091bcfa938ff6afd36bd04c013dc763cac09ce1a738fa835ebb96"} Jun 11 16:35:14.333733 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.333242 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"17703228-ab40-4328-a712-59c9c78901e1","Type":"ContainerStarted","Data":"be9cb9642cf5a23b6262fd836071107fdea4c1463e60c1a4c30886b6a8813e7a"} Jun 11 16:35:14.333733 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.333318 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"17703228-ab40-4328-a712-59c9c78901e1","Type":"ContainerStarted","Data":"f57883f05b480af16739823769d451686124d1b7ed8b7e785129e08a0af3a1c8"} Jun 11 16:35:14.333733 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.333363 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"17703228-ab40-4328-a712-59c9c78901e1","Type":"ContainerStarted","Data":"d065e1fa9559030f16bf43072c9485898e0300c96a20d87cfa7e2c362dbd720e"} Jun 11 16:35:14.334849 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.334813 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-6pnqb" event={"ID":"2bec74cd-b2ee-432c-a68c-eee82ac4b08a","Type":"ContainerStarted","Data":"4bd3f48ba16c6af6d47aacb7b53ef3e6750dd8faebd52c08696f98421080dd99"} Jun 11 16:35:14.614687 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.614649 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 16:35:14.628463 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.628388 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.633990 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.633964 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 16:35:14.636838 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.636664 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 16:35:14.637273 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.637232 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 16:35:14.637273 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.637270 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 16:35:14.637462 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.637397 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 16:35:14.637562 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.637479 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mxzfg\"" Jun 11 16:35:14.637845 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.637831 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 16:35:14.642768 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.642749 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 16:35:14.649863 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.649838 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6nbpjqeo64b3g\"" Jun 11 16:35:14.649976 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.649840 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 16:35:14.649976 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.649857 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 16:35:14.652409 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.652387 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 16:35:14.653279 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.653259 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 16:35:14.655929 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.655898 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 16:35:14.658077 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.658034 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 16:35:14.665894 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.665872 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 16:35:14.666004 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.665900 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 16:35:14.673919 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.673894 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.674096 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.673932 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.674096 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.673963 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7212542f-c985-45f8-985c-469ff9b027ed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.674096 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.673991 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.674096 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.674018 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-web-config\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.674096 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.674044 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.674311 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.674098 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.674311 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.674120 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7212542f-c985-45f8-985c-469ff9b027ed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.674311 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.674198 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-config\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.674311 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.674243 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.674311 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.674283 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.674449 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.674312 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.674449 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.674344 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7212542f-c985-45f8-985c-469ff9b027ed-config-out\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.674449 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.674367 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.674449 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.674391 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.674449 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.674435 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.674616 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.674466 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.674616 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.674492 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjfc6\" (UniqueName: \"kubernetes.io/projected/7212542f-c985-45f8-985c-469ff9b027ed-kube-api-access-jjfc6\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.674616 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.674578 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.674802 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.674615 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.722267 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.722237 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 16:35:14.775842 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.775810 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.776043 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.775866 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.776043 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.775910 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.776043 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.775944 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7212542f-c985-45f8-985c-469ff9b027ed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.776043 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.775970 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.776043 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.775995 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-web-config\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.776043 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.776021 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.776043 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.776041 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.776396 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.776105 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7212542f-c985-45f8-985c-469ff9b027ed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.776874 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.776507 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7212542f-c985-45f8-985c-469ff9b027ed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.777631 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.776968 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.777631 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.777025 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-config\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.777631 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.777096 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.777631 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.777155 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.777631 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.777183 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.777631 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.777216 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7212542f-c985-45f8-985c-469ff9b027ed-config-out\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.777631 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.777242 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.777631 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.777267 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.777631 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.777310 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.777631 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.777348 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.777631 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.777374 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjfc6\" (UniqueName: \"kubernetes.io/projected/7212542f-c985-45f8-985c-469ff9b027ed-kube-api-access-jjfc6\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.777631 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.777420 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.780806 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.778388 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.780806 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.778450 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.780806 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.779035 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.780806 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.779873 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.780806 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.780222 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.781242 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.781219 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.782387 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.781914 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7212542f-c985-45f8-985c-469ff9b027ed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.782387 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.782009 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.782387 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.782350 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-config\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.783110 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.782613 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.783110 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.782695 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.783110 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.782834 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.783110 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.782976 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-web-config\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.783110 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.783041 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.784107 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.783805 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.784107 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.784015 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.784315 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.784292 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7212542f-c985-45f8-985c-469ff9b027ed-config-out\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.792208 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.792183 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjfc6\" (UniqueName: \"kubernetes.io/projected/7212542f-c985-45f8-985c-469ff9b027ed-kube-api-access-jjfc6\") pod \"prometheus-k8s-0\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:14.940080 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:14.940020 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:15.110943 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:15.110911 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 16:35:15.342669 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:15.342588 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"17703228-ab40-4328-a712-59c9c78901e1","Type":"ContainerStarted","Data":"13f7820c47833e226f56ff02bcd099da572c5d1bec3321cee0b1b5cbab22318e"} Jun 11 16:35:15.343118 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:15.342676 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"17703228-ab40-4328-a712-59c9c78901e1","Type":"ContainerStarted","Data":"4a80d49ecb2e1a8fcee2acf5828fa2dca3f1f08f34dc1a996b5ac85af279b17e"} Jun 11 16:35:15.343118 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:15.342725 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"17703228-ab40-4328-a712-59c9c78901e1","Type":"ContainerStarted","Data":"9faa6e7027455608f6a23db0184aa471be2b5d1bcb80b054ee973e128aab0ae2"} Jun 11 16:35:15.373385 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:15.373319 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.530809202 podStartE2EDuration="6.373298425s" totalImagesPullingTime="2.826709117s" totalInitContainerRuntime="15.780106ms" isStatefulPod=false podCreationTimestamp="2026-06-11 16:35:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:35:15.370784058 +0000 UTC m=+243.439054095" watchObservedRunningTime="2026-06-11 16:35:15.373298425 +0000 UTC m=+243.441568462" Jun 11 16:35:15.401301 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:15.400121 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" podStartSLOduration=2.333549915 podStartE2EDuration="5.400095445s" totalImagesPullingTime="3.06654553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:35:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:35:15.39908295 +0000 UTC m=+243.467352987" watchObservedRunningTime="2026-06-11 16:35:15.400095445 +0000 UTC m=+243.468365482" Jun 11 16:35:15.443597 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:35:15.443548 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7212542f_c985_45f8_985c_469ff9b027ed.slice/crio-fd06495e29ddfaf219e26cc7cca4334b77d739a08ed6c115421c039b60185fd6 WatchSource:0}: Error finding container fd06495e29ddfaf219e26cc7cca4334b77d739a08ed6c115421c039b60185fd6: Status 404 returned error can't find the container with id fd06495e29ddfaf219e26cc7cca4334b77d739a08ed6c115421c039b60185fd6 Jun 11 16:35:16.348742 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:16.348644 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-6pnqb" event={"ID":"2bec74cd-b2ee-432c-a68c-eee82ac4b08a","Type":"ContainerStarted","Data":"a0d3cef52fcea73787c38d7018c75a1ba2ead3fe32cb6deacd54143628fe5f6d"} Jun 11 16:35:16.349189 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:16.348794 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-6pnqb" Jun 11 16:35:16.350796 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:16.350760 2569 generic.go:356] "Generic (PLEG): container finished" podID="7212542f-c985-45f8-985c-469ff9b027ed" containerID="2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e" exitCode=0 Jun 11 16:35:16.350996 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:16.350976 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7212542f-c985-45f8-985c-469ff9b027ed","Type":"ContainerDied","Data":"2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e"} Jun 11 16:35:16.351136 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:16.351117 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7212542f-c985-45f8-985c-469ff9b027ed","Type":"ContainerStarted","Data":"fd06495e29ddfaf219e26cc7cca4334b77d739a08ed6c115421c039b60185fd6"} Jun 11 16:35:16.355622 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:16.351814 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" Jun 11 16:35:16.360762 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:16.360745 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-6pnqb" Jun 11 16:35:16.367730 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:16.367686 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-6pnqb" podStartSLOduration=2.122018073 podStartE2EDuration="3.367671567s" totalImagesPullingTime="1.245653494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:35:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:35:16.366290092 +0000 UTC m=+244.434560128" watchObservedRunningTime="2026-06-11 16:35:16.367671567 +0000 UTC m=+244.435941645" Jun 11 16:35:20.370214 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:20.370183 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7212542f-c985-45f8-985c-469ff9b027ed","Type":"ContainerStarted","Data":"95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7"} Jun 11 16:35:20.370628 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:20.370247 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7212542f-c985-45f8-985c-469ff9b027ed","Type":"ContainerStarted","Data":"ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a"} Jun 11 16:35:20.370628 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:20.370275 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7212542f-c985-45f8-985c-469ff9b027ed","Type":"ContainerStarted","Data":"aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a"} Jun 11 16:35:20.370628 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:20.370301 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7212542f-c985-45f8-985c-469ff9b027ed","Type":"ContainerStarted","Data":"96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1"} Jun 11 16:35:20.370628 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:20.370324 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7212542f-c985-45f8-985c-469ff9b027ed","Type":"ContainerStarted","Data":"1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16"} Jun 11 16:35:20.370628 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:20.370346 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7212542f-c985-45f8-985c-469ff9b027ed","Type":"ContainerStarted","Data":"dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4"} Jun 11 16:35:20.404318 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:20.404252 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.102325438 podStartE2EDuration="6.404228988s" totalImagesPullingTime="3.280918447s" totalInitContainerRuntime="20.985103ms" isStatefulPod=false podCreationTimestamp="2026-06-11 16:35:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:35:20.40272791 +0000 UTC m=+248.470997970" watchObservedRunningTime="2026-06-11 16:35:20.404228988 +0000 UTC m=+248.472499027" Jun 11 16:35:22.363562 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:22.363537 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-689b7c9588-474jg" Jun 11 16:35:23.258480 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:23.258424 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-metrics-certs\") pod \"network-metrics-daemon-6k5sj\" (UID: \"941f2a27-1f4c-400e-a50e-8a541e5fb4a7\") " pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:35:23.261024 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:23.260995 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/941f2a27-1f4c-400e-a50e-8a541e5fb4a7-metrics-certs\") pod \"network-metrics-daemon-6k5sj\" (UID: \"941f2a27-1f4c-400e-a50e-8a541e5fb4a7\") " pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:35:23.359211 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:23.359178 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l4qlb\"" Jun 11 16:35:23.367573 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:23.367545 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6k5sj" Jun 11 16:35:23.523581 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:23.523416 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6k5sj"] Jun 11 16:35:23.530962 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:35:23.530931 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod941f2a27_1f4c_400e_a50e_8a541e5fb4a7.slice/crio-b5ddd1d02c68649654129dba6528f2243ea510c1eab775b978652ffa347e0f89 WatchSource:0}: Error finding container b5ddd1d02c68649654129dba6528f2243ea510c1eab775b978652ffa347e0f89: Status 404 returned error can't find the container with id b5ddd1d02c68649654129dba6528f2243ea510c1eab775b978652ffa347e0f89 Jun 11 16:35:24.388569 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:24.388529 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6k5sj" event={"ID":"941f2a27-1f4c-400e-a50e-8a541e5fb4a7","Type":"ContainerStarted","Data":"b5ddd1d02c68649654129dba6528f2243ea510c1eab775b978652ffa347e0f89"} Jun 11 16:35:24.940889 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:24.940851 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:35:25.396253 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:25.396166 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6k5sj" event={"ID":"941f2a27-1f4c-400e-a50e-8a541e5fb4a7","Type":"ContainerStarted","Data":"e375ee16d9c3d3ca50ffdc51b6c56897948f7fd366b7150398cc341f074f8384"} Jun 11 16:35:25.396253 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:25.396224 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6k5sj" event={"ID":"941f2a27-1f4c-400e-a50e-8a541e5fb4a7","Type":"ContainerStarted","Data":"45b73b5ede88b64e7df59c2eb06a4b2a4f1a393249a1d2d0c1a95b1db58fa7d5"} Jun 11 16:35:25.413800 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:25.413740 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6k5sj" podStartSLOduration=252.519713891 podStartE2EDuration="4m13.413718469s" totalImagesPullingTime="894.004578ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:35:25.412386004 +0000 UTC m=+253.480656051" watchObservedRunningTime="2026-06-11 16:35:25.413718469 +0000 UTC m=+253.481988506" Jun 11 16:35:54.052341 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:35:54.052291 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lxkqq" podUID="305a9021-ddf2-4eca-8df5-2fbe025ac9bd" Jun 11 16:35:54.078845 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:54.078811 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_17703228-ab40-4328-a712-59c9c78901e1/init-config-reloader/0.log" Jun 11 16:35:54.277265 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:54.277236 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_17703228-ab40-4328-a712-59c9c78901e1/alertmanager/0.log" Jun 11 16:35:54.478073 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:54.478024 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_17703228-ab40-4328-a712-59c9c78901e1/config-reloader/0.log" Jun 11 16:35:54.505297 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:54.505267 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lxkqq" Jun 11 16:35:54.677809 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:54.677777 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_17703228-ab40-4328-a712-59c9c78901e1/kube-rbac-proxy-web/0.log" Jun 11 16:35:54.877978 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:54.877894 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_17703228-ab40-4328-a712-59c9c78901e1/kube-rbac-proxy/0.log" Jun 11 16:35:55.078086 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:55.078042 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_17703228-ab40-4328-a712-59c9c78901e1/kube-rbac-proxy-metric/0.log" Jun 11 16:35:55.277132 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:55.277106 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_17703228-ab40-4328-a712-59c9c78901e1/prom-label-proxy/0.log" Jun 11 16:35:56.477504 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:56.477475 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-6pnqb_2bec74cd-b2ee-432c-a68c-eee82ac4b08a/monitoring-plugin/0.log" Jun 11 16:35:56.677282 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:56.677258 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pzjft_f5ae726b-5718-439a-a58d-d26a0dd8c442/init-textfile/0.log" Jun 11 16:35:56.878981 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:56.878898 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pzjft_f5ae726b-5718-439a-a58d-d26a0dd8c442/node-exporter/0.log" Jun 11 16:35:57.080943 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:57.080918 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pzjft_f5ae726b-5718-439a-a58d-d26a0dd8c442/kube-rbac-proxy/0.log" Jun 11 16:35:57.356668 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:57.356635 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-metrics-tls\") pod \"dns-default-lxkqq\" (UID: \"305a9021-ddf2-4eca-8df5-2fbe025ac9bd\") " pod="openshift-dns/dns-default-lxkqq" Jun 11 16:35:57.359086 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:57.359047 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/305a9021-ddf2-4eca-8df5-2fbe025ac9bd-metrics-tls\") pod \"dns-default-lxkqq\" (UID: \"305a9021-ddf2-4eca-8df5-2fbe025ac9bd\") " pod="openshift-dns/dns-default-lxkqq" Jun 11 16:35:57.509306 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:57.509279 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hsnw5\"" Jun 11 16:35:57.516978 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:57.516961 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lxkqq" Jun 11 16:35:57.658303 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:57.654372 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lxkqq"] Jun 11 16:35:57.662404 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:35:57.662378 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod305a9021_ddf2_4eca_8df5_2fbe025ac9bd.slice/crio-978e058d4ef9847fab6b659c0e789d1d35c8620e9c46d3bdbb46d69b275524e0 WatchSource:0}: Error finding container 978e058d4ef9847fab6b659c0e789d1d35c8620e9c46d3bdbb46d69b275524e0: Status 404 returned error can't find the container with id 978e058d4ef9847fab6b659c0e789d1d35c8620e9c46d3bdbb46d69b275524e0 Jun 11 16:35:58.521256 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:58.521218 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lxkqq" event={"ID":"305a9021-ddf2-4eca-8df5-2fbe025ac9bd","Type":"ContainerStarted","Data":"978e058d4ef9847fab6b659c0e789d1d35c8620e9c46d3bdbb46d69b275524e0"} Jun 11 16:35:59.077970 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:59.077937 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7212542f-c985-45f8-985c-469ff9b027ed/init-config-reloader/0.log" Jun 11 16:35:59.279590 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:59.279563 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7212542f-c985-45f8-985c-469ff9b027ed/prometheus/0.log" Jun 11 16:35:59.477969 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:59.477941 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7212542f-c985-45f8-985c-469ff9b027ed/config-reloader/0.log" Jun 11 16:35:59.529031 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:59.528995 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lxkqq" event={"ID":"305a9021-ddf2-4eca-8df5-2fbe025ac9bd","Type":"ContainerStarted","Data":"6124fe58418f9b05e79a64a466c66c63ff360303e93a48941ab0e620ad85d615"} Jun 11 16:35:59.529438 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:59.529067 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lxkqq" event={"ID":"305a9021-ddf2-4eca-8df5-2fbe025ac9bd","Type":"ContainerStarted","Data":"ac360394ef1894112e112794597ff3fe6808edc921c55e3139530bda0f960e19"} Jun 11 16:35:59.529438 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:59.529116 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lxkqq" Jun 11 16:35:59.548107 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:59.548029 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lxkqq" podStartSLOduration=251.12753198 podStartE2EDuration="4m12.548013734s" totalImagesPullingTime="1.420481754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:35:59.546360268 +0000 UTC m=+287.614630304" watchObservedRunningTime="2026-06-11 16:35:59.548013734 +0000 UTC m=+287.616283770" Jun 11 16:35:59.678136 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:59.678110 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7212542f-c985-45f8-985c-469ff9b027ed/thanos-sidecar/0.log" Jun 11 16:35:59.877273 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:35:59.877194 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7212542f-c985-45f8-985c-469ff9b027ed/kube-rbac-proxy-web/0.log" Jun 11 16:36:00.077459 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:00.077429 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7212542f-c985-45f8-985c-469ff9b027ed/kube-rbac-proxy/0.log" Jun 11 16:36:00.277665 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:00.277634 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7212542f-c985-45f8-985c-469ff9b027ed/kube-rbac-proxy-thanos/0.log" Jun 11 16:36:00.479723 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:00.479683 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-gptdq_d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4/prometheus-operator/0.log" Jun 11 16:36:00.677500 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:00.677454 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-gptdq_d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4/kube-rbac-proxy/0.log" Jun 11 16:36:00.877731 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:00.877704 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-vf2mk_f6878e6f-105f-4b95-a976-67173395f4d1/prometheus-operator-admission-webhook/0.log" Jun 11 16:36:01.077756 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:01.077683 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-689b7c9588-474jg_fb4efb1d-c77a-4ce2-a5b3-8cc963f72508/thanos-query/0.log" Jun 11 16:36:01.277272 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:01.277238 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-689b7c9588-474jg_fb4efb1d-c77a-4ce2-a5b3-8cc963f72508/kube-rbac-proxy-web/0.log" Jun 11 16:36:01.477736 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:01.477709 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-689b7c9588-474jg_fb4efb1d-c77a-4ce2-a5b3-8cc963f72508/kube-rbac-proxy/0.log" Jun 11 16:36:01.677084 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:01.677038 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-689b7c9588-474jg_fb4efb1d-c77a-4ce2-a5b3-8cc963f72508/prom-label-proxy/0.log" Jun 11 16:36:01.878009 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:01.877931 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-689b7c9588-474jg_fb4efb1d-c77a-4ce2-a5b3-8cc963f72508/kube-rbac-proxy-rules/0.log" Jun 11 16:36:02.077371 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:02.077341 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-689b7c9588-474jg_fb4efb1d-c77a-4ce2-a5b3-8cc963f72508/kube-rbac-proxy-metrics/0.log" Jun 11 16:36:02.278010 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:02.277981 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-gf2qf_c68b7331-ae32-4a9e-9687-1321770eab37/networking-console-plugin/0.log" Jun 11 16:36:04.077358 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:04.077326 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lxkqq_305a9021-ddf2-4eca-8df5-2fbe025ac9bd/dns/0.log" Jun 11 16:36:04.277927 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:04.277900 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lxkqq_305a9021-ddf2-4eca-8df5-2fbe025ac9bd/kube-rbac-proxy/0.log" Jun 11 16:36:05.077957 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:05.077923 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8h74q_66a0433d-006a-4974-960f-30704fb9949d/dns-node-resolver/0.log" Jun 11 16:36:05.877778 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:05.877748 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lvfpt_2ac98822-4208-4aec-9b86-0bc5aecbd145/node-ca/0.log" Jun 11 16:36:06.878279 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:06.878255 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s2gvs_6ba18fd1-dd09-45d8-81c7-8796fde2340e/serve-healthcheck-canary/0.log" Jun 11 16:36:09.538519 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:09.538479 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lxkqq" Jun 11 16:36:12.314633 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:12.314595 2569 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 16:36:14.940647 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:14.940610 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:14.962224 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:14.962197 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:15.610851 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:15.610826 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:28.637683 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:28.637644 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 16:36:28.638253 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:28.637960 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="17703228-ab40-4328-a712-59c9c78901e1" containerName="alertmanager" containerID="cri-o://d065e1fa9559030f16bf43072c9485898e0300c96a20d87cfa7e2c362dbd720e" gracePeriod=120 Jun 11 16:36:28.638253 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:28.638015 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="17703228-ab40-4328-a712-59c9c78901e1" containerName="kube-rbac-proxy-metric" containerID="cri-o://4a80d49ecb2e1a8fcee2acf5828fa2dca3f1f08f34dc1a996b5ac85af279b17e" gracePeriod=120 Jun 11 16:36:28.638253 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:28.638070 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="17703228-ab40-4328-a712-59c9c78901e1" containerName="prom-label-proxy" containerID="cri-o://13f7820c47833e226f56ff02bcd099da572c5d1bec3321cee0b1b5cbab22318e" gracePeriod=120 Jun 11 16:36:28.638253 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:28.638133 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="17703228-ab40-4328-a712-59c9c78901e1" containerName="kube-rbac-proxy" containerID="cri-o://9faa6e7027455608f6a23db0184aa471be2b5d1bcb80b054ee973e128aab0ae2" gracePeriod=120 Jun 11 16:36:28.638253 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:28.638143 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="17703228-ab40-4328-a712-59c9c78901e1" containerName="kube-rbac-proxy-web" containerID="cri-o://be9cb9642cf5a23b6262fd836071107fdea4c1463e60c1a4c30886b6a8813e7a" gracePeriod=120 Jun 11 16:36:28.638253 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:28.638197 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="17703228-ab40-4328-a712-59c9c78901e1" containerName="config-reloader" containerID="cri-o://f57883f05b480af16739823769d451686124d1b7ed8b7e785129e08a0af3a1c8" gracePeriod=120 Jun 11 16:36:29.653916 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.653879 2569 generic.go:356] "Generic (PLEG): container finished" podID="17703228-ab40-4328-a712-59c9c78901e1" containerID="13f7820c47833e226f56ff02bcd099da572c5d1bec3321cee0b1b5cbab22318e" exitCode=0 Jun 11 16:36:29.653916 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.653906 2569 generic.go:356] "Generic (PLEG): container finished" podID="17703228-ab40-4328-a712-59c9c78901e1" containerID="9faa6e7027455608f6a23db0184aa471be2b5d1bcb80b054ee973e128aab0ae2" exitCode=0 Jun 11 16:36:29.653916 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.653913 2569 generic.go:356] "Generic (PLEG): container finished" podID="17703228-ab40-4328-a712-59c9c78901e1" containerID="f57883f05b480af16739823769d451686124d1b7ed8b7e785129e08a0af3a1c8" exitCode=0 Jun 11 16:36:29.653916 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.653922 2569 generic.go:356] "Generic (PLEG): container finished" podID="17703228-ab40-4328-a712-59c9c78901e1" containerID="d065e1fa9559030f16bf43072c9485898e0300c96a20d87cfa7e2c362dbd720e" exitCode=0 Jun 11 16:36:29.654406 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.653947 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"17703228-ab40-4328-a712-59c9c78901e1","Type":"ContainerDied","Data":"13f7820c47833e226f56ff02bcd099da572c5d1bec3321cee0b1b5cbab22318e"} Jun 11 16:36:29.654406 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.654041 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"17703228-ab40-4328-a712-59c9c78901e1","Type":"ContainerDied","Data":"9faa6e7027455608f6a23db0184aa471be2b5d1bcb80b054ee973e128aab0ae2"} Jun 11 16:36:29.654406 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.654083 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"17703228-ab40-4328-a712-59c9c78901e1","Type":"ContainerDied","Data":"f57883f05b480af16739823769d451686124d1b7ed8b7e785129e08a0af3a1c8"} Jun 11 16:36:29.654406 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.654108 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"17703228-ab40-4328-a712-59c9c78901e1","Type":"ContainerDied","Data":"d065e1fa9559030f16bf43072c9485898e0300c96a20d87cfa7e2c362dbd720e"} Jun 11 16:36:29.893882 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.893855 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:29.934582 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.934550 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/17703228-ab40-4328-a712-59c9c78901e1-config-out\") pod \"17703228-ab40-4328-a712-59c9c78901e1\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " Jun 11 16:36:29.934783 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.934612 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-secret-alertmanager-kube-rbac-proxy-web\") pod \"17703228-ab40-4328-a712-59c9c78901e1\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " Jun 11 16:36:29.934783 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.934654 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17703228-ab40-4328-a712-59c9c78901e1-alertmanager-trusted-ca-bundle\") pod \"17703228-ab40-4328-a712-59c9c78901e1\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " Jun 11 16:36:29.934783 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.934692 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/17703228-ab40-4328-a712-59c9c78901e1-alertmanager-main-db\") pod \"17703228-ab40-4328-a712-59c9c78901e1\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " Jun 11 16:36:29.934783 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.934727 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-cluster-tls-config\") pod \"17703228-ab40-4328-a712-59c9c78901e1\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " Jun 11 16:36:29.934783 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.934755 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptrwh\" (UniqueName: \"kubernetes.io/projected/17703228-ab40-4328-a712-59c9c78901e1-kube-api-access-ptrwh\") pod \"17703228-ab40-4328-a712-59c9c78901e1\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " Jun 11 16:36:29.935076 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.934800 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-web-config\") pod \"17703228-ab40-4328-a712-59c9c78901e1\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " Jun 11 16:36:29.935076 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.934824 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17703228-ab40-4328-a712-59c9c78901e1-metrics-client-ca\") pod \"17703228-ab40-4328-a712-59c9c78901e1\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " Jun 11 16:36:29.935076 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.934851 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-secret-alertmanager-main-tls\") pod \"17703228-ab40-4328-a712-59c9c78901e1\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " Jun 11 16:36:29.935076 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.934884 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/17703228-ab40-4328-a712-59c9c78901e1-tls-assets\") pod \"17703228-ab40-4328-a712-59c9c78901e1\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " Jun 11 16:36:29.935076 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.934951 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"17703228-ab40-4328-a712-59c9c78901e1\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " Jun 11 16:36:29.935076 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.935002 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-config-volume\") pod \"17703228-ab40-4328-a712-59c9c78901e1\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " Jun 11 16:36:29.935076 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.935043 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-secret-alertmanager-kube-rbac-proxy\") pod \"17703228-ab40-4328-a712-59c9c78901e1\" (UID: \"17703228-ab40-4328-a712-59c9c78901e1\") " Jun 11 16:36:29.936732 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.936400 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17703228-ab40-4328-a712-59c9c78901e1-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "17703228-ab40-4328-a712-59c9c78901e1" (UID: "17703228-ab40-4328-a712-59c9c78901e1"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:36:29.936732 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.936433 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17703228-ab40-4328-a712-59c9c78901e1-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "17703228-ab40-4328-a712-59c9c78901e1" (UID: "17703228-ab40-4328-a712-59c9c78901e1"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:36:29.936732 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.936692 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17703228-ab40-4328-a712-59c9c78901e1-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "17703228-ab40-4328-a712-59c9c78901e1" (UID: "17703228-ab40-4328-a712-59c9c78901e1"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:36:29.937962 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.937926 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17703228-ab40-4328-a712-59c9c78901e1-config-out" (OuterVolumeSpecName: "config-out") pod "17703228-ab40-4328-a712-59c9c78901e1" (UID: "17703228-ab40-4328-a712-59c9c78901e1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:36:29.938253 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.938213 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17703228-ab40-4328-a712-59c9c78901e1-kube-api-access-ptrwh" (OuterVolumeSpecName: "kube-api-access-ptrwh") pod "17703228-ab40-4328-a712-59c9c78901e1" (UID: "17703228-ab40-4328-a712-59c9c78901e1"). InnerVolumeSpecName "kube-api-access-ptrwh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:36:29.938480 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.938450 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "17703228-ab40-4328-a712-59c9c78901e1" (UID: "17703228-ab40-4328-a712-59c9c78901e1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:36:29.940699 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.940658 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "17703228-ab40-4328-a712-59c9c78901e1" (UID: "17703228-ab40-4328-a712-59c9c78901e1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:36:29.940901 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.940862 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "17703228-ab40-4328-a712-59c9c78901e1" (UID: "17703228-ab40-4328-a712-59c9c78901e1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:36:29.940975 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.940953 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "17703228-ab40-4328-a712-59c9c78901e1" (UID: "17703228-ab40-4328-a712-59c9c78901e1"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:36:29.941622 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.941584 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-config-volume" (OuterVolumeSpecName: "config-volume") pod "17703228-ab40-4328-a712-59c9c78901e1" (UID: "17703228-ab40-4328-a712-59c9c78901e1"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:36:29.942255 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.942229 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17703228-ab40-4328-a712-59c9c78901e1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "17703228-ab40-4328-a712-59c9c78901e1" (UID: "17703228-ab40-4328-a712-59c9c78901e1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:36:29.946771 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.946741 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "17703228-ab40-4328-a712-59c9c78901e1" (UID: "17703228-ab40-4328-a712-59c9c78901e1"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:36:29.953530 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:29.953497 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-web-config" (OuterVolumeSpecName: "web-config") pod "17703228-ab40-4328-a712-59c9c78901e1" (UID: "17703228-ab40-4328-a712-59c9c78901e1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:36:30.036249 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.036208 2569 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-config-volume\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:30.036249 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.036242 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:30.036249 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.036252 2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/17703228-ab40-4328-a712-59c9c78901e1-config-out\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:30.036249 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.036261 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:30.036519 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.036270 2569 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17703228-ab40-4328-a712-59c9c78901e1-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:30.036519 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.036279 2569 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/17703228-ab40-4328-a712-59c9c78901e1-alertmanager-main-db\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:30.036519 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.036287 2569 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-cluster-tls-config\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:30.036519 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.036295 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptrwh\" (UniqueName: \"kubernetes.io/projected/17703228-ab40-4328-a712-59c9c78901e1-kube-api-access-ptrwh\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:30.036519 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.036302 2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-web-config\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:30.036519 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.036309 2569 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17703228-ab40-4328-a712-59c9c78901e1-metrics-client-ca\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:30.036519 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.036317 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-secret-alertmanager-main-tls\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:30.036519 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.036325 2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/17703228-ab40-4328-a712-59c9c78901e1-tls-assets\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:30.036519 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.036333 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/17703228-ab40-4328-a712-59c9c78901e1-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:30.660657 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.660563 2569 generic.go:356] "Generic (PLEG): container finished" podID="17703228-ab40-4328-a712-59c9c78901e1" containerID="4a80d49ecb2e1a8fcee2acf5828fa2dca3f1f08f34dc1a996b5ac85af279b17e" exitCode=0 Jun 11 16:36:30.660657 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.660598 2569 generic.go:356] "Generic (PLEG): container finished" podID="17703228-ab40-4328-a712-59c9c78901e1" containerID="be9cb9642cf5a23b6262fd836071107fdea4c1463e60c1a4c30886b6a8813e7a" exitCode=0 Jun 11 16:36:30.660657 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.660648 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.661129 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.660660 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"17703228-ab40-4328-a712-59c9c78901e1","Type":"ContainerDied","Data":"4a80d49ecb2e1a8fcee2acf5828fa2dca3f1f08f34dc1a996b5ac85af279b17e"} Jun 11 16:36:30.661129 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.660728 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"17703228-ab40-4328-a712-59c9c78901e1","Type":"ContainerDied","Data":"be9cb9642cf5a23b6262fd836071107fdea4c1463e60c1a4c30886b6a8813e7a"} Jun 11 16:36:30.661129 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.660755 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"17703228-ab40-4328-a712-59c9c78901e1","Type":"ContainerDied","Data":"9cf940ce5920c202b8a10b34d4ca6f1e3852f583a0a270e7e77a1544a4bf2cc3"} Jun 11 16:36:30.661129 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.660798 2569 scope.go:117] "RemoveContainer" containerID="13f7820c47833e226f56ff02bcd099da572c5d1bec3321cee0b1b5cbab22318e" Jun 11 16:36:30.668961 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.668942 2569 scope.go:117] "RemoveContainer" containerID="4a80d49ecb2e1a8fcee2acf5828fa2dca3f1f08f34dc1a996b5ac85af279b17e" Jun 11 16:36:30.676205 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.676185 2569 scope.go:117] "RemoveContainer" containerID="9faa6e7027455608f6a23db0184aa471be2b5d1bcb80b054ee973e128aab0ae2" Jun 11 16:36:30.681889 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.681865 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 16:36:30.684746 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.684721 2569 scope.go:117] "RemoveContainer" containerID="be9cb9642cf5a23b6262fd836071107fdea4c1463e60c1a4c30886b6a8813e7a" Jun 11 16:36:30.685322 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.685301 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 16:36:30.692334 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.692317 2569 scope.go:117] "RemoveContainer" containerID="f57883f05b480af16739823769d451686124d1b7ed8b7e785129e08a0af3a1c8" Jun 11 16:36:30.699806 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.699790 2569 scope.go:117] "RemoveContainer" containerID="d065e1fa9559030f16bf43072c9485898e0300c96a20d87cfa7e2c362dbd720e" Jun 11 16:36:30.707136 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.707116 2569 scope.go:117] "RemoveContainer" containerID="16d532316e5b75f39a7ebe7b8326752e0999ae198cfd5b4470be2bfbc4c64f16" Jun 11 16:36:30.711190 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.711167 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 16:36:30.711574 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.711557 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17703228-ab40-4328-a712-59c9c78901e1" containerName="prom-label-proxy" Jun 11 16:36:30.711633 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.711581 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="17703228-ab40-4328-a712-59c9c78901e1" containerName="prom-label-proxy" Jun 11 16:36:30.711633 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.711596 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17703228-ab40-4328-a712-59c9c78901e1" containerName="kube-rbac-proxy-web" Jun 11 16:36:30.711633 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.711607 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="17703228-ab40-4328-a712-59c9c78901e1" containerName="kube-rbac-proxy-web" Jun 11 16:36:30.711633 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.711617 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17703228-ab40-4328-a712-59c9c78901e1" containerName="kube-rbac-proxy-metric" Jun 11 16:36:30.711633 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.711627 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="17703228-ab40-4328-a712-59c9c78901e1" containerName="kube-rbac-proxy-metric" Jun 11 16:36:30.711777 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.711645 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17703228-ab40-4328-a712-59c9c78901e1" containerName="init-config-reloader" Jun 11 16:36:30.711777 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.711655 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="17703228-ab40-4328-a712-59c9c78901e1" containerName="init-config-reloader" Jun 11 16:36:30.711777 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.711666 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17703228-ab40-4328-a712-59c9c78901e1" containerName="alertmanager" Jun 11 16:36:30.711777 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.711674 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="17703228-ab40-4328-a712-59c9c78901e1" containerName="alertmanager" Jun 11 16:36:30.711777 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.711692 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17703228-ab40-4328-a712-59c9c78901e1" containerName="kube-rbac-proxy" Jun 11 16:36:30.711777 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.711700 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="17703228-ab40-4328-a712-59c9c78901e1" containerName="kube-rbac-proxy" Jun 11 16:36:30.711777 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.711716 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17703228-ab40-4328-a712-59c9c78901e1" containerName="config-reloader" Jun 11 16:36:30.711777 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.711726 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="17703228-ab40-4328-a712-59c9c78901e1" containerName="config-reloader" Jun 11 16:36:30.711989 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.711796 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="17703228-ab40-4328-a712-59c9c78901e1" containerName="prom-label-proxy" Jun 11 16:36:30.711989 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.711808 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="17703228-ab40-4328-a712-59c9c78901e1" containerName="kube-rbac-proxy-metric" Jun 11 16:36:30.711989 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.711820 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="17703228-ab40-4328-a712-59c9c78901e1" containerName="config-reloader" Jun 11 16:36:30.711989 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.711830 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="17703228-ab40-4328-a712-59c9c78901e1" containerName="alertmanager" Jun 11 16:36:30.711989 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.711839 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="17703228-ab40-4328-a712-59c9c78901e1" containerName="kube-rbac-proxy" Jun 11 16:36:30.711989 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.711844 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="17703228-ab40-4328-a712-59c9c78901e1" containerName="kube-rbac-proxy-web" Jun 11 16:36:30.716338 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.716320 2569 scope.go:117] "RemoveContainer" containerID="13f7820c47833e226f56ff02bcd099da572c5d1bec3321cee0b1b5cbab22318e" Jun 11 16:36:30.716603 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:36:30.716583 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13f7820c47833e226f56ff02bcd099da572c5d1bec3321cee0b1b5cbab22318e\": container with ID starting with 13f7820c47833e226f56ff02bcd099da572c5d1bec3321cee0b1b5cbab22318e not found: ID does not exist" containerID="13f7820c47833e226f56ff02bcd099da572c5d1bec3321cee0b1b5cbab22318e" Jun 11 16:36:30.716663 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.716613 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13f7820c47833e226f56ff02bcd099da572c5d1bec3321cee0b1b5cbab22318e"} err="failed to get container status \"13f7820c47833e226f56ff02bcd099da572c5d1bec3321cee0b1b5cbab22318e\": rpc error: code = NotFound desc = could not find container \"13f7820c47833e226f56ff02bcd099da572c5d1bec3321cee0b1b5cbab22318e\": container with ID starting with 13f7820c47833e226f56ff02bcd099da572c5d1bec3321cee0b1b5cbab22318e not found: ID does not exist" Jun 11 16:36:30.716663 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.716633 2569 scope.go:117] "RemoveContainer" containerID="4a80d49ecb2e1a8fcee2acf5828fa2dca3f1f08f34dc1a996b5ac85af279b17e" Jun 11 16:36:30.716889 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:36:30.716873 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a80d49ecb2e1a8fcee2acf5828fa2dca3f1f08f34dc1a996b5ac85af279b17e\": container with ID starting with 4a80d49ecb2e1a8fcee2acf5828fa2dca3f1f08f34dc1a996b5ac85af279b17e not found: ID does not exist" containerID="4a80d49ecb2e1a8fcee2acf5828fa2dca3f1f08f34dc1a996b5ac85af279b17e" Jun 11 16:36:30.716931 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.716896 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a80d49ecb2e1a8fcee2acf5828fa2dca3f1f08f34dc1a996b5ac85af279b17e"} err="failed to get container status \"4a80d49ecb2e1a8fcee2acf5828fa2dca3f1f08f34dc1a996b5ac85af279b17e\": rpc error: code = NotFound desc = could not find container \"4a80d49ecb2e1a8fcee2acf5828fa2dca3f1f08f34dc1a996b5ac85af279b17e\": container with ID starting with 4a80d49ecb2e1a8fcee2acf5828fa2dca3f1f08f34dc1a996b5ac85af279b17e not found: ID does not exist" Jun 11 16:36:30.716931 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.716911 2569 scope.go:117] "RemoveContainer" containerID="9faa6e7027455608f6a23db0184aa471be2b5d1bcb80b054ee973e128aab0ae2" Jun 11 16:36:30.717145 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:36:30.717132 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9faa6e7027455608f6a23db0184aa471be2b5d1bcb80b054ee973e128aab0ae2\": container with ID starting with 9faa6e7027455608f6a23db0184aa471be2b5d1bcb80b054ee973e128aab0ae2 not found: ID does not exist" containerID="9faa6e7027455608f6a23db0184aa471be2b5d1bcb80b054ee973e128aab0ae2" Jun 11 16:36:30.717193 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.717151 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9faa6e7027455608f6a23db0184aa471be2b5d1bcb80b054ee973e128aab0ae2"} err="failed to get container status \"9faa6e7027455608f6a23db0184aa471be2b5d1bcb80b054ee973e128aab0ae2\": rpc error: code = NotFound desc = could not find container \"9faa6e7027455608f6a23db0184aa471be2b5d1bcb80b054ee973e128aab0ae2\": container with ID starting with 9faa6e7027455608f6a23db0184aa471be2b5d1bcb80b054ee973e128aab0ae2 not found: ID does not exist" Jun 11 16:36:30.717193 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.717164 2569 scope.go:117] "RemoveContainer" containerID="be9cb9642cf5a23b6262fd836071107fdea4c1463e60c1a4c30886b6a8813e7a" Jun 11 16:36:30.717361 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:36:30.717347 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be9cb9642cf5a23b6262fd836071107fdea4c1463e60c1a4c30886b6a8813e7a\": container with ID starting with be9cb9642cf5a23b6262fd836071107fdea4c1463e60c1a4c30886b6a8813e7a not found: ID does not exist" containerID="be9cb9642cf5a23b6262fd836071107fdea4c1463e60c1a4c30886b6a8813e7a" Jun 11 16:36:30.717400 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.717364 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be9cb9642cf5a23b6262fd836071107fdea4c1463e60c1a4c30886b6a8813e7a"} err="failed to get container status \"be9cb9642cf5a23b6262fd836071107fdea4c1463e60c1a4c30886b6a8813e7a\": rpc error: code = NotFound desc = could not find container \"be9cb9642cf5a23b6262fd836071107fdea4c1463e60c1a4c30886b6a8813e7a\": container with ID starting with be9cb9642cf5a23b6262fd836071107fdea4c1463e60c1a4c30886b6a8813e7a not found: ID does not exist" Jun 11 16:36:30.717400 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.717375 2569 scope.go:117] "RemoveContainer" containerID="f57883f05b480af16739823769d451686124d1b7ed8b7e785129e08a0af3a1c8" Jun 11 16:36:30.717568 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:36:30.717553 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f57883f05b480af16739823769d451686124d1b7ed8b7e785129e08a0af3a1c8\": container with ID starting with f57883f05b480af16739823769d451686124d1b7ed8b7e785129e08a0af3a1c8 not found: ID does not exist" containerID="f57883f05b480af16739823769d451686124d1b7ed8b7e785129e08a0af3a1c8" Jun 11 16:36:30.717603 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.717571 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f57883f05b480af16739823769d451686124d1b7ed8b7e785129e08a0af3a1c8"} err="failed to get container status \"f57883f05b480af16739823769d451686124d1b7ed8b7e785129e08a0af3a1c8\": rpc error: code = NotFound desc = could not find container \"f57883f05b480af16739823769d451686124d1b7ed8b7e785129e08a0af3a1c8\": container with ID starting with f57883f05b480af16739823769d451686124d1b7ed8b7e785129e08a0af3a1c8 not found: ID does not exist" Jun 11 16:36:30.717603 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.717582 2569 scope.go:117] "RemoveContainer" containerID="d065e1fa9559030f16bf43072c9485898e0300c96a20d87cfa7e2c362dbd720e" Jun 11 16:36:30.717808 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:36:30.717791 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d065e1fa9559030f16bf43072c9485898e0300c96a20d87cfa7e2c362dbd720e\": container with ID starting with d065e1fa9559030f16bf43072c9485898e0300c96a20d87cfa7e2c362dbd720e not found: ID does not exist" containerID="d065e1fa9559030f16bf43072c9485898e0300c96a20d87cfa7e2c362dbd720e" Jun 11 16:36:30.717862 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.717811 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d065e1fa9559030f16bf43072c9485898e0300c96a20d87cfa7e2c362dbd720e"} err="failed to get container status \"d065e1fa9559030f16bf43072c9485898e0300c96a20d87cfa7e2c362dbd720e\": rpc error: code = NotFound desc = could not find container \"d065e1fa9559030f16bf43072c9485898e0300c96a20d87cfa7e2c362dbd720e\": container with ID starting with d065e1fa9559030f16bf43072c9485898e0300c96a20d87cfa7e2c362dbd720e not found: ID does not exist" Jun 11 16:36:30.717862 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.717823 2569 scope.go:117] "RemoveContainer" containerID="16d532316e5b75f39a7ebe7b8326752e0999ae198cfd5b4470be2bfbc4c64f16" Jun 11 16:36:30.718078 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:36:30.718034 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16d532316e5b75f39a7ebe7b8326752e0999ae198cfd5b4470be2bfbc4c64f16\": container with ID starting with 16d532316e5b75f39a7ebe7b8326752e0999ae198cfd5b4470be2bfbc4c64f16 not found: ID does not exist" containerID="16d532316e5b75f39a7ebe7b8326752e0999ae198cfd5b4470be2bfbc4c64f16" Jun 11 16:36:30.718134 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.718079 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16d532316e5b75f39a7ebe7b8326752e0999ae198cfd5b4470be2bfbc4c64f16"} err="failed to get container status \"16d532316e5b75f39a7ebe7b8326752e0999ae198cfd5b4470be2bfbc4c64f16\": rpc error: code = NotFound desc = could not find container \"16d532316e5b75f39a7ebe7b8326752e0999ae198cfd5b4470be2bfbc4c64f16\": container with ID starting with 16d532316e5b75f39a7ebe7b8326752e0999ae198cfd5b4470be2bfbc4c64f16 not found: ID does not exist" Jun 11 16:36:30.718134 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.718093 2569 scope.go:117] "RemoveContainer" containerID="13f7820c47833e226f56ff02bcd099da572c5d1bec3321cee0b1b5cbab22318e" Jun 11 16:36:30.718318 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.718298 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13f7820c47833e226f56ff02bcd099da572c5d1bec3321cee0b1b5cbab22318e"} err="failed to get container status \"13f7820c47833e226f56ff02bcd099da572c5d1bec3321cee0b1b5cbab22318e\": rpc error: code = NotFound desc = could not find container \"13f7820c47833e226f56ff02bcd099da572c5d1bec3321cee0b1b5cbab22318e\": container with ID starting with 13f7820c47833e226f56ff02bcd099da572c5d1bec3321cee0b1b5cbab22318e not found: ID does not exist" Jun 11 16:36:30.718318 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.718315 2569 scope.go:117] "RemoveContainer" containerID="4a80d49ecb2e1a8fcee2acf5828fa2dca3f1f08f34dc1a996b5ac85af279b17e" Jun 11 16:36:30.718574 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.718559 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.718574 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.718564 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a80d49ecb2e1a8fcee2acf5828fa2dca3f1f08f34dc1a996b5ac85af279b17e"} err="failed to get container status \"4a80d49ecb2e1a8fcee2acf5828fa2dca3f1f08f34dc1a996b5ac85af279b17e\": rpc error: code = NotFound desc = could not find container \"4a80d49ecb2e1a8fcee2acf5828fa2dca3f1f08f34dc1a996b5ac85af279b17e\": container with ID starting with 4a80d49ecb2e1a8fcee2acf5828fa2dca3f1f08f34dc1a996b5ac85af279b17e not found: ID does not exist" Jun 11 16:36:30.718662 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.718584 2569 scope.go:117] "RemoveContainer" containerID="9faa6e7027455608f6a23db0184aa471be2b5d1bcb80b054ee973e128aab0ae2" Jun 11 16:36:30.719015 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.718916 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9faa6e7027455608f6a23db0184aa471be2b5d1bcb80b054ee973e128aab0ae2"} err="failed to get container status \"9faa6e7027455608f6a23db0184aa471be2b5d1bcb80b054ee973e128aab0ae2\": rpc error: code = NotFound desc = could not find container \"9faa6e7027455608f6a23db0184aa471be2b5d1bcb80b054ee973e128aab0ae2\": container with ID starting with 9faa6e7027455608f6a23db0184aa471be2b5d1bcb80b054ee973e128aab0ae2 not found: ID does not exist" Jun 11 16:36:30.719015 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.718943 2569 scope.go:117] "RemoveContainer" containerID="be9cb9642cf5a23b6262fd836071107fdea4c1463e60c1a4c30886b6a8813e7a" Jun 11 16:36:30.719312 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.719290 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be9cb9642cf5a23b6262fd836071107fdea4c1463e60c1a4c30886b6a8813e7a"} err="failed to get container status \"be9cb9642cf5a23b6262fd836071107fdea4c1463e60c1a4c30886b6a8813e7a\": rpc error: code = NotFound desc = could not find container \"be9cb9642cf5a23b6262fd836071107fdea4c1463e60c1a4c30886b6a8813e7a\": container with ID starting with be9cb9642cf5a23b6262fd836071107fdea4c1463e60c1a4c30886b6a8813e7a not found: ID does not exist" Jun 11 16:36:30.719312 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.719314 2569 scope.go:117] "RemoveContainer" containerID="f57883f05b480af16739823769d451686124d1b7ed8b7e785129e08a0af3a1c8" Jun 11 16:36:30.719597 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.719574 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f57883f05b480af16739823769d451686124d1b7ed8b7e785129e08a0af3a1c8"} err="failed to get container status \"f57883f05b480af16739823769d451686124d1b7ed8b7e785129e08a0af3a1c8\": rpc error: code = NotFound desc = could not find container \"f57883f05b480af16739823769d451686124d1b7ed8b7e785129e08a0af3a1c8\": container with ID starting with f57883f05b480af16739823769d451686124d1b7ed8b7e785129e08a0af3a1c8 not found: ID does not exist" Jun 11 16:36:30.719645 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.719600 2569 scope.go:117] "RemoveContainer" containerID="d065e1fa9559030f16bf43072c9485898e0300c96a20d87cfa7e2c362dbd720e" Jun 11 16:36:30.719877 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.719861 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d065e1fa9559030f16bf43072c9485898e0300c96a20d87cfa7e2c362dbd720e"} err="failed to get container status \"d065e1fa9559030f16bf43072c9485898e0300c96a20d87cfa7e2c362dbd720e\": rpc error: code = NotFound desc = could not find container \"d065e1fa9559030f16bf43072c9485898e0300c96a20d87cfa7e2c362dbd720e\": container with ID starting with d065e1fa9559030f16bf43072c9485898e0300c96a20d87cfa7e2c362dbd720e not found: ID does not exist" Jun 11 16:36:30.719926 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.719877 2569 scope.go:117] "RemoveContainer" containerID="16d532316e5b75f39a7ebe7b8326752e0999ae198cfd5b4470be2bfbc4c64f16" Jun 11 16:36:30.720150 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.720127 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16d532316e5b75f39a7ebe7b8326752e0999ae198cfd5b4470be2bfbc4c64f16"} err="failed to get container status \"16d532316e5b75f39a7ebe7b8326752e0999ae198cfd5b4470be2bfbc4c64f16\": rpc error: code = NotFound desc = could not find container \"16d532316e5b75f39a7ebe7b8326752e0999ae198cfd5b4470be2bfbc4c64f16\": container with ID starting with 16d532316e5b75f39a7ebe7b8326752e0999ae198cfd5b4470be2bfbc4c64f16 not found: ID does not exist" Jun 11 16:36:30.721790 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.721773 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 16:36:30.721905 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.721796 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 16:36:30.721905 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.721809 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 16:36:30.721905 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.721809 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 16:36:30.721905 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.721862 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 16:36:30.722138 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.721928 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 16:36:30.722198 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.722146 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 16:36:30.722247 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.722219 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-78c6g\"" Jun 11 16:36:30.722529 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.722509 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 16:36:30.728782 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.728755 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 16:36:30.730680 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.730659 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 16:36:30.842365 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.842331 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5414b4ed-7c62-4d38-9802-516f25d0a76a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.842365 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.842366 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5414b4ed-7c62-4d38-9802-516f25d0a76a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.842605 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.842390 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5414b4ed-7c62-4d38-9802-516f25d0a76a-web-config\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.842605 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.842409 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5414b4ed-7c62-4d38-9802-516f25d0a76a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.842605 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.842460 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5414b4ed-7c62-4d38-9802-516f25d0a76a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.842605 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.842507 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5414b4ed-7c62-4d38-9802-516f25d0a76a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.842605 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.842541 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5414b4ed-7c62-4d38-9802-516f25d0a76a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.842605 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.842570 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5414b4ed-7c62-4d38-9802-516f25d0a76a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.842605 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.842600 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5414b4ed-7c62-4d38-9802-516f25d0a76a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.842899 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.842627 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5414b4ed-7c62-4d38-9802-516f25d0a76a-config-out\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.842899 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.842654 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnqfd\" (UniqueName: \"kubernetes.io/projected/5414b4ed-7c62-4d38-9802-516f25d0a76a-kube-api-access-fnqfd\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.842899 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.842684 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5414b4ed-7c62-4d38-9802-516f25d0a76a-config-volume\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.842899 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.842766 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5414b4ed-7c62-4d38-9802-516f25d0a76a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.944190 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.944155 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5414b4ed-7c62-4d38-9802-516f25d0a76a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.944382 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.944209 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5414b4ed-7c62-4d38-9802-516f25d0a76a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.944382 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.944228 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5414b4ed-7c62-4d38-9802-516f25d0a76a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.944382 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.944249 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5414b4ed-7c62-4d38-9802-516f25d0a76a-web-config\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.944382 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.944268 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5414b4ed-7c62-4d38-9802-516f25d0a76a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.944382 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.944296 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5414b4ed-7c62-4d38-9802-516f25d0a76a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.944382 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.944330 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5414b4ed-7c62-4d38-9802-516f25d0a76a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.944382 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.944363 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5414b4ed-7c62-4d38-9802-516f25d0a76a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.944747 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.944387 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5414b4ed-7c62-4d38-9802-516f25d0a76a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.944747 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.944406 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5414b4ed-7c62-4d38-9802-516f25d0a76a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.944747 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.944426 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5414b4ed-7c62-4d38-9802-516f25d0a76a-config-out\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.944747 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.944453 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnqfd\" (UniqueName: \"kubernetes.io/projected/5414b4ed-7c62-4d38-9802-516f25d0a76a-kube-api-access-fnqfd\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.944747 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.944482 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5414b4ed-7c62-4d38-9802-516f25d0a76a-config-volume\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.944747 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.944700 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5414b4ed-7c62-4d38-9802-516f25d0a76a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.945348 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.945322 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5414b4ed-7c62-4d38-9802-516f25d0a76a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.945460 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.945384 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5414b4ed-7c62-4d38-9802-516f25d0a76a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.947817 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.947769 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5414b4ed-7c62-4d38-9802-516f25d0a76a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.947930 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.947818 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5414b4ed-7c62-4d38-9802-516f25d0a76a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.948125 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.948103 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5414b4ed-7c62-4d38-9802-516f25d0a76a-config-volume\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.948719 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.948357 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5414b4ed-7c62-4d38-9802-516f25d0a76a-config-out\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.948719 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.948502 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5414b4ed-7c62-4d38-9802-516f25d0a76a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.948719 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.948604 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5414b4ed-7c62-4d38-9802-516f25d0a76a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.948896 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.948798 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5414b4ed-7c62-4d38-9802-516f25d0a76a-web-config\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.949277 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.949251 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5414b4ed-7c62-4d38-9802-516f25d0a76a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.949359 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.949281 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5414b4ed-7c62-4d38-9802-516f25d0a76a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:30.954168 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:30.954145 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnqfd\" (UniqueName: \"kubernetes.io/projected/5414b4ed-7c62-4d38-9802-516f25d0a76a-kube-api-access-fnqfd\") pod \"alertmanager-main-0\" (UID: \"5414b4ed-7c62-4d38-9802-516f25d0a76a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:31.038308 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:31.038273 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 16:36:31.184226 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:31.184143 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 16:36:31.666123 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:31.666015 2569 generic.go:356] "Generic (PLEG): container finished" podID="5414b4ed-7c62-4d38-9802-516f25d0a76a" containerID="ab13502807e592da841325229e0e408aa77233e5c65dba619ab81a026f541fb4" exitCode=0 Jun 11 16:36:31.666123 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:31.666107 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5414b4ed-7c62-4d38-9802-516f25d0a76a","Type":"ContainerDied","Data":"ab13502807e592da841325229e0e408aa77233e5c65dba619ab81a026f541fb4"} Jun 11 16:36:31.666586 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:31.666186 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5414b4ed-7c62-4d38-9802-516f25d0a76a","Type":"ContainerStarted","Data":"879a8d5f7eff072e4174ea2c0c973ca40da9b8179cc3945597aca8d3ec55f109"} Jun 11 16:36:32.361337 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:32.361259 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17703228-ab40-4328-a712-59c9c78901e1" path="/var/lib/kubelet/pods/17703228-ab40-4328-a712-59c9c78901e1/volumes" Jun 11 16:36:32.676977 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:32.676936 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5414b4ed-7c62-4d38-9802-516f25d0a76a","Type":"ContainerStarted","Data":"135137670b0e409e8dd4e2a741d30bb4b94ba7948c03eb0f151aa33bface1f56"} Jun 11 16:36:32.677503 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:32.677026 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5414b4ed-7c62-4d38-9802-516f25d0a76a","Type":"ContainerStarted","Data":"44e43fe42f060ad0cf2c4e8ab81a96ad91cb78b9967a03417bdde12d28a2295d"} Jun 11 16:36:32.677503 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:32.677085 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5414b4ed-7c62-4d38-9802-516f25d0a76a","Type":"ContainerStarted","Data":"0f746b8535f078ecf0f05d64f46e1a8cd7015fd513be3716e2f6918e6e60f2a9"} Jun 11 16:36:32.677503 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:32.677124 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5414b4ed-7c62-4d38-9802-516f25d0a76a","Type":"ContainerStarted","Data":"db3c9d6f9096449124cd7377d5b7e2921fe19647ad5e77e7c32562e412b1f9eb"} Jun 11 16:36:32.677503 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:32.677163 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5414b4ed-7c62-4d38-9802-516f25d0a76a","Type":"ContainerStarted","Data":"fd6032cc27479377f13740cc542d1b6ce8cd1fea20d366a619fce19eefc6116b"} Jun 11 16:36:32.677503 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:32.677200 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5414b4ed-7c62-4d38-9802-516f25d0a76a","Type":"ContainerStarted","Data":"d4e04ff75d46c5ae2a7bb455f77e1826e7167259d188b98a015b7c478507bed0"} Jun 11 16:36:32.990457 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:32.990331 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.970154039 podStartE2EDuration="2.990304482s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.150443ms" isStatefulPod=false podCreationTimestamp="2026-06-11 16:36:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:36:32.713941415 +0000 UTC m=+320.782211452" watchObservedRunningTime="2026-06-11 16:36:32.990304482 +0000 UTC m=+321.058574520" Jun 11 16:36:32.990865 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:32.990842 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 16:36:32.991301 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:32.991267 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7212542f-c985-45f8-985c-469ff9b027ed" containerName="prometheus" containerID="cri-o://dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4" gracePeriod=600 Jun 11 16:36:32.991399 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:32.991286 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7212542f-c985-45f8-985c-469ff9b027ed" containerName="kube-rbac-proxy" containerID="cri-o://ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a" gracePeriod=600 Jun 11 16:36:32.991476 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:32.991400 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7212542f-c985-45f8-985c-469ff9b027ed" containerName="thanos-sidecar" containerID="cri-o://96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1" gracePeriod=600 Jun 11 16:36:32.991542 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:32.991506 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7212542f-c985-45f8-985c-469ff9b027ed" containerName="kube-rbac-proxy-web" containerID="cri-o://aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a" gracePeriod=600 Jun 11 16:36:32.991669 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:32.991627 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7212542f-c985-45f8-985c-469ff9b027ed" containerName="kube-rbac-proxy-thanos" containerID="cri-o://95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7" gracePeriod=600 Jun 11 16:36:32.991756 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:32.991722 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7212542f-c985-45f8-985c-469ff9b027ed" containerName="config-reloader" containerID="cri-o://1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16" gracePeriod=600 Jun 11 16:36:33.246154 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.246088 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.366176 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.366139 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-thanos-prometheus-http-client-file\") pod \"7212542f-c985-45f8-985c-469ff9b027ed\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " Jun 11 16:36:33.366176 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.366179 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7212542f-c985-45f8-985c-469ff9b027ed-config-out\") pod \"7212542f-c985-45f8-985c-469ff9b027ed\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " Jun 11 16:36:33.366453 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.366203 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-prometheus-k8s-tls\") pod \"7212542f-c985-45f8-985c-469ff9b027ed\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " Jun 11 16:36:33.366453 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.366247 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7212542f-c985-45f8-985c-469ff9b027ed-prometheus-k8s-db\") pod \"7212542f-c985-45f8-985c-469ff9b027ed\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " Jun 11 16:36:33.366453 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.366286 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-grpc-tls\") pod \"7212542f-c985-45f8-985c-469ff9b027ed\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " Jun 11 16:36:33.366453 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.366310 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"7212542f-c985-45f8-985c-469ff9b027ed\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " Jun 11 16:36:33.366453 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.366336 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-web-config\") pod \"7212542f-c985-45f8-985c-469ff9b027ed\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " Jun 11 16:36:33.366453 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.366423 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-configmap-kubelet-serving-ca-bundle\") pod \"7212542f-c985-45f8-985c-469ff9b027ed\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " Jun 11 16:36:33.366758 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.366466 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-kube-rbac-proxy\") pod \"7212542f-c985-45f8-985c-469ff9b027ed\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " Jun 11 16:36:33.366758 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.366511 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-prometheus-trusted-ca-bundle\") pod \"7212542f-c985-45f8-985c-469ff9b027ed\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " Jun 11 16:36:33.366758 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.366543 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-prometheus-k8s-rulefiles-0\") pod \"7212542f-c985-45f8-985c-469ff9b027ed\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " Jun 11 16:36:33.366758 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.366576 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjfc6\" (UniqueName: \"kubernetes.io/projected/7212542f-c985-45f8-985c-469ff9b027ed-kube-api-access-jjfc6\") pod \"7212542f-c985-45f8-985c-469ff9b027ed\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " Jun 11 16:36:33.366758 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.366609 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7212542f-c985-45f8-985c-469ff9b027ed-tls-assets\") pod \"7212542f-c985-45f8-985c-469ff9b027ed\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " Jun 11 16:36:33.366758 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.366641 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-configmap-metrics-client-ca\") pod \"7212542f-c985-45f8-985c-469ff9b027ed\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " Jun 11 16:36:33.366758 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.366664 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-configmap-serving-certs-ca-bundle\") pod \"7212542f-c985-45f8-985c-469ff9b027ed\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " Jun 11 16:36:33.366758 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.366697 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-prometheus-k8s-rulefiles-2\") pod \"7212542f-c985-45f8-985c-469ff9b027ed\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " Jun 11 16:36:33.366758 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.366720 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"7212542f-c985-45f8-985c-469ff9b027ed\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " Jun 11 16:36:33.367634 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.366770 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-config\") pod \"7212542f-c985-45f8-985c-469ff9b027ed\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " Jun 11 16:36:33.367634 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.366806 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-metrics-client-certs\") pod \"7212542f-c985-45f8-985c-469ff9b027ed\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " Jun 11 16:36:33.367634 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.366831 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-prometheus-k8s-rulefiles-1\") pod \"7212542f-c985-45f8-985c-469ff9b027ed\" (UID: \"7212542f-c985-45f8-985c-469ff9b027ed\") " Jun 11 16:36:33.367634 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.367529 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7212542f-c985-45f8-985c-469ff9b027ed-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "7212542f-c985-45f8-985c-469ff9b027ed" (UID: "7212542f-c985-45f8-985c-469ff9b027ed"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:36:33.367634 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.367463 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "7212542f-c985-45f8-985c-469ff9b027ed" (UID: "7212542f-c985-45f8-985c-469ff9b027ed"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:36:33.369224 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.367923 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "7212542f-c985-45f8-985c-469ff9b027ed" (UID: "7212542f-c985-45f8-985c-469ff9b027ed"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:36:33.369224 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.368944 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "7212542f-c985-45f8-985c-469ff9b027ed" (UID: "7212542f-c985-45f8-985c-469ff9b027ed"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:36:33.369224 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.369173 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "7212542f-c985-45f8-985c-469ff9b027ed" (UID: "7212542f-c985-45f8-985c-469ff9b027ed"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:36:33.369597 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.369568 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "7212542f-c985-45f8-985c-469ff9b027ed" (UID: "7212542f-c985-45f8-985c-469ff9b027ed"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:36:33.369828 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.369807 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "7212542f-c985-45f8-985c-469ff9b027ed" (UID: "7212542f-c985-45f8-985c-469ff9b027ed"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:36:33.369903 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.369865 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7212542f-c985-45f8-985c-469ff9b027ed-config-out" (OuterVolumeSpecName: "config-out") pod "7212542f-c985-45f8-985c-469ff9b027ed" (UID: "7212542f-c985-45f8-985c-469ff9b027ed"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:36:33.369960 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.369921 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "7212542f-c985-45f8-985c-469ff9b027ed" (UID: "7212542f-c985-45f8-985c-469ff9b027ed"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:36:33.370190 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.370133 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "7212542f-c985-45f8-985c-469ff9b027ed" (UID: "7212542f-c985-45f8-985c-469ff9b027ed"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:36:33.370550 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.370509 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "7212542f-c985-45f8-985c-469ff9b027ed" (UID: "7212542f-c985-45f8-985c-469ff9b027ed"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:36:33.371328 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.371298 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "7212542f-c985-45f8-985c-469ff9b027ed" (UID: "7212542f-c985-45f8-985c-469ff9b027ed"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:36:33.371448 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.371361 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-config" (OuterVolumeSpecName: "config") pod "7212542f-c985-45f8-985c-469ff9b027ed" (UID: "7212542f-c985-45f8-985c-469ff9b027ed"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:36:33.371525 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.371436 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7212542f-c985-45f8-985c-469ff9b027ed-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7212542f-c985-45f8-985c-469ff9b027ed" (UID: "7212542f-c985-45f8-985c-469ff9b027ed"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:36:33.371525 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.371502 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7212542f-c985-45f8-985c-469ff9b027ed-kube-api-access-jjfc6" (OuterVolumeSpecName: "kube-api-access-jjfc6") pod "7212542f-c985-45f8-985c-469ff9b027ed" (UID: "7212542f-c985-45f8-985c-469ff9b027ed"). InnerVolumeSpecName "kube-api-access-jjfc6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:36:33.371701 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.371678 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "7212542f-c985-45f8-985c-469ff9b027ed" (UID: "7212542f-c985-45f8-985c-469ff9b027ed"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:36:33.371762 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.371724 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "7212542f-c985-45f8-985c-469ff9b027ed" (UID: "7212542f-c985-45f8-985c-469ff9b027ed"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:36:33.371917 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.371892 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "7212542f-c985-45f8-985c-469ff9b027ed" (UID: "7212542f-c985-45f8-985c-469ff9b027ed"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:36:33.372242 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.372223 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "7212542f-c985-45f8-985c-469ff9b027ed" (UID: "7212542f-c985-45f8-985c-469ff9b027ed"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:36:33.381376 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.381349 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-web-config" (OuterVolumeSpecName: "web-config") pod "7212542f-c985-45f8-985c-469ff9b027ed" (UID: "7212542f-c985-45f8-985c-469ff9b027ed"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:36:33.467926 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.467889 2569 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-grpc-tls\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:33.467926 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.467922 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:33.467926 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.467934 2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-web-config\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:33.468181 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.467943 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:33.468181 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.467952 2569 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-kube-rbac-proxy\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:33.468181 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.467961 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:33.468181 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.467970 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:33.468181 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.467978 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjfc6\" (UniqueName: \"kubernetes.io/projected/7212542f-c985-45f8-985c-469ff9b027ed-kube-api-access-jjfc6\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:33.468181 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.467986 2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7212542f-c985-45f8-985c-469ff9b027ed-tls-assets\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:33.468181 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.467994 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-configmap-metrics-client-ca\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:33.468181 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.468001 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:33.468181 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.468010 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:33.468181 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.468018 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:33.468181 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.468025 2569 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-config\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:33.468181 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.468033 2569 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-metrics-client-certs\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:33.468181 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.468041 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7212542f-c985-45f8-985c-469ff9b027ed-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:33.468181 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.468049 2569 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:33.468181 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.468083 2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7212542f-c985-45f8-985c-469ff9b027ed-config-out\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:33.468181 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.468093 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7212542f-c985-45f8-985c-469ff9b027ed-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:33.468181 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.468100 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7212542f-c985-45f8-985c-469ff9b027ed-prometheus-k8s-db\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:36:33.684310 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.684271 2569 generic.go:356] "Generic (PLEG): container finished" podID="7212542f-c985-45f8-985c-469ff9b027ed" containerID="95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7" exitCode=0 Jun 11 16:36:33.684310 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.684302 2569 generic.go:356] "Generic (PLEG): container finished" podID="7212542f-c985-45f8-985c-469ff9b027ed" containerID="ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a" exitCode=0 Jun 11 16:36:33.684310 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.684308 2569 generic.go:356] "Generic (PLEG): container finished" podID="7212542f-c985-45f8-985c-469ff9b027ed" containerID="aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a" exitCode=0 Jun 11 16:36:33.684310 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.684313 2569 generic.go:356] "Generic (PLEG): container finished" podID="7212542f-c985-45f8-985c-469ff9b027ed" containerID="96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1" exitCode=0 Jun 11 16:36:33.684310 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.684319 2569 generic.go:356] "Generic (PLEG): container finished" podID="7212542f-c985-45f8-985c-469ff9b027ed" containerID="1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16" exitCode=0 Jun 11 16:36:33.684826 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.684324 2569 generic.go:356] "Generic (PLEG): container finished" podID="7212542f-c985-45f8-985c-469ff9b027ed" containerID="dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4" exitCode=0 Jun 11 16:36:33.684826 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.684363 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7212542f-c985-45f8-985c-469ff9b027ed","Type":"ContainerDied","Data":"95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7"} Jun 11 16:36:33.684826 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.684384 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.684826 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.684448 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7212542f-c985-45f8-985c-469ff9b027ed","Type":"ContainerDied","Data":"ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a"} Jun 11 16:36:33.684826 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.684491 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7212542f-c985-45f8-985c-469ff9b027ed","Type":"ContainerDied","Data":"aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a"} Jun 11 16:36:33.684826 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.684533 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7212542f-c985-45f8-985c-469ff9b027ed","Type":"ContainerDied","Data":"96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1"} Jun 11 16:36:33.684826 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.684527 2569 scope.go:117] "RemoveContainer" containerID="95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7" Jun 11 16:36:33.684826 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.684574 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7212542f-c985-45f8-985c-469ff9b027ed","Type":"ContainerDied","Data":"1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16"} Jun 11 16:36:33.684826 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.684616 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7212542f-c985-45f8-985c-469ff9b027ed","Type":"ContainerDied","Data":"dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4"} Jun 11 16:36:33.684826 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.684656 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7212542f-c985-45f8-985c-469ff9b027ed","Type":"ContainerDied","Data":"fd06495e29ddfaf219e26cc7cca4334b77d739a08ed6c115421c039b60185fd6"} Jun 11 16:36:33.693151 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.693134 2569 scope.go:117] "RemoveContainer" containerID="ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a" Jun 11 16:36:33.700809 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.700778 2569 scope.go:117] "RemoveContainer" containerID="aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a" Jun 11 16:36:33.707802 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.707786 2569 scope.go:117] "RemoveContainer" containerID="96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1" Jun 11 16:36:33.714552 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.714528 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 16:36:33.715180 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.715161 2569 scope.go:117] "RemoveContainer" containerID="1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16" Jun 11 16:36:33.718234 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.718212 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 16:36:33.737942 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.737922 2569 scope.go:117] "RemoveContainer" containerID="dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4" Jun 11 16:36:33.742710 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.742688 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 16:36:33.743102 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.743084 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7212542f-c985-45f8-985c-469ff9b027ed" containerName="kube-rbac-proxy-web" Jun 11 16:36:33.743162 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.743107 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7212542f-c985-45f8-985c-469ff9b027ed" containerName="kube-rbac-proxy-web" Jun 11 16:36:33.743162 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.743123 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7212542f-c985-45f8-985c-469ff9b027ed" containerName="init-config-reloader" Jun 11 16:36:33.743162 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.743133 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7212542f-c985-45f8-985c-469ff9b027ed" containerName="init-config-reloader" Jun 11 16:36:33.743162 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.743153 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7212542f-c985-45f8-985c-469ff9b027ed" containerName="thanos-sidecar" Jun 11 16:36:33.743310 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.743161 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7212542f-c985-45f8-985c-469ff9b027ed" containerName="thanos-sidecar" Jun 11 16:36:33.743310 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.743173 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7212542f-c985-45f8-985c-469ff9b027ed" containerName="kube-rbac-proxy" Jun 11 16:36:33.743310 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.743180 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7212542f-c985-45f8-985c-469ff9b027ed" containerName="kube-rbac-proxy" Jun 11 16:36:33.743310 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.743194 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7212542f-c985-45f8-985c-469ff9b027ed" containerName="prometheus" Jun 11 16:36:33.743310 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.743202 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7212542f-c985-45f8-985c-469ff9b027ed" containerName="prometheus" Jun 11 16:36:33.743310 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.743216 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7212542f-c985-45f8-985c-469ff9b027ed" containerName="kube-rbac-proxy-thanos" Jun 11 16:36:33.743310 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.743223 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7212542f-c985-45f8-985c-469ff9b027ed" containerName="kube-rbac-proxy-thanos" Jun 11 16:36:33.743310 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.743242 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7212542f-c985-45f8-985c-469ff9b027ed" containerName="config-reloader" Jun 11 16:36:33.743310 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.743249 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7212542f-c985-45f8-985c-469ff9b027ed" containerName="config-reloader" Jun 11 16:36:33.743613 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.743316 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7212542f-c985-45f8-985c-469ff9b027ed" containerName="thanos-sidecar" Jun 11 16:36:33.743613 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.743328 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7212542f-c985-45f8-985c-469ff9b027ed" containerName="prometheus" Jun 11 16:36:33.743613 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.743338 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7212542f-c985-45f8-985c-469ff9b027ed" containerName="kube-rbac-proxy" Jun 11 16:36:33.743613 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.743346 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7212542f-c985-45f8-985c-469ff9b027ed" containerName="kube-rbac-proxy-thanos" Jun 11 16:36:33.743613 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.743355 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7212542f-c985-45f8-985c-469ff9b027ed" containerName="config-reloader" Jun 11 16:36:33.743613 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.743363 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7212542f-c985-45f8-985c-469ff9b027ed" containerName="kube-rbac-proxy-web" Jun 11 16:36:33.747780 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.747763 2569 scope.go:117] "RemoveContainer" containerID="2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e" Jun 11 16:36:33.750692 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.750676 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.753812 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.753793 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mxzfg\"" Jun 11 16:36:33.754089 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.754074 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6nbpjqeo64b3g\"" Jun 11 16:36:33.754170 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.754154 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 16:36:33.754236 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.754219 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 16:36:33.754288 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.754255 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 16:36:33.754422 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.754407 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 16:36:33.754511 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.754493 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 16:36:33.754625 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.754610 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 16:36:33.755130 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.755111 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 16:36:33.755236 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.755138 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 16:36:33.755236 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.755184 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 16:36:33.755236 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.755194 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 16:36:33.755618 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.755598 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 16:36:33.755717 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.755637 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 16:36:33.755836 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.755719 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 16:36:33.757070 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.757027 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 16:36:33.757322 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.757303 2569 scope.go:117] "RemoveContainer" containerID="95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7" Jun 11 16:36:33.757716 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:36:33.757693 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7\": container with ID starting with 95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7 not found: ID does not exist" containerID="95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7" Jun 11 16:36:33.757803 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.757725 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7"} err="failed to get container status \"95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7\": rpc error: code = NotFound desc = could not find container \"95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7\": container with ID starting with 95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7 not found: ID does not exist" Jun 11 16:36:33.757803 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.757746 2569 scope.go:117] "RemoveContainer" containerID="ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a" Jun 11 16:36:33.758013 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:36:33.757997 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a\": container with ID starting with ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a not found: ID does not exist" containerID="ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a" Jun 11 16:36:33.758073 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.758021 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a"} err="failed to get container status \"ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a\": rpc error: code = NotFound desc = could not find container \"ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a\": container with ID starting with ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a not found: ID does not exist" Jun 11 16:36:33.758073 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.758037 2569 scope.go:117] "RemoveContainer" containerID="aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a" Jun 11 16:36:33.758388 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:36:33.758364 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a\": container with ID starting with aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a not found: ID does not exist" containerID="aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a" Jun 11 16:36:33.758468 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.758395 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a"} err="failed to get container status \"aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a\": rpc error: code = NotFound desc = could not find container \"aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a\": container with ID starting with aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a not found: ID does not exist" Jun 11 16:36:33.758468 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.758415 2569 scope.go:117] "RemoveContainer" containerID="96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1" Jun 11 16:36:33.758800 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:36:33.758766 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1\": container with ID starting with 96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1 not found: ID does not exist" containerID="96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1" Jun 11 16:36:33.758865 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.758798 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1"} err="failed to get container status \"96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1\": rpc error: code = NotFound desc = could not find container \"96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1\": container with ID starting with 96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1 not found: ID does not exist" Jun 11 16:36:33.758865 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.758816 2569 scope.go:117] "RemoveContainer" containerID="1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16" Jun 11 16:36:33.759569 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:36:33.759547 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16\": container with ID starting with 1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16 not found: ID does not exist" containerID="1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16" Jun 11 16:36:33.759648 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.759573 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16"} err="failed to get container status \"1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16\": rpc error: code = NotFound desc = could not find container \"1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16\": container with ID starting with 1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16 not found: ID does not exist" Jun 11 16:36:33.759648 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.759619 2569 scope.go:117] "RemoveContainer" containerID="dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4" Jun 11 16:36:33.759720 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.759662 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 16:36:33.760036 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:36:33.760010 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4\": container with ID starting with dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4 not found: ID does not exist" containerID="dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4" Jun 11 16:36:33.760177 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.760043 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4"} err="failed to get container status \"dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4\": rpc error: code = NotFound desc = could not find container \"dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4\": container with ID starting with dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4 not found: ID does not exist" Jun 11 16:36:33.760177 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.760081 2569 scope.go:117] "RemoveContainer" containerID="2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e" Jun 11 16:36:33.760735 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:36:33.760442 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e\": container with ID starting with 2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e not found: ID does not exist" containerID="2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e" Jun 11 16:36:33.760735 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.760476 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e"} err="failed to get container status \"2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e\": rpc error: code = NotFound desc = could not find container \"2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e\": container with ID starting with 2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e not found: ID does not exist" Jun 11 16:36:33.760735 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.760492 2569 scope.go:117] "RemoveContainer" containerID="95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7" Jun 11 16:36:33.760735 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.760698 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7"} err="failed to get container status \"95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7\": rpc error: code = NotFound desc = could not find container \"95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7\": container with ID starting with 95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7 not found: ID does not exist" Jun 11 16:36:33.760735 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.760714 2569 scope.go:117] "RemoveContainer" containerID="ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a" Jun 11 16:36:33.760994 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.760919 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a"} err="failed to get container status \"ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a\": rpc error: code = NotFound desc = could not find container \"ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a\": container with ID starting with ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a not found: ID does not exist" Jun 11 16:36:33.760994 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.760935 2569 scope.go:117] "RemoveContainer" containerID="aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a" Jun 11 16:36:33.761286 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.761265 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a"} err="failed to get container status \"aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a\": rpc error: code = NotFound desc = could not find container \"aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a\": container with ID starting with aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a not found: ID does not exist" Jun 11 16:36:33.761286 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.761285 2569 scope.go:117] "RemoveContainer" containerID="96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1" Jun 11 16:36:33.761567 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.761547 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1"} err="failed to get container status \"96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1\": rpc error: code = NotFound desc = could not find container \"96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1\": container with ID starting with 96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1 not found: ID does not exist" Jun 11 16:36:33.761567 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.761568 2569 scope.go:117] "RemoveContainer" containerID="1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16" Jun 11 16:36:33.761835 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.761809 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16"} err="failed to get container status \"1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16\": rpc error: code = NotFound desc = could not find container \"1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16\": container with ID starting with 1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16 not found: ID does not exist" Jun 11 16:36:33.761930 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.761835 2569 scope.go:117] "RemoveContainer" containerID="dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4" Jun 11 16:36:33.762369 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.762348 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4"} err="failed to get container status \"dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4\": rpc error: code = NotFound desc = could not find container \"dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4\": container with ID starting with dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4 not found: ID does not exist" Jun 11 16:36:33.762369 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.762369 2569 scope.go:117] "RemoveContainer" containerID="2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e" Jun 11 16:36:33.762501 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.762475 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 16:36:33.762631 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.762612 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e"} err="failed to get container status \"2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e\": rpc error: code = NotFound desc = could not find container \"2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e\": container with ID starting with 2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e not found: ID does not exist" Jun 11 16:36:33.762672 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.762633 2569 scope.go:117] "RemoveContainer" containerID="95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7" Jun 11 16:36:33.762872 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.762857 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7"} err="failed to get container status \"95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7\": rpc error: code = NotFound desc = could not find container \"95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7\": container with ID starting with 95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7 not found: ID does not exist" Jun 11 16:36:33.762916 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.762873 2569 scope.go:117] "RemoveContainer" containerID="ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a" Jun 11 16:36:33.763125 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.763102 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a"} err="failed to get container status \"ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a\": rpc error: code = NotFound desc = could not find container \"ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a\": container with ID starting with ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a not found: ID does not exist" Jun 11 16:36:33.763212 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.763125 2569 scope.go:117] "RemoveContainer" containerID="aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a" Jun 11 16:36:33.763370 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.763352 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a"} err="failed to get container status \"aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a\": rpc error: code = NotFound desc = could not find container \"aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a\": container with ID starting with aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a not found: ID does not exist" Jun 11 16:36:33.763425 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.763370 2569 scope.go:117] "RemoveContainer" containerID="96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1" Jun 11 16:36:33.763633 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.763613 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1"} err="failed to get container status \"96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1\": rpc error: code = NotFound desc = could not find container \"96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1\": container with ID starting with 96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1 not found: ID does not exist" Jun 11 16:36:33.763722 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.763641 2569 scope.go:117] "RemoveContainer" containerID="1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16" Jun 11 16:36:33.763890 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.763873 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16"} err="failed to get container status \"1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16\": rpc error: code = NotFound desc = could not find container \"1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16\": container with ID starting with 1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16 not found: ID does not exist" Jun 11 16:36:33.763934 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.763891 2569 scope.go:117] "RemoveContainer" containerID="dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4" Jun 11 16:36:33.764174 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.764150 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4"} err="failed to get container status \"dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4\": rpc error: code = NotFound desc = could not find container \"dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4\": container with ID starting with dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4 not found: ID does not exist" Jun 11 16:36:33.764263 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.764176 2569 scope.go:117] "RemoveContainer" containerID="2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e" Jun 11 16:36:33.764500 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.764455 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e"} err="failed to get container status \"2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e\": rpc error: code = NotFound desc = could not find container \"2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e\": container with ID starting with 2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e not found: ID does not exist" Jun 11 16:36:33.764500 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.764475 2569 scope.go:117] "RemoveContainer" containerID="95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7" Jun 11 16:36:33.764962 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.764940 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7"} err="failed to get container status \"95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7\": rpc error: code = NotFound desc = could not find container \"95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7\": container with ID starting with 95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7 not found: ID does not exist" Jun 11 16:36:33.764962 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.764962 2569 scope.go:117] "RemoveContainer" containerID="ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a" Jun 11 16:36:33.765276 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.765254 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a"} err="failed to get container status \"ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a\": rpc error: code = NotFound desc = could not find container \"ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a\": container with ID starting with ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a not found: ID does not exist" Jun 11 16:36:33.765356 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.765277 2569 scope.go:117] "RemoveContainer" containerID="aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a" Jun 11 16:36:33.765578 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.765552 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a"} err="failed to get container status \"aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a\": rpc error: code = NotFound desc = could not find container \"aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a\": container with ID starting with aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a not found: ID does not exist" Jun 11 16:36:33.765578 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.765578 2569 scope.go:117] "RemoveContainer" containerID="96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1" Jun 11 16:36:33.766210 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.766189 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1"} err="failed to get container status \"96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1\": rpc error: code = NotFound desc = could not find container \"96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1\": container with ID starting with 96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1 not found: ID does not exist" Jun 11 16:36:33.766210 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.766210 2569 scope.go:117] "RemoveContainer" containerID="1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16" Jun 11 16:36:33.766455 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.766439 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16"} err="failed to get container status \"1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16\": rpc error: code = NotFound desc = could not find container \"1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16\": container with ID starting with 1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16 not found: ID does not exist" Jun 11 16:36:33.766504 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.766455 2569 scope.go:117] "RemoveContainer" containerID="dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4" Jun 11 16:36:33.766691 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.766673 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4"} err="failed to get container status \"dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4\": rpc error: code = NotFound desc = could not find container \"dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4\": container with ID starting with dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4 not found: ID does not exist" Jun 11 16:36:33.766737 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.766693 2569 scope.go:117] "RemoveContainer" containerID="2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e" Jun 11 16:36:33.766911 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.766894 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e"} err="failed to get container status \"2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e\": rpc error: code = NotFound desc = could not find container \"2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e\": container with ID starting with 2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e not found: ID does not exist" Jun 11 16:36:33.766957 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.766912 2569 scope.go:117] "RemoveContainer" containerID="95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7" Jun 11 16:36:33.767156 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.767135 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7"} err="failed to get container status \"95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7\": rpc error: code = NotFound desc = could not find container \"95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7\": container with ID starting with 95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7 not found: ID does not exist" Jun 11 16:36:33.767217 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.767157 2569 scope.go:117] "RemoveContainer" containerID="ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a" Jun 11 16:36:33.767373 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.767357 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a"} err="failed to get container status \"ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a\": rpc error: code = NotFound desc = could not find container \"ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a\": container with ID starting with ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a not found: ID does not exist" Jun 11 16:36:33.767440 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.767376 2569 scope.go:117] "RemoveContainer" containerID="aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a" Jun 11 16:36:33.767611 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.767592 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a"} err="failed to get container status \"aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a\": rpc error: code = NotFound desc = could not find container \"aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a\": container with ID starting with aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a not found: ID does not exist" Jun 11 16:36:33.767656 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.767612 2569 scope.go:117] "RemoveContainer" containerID="96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1" Jun 11 16:36:33.767803 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.767790 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1"} err="failed to get container status \"96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1\": rpc error: code = NotFound desc = could not find container \"96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1\": container with ID starting with 96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1 not found: ID does not exist" Jun 11 16:36:33.767853 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.767803 2569 scope.go:117] "RemoveContainer" containerID="1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16" Jun 11 16:36:33.768036 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.768019 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16"} err="failed to get container status \"1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16\": rpc error: code = NotFound desc = could not find container \"1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16\": container with ID starting with 1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16 not found: ID does not exist" Jun 11 16:36:33.768108 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.768037 2569 scope.go:117] "RemoveContainer" containerID="dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4" Jun 11 16:36:33.768283 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.768267 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4"} err="failed to get container status \"dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4\": rpc error: code = NotFound desc = could not find container \"dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4\": container with ID starting with dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4 not found: ID does not exist" Jun 11 16:36:33.768341 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.768284 2569 scope.go:117] "RemoveContainer" containerID="2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e" Jun 11 16:36:33.768512 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.768494 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e"} err="failed to get container status \"2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e\": rpc error: code = NotFound desc = could not find container \"2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e\": container with ID starting with 2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e not found: ID does not exist" Jun 11 16:36:33.768557 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.768513 2569 scope.go:117] "RemoveContainer" containerID="95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7" Jun 11 16:36:33.768731 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.768717 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7"} err="failed to get container status \"95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7\": rpc error: code = NotFound desc = could not find container \"95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7\": container with ID starting with 95d3d6762ec0c6c5ca76bb9b3b0abc9a7f67b7f2651b6246f1eac64259d6cff7 not found: ID does not exist" Jun 11 16:36:33.768769 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.768732 2569 scope.go:117] "RemoveContainer" containerID="ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a" Jun 11 16:36:33.768925 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.768906 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a"} err="failed to get container status \"ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a\": rpc error: code = NotFound desc = could not find container \"ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a\": container with ID starting with ac0ad5e02656b622e332a3b6a222bbedb1cc3280193b476023d12b0df1505b6a not found: ID does not exist" Jun 11 16:36:33.768975 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.768926 2569 scope.go:117] "RemoveContainer" containerID="aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a" Jun 11 16:36:33.769189 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.769173 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a"} err="failed to get container status \"aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a\": rpc error: code = NotFound desc = could not find container \"aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a\": container with ID starting with aff6841c8bca9408eb9a8b83c19fab3686ebeb32bab9581c630e60ee6560909a not found: ID does not exist" Jun 11 16:36:33.769189 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.769188 2569 scope.go:117] "RemoveContainer" containerID="96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1" Jun 11 16:36:33.769392 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.769376 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1"} err="failed to get container status \"96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1\": rpc error: code = NotFound desc = could not find container \"96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1\": container with ID starting with 96bd1e3bf1472013c722140c54529109a679423652f683de5022bf8a17bb84f1 not found: ID does not exist" Jun 11 16:36:33.769431 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.769392 2569 scope.go:117] "RemoveContainer" containerID="1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16" Jun 11 16:36:33.769616 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.769593 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16"} err="failed to get container status \"1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16\": rpc error: code = NotFound desc = could not find container \"1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16\": container with ID starting with 1ad5988422a785eeab3ccbd31abfade844ed458970a5cd949f707ff211e87c16 not found: ID does not exist" Jun 11 16:36:33.769616 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.769614 2569 scope.go:117] "RemoveContainer" containerID="dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4" Jun 11 16:36:33.769836 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.769818 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4"} err="failed to get container status \"dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4\": rpc error: code = NotFound desc = could not find container \"dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4\": container with ID starting with dc68318d2f248900afe21ba2e4990019b19f950c6e866291dc6a02acf67106e4 not found: ID does not exist" Jun 11 16:36:33.769836 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.769835 2569 scope.go:117] "RemoveContainer" containerID="2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e" Jun 11 16:36:33.770096 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.770078 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e"} err="failed to get container status \"2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e\": rpc error: code = NotFound desc = could not find container \"2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e\": container with ID starting with 2974e126d45925fd6328ed1daf77db8802698f956fe49473cf3873db8565dc0e not found: ID does not exist" Jun 11 16:36:33.871883 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.871851 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e71f196a-e2e4-4f4f-860d-e3027493896e-config\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.871883 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.871888 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e71f196a-e2e4-4f4f-860d-e3027493896e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.872105 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.871921 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e71f196a-e2e4-4f4f-860d-e3027493896e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.872105 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.871949 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e71f196a-e2e4-4f4f-860d-e3027493896e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.872105 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.871979 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e71f196a-e2e4-4f4f-860d-e3027493896e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.872105 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.872012 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e71f196a-e2e4-4f4f-860d-e3027493896e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.872105 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.872029 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e71f196a-e2e4-4f4f-860d-e3027493896e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.872105 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.872049 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e71f196a-e2e4-4f4f-860d-e3027493896e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.872105 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.872094 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e71f196a-e2e4-4f4f-860d-e3027493896e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.872306 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.872112 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e71f196a-e2e4-4f4f-860d-e3027493896e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.872306 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.872142 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e71f196a-e2e4-4f4f-860d-e3027493896e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.872306 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.872201 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e71f196a-e2e4-4f4f-860d-e3027493896e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.872306 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.872235 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e71f196a-e2e4-4f4f-860d-e3027493896e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.872306 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.872259 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e71f196a-e2e4-4f4f-860d-e3027493896e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.872306 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.872279 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfc6q\" (UniqueName: \"kubernetes.io/projected/e71f196a-e2e4-4f4f-860d-e3027493896e-kube-api-access-cfc6q\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.872306 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.872303 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e71f196a-e2e4-4f4f-860d-e3027493896e-config-out\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.872542 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.872318 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e71f196a-e2e4-4f4f-860d-e3027493896e-web-config\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.872542 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.872336 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e71f196a-e2e4-4f4f-860d-e3027493896e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.872542 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.872379 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e71f196a-e2e4-4f4f-860d-e3027493896e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.872542 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.872399 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e71f196a-e2e4-4f4f-860d-e3027493896e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.973390 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.973302 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e71f196a-e2e4-4f4f-860d-e3027493896e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.973390 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.973342 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e71f196a-e2e4-4f4f-860d-e3027493896e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.973390 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.973361 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e71f196a-e2e4-4f4f-860d-e3027493896e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.973711 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.973688 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e71f196a-e2e4-4f4f-860d-e3027493896e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.973783 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.973730 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e71f196a-e2e4-4f4f-860d-e3027493896e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.973883 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.973845 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e71f196a-e2e4-4f4f-860d-e3027493896e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.973883 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.973881 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e71f196a-e2e4-4f4f-860d-e3027493896e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.974227 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.973927 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e71f196a-e2e4-4f4f-860d-e3027493896e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.974227 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.973991 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e71f196a-e2e4-4f4f-860d-e3027493896e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.974227 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.974027 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e71f196a-e2e4-4f4f-860d-e3027493896e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.974227 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.974077 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e71f196a-e2e4-4f4f-860d-e3027493896e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.974448 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.974205 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e71f196a-e2e4-4f4f-860d-e3027493896e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.974448 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.974292 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfc6q\" (UniqueName: \"kubernetes.io/projected/e71f196a-e2e4-4f4f-860d-e3027493896e-kube-api-access-cfc6q\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.974448 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.974319 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e71f196a-e2e4-4f4f-860d-e3027493896e-config-out\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.974448 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.974342 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e71f196a-e2e4-4f4f-860d-e3027493896e-web-config\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.974448 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.974375 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e71f196a-e2e4-4f4f-860d-e3027493896e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.974448 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.974422 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e71f196a-e2e4-4f4f-860d-e3027493896e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.974448 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.974445 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e71f196a-e2e4-4f4f-860d-e3027493896e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.974809 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.974477 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e71f196a-e2e4-4f4f-860d-e3027493896e-config\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.974809 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.974546 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e71f196a-e2e4-4f4f-860d-e3027493896e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.974926 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.974812 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e71f196a-e2e4-4f4f-860d-e3027493896e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.975469 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.975145 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e71f196a-e2e4-4f4f-860d-e3027493896e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.975469 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.975388 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e71f196a-e2e4-4f4f-860d-e3027493896e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.975621 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.975572 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e71f196a-e2e4-4f4f-860d-e3027493896e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.975697 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.975669 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e71f196a-e2e4-4f4f-860d-e3027493896e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.976848 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.976819 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e71f196a-e2e4-4f4f-860d-e3027493896e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.976958 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.976909 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e71f196a-e2e4-4f4f-860d-e3027493896e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.977472 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.977438 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e71f196a-e2e4-4f4f-860d-e3027493896e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.977558 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.977488 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e71f196a-e2e4-4f4f-860d-e3027493896e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.979254 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.978335 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e71f196a-e2e4-4f4f-860d-e3027493896e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.979254 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.978743 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e71f196a-e2e4-4f4f-860d-e3027493896e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.979254 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.979014 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e71f196a-e2e4-4f4f-860d-e3027493896e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.979254 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.979027 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e71f196a-e2e4-4f4f-860d-e3027493896e-web-config\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.979254 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.979210 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e71f196a-e2e4-4f4f-860d-e3027493896e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.979254 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.979221 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e71f196a-e2e4-4f4f-860d-e3027493896e-config-out\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.980037 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.980017 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e71f196a-e2e4-4f4f-860d-e3027493896e-config\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.980202 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.980184 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e71f196a-e2e4-4f4f-860d-e3027493896e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.980526 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.980505 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e71f196a-e2e4-4f4f-860d-e3027493896e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.981001 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.980981 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e71f196a-e2e4-4f4f-860d-e3027493896e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:33.983263 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:33.983242 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfc6q\" (UniqueName: \"kubernetes.io/projected/e71f196a-e2e4-4f4f-860d-e3027493896e-kube-api-access-cfc6q\") pod \"prometheus-k8s-0\" (UID: \"e71f196a-e2e4-4f4f-860d-e3027493896e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:34.062296 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:34.062256 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:36:34.204466 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:34.204420 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 16:36:34.207540 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:36:34.207517 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode71f196a_e2e4_4f4f_860d_e3027493896e.slice/crio-5ef2e28a3ff54f0c12ac6b287503f8f4821ad62e05cef099bc567c359ad39aa0 WatchSource:0}: Error finding container 5ef2e28a3ff54f0c12ac6b287503f8f4821ad62e05cef099bc567c359ad39aa0: Status 404 returned error can't find the container with id 5ef2e28a3ff54f0c12ac6b287503f8f4821ad62e05cef099bc567c359ad39aa0 Jun 11 16:36:34.361031 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:34.360999 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7212542f-c985-45f8-985c-469ff9b027ed" path="/var/lib/kubelet/pods/7212542f-c985-45f8-985c-469ff9b027ed/volumes" Jun 11 16:36:34.690068 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:34.690029 2569 generic.go:356] "Generic (PLEG): container finished" podID="e71f196a-e2e4-4f4f-860d-e3027493896e" containerID="ebf0d40cb1fd9eb6bed35c1f85f6d6783aed6bf12c1a1c5e3c9fbc4074c9693d" exitCode=0 Jun 11 16:36:34.690433 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:34.690114 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e71f196a-e2e4-4f4f-860d-e3027493896e","Type":"ContainerDied","Data":"ebf0d40cb1fd9eb6bed35c1f85f6d6783aed6bf12c1a1c5e3c9fbc4074c9693d"} Jun 11 16:36:34.690433 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:34.690174 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e71f196a-e2e4-4f4f-860d-e3027493896e","Type":"ContainerStarted","Data":"5ef2e28a3ff54f0c12ac6b287503f8f4821ad62e05cef099bc567c359ad39aa0"} Jun 11 16:36:35.697868 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:35.697828 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e71f196a-e2e4-4f4f-860d-e3027493896e","Type":"ContainerStarted","Data":"23df0e267f029d94e164aed55fdaf4f378ed5dee55df792653da3217be4daf4d"} Jun 11 16:36:35.698286 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:35.697921 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e71f196a-e2e4-4f4f-860d-e3027493896e","Type":"ContainerStarted","Data":"da10f893dacd170c0f9404e7ac08896765ca55fc366588598854f0bbc7866520"} Jun 11 16:36:35.698286 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:35.697947 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e71f196a-e2e4-4f4f-860d-e3027493896e","Type":"ContainerStarted","Data":"fc2492dd03c039b55df23a3e4d1018db670eae24f195de35e37c2601db72e09d"} Jun 11 16:36:35.698286 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:35.697970 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e71f196a-e2e4-4f4f-860d-e3027493896e","Type":"ContainerStarted","Data":"a6b9fac9f128a50b3a83b8cec0c334b530ef570c275a5696c0cb62ac64c16ee7"} Jun 11 16:36:35.698286 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:35.697995 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e71f196a-e2e4-4f4f-860d-e3027493896e","Type":"ContainerStarted","Data":"3373437dfe671c01e755fbab06ffb8ea7afe0bdf3a55d8fde7e557c0b663de83"} Jun 11 16:36:35.698286 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:35.698016 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e71f196a-e2e4-4f4f-860d-e3027493896e","Type":"ContainerStarted","Data":"df667775c5ded2f041773e83fad04a4705c18a053c46596304c15ebe1acfa028"} Jun 11 16:36:35.728763 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:35.728709 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.707848044 podStartE2EDuration="2.728692031s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.843987ms" isStatefulPod=false podCreationTimestamp="2026-06-11 16:36:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:36:35.726973571 +0000 UTC m=+323.795243607" watchObservedRunningTime="2026-06-11 16:36:35.728692031 +0000 UTC m=+323.796962067" Jun 11 16:36:39.063360 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:36:39.063320 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:37:34.063381 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:37:34.063343 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:37:34.079532 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:37:34.079508 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:37:34.942196 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:37:34.942165 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 16:40:10.193888 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:10.193857 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74d99d69cd-645bl"] Jun 11 16:40:10.197317 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:10.197301 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-645bl" Jun 11 16:40:10.206634 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:10.206612 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 16:40:10.206961 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:10.206941 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 16:40:10.207089 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:10.207022 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 16:40:10.207159 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:10.207110 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 16:40:10.207218 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:10.207167 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lrc8l\"" Jun 11 16:40:10.226190 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:10.226160 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74d99d69cd-645bl"] Jun 11 16:40:10.304163 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:10.304130 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76a585b0-4596-4280-9d77-b31d8dcc303f-tmp\") pod \"opendatahub-operator-controller-manager-74d99d69cd-645bl\" (UID: \"76a585b0-4596-4280-9d77-b31d8dcc303f\") " pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-645bl" Jun 11 16:40:10.304163 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:10.304174 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/76a585b0-4596-4280-9d77-b31d8dcc303f-manifests\") pod \"opendatahub-operator-controller-manager-74d99d69cd-645bl\" (UID: \"76a585b0-4596-4280-9d77-b31d8dcc303f\") " pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-645bl" Jun 11 16:40:10.304431 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:10.304199 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/76a585b0-4596-4280-9d77-b31d8dcc303f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74d99d69cd-645bl\" (UID: \"76a585b0-4596-4280-9d77-b31d8dcc303f\") " pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-645bl" Jun 11 16:40:10.304431 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:10.304335 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76a585b0-4596-4280-9d77-b31d8dcc303f-webhook-cert\") pod \"opendatahub-operator-controller-manager-74d99d69cd-645bl\" (UID: \"76a585b0-4596-4280-9d77-b31d8dcc303f\") " pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-645bl" Jun 11 16:40:10.304431 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:10.304376 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq5fz\" (UniqueName: \"kubernetes.io/projected/76a585b0-4596-4280-9d77-b31d8dcc303f-kube-api-access-kq5fz\") pod \"opendatahub-operator-controller-manager-74d99d69cd-645bl\" (UID: \"76a585b0-4596-4280-9d77-b31d8dcc303f\") " pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-645bl" Jun 11 16:40:10.405865 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:10.405831 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76a585b0-4596-4280-9d77-b31d8dcc303f-webhook-cert\") pod \"opendatahub-operator-controller-manager-74d99d69cd-645bl\" (UID: \"76a585b0-4596-4280-9d77-b31d8dcc303f\") " pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-645bl" Jun 11 16:40:10.406079 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:10.405873 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq5fz\" (UniqueName: \"kubernetes.io/projected/76a585b0-4596-4280-9d77-b31d8dcc303f-kube-api-access-kq5fz\") pod \"opendatahub-operator-controller-manager-74d99d69cd-645bl\" (UID: \"76a585b0-4596-4280-9d77-b31d8dcc303f\") " pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-645bl" Jun 11 16:40:10.406079 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:10.405921 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76a585b0-4596-4280-9d77-b31d8dcc303f-tmp\") pod \"opendatahub-operator-controller-manager-74d99d69cd-645bl\" (UID: \"76a585b0-4596-4280-9d77-b31d8dcc303f\") " pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-645bl" Jun 11 16:40:10.406079 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:10.405952 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/76a585b0-4596-4280-9d77-b31d8dcc303f-manifests\") pod \"opendatahub-operator-controller-manager-74d99d69cd-645bl\" (UID: \"76a585b0-4596-4280-9d77-b31d8dcc303f\") " pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-645bl" Jun 11 16:40:10.406079 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:10.405973 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/76a585b0-4596-4280-9d77-b31d8dcc303f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74d99d69cd-645bl\" (UID: \"76a585b0-4596-4280-9d77-b31d8dcc303f\") " pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-645bl" Jun 11 16:40:10.406455 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:10.406421 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/76a585b0-4596-4280-9d77-b31d8dcc303f-manifests\") pod \"opendatahub-operator-controller-manager-74d99d69cd-645bl\" (UID: \"76a585b0-4596-4280-9d77-b31d8dcc303f\") " pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-645bl" Jun 11 16:40:10.408444 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:10.408411 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76a585b0-4596-4280-9d77-b31d8dcc303f-tmp\") pod \"opendatahub-operator-controller-manager-74d99d69cd-645bl\" (UID: \"76a585b0-4596-4280-9d77-b31d8dcc303f\") " pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-645bl" Jun 11 16:40:10.408543 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:10.408494 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76a585b0-4596-4280-9d77-b31d8dcc303f-webhook-cert\") pod \"opendatahub-operator-controller-manager-74d99d69cd-645bl\" (UID: \"76a585b0-4596-4280-9d77-b31d8dcc303f\") " pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-645bl" Jun 11 16:40:10.408664 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:10.408647 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/76a585b0-4596-4280-9d77-b31d8dcc303f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74d99d69cd-645bl\" (UID: \"76a585b0-4596-4280-9d77-b31d8dcc303f\") " pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-645bl" Jun 11 16:40:10.421296 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:10.421270 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq5fz\" (UniqueName: \"kubernetes.io/projected/76a585b0-4596-4280-9d77-b31d8dcc303f-kube-api-access-kq5fz\") pod \"opendatahub-operator-controller-manager-74d99d69cd-645bl\" (UID: \"76a585b0-4596-4280-9d77-b31d8dcc303f\") " pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-645bl" Jun 11 16:40:10.507484 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:10.507405 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-645bl" Jun 11 16:40:10.672114 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:10.672074 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74d99d69cd-645bl"] Jun 11 16:40:10.676138 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:40:10.676111 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76a585b0_4596_4280_9d77_b31d8dcc303f.slice/crio-8a8fe114238f78d4d05cdcbb39679175336de27884ce35e318aaa5d160f85329 WatchSource:0}: Error finding container 8a8fe114238f78d4d05cdcbb39679175336de27884ce35e318aaa5d160f85329: Status 404 returned error can't find the container with id 8a8fe114238f78d4d05cdcbb39679175336de27884ce35e318aaa5d160f85329 Jun 11 16:40:10.677965 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:10.677948 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:40:11.528445 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:11.528405 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-645bl" event={"ID":"76a585b0-4596-4280-9d77-b31d8dcc303f","Type":"ContainerStarted","Data":"8a8fe114238f78d4d05cdcbb39679175336de27884ce35e318aaa5d160f85329"} Jun 11 16:40:14.544890 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:14.544854 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-645bl" event={"ID":"76a585b0-4596-4280-9d77-b31d8dcc303f","Type":"ContainerStarted","Data":"bc40ed60e8ac3e637f24875f676ed5da9a3a73e073bc9cb8dd22ec4c49ac29bf"} Jun 11 16:40:15.550033 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:15.549999 2569 generic.go:356] "Generic (PLEG): container finished" podID="76a585b0-4596-4280-9d77-b31d8dcc303f" containerID="bc40ed60e8ac3e637f24875f676ed5da9a3a73e073bc9cb8dd22ec4c49ac29bf" exitCode=0 Jun 11 16:40:15.550426 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:15.550094 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-645bl" event={"ID":"76a585b0-4596-4280-9d77-b31d8dcc303f","Type":"ContainerDied","Data":"bc40ed60e8ac3e637f24875f676ed5da9a3a73e073bc9cb8dd22ec4c49ac29bf"} Jun 11 16:40:16.555977 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:16.555941 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-645bl" event={"ID":"76a585b0-4596-4280-9d77-b31d8dcc303f","Type":"ContainerStarted","Data":"b40c10981a9ad235b27e392def75e746a983398fd0fce2cb4efde455f24319d1"} Jun 11 16:40:16.556364 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:16.556038 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-645bl" Jun 11 16:40:16.595882 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:16.595715 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-645bl" podStartSLOduration=2.243117855 podStartE2EDuration="6.595694039s" totalImagesPullingTime="3.402961615s" totalInitContainerRuntime="949.614569ms" isStatefulPod=false podCreationTimestamp="2026-06-11 16:40:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:40:16.593175214 +0000 UTC m=+544.661445250" watchObservedRunningTime="2026-06-11 16:40:16.595694039 +0000 UTC m=+544.663964078" Jun 11 16:40:27.561925 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:27.561890 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-645bl" Jun 11 16:40:38.416117 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:38.416077 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5d6f6b5548-brzvm"] Jun 11 16:40:38.419566 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:38.419536 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5d6f6b5548-brzvm" Jun 11 16:40:38.423485 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:38.423461 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6mxfc\"" Jun 11 16:40:38.423677 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:38.423550 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:40:38.423677 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:38.423552 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 16:40:38.423850 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:38.423677 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 16:40:38.423850 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:38.423563 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 16:40:38.423850 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:38.423601 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 16:40:38.433700 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:38.433669 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5d6f6b5548-brzvm"] Jun 11 16:40:38.447655 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:38.447620 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/279eb59e-9db9-4121-9847-ac12a6ef37a4-manager-config\") pod \"lws-controller-manager-5d6f6b5548-brzvm\" (UID: \"279eb59e-9db9-4121-9847-ac12a6ef37a4\") " pod="openshift-lws-operator/lws-controller-manager-5d6f6b5548-brzvm" Jun 11 16:40:38.447774 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:38.447669 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szjpd\" (UniqueName: \"kubernetes.io/projected/279eb59e-9db9-4121-9847-ac12a6ef37a4-kube-api-access-szjpd\") pod \"lws-controller-manager-5d6f6b5548-brzvm\" (UID: \"279eb59e-9db9-4121-9847-ac12a6ef37a4\") " pod="openshift-lws-operator/lws-controller-manager-5d6f6b5548-brzvm" Jun 11 16:40:38.447774 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:38.447712 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/279eb59e-9db9-4121-9847-ac12a6ef37a4-cert\") pod \"lws-controller-manager-5d6f6b5548-brzvm\" (UID: \"279eb59e-9db9-4121-9847-ac12a6ef37a4\") " pod="openshift-lws-operator/lws-controller-manager-5d6f6b5548-brzvm" Jun 11 16:40:38.447858 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:38.447811 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/279eb59e-9db9-4121-9847-ac12a6ef37a4-metrics-cert\") pod \"lws-controller-manager-5d6f6b5548-brzvm\" (UID: \"279eb59e-9db9-4121-9847-ac12a6ef37a4\") " pod="openshift-lws-operator/lws-controller-manager-5d6f6b5548-brzvm" Jun 11 16:40:38.548518 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:38.548483 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/279eb59e-9db9-4121-9847-ac12a6ef37a4-manager-config\") pod \"lws-controller-manager-5d6f6b5548-brzvm\" (UID: \"279eb59e-9db9-4121-9847-ac12a6ef37a4\") " pod="openshift-lws-operator/lws-controller-manager-5d6f6b5548-brzvm" Jun 11 16:40:38.548703 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:38.548530 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szjpd\" (UniqueName: \"kubernetes.io/projected/279eb59e-9db9-4121-9847-ac12a6ef37a4-kube-api-access-szjpd\") pod \"lws-controller-manager-5d6f6b5548-brzvm\" (UID: \"279eb59e-9db9-4121-9847-ac12a6ef37a4\") " pod="openshift-lws-operator/lws-controller-manager-5d6f6b5548-brzvm" Jun 11 16:40:38.548703 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:38.548563 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/279eb59e-9db9-4121-9847-ac12a6ef37a4-cert\") pod \"lws-controller-manager-5d6f6b5548-brzvm\" (UID: \"279eb59e-9db9-4121-9847-ac12a6ef37a4\") " pod="openshift-lws-operator/lws-controller-manager-5d6f6b5548-brzvm" Jun 11 16:40:38.548703 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:38.548636 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/279eb59e-9db9-4121-9847-ac12a6ef37a4-metrics-cert\") pod \"lws-controller-manager-5d6f6b5548-brzvm\" (UID: \"279eb59e-9db9-4121-9847-ac12a6ef37a4\") " pod="openshift-lws-operator/lws-controller-manager-5d6f6b5548-brzvm" Jun 11 16:40:38.549387 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:38.549362 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/279eb59e-9db9-4121-9847-ac12a6ef37a4-manager-config\") pod \"lws-controller-manager-5d6f6b5548-brzvm\" (UID: \"279eb59e-9db9-4121-9847-ac12a6ef37a4\") " pod="openshift-lws-operator/lws-controller-manager-5d6f6b5548-brzvm" Jun 11 16:40:38.551198 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:38.551172 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/279eb59e-9db9-4121-9847-ac12a6ef37a4-metrics-cert\") pod \"lws-controller-manager-5d6f6b5548-brzvm\" (UID: \"279eb59e-9db9-4121-9847-ac12a6ef37a4\") " pod="openshift-lws-operator/lws-controller-manager-5d6f6b5548-brzvm" Jun 11 16:40:38.551392 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:38.551371 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/279eb59e-9db9-4121-9847-ac12a6ef37a4-cert\") pod \"lws-controller-manager-5d6f6b5548-brzvm\" (UID: \"279eb59e-9db9-4121-9847-ac12a6ef37a4\") " pod="openshift-lws-operator/lws-controller-manager-5d6f6b5548-brzvm" Jun 11 16:40:38.556906 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:38.556885 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szjpd\" (UniqueName: \"kubernetes.io/projected/279eb59e-9db9-4121-9847-ac12a6ef37a4-kube-api-access-szjpd\") pod \"lws-controller-manager-5d6f6b5548-brzvm\" (UID: \"279eb59e-9db9-4121-9847-ac12a6ef37a4\") " pod="openshift-lws-operator/lws-controller-manager-5d6f6b5548-brzvm" Jun 11 16:40:38.729644 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:38.729602 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5d6f6b5548-brzvm" Jun 11 16:40:38.915364 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:38.915000 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5d6f6b5548-brzvm"] Jun 11 16:40:39.648385 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:39.648338 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5d6f6b5548-brzvm" event={"ID":"279eb59e-9db9-4121-9847-ac12a6ef37a4","Type":"ContainerStarted","Data":"56778a6f81b8513630cde82f31c9aed605fd84ae210b200e387c9bab3c48b6cd"} Jun 11 16:40:41.658340 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:41.658245 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5d6f6b5548-brzvm" event={"ID":"279eb59e-9db9-4121-9847-ac12a6ef37a4","Type":"ContainerStarted","Data":"450d80346269270881171057612d335a96c263f3d30280ebacb3320f84c55f34"} Jun 11 16:40:41.658712 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:41.658375 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5d6f6b5548-brzvm" Jun 11 16:40:41.680546 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:41.680492 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5d6f6b5548-brzvm" podStartSLOduration=1.429248507 podStartE2EDuration="3.680474946s" totalImagesPullingTime="2.251226439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:40:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:40:41.679672705 +0000 UTC m=+569.747942738" watchObservedRunningTime="2026-06-11 16:40:41.680474946 +0000 UTC m=+569.748744964" Jun 11 16:40:52.665998 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:52.665903 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5d6f6b5548-brzvm" Jun 11 16:40:59.969314 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:59.969278 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-79b7c87c7f-tb5db"] Jun 11 16:40:59.972704 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:59.972679 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-79b7c87c7f-tb5db" Jun 11 16:40:59.975350 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:59.975321 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-fq5pd\"" Jun 11 16:40:59.975467 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:59.975337 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 16:40:59.981606 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:40:59.981582 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-79b7c87c7f-tb5db"] Jun 11 16:41:00.038955 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:00.038913 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28nmk\" (UniqueName: \"kubernetes.io/projected/85f78129-7241-499c-be81-ef4342515bfd-kube-api-access-28nmk\") pod \"dashboard-redirect-79b7c87c7f-tb5db\" (UID: \"85f78129-7241-499c-be81-ef4342515bfd\") " pod="opendatahub/dashboard-redirect-79b7c87c7f-tb5db" Jun 11 16:41:00.039148 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:00.039025 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/85f78129-7241-499c-be81-ef4342515bfd-redirect-config\") pod \"dashboard-redirect-79b7c87c7f-tb5db\" (UID: \"85f78129-7241-499c-be81-ef4342515bfd\") " pod="opendatahub/dashboard-redirect-79b7c87c7f-tb5db" Jun 11 16:41:00.140026 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:00.139984 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/85f78129-7241-499c-be81-ef4342515bfd-redirect-config\") pod \"dashboard-redirect-79b7c87c7f-tb5db\" (UID: \"85f78129-7241-499c-be81-ef4342515bfd\") " pod="opendatahub/dashboard-redirect-79b7c87c7f-tb5db" Jun 11 16:41:00.140026 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:00.140034 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28nmk\" (UniqueName: \"kubernetes.io/projected/85f78129-7241-499c-be81-ef4342515bfd-kube-api-access-28nmk\") pod \"dashboard-redirect-79b7c87c7f-tb5db\" (UID: \"85f78129-7241-499c-be81-ef4342515bfd\") " pod="opendatahub/dashboard-redirect-79b7c87c7f-tb5db" Jun 11 16:41:00.140735 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:00.140713 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/85f78129-7241-499c-be81-ef4342515bfd-redirect-config\") pod \"dashboard-redirect-79b7c87c7f-tb5db\" (UID: \"85f78129-7241-499c-be81-ef4342515bfd\") " pod="opendatahub/dashboard-redirect-79b7c87c7f-tb5db" Jun 11 16:41:00.149112 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:00.149047 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28nmk\" (UniqueName: \"kubernetes.io/projected/85f78129-7241-499c-be81-ef4342515bfd-kube-api-access-28nmk\") pod \"dashboard-redirect-79b7c87c7f-tb5db\" (UID: \"85f78129-7241-499c-be81-ef4342515bfd\") " pod="opendatahub/dashboard-redirect-79b7c87c7f-tb5db" Jun 11 16:41:00.284542 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:00.284443 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-79b7c87c7f-tb5db" Jun 11 16:41:00.418824 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:00.418794 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-79b7c87c7f-tb5db"] Jun 11 16:41:00.421428 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:41:00.421400 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85f78129_7241_499c_be81_ef4342515bfd.slice/crio-26df7491777488d09751b32937c7395f45395e94841519861bd72edaa6dfc74c WatchSource:0}: Error finding container 26df7491777488d09751b32937c7395f45395e94841519861bd72edaa6dfc74c: Status 404 returned error can't find the container with id 26df7491777488d09751b32937c7395f45395e94841519861bd72edaa6dfc74c Jun 11 16:41:00.737623 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:00.737585 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-79b7c87c7f-tb5db" event={"ID":"85f78129-7241-499c-be81-ef4342515bfd","Type":"ContainerStarted","Data":"26df7491777488d09751b32937c7395f45395e94841519861bd72edaa6dfc74c"} Jun 11 16:41:05.764260 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:05.764203 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-79b7c87c7f-tb5db" event={"ID":"85f78129-7241-499c-be81-ef4342515bfd","Type":"ContainerStarted","Data":"a96d0ff4b2f915676a06f1726115bd940086c135eee9863cf9d4013c96811591"} Jun 11 16:41:05.780134 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:05.780086 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-79b7c87c7f-tb5db" podStartSLOduration=2.508868412 podStartE2EDuration="6.780071424s" totalImagesPullingTime="4.271203012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:40:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:41:05.778650891 +0000 UTC m=+593.846920927" watchObservedRunningTime="2026-06-11 16:41:05.780071424 +0000 UTC m=+593.848341451" Jun 11 16:41:18.491469 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.491435 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq"] Jun 11 16:41:18.495481 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.495459 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:18.498175 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.498145 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-twx4x\"" Jun 11 16:41:18.498317 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.498180 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 16:41:18.498317 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.498151 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 16:41:18.498317 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.498248 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 16:41:18.499026 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.499003 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea71637b-58b4-48f4-bb29-60023d732365-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5c5946766fn78nq\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:18.499142 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.499034 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea71637b-58b4-48f4-bb29-60023d732365-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5c5946766fn78nq\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:18.499142 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.499083 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea71637b-58b4-48f4-bb29-60023d732365-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5c5946766fn78nq\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:18.499266 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.499158 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea71637b-58b4-48f4-bb29-60023d732365-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5c5946766fn78nq\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:18.499266 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.499206 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea71637b-58b4-48f4-bb29-60023d732365-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5c5946766fn78nq\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:18.499266 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.499225 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrmnd\" (UniqueName: \"kubernetes.io/projected/ea71637b-58b4-48f4-bb29-60023d732365-kube-api-access-jrmnd\") pod \"data-science-gateway-data-science-gateway-class-5c5946766fn78nq\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:18.499467 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.499323 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea71637b-58b4-48f4-bb29-60023d732365-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5c5946766fn78nq\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:18.499467 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.499351 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea71637b-58b4-48f4-bb29-60023d732365-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5c5946766fn78nq\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:18.499467 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.499379 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea71637b-58b4-48f4-bb29-60023d732365-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5c5946766fn78nq\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:18.506976 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.506953 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq"] Jun 11 16:41:18.599994 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.599953 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea71637b-58b4-48f4-bb29-60023d732365-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5c5946766fn78nq\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:18.599994 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.599992 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea71637b-58b4-48f4-bb29-60023d732365-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5c5946766fn78nq\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:18.600253 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.600008 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea71637b-58b4-48f4-bb29-60023d732365-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5c5946766fn78nq\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:18.600253 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.600034 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea71637b-58b4-48f4-bb29-60023d732365-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5c5946766fn78nq\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:18.600253 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.600078 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea71637b-58b4-48f4-bb29-60023d732365-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5c5946766fn78nq\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:18.600253 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.600107 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea71637b-58b4-48f4-bb29-60023d732365-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5c5946766fn78nq\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:18.600253 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.600160 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea71637b-58b4-48f4-bb29-60023d732365-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5c5946766fn78nq\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:18.600253 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.600205 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea71637b-58b4-48f4-bb29-60023d732365-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5c5946766fn78nq\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:18.600253 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.600228 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrmnd\" (UniqueName: \"kubernetes.io/projected/ea71637b-58b4-48f4-bb29-60023d732365-kube-api-access-jrmnd\") pod \"data-science-gateway-data-science-gateway-class-5c5946766fn78nq\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:18.600598 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.600529 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea71637b-58b4-48f4-bb29-60023d732365-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5c5946766fn78nq\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:18.600688 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.600660 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea71637b-58b4-48f4-bb29-60023d732365-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5c5946766fn78nq\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:18.600800 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.600699 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea71637b-58b4-48f4-bb29-60023d732365-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5c5946766fn78nq\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:18.600800 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.600726 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea71637b-58b4-48f4-bb29-60023d732365-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5c5946766fn78nq\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:18.601166 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.601144 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea71637b-58b4-48f4-bb29-60023d732365-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5c5946766fn78nq\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:18.602608 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.602583 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea71637b-58b4-48f4-bb29-60023d732365-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5c5946766fn78nq\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:18.602745 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.602728 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea71637b-58b4-48f4-bb29-60023d732365-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5c5946766fn78nq\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:18.608297 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.608268 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea71637b-58b4-48f4-bb29-60023d732365-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5c5946766fn78nq\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:18.608488 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.608471 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrmnd\" (UniqueName: \"kubernetes.io/projected/ea71637b-58b4-48f4-bb29-60023d732365-kube-api-access-jrmnd\") pod \"data-science-gateway-data-science-gateway-class-5c5946766fn78nq\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:18.806282 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.806191 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:18.881973 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.881934 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc"] Jun 11 16:41:18.886015 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.885982 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:18.897749 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.897725 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc"] Jun 11 16:41:18.903593 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.903556 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0cdb506-3a94-4f23-918b-bbbd5e04157a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcpfsbc\" (UID: \"c0cdb506-3a94-4f23-918b-bbbd5e04157a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:18.903593 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.903589 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0cdb506-3a94-4f23-918b-bbbd5e04157a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcpfsbc\" (UID: \"c0cdb506-3a94-4f23-918b-bbbd5e04157a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:18.903812 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.903613 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0cdb506-3a94-4f23-918b-bbbd5e04157a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcpfsbc\" (UID: \"c0cdb506-3a94-4f23-918b-bbbd5e04157a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:18.903812 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.903680 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0cdb506-3a94-4f23-918b-bbbd5e04157a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcpfsbc\" (UID: \"c0cdb506-3a94-4f23-918b-bbbd5e04157a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:18.903812 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.903772 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2bfr\" (UniqueName: \"kubernetes.io/projected/c0cdb506-3a94-4f23-918b-bbbd5e04157a-kube-api-access-m2bfr\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcpfsbc\" (UID: \"c0cdb506-3a94-4f23-918b-bbbd5e04157a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:18.903970 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.903815 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0cdb506-3a94-4f23-918b-bbbd5e04157a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcpfsbc\" (UID: \"c0cdb506-3a94-4f23-918b-bbbd5e04157a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:18.903970 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.903870 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0cdb506-3a94-4f23-918b-bbbd5e04157a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcpfsbc\" (UID: \"c0cdb506-3a94-4f23-918b-bbbd5e04157a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:18.903970 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.903929 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0cdb506-3a94-4f23-918b-bbbd5e04157a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcpfsbc\" (UID: \"c0cdb506-3a94-4f23-918b-bbbd5e04157a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:18.903970 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.903957 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0cdb506-3a94-4f23-918b-bbbd5e04157a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcpfsbc\" (UID: \"c0cdb506-3a94-4f23-918b-bbbd5e04157a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:18.952824 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:18.952780 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq"] Jun 11 16:41:18.955076 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:41:18.955034 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea71637b_58b4_48f4_bb29_60023d732365.slice/crio-1a0e4016387f24d96577c322b89fcca2fe4f74ffe824bd9b5ce5548bec8ba355 WatchSource:0}: Error finding container 1a0e4016387f24d96577c322b89fcca2fe4f74ffe824bd9b5ce5548bec8ba355: Status 404 returned error can't find the container with id 1a0e4016387f24d96577c322b89fcca2fe4f74ffe824bd9b5ce5548bec8ba355 Jun 11 16:41:19.004603 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:19.004563 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2bfr\" (UniqueName: \"kubernetes.io/projected/c0cdb506-3a94-4f23-918b-bbbd5e04157a-kube-api-access-m2bfr\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcpfsbc\" (UID: \"c0cdb506-3a94-4f23-918b-bbbd5e04157a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:19.004603 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:19.004611 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0cdb506-3a94-4f23-918b-bbbd5e04157a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcpfsbc\" (UID: \"c0cdb506-3a94-4f23-918b-bbbd5e04157a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:19.004872 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:19.004648 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0cdb506-3a94-4f23-918b-bbbd5e04157a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcpfsbc\" (UID: \"c0cdb506-3a94-4f23-918b-bbbd5e04157a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:19.004872 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:19.004665 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0cdb506-3a94-4f23-918b-bbbd5e04157a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcpfsbc\" (UID: \"c0cdb506-3a94-4f23-918b-bbbd5e04157a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:19.004872 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:19.004684 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0cdb506-3a94-4f23-918b-bbbd5e04157a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcpfsbc\" (UID: \"c0cdb506-3a94-4f23-918b-bbbd5e04157a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:19.004872 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:19.004717 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0cdb506-3a94-4f23-918b-bbbd5e04157a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcpfsbc\" (UID: \"c0cdb506-3a94-4f23-918b-bbbd5e04157a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:19.004872 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:19.004781 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0cdb506-3a94-4f23-918b-bbbd5e04157a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcpfsbc\" (UID: \"c0cdb506-3a94-4f23-918b-bbbd5e04157a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:19.004872 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:19.004834 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0cdb506-3a94-4f23-918b-bbbd5e04157a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcpfsbc\" (UID: \"c0cdb506-3a94-4f23-918b-bbbd5e04157a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:19.004872 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:19.004858 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0cdb506-3a94-4f23-918b-bbbd5e04157a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcpfsbc\" (UID: \"c0cdb506-3a94-4f23-918b-bbbd5e04157a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:19.005276 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:19.005174 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0cdb506-3a94-4f23-918b-bbbd5e04157a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcpfsbc\" (UID: \"c0cdb506-3a94-4f23-918b-bbbd5e04157a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:19.005276 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:19.005206 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0cdb506-3a94-4f23-918b-bbbd5e04157a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcpfsbc\" (UID: \"c0cdb506-3a94-4f23-918b-bbbd5e04157a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:19.005382 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:19.005324 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0cdb506-3a94-4f23-918b-bbbd5e04157a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcpfsbc\" (UID: \"c0cdb506-3a94-4f23-918b-bbbd5e04157a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:19.005463 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:19.005440 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0cdb506-3a94-4f23-918b-bbbd5e04157a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcpfsbc\" (UID: \"c0cdb506-3a94-4f23-918b-bbbd5e04157a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:19.005556 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:19.005539 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0cdb506-3a94-4f23-918b-bbbd5e04157a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcpfsbc\" (UID: \"c0cdb506-3a94-4f23-918b-bbbd5e04157a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:19.007327 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:19.007305 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0cdb506-3a94-4f23-918b-bbbd5e04157a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcpfsbc\" (UID: \"c0cdb506-3a94-4f23-918b-bbbd5e04157a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:19.007484 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:19.007465 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0cdb506-3a94-4f23-918b-bbbd5e04157a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcpfsbc\" (UID: \"c0cdb506-3a94-4f23-918b-bbbd5e04157a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:19.015205 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:19.015183 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0cdb506-3a94-4f23-918b-bbbd5e04157a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcpfsbc\" (UID: \"c0cdb506-3a94-4f23-918b-bbbd5e04157a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:19.015302 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:19.015244 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2bfr\" (UniqueName: \"kubernetes.io/projected/c0cdb506-3a94-4f23-918b-bbbd5e04157a-kube-api-access-m2bfr\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcpfsbc\" (UID: \"c0cdb506-3a94-4f23-918b-bbbd5e04157a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:19.198002 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:19.197964 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:19.332666 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:19.332642 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc"] Jun 11 16:41:19.335033 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:41:19.335007 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0cdb506_3a94_4f23_918b_bbbd5e04157a.slice/crio-d7a96aafd61a1eec5a36c656c9ea7faf191139eec5133a7f5ba5545245cec1dc WatchSource:0}: Error finding container d7a96aafd61a1eec5a36c656c9ea7faf191139eec5133a7f5ba5545245cec1dc: Status 404 returned error can't find the container with id d7a96aafd61a1eec5a36c656c9ea7faf191139eec5133a7f5ba5545245cec1dc Jun 11 16:41:19.826630 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:19.826591 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" event={"ID":"c0cdb506-3a94-4f23-918b-bbbd5e04157a","Type":"ContainerStarted","Data":"d7a96aafd61a1eec5a36c656c9ea7faf191139eec5133a7f5ba5545245cec1dc"} Jun 11 16:41:19.828067 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:19.828010 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" event={"ID":"ea71637b-58b4-48f4-bb29-60023d732365","Type":"ContainerStarted","Data":"1a0e4016387f24d96577c322b89fcca2fe4f74ffe824bd9b5ce5548bec8ba355"} Jun 11 16:41:21.894009 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:21.893965 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Jun 11 16:41:21.894376 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:21.894046 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Jun 11 16:41:21.894376 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:21.894129 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Jun 11 16:41:21.900243 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:21.900215 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Jun 11 16:41:21.900323 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:21.900292 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Jun 11 16:41:21.900379 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:21.900334 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Jun 11 16:41:22.847181 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:22.847143 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" event={"ID":"ea71637b-58b4-48f4-bb29-60023d732365","Type":"ContainerStarted","Data":"9afd4fa6361e372f7b5dee61cebf0c2a51908c46769bddfbbedaa4d2f231cbf1"} Jun 11 16:41:22.848758 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:22.848729 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" event={"ID":"c0cdb506-3a94-4f23-918b-bbbd5e04157a","Type":"ContainerStarted","Data":"c3e5a4aad78fcd37ebedb1df8b1a7a2489d45674b51ab34b0efb156cbc16be9e"} Jun 11 16:41:22.869666 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:22.869619 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" podStartSLOduration=1.9330643680000001 podStartE2EDuration="4.869604668s" totalImagesPullingTime="2.9365403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:41:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:41:22.868240371 +0000 UTC m=+610.936510408" watchObservedRunningTime="2026-06-11 16:41:22.869604668 +0000 UTC m=+610.937874703" Jun 11 16:41:22.890885 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:22.890839 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" podStartSLOduration=2.328010282 podStartE2EDuration="4.890823408s" totalImagesPullingTime="2.562813126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:41:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:41:22.88915637 +0000 UTC m=+610.957426406" watchObservedRunningTime="2026-06-11 16:41:22.890823408 +0000 UTC m=+610.959093444" Jun 11 16:41:23.199089 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:23.199030 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:23.204270 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:23.204242 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:23.807244 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:23.807208 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:23.808450 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:23.808427 2569 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5c5946766fn78nq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body= Jun 11 16:41:23.808505 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:23.808480 2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" podUID="ea71637b-58b4-48f4-bb29-60023d732365" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" Jun 11 16:41:23.853868 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:23.853839 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:23.854826 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:23.854809 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcpfsbc" Jun 11 16:41:23.903530 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:23.903501 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq"] Jun 11 16:41:24.806969 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:24.806928 2569 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5c5946766fn78nq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body= Jun 11 16:41:24.807365 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:24.806998 2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" podUID="ea71637b-58b4-48f4-bb29-60023d732365" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" Jun 11 16:41:25.807545 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:25.807506 2569 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5c5946766fn78nq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body= Jun 11 16:41:25.807946 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:25.807568 2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" podUID="ea71637b-58b4-48f4-bb29-60023d732365" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" Jun 11 16:41:25.861918 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:25.861881 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" podUID="ea71637b-58b4-48f4-bb29-60023d732365" containerName="istio-proxy" containerID="cri-o://9afd4fa6361e372f7b5dee61cebf0c2a51908c46769bddfbbedaa4d2f231cbf1" gracePeriod=30 Jun 11 16:41:30.818817 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:30.818730 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lqjns"] Jun 11 16:41:30.822427 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:30.822402 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lqjns" Jun 11 16:41:30.825391 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:30.825357 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-fzmcg\"" Jun 11 16:41:30.825531 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:30.825394 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 16:41:30.826666 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:30.826644 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 16:41:30.832948 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:30.832928 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lqjns"] Jun 11 16:41:30.924311 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:30.924269 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxvkx\" (UniqueName: \"kubernetes.io/projected/34e0f7b6-5f8d-4295-9bf7-784f984cb61d-kube-api-access-pxvkx\") pod \"kuadrant-operator-catalog-lqjns\" (UID: \"34e0f7b6-5f8d-4295-9bf7-784f984cb61d\") " pod="kuadrant-system/kuadrant-operator-catalog-lqjns" Jun 11 16:41:31.025757 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.025721 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxvkx\" (UniqueName: \"kubernetes.io/projected/34e0f7b6-5f8d-4295-9bf7-784f984cb61d-kube-api-access-pxvkx\") pod \"kuadrant-operator-catalog-lqjns\" (UID: \"34e0f7b6-5f8d-4295-9bf7-784f984cb61d\") " pod="kuadrant-system/kuadrant-operator-catalog-lqjns" Jun 11 16:41:31.033684 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.033657 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxvkx\" (UniqueName: \"kubernetes.io/projected/34e0f7b6-5f8d-4295-9bf7-784f984cb61d-kube-api-access-pxvkx\") pod \"kuadrant-operator-catalog-lqjns\" (UID: \"34e0f7b6-5f8d-4295-9bf7-784f984cb61d\") " pod="kuadrant-system/kuadrant-operator-catalog-lqjns" Jun 11 16:41:31.117645 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.117614 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:31.133047 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.133014 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lqjns" Jun 11 16:41:31.199669 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.199627 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lqjns"] Jun 11 16:41:31.226633 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.226600 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea71637b-58b4-48f4-bb29-60023d732365-credential-socket\") pod \"ea71637b-58b4-48f4-bb29-60023d732365\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " Jun 11 16:41:31.226762 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.226644 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea71637b-58b4-48f4-bb29-60023d732365-istio-data\") pod \"ea71637b-58b4-48f4-bb29-60023d732365\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " Jun 11 16:41:31.226762 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.226673 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrmnd\" (UniqueName: \"kubernetes.io/projected/ea71637b-58b4-48f4-bb29-60023d732365-kube-api-access-jrmnd\") pod \"ea71637b-58b4-48f4-bb29-60023d732365\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " Jun 11 16:41:31.226762 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.226697 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea71637b-58b4-48f4-bb29-60023d732365-istio-podinfo\") pod \"ea71637b-58b4-48f4-bb29-60023d732365\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " Jun 11 16:41:31.226762 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.226740 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea71637b-58b4-48f4-bb29-60023d732365-workload-socket\") pod \"ea71637b-58b4-48f4-bb29-60023d732365\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " Jun 11 16:41:31.226968 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.226764 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea71637b-58b4-48f4-bb29-60023d732365-istio-token\") pod \"ea71637b-58b4-48f4-bb29-60023d732365\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " Jun 11 16:41:31.226968 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.226822 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea71637b-58b4-48f4-bb29-60023d732365-istiod-ca-cert\") pod \"ea71637b-58b4-48f4-bb29-60023d732365\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " Jun 11 16:41:31.226968 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.226856 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea71637b-58b4-48f4-bb29-60023d732365-istio-envoy\") pod \"ea71637b-58b4-48f4-bb29-60023d732365\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " Jun 11 16:41:31.226968 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.226891 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea71637b-58b4-48f4-bb29-60023d732365-workload-certs\") pod \"ea71637b-58b4-48f4-bb29-60023d732365\" (UID: \"ea71637b-58b4-48f4-bb29-60023d732365\") " Jun 11 16:41:31.226968 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.226937 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea71637b-58b4-48f4-bb29-60023d732365-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ea71637b-58b4-48f4-bb29-60023d732365" (UID: "ea71637b-58b4-48f4-bb29-60023d732365"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:41:31.227249 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.227220 2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea71637b-58b4-48f4-bb29-60023d732365-credential-socket\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:41:31.227409 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.227334 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea71637b-58b4-48f4-bb29-60023d732365-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ea71637b-58b4-48f4-bb29-60023d732365" (UID: "ea71637b-58b4-48f4-bb29-60023d732365"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:41:31.227535 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.227419 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea71637b-58b4-48f4-bb29-60023d732365-istio-data" (OuterVolumeSpecName: "istio-data") pod "ea71637b-58b4-48f4-bb29-60023d732365" (UID: "ea71637b-58b4-48f4-bb29-60023d732365"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:41:31.227535 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.227442 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea71637b-58b4-48f4-bb29-60023d732365-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ea71637b-58b4-48f4-bb29-60023d732365" (UID: "ea71637b-58b4-48f4-bb29-60023d732365"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:41:31.230262 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.230235 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea71637b-58b4-48f4-bb29-60023d732365-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ea71637b-58b4-48f4-bb29-60023d732365" (UID: "ea71637b-58b4-48f4-bb29-60023d732365"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:41:31.232203 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.232157 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea71637b-58b4-48f4-bb29-60023d732365-istio-token" (OuterVolumeSpecName: "istio-token") pod "ea71637b-58b4-48f4-bb29-60023d732365" (UID: "ea71637b-58b4-48f4-bb29-60023d732365"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:41:31.232296 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.232197 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ea71637b-58b4-48f4-bb29-60023d732365-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ea71637b-58b4-48f4-bb29-60023d732365" (UID: "ea71637b-58b4-48f4-bb29-60023d732365"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 16:41:31.232296 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.232204 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea71637b-58b4-48f4-bb29-60023d732365-kube-api-access-jrmnd" (OuterVolumeSpecName: "kube-api-access-jrmnd") pod "ea71637b-58b4-48f4-bb29-60023d732365" (UID: "ea71637b-58b4-48f4-bb29-60023d732365"). InnerVolumeSpecName "kube-api-access-jrmnd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:41:31.232296 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.232211 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea71637b-58b4-48f4-bb29-60023d732365-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ea71637b-58b4-48f4-bb29-60023d732365" (UID: "ea71637b-58b4-48f4-bb29-60023d732365"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:41:31.268608 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.268582 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lqjns"] Jun 11 16:41:31.271199 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:41:31.271171 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34e0f7b6_5f8d_4295_9bf7_784f984cb61d.slice/crio-7d5e3e672a0f4b742776b39c4ce552c4978ec42875fdf67f0845b4885ab65a82 WatchSource:0}: Error finding container 7d5e3e672a0f4b742776b39c4ce552c4978ec42875fdf67f0845b4885ab65a82: Status 404 returned error can't find the container with id 7d5e3e672a0f4b742776b39c4ce552c4978ec42875fdf67f0845b4885ab65a82 Jun 11 16:41:31.328450 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.328412 2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea71637b-58b4-48f4-bb29-60023d732365-istio-data\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:41:31.328450 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.328446 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrmnd\" (UniqueName: \"kubernetes.io/projected/ea71637b-58b4-48f4-bb29-60023d732365-kube-api-access-jrmnd\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:41:31.328450 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.328458 2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea71637b-58b4-48f4-bb29-60023d732365-istio-podinfo\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:41:31.328683 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.328470 2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea71637b-58b4-48f4-bb29-60023d732365-workload-socket\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:41:31.328683 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.328482 2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea71637b-58b4-48f4-bb29-60023d732365-istio-token\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:41:31.328683 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.328494 2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea71637b-58b4-48f4-bb29-60023d732365-istiod-ca-cert\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:41:31.328683 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.328504 2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea71637b-58b4-48f4-bb29-60023d732365-istio-envoy\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:41:31.328683 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.328514 2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea71637b-58b4-48f4-bb29-60023d732365-workload-certs\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:41:31.406646 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.406561 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lflck"] Jun 11 16:41:31.407094 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.407076 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea71637b-58b4-48f4-bb29-60023d732365" containerName="istio-proxy" Jun 11 16:41:31.407151 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.407097 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea71637b-58b4-48f4-bb29-60023d732365" containerName="istio-proxy" Jun 11 16:41:31.407197 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.407187 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea71637b-58b4-48f4-bb29-60023d732365" containerName="istio-proxy" Jun 11 16:41:31.413311 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.413293 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lflck" Jun 11 16:41:31.417048 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.417024 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lflck"] Jun 11 16:41:31.530881 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.530838 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d4b5\" (UniqueName: \"kubernetes.io/projected/8db13793-72d0-42bd-b411-23696cf7aadb-kube-api-access-4d4b5\") pod \"kuadrant-operator-catalog-lflck\" (UID: \"8db13793-72d0-42bd-b411-23696cf7aadb\") " pod="kuadrant-system/kuadrant-operator-catalog-lflck" Jun 11 16:41:31.632175 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.632138 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d4b5\" (UniqueName: \"kubernetes.io/projected/8db13793-72d0-42bd-b411-23696cf7aadb-kube-api-access-4d4b5\") pod \"kuadrant-operator-catalog-lflck\" (UID: \"8db13793-72d0-42bd-b411-23696cf7aadb\") " pod="kuadrant-system/kuadrant-operator-catalog-lflck" Jun 11 16:41:31.640877 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.640856 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d4b5\" (UniqueName: \"kubernetes.io/projected/8db13793-72d0-42bd-b411-23696cf7aadb-kube-api-access-4d4b5\") pod \"kuadrant-operator-catalog-lflck\" (UID: \"8db13793-72d0-42bd-b411-23696cf7aadb\") " pod="kuadrant-system/kuadrant-operator-catalog-lflck" Jun 11 16:41:31.724958 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.724923 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lflck" Jun 11 16:41:31.868413 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.868377 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lflck"] Jun 11 16:41:31.894978 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.894618 2569 generic.go:356] "Generic (PLEG): container finished" podID="ea71637b-58b4-48f4-bb29-60023d732365" containerID="9afd4fa6361e372f7b5dee61cebf0c2a51908c46769bddfbbedaa4d2f231cbf1" exitCode=0 Jun 11 16:41:31.894978 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.894686 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" Jun 11 16:41:31.894978 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.894708 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" event={"ID":"ea71637b-58b4-48f4-bb29-60023d732365","Type":"ContainerDied","Data":"9afd4fa6361e372f7b5dee61cebf0c2a51908c46769bddfbbedaa4d2f231cbf1"} Jun 11 16:41:31.894978 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.894776 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq" event={"ID":"ea71637b-58b4-48f4-bb29-60023d732365","Type":"ContainerDied","Data":"1a0e4016387f24d96577c322b89fcca2fe4f74ffe824bd9b5ce5548bec8ba355"} Jun 11 16:41:31.894978 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.894811 2569 scope.go:117] "RemoveContainer" containerID="9afd4fa6361e372f7b5dee61cebf0c2a51908c46769bddfbbedaa4d2f231cbf1" Jun 11 16:41:31.896851 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.896817 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lqjns" event={"ID":"34e0f7b6-5f8d-4295-9bf7-784f984cb61d","Type":"ContainerStarted","Data":"7d5e3e672a0f4b742776b39c4ce552c4978ec42875fdf67f0845b4885ab65a82"} Jun 11 16:41:31.919514 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.919482 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq"] Jun 11 16:41:31.923464 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.923439 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5c5946766fn78nq"] Jun 11 16:41:31.926268 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:41:31.926243 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8db13793_72d0_42bd_b411_23696cf7aadb.slice/crio-f9e24de314fe8e3c2379a8e60ce664756ff8049e232875c14fc395736f8cd8cf WatchSource:0}: Error finding container f9e24de314fe8e3c2379a8e60ce664756ff8049e232875c14fc395736f8cd8cf: Status 404 returned error can't find the container with id f9e24de314fe8e3c2379a8e60ce664756ff8049e232875c14fc395736f8cd8cf Jun 11 16:41:31.929373 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.929354 2569 scope.go:117] "RemoveContainer" containerID="9afd4fa6361e372f7b5dee61cebf0c2a51908c46769bddfbbedaa4d2f231cbf1" Jun 11 16:41:31.929736 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:41:31.929708 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9afd4fa6361e372f7b5dee61cebf0c2a51908c46769bddfbbedaa4d2f231cbf1\": container with ID starting with 9afd4fa6361e372f7b5dee61cebf0c2a51908c46769bddfbbedaa4d2f231cbf1 not found: ID does not exist" containerID="9afd4fa6361e372f7b5dee61cebf0c2a51908c46769bddfbbedaa4d2f231cbf1" Jun 11 16:41:31.929812 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:31.929751 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9afd4fa6361e372f7b5dee61cebf0c2a51908c46769bddfbbedaa4d2f231cbf1"} err="failed to get container status \"9afd4fa6361e372f7b5dee61cebf0c2a51908c46769bddfbbedaa4d2f231cbf1\": rpc error: code = NotFound desc = could not find container \"9afd4fa6361e372f7b5dee61cebf0c2a51908c46769bddfbbedaa4d2f231cbf1\": container with ID starting with 9afd4fa6361e372f7b5dee61cebf0c2a51908c46769bddfbbedaa4d2f231cbf1 not found: ID does not exist" Jun 11 16:41:32.362617 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:32.362587 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea71637b-58b4-48f4-bb29-60023d732365" path="/var/lib/kubelet/pods/ea71637b-58b4-48f4-bb29-60023d732365/volumes" Jun 11 16:41:32.903618 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:32.903587 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lflck" event={"ID":"8db13793-72d0-42bd-b411-23696cf7aadb","Type":"ContainerStarted","Data":"f9e24de314fe8e3c2379a8e60ce664756ff8049e232875c14fc395736f8cd8cf"} Jun 11 16:41:33.910086 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:33.909957 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lqjns" event={"ID":"34e0f7b6-5f8d-4295-9bf7-784f984cb61d","Type":"ContainerStarted","Data":"afbf1219e8da3b3872a468fa33293c14e72cc4dc510aad83cc86ed80917a8d54"} Jun 11 16:41:33.910086 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:33.910003 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-lqjns" podUID="34e0f7b6-5f8d-4295-9bf7-784f984cb61d" containerName="registry-server" containerID="cri-o://afbf1219e8da3b3872a468fa33293c14e72cc4dc510aad83cc86ed80917a8d54" gracePeriod=2 Jun 11 16:41:33.911771 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:33.911746 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lflck" event={"ID":"8db13793-72d0-42bd-b411-23696cf7aadb","Type":"ContainerStarted","Data":"d0269e86acad062d64ef8d3558e455fa585334d182547d7bb6c85a7769800a7a"} Jun 11 16:41:33.926420 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:33.926368 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-lqjns" podStartSLOduration=1.644151995 podStartE2EDuration="3.926348618s" totalImagesPullingTime="2.282196623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:41:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:41:33.924186975 +0000 UTC m=+621.992457014" watchObservedRunningTime="2026-06-11 16:41:33.926348618 +0000 UTC m=+621.994618655" Jun 11 16:41:33.940147 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:33.940096 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-lflck" podStartSLOduration=1.310454399 podStartE2EDuration="2.940045885s" totalImagesPullingTime="1.629591486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:41:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:41:33.938809667 +0000 UTC m=+622.007079705" watchObservedRunningTime="2026-06-11 16:41:33.940045885 +0000 UTC m=+622.008315920" Jun 11 16:41:34.161309 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:34.161234 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lqjns" Jun 11 16:41:34.264961 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:34.264915 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxvkx\" (UniqueName: \"kubernetes.io/projected/34e0f7b6-5f8d-4295-9bf7-784f984cb61d-kube-api-access-pxvkx\") pod \"34e0f7b6-5f8d-4295-9bf7-784f984cb61d\" (UID: \"34e0f7b6-5f8d-4295-9bf7-784f984cb61d\") " Jun 11 16:41:34.267310 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:34.267276 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34e0f7b6-5f8d-4295-9bf7-784f984cb61d-kube-api-access-pxvkx" (OuterVolumeSpecName: "kube-api-access-pxvkx") pod "34e0f7b6-5f8d-4295-9bf7-784f984cb61d" (UID: "34e0f7b6-5f8d-4295-9bf7-784f984cb61d"). InnerVolumeSpecName "kube-api-access-pxvkx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:41:34.365705 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:34.365673 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxvkx\" (UniqueName: \"kubernetes.io/projected/34e0f7b6-5f8d-4295-9bf7-784f984cb61d-kube-api-access-pxvkx\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:41:34.917533 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:34.917504 2569 generic.go:356] "Generic (PLEG): container finished" podID="34e0f7b6-5f8d-4295-9bf7-784f984cb61d" containerID="afbf1219e8da3b3872a468fa33293c14e72cc4dc510aad83cc86ed80917a8d54" exitCode=0 Jun 11 16:41:34.917946 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:34.917546 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lqjns" Jun 11 16:41:34.917946 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:34.917590 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lqjns" event={"ID":"34e0f7b6-5f8d-4295-9bf7-784f984cb61d","Type":"ContainerDied","Data":"afbf1219e8da3b3872a468fa33293c14e72cc4dc510aad83cc86ed80917a8d54"} Jun 11 16:41:34.917946 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:34.917642 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lqjns" event={"ID":"34e0f7b6-5f8d-4295-9bf7-784f984cb61d","Type":"ContainerDied","Data":"7d5e3e672a0f4b742776b39c4ce552c4978ec42875fdf67f0845b4885ab65a82"} Jun 11 16:41:34.917946 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:34.917662 2569 scope.go:117] "RemoveContainer" containerID="afbf1219e8da3b3872a468fa33293c14e72cc4dc510aad83cc86ed80917a8d54" Jun 11 16:41:34.927104 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:34.927093 2569 scope.go:117] "RemoveContainer" containerID="afbf1219e8da3b3872a468fa33293c14e72cc4dc510aad83cc86ed80917a8d54" Jun 11 16:41:34.927382 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:41:34.927363 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afbf1219e8da3b3872a468fa33293c14e72cc4dc510aad83cc86ed80917a8d54\": container with ID starting with afbf1219e8da3b3872a468fa33293c14e72cc4dc510aad83cc86ed80917a8d54 not found: ID does not exist" containerID="afbf1219e8da3b3872a468fa33293c14e72cc4dc510aad83cc86ed80917a8d54" Jun 11 16:41:34.927448 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:34.927394 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afbf1219e8da3b3872a468fa33293c14e72cc4dc510aad83cc86ed80917a8d54"} err="failed to get container status \"afbf1219e8da3b3872a468fa33293c14e72cc4dc510aad83cc86ed80917a8d54\": rpc error: code = NotFound desc = could not find container \"afbf1219e8da3b3872a468fa33293c14e72cc4dc510aad83cc86ed80917a8d54\": container with ID starting with afbf1219e8da3b3872a468fa33293c14e72cc4dc510aad83cc86ed80917a8d54 not found: ID does not exist" Jun 11 16:41:34.933253 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:34.933230 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lqjns"] Jun 11 16:41:34.937797 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:34.937775 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lqjns"] Jun 11 16:41:36.366184 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:36.366151 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34e0f7b6-5f8d-4295-9bf7-784f984cb61d" path="/var/lib/kubelet/pods/34e0f7b6-5f8d-4295-9bf7-784f984cb61d/volumes" Jun 11 16:41:41.725532 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:41.725494 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-lflck" Jun 11 16:41:41.725950 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:41.725564 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-lflck" Jun 11 16:41:41.748310 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:41.748282 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-lflck" Jun 11 16:41:41.973326 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:41:41.973299 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-lflck" Jun 11 16:42:03.369197 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:03.369160 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ppvjt"] Jun 11 16:42:03.369586 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:03.369514 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34e0f7b6-5f8d-4295-9bf7-784f984cb61d" containerName="registry-server" Jun 11 16:42:03.369586 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:03.369526 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="34e0f7b6-5f8d-4295-9bf7-784f984cb61d" containerName="registry-server" Jun 11 16:42:03.369657 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:03.369608 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="34e0f7b6-5f8d-4295-9bf7-784f984cb61d" containerName="registry-server" Jun 11 16:42:03.372616 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:03.372595 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ppvjt" Jun 11 16:42:03.375823 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:03.375792 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-vkc45\"" Jun 11 16:42:03.384685 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:03.384662 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ppvjt"] Jun 11 16:42:03.417067 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:03.417017 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlm2d\" (UniqueName: \"kubernetes.io/projected/53bba977-ba03-4403-8be8-248e9d92e264-kube-api-access-rlm2d\") pod \"authorino-operator-75cc8d5cb7-ppvjt\" (UID: \"53bba977-ba03-4403-8be8-248e9d92e264\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ppvjt" Jun 11 16:42:03.517642 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:03.517606 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlm2d\" (UniqueName: \"kubernetes.io/projected/53bba977-ba03-4403-8be8-248e9d92e264-kube-api-access-rlm2d\") pod \"authorino-operator-75cc8d5cb7-ppvjt\" (UID: \"53bba977-ba03-4403-8be8-248e9d92e264\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ppvjt" Jun 11 16:42:03.532443 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:03.532405 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlm2d\" (UniqueName: \"kubernetes.io/projected/53bba977-ba03-4403-8be8-248e9d92e264-kube-api-access-rlm2d\") pod \"authorino-operator-75cc8d5cb7-ppvjt\" (UID: \"53bba977-ba03-4403-8be8-248e9d92e264\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ppvjt" Jun 11 16:42:03.685103 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:03.685027 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ppvjt" Jun 11 16:42:03.854952 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:03.854921 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ppvjt"] Jun 11 16:42:03.858417 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:42:03.858389 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53bba977_ba03_4403_8be8_248e9d92e264.slice/crio-66698cf85c78cc195a465fbd22bd790ddd0704b47c56d21f6dfccd40acfd6d3e WatchSource:0}: Error finding container 66698cf85c78cc195a465fbd22bd790ddd0704b47c56d21f6dfccd40acfd6d3e: Status 404 returned error can't find the container with id 66698cf85c78cc195a465fbd22bd790ddd0704b47c56d21f6dfccd40acfd6d3e Jun 11 16:42:04.047912 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:04.047829 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ppvjt" event={"ID":"53bba977-ba03-4403-8be8-248e9d92e264","Type":"ContainerStarted","Data":"66698cf85c78cc195a465fbd22bd790ddd0704b47c56d21f6dfccd40acfd6d3e"} Jun 11 16:42:06.584705 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:06.584639 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2sblm"] Jun 11 16:42:06.589243 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:06.589221 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2sblm" Jun 11 16:42:06.592041 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:06.592020 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 11 16:42:06.592175 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:06.592020 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-bxnqd\"" Jun 11 16:42:06.598956 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:06.598935 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2sblm"] Jun 11 16:42:06.650008 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:06.649957 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvxpd\" (UniqueName: \"kubernetes.io/projected/a129be54-0708-4179-83e7-2c9d4783ea02-kube-api-access-jvxpd\") pod \"dns-operator-controller-manager-864dd78c4c-2sblm\" (UID: \"a129be54-0708-4179-83e7-2c9d4783ea02\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2sblm" Jun 11 16:42:06.751027 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:06.750986 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvxpd\" (UniqueName: \"kubernetes.io/projected/a129be54-0708-4179-83e7-2c9d4783ea02-kube-api-access-jvxpd\") pod \"dns-operator-controller-manager-864dd78c4c-2sblm\" (UID: \"a129be54-0708-4179-83e7-2c9d4783ea02\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2sblm" Jun 11 16:42:06.766412 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:06.766384 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvxpd\" (UniqueName: \"kubernetes.io/projected/a129be54-0708-4179-83e7-2c9d4783ea02-kube-api-access-jvxpd\") pod \"dns-operator-controller-manager-864dd78c4c-2sblm\" (UID: \"a129be54-0708-4179-83e7-2c9d4783ea02\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2sblm" Jun 11 16:42:06.909692 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:06.909607 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2sblm" Jun 11 16:42:07.050546 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:07.050517 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2sblm"] Jun 11 16:42:07.053260 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:42:07.053228 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda129be54_0708_4179_83e7_2c9d4783ea02.slice/crio-c111b2e6b1b6e379bbb591aa78ddc86d8f0dce627828efd7cc5a35a9afeadc2a WatchSource:0}: Error finding container c111b2e6b1b6e379bbb591aa78ddc86d8f0dce627828efd7cc5a35a9afeadc2a: Status 404 returned error can't find the container with id c111b2e6b1b6e379bbb591aa78ddc86d8f0dce627828efd7cc5a35a9afeadc2a Jun 11 16:42:07.064678 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:07.064647 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2sblm" event={"ID":"a129be54-0708-4179-83e7-2c9d4783ea02","Type":"ContainerStarted","Data":"c111b2e6b1b6e379bbb591aa78ddc86d8f0dce627828efd7cc5a35a9afeadc2a"} Jun 11 16:42:07.066231 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:07.066209 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ppvjt" event={"ID":"53bba977-ba03-4403-8be8-248e9d92e264","Type":"ContainerStarted","Data":"c20e6f539d1f7f57c5d76f2965b70056d9bafc76c264ab66eb58791f9eea147a"} Jun 11 16:42:07.066347 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:07.066326 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ppvjt" Jun 11 16:42:07.086791 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:07.086736 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ppvjt" podStartSLOduration=1.410963045 podStartE2EDuration="4.08672085s" totalImagesPullingTime="2.675757805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:42:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:42:07.085979892 +0000 UTC m=+655.154249928" watchObservedRunningTime="2026-06-11 16:42:07.08672085 +0000 UTC m=+655.154990885" Jun 11 16:42:10.083009 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:10.082908 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2sblm" event={"ID":"a129be54-0708-4179-83e7-2c9d4783ea02","Type":"ContainerStarted","Data":"9d9309cfaeaac7584d790eb14e8ce33f3f370c38ed60b0b59cebdb43f97e267b"} Jun 11 16:42:10.083009 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:10.082989 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2sblm" Jun 11 16:42:10.102283 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:10.102234 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2sblm" podStartSLOduration=1.375009376 podStartE2EDuration="4.102216101s" totalImagesPullingTime="2.727206725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:42:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:42:10.100732441 +0000 UTC m=+658.169002476" watchObservedRunningTime="2026-06-11 16:42:10.102216101 +0000 UTC m=+658.170486137" Jun 11 16:42:11.410631 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:11.410597 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d77tb"] Jun 11 16:42:11.414065 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:11.414038 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d77tb" Jun 11 16:42:11.416923 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:11.416895 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6ftgv\"" Jun 11 16:42:11.427683 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:11.427649 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d77tb"] Jun 11 16:42:11.498395 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:11.498359 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6vcq\" (UniqueName: \"kubernetes.io/projected/46fc9ef8-4427-4bbe-8933-e414880ad636-kube-api-access-m6vcq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d77tb\" (UID: \"46fc9ef8-4427-4bbe-8933-e414880ad636\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d77tb" Jun 11 16:42:11.498563 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:11.498403 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46fc9ef8-4427-4bbe-8933-e414880ad636-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d77tb\" (UID: \"46fc9ef8-4427-4bbe-8933-e414880ad636\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d77tb" Jun 11 16:42:11.599355 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:11.599302 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6vcq\" (UniqueName: \"kubernetes.io/projected/46fc9ef8-4427-4bbe-8933-e414880ad636-kube-api-access-m6vcq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d77tb\" (UID: \"46fc9ef8-4427-4bbe-8933-e414880ad636\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d77tb" Jun 11 16:42:11.599553 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:11.599367 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46fc9ef8-4427-4bbe-8933-e414880ad636-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d77tb\" (UID: \"46fc9ef8-4427-4bbe-8933-e414880ad636\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d77tb" Jun 11 16:42:11.599762 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:11.599737 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46fc9ef8-4427-4bbe-8933-e414880ad636-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d77tb\" (UID: \"46fc9ef8-4427-4bbe-8933-e414880ad636\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d77tb" Jun 11 16:42:11.607999 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:11.607972 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6vcq\" (UniqueName: \"kubernetes.io/projected/46fc9ef8-4427-4bbe-8933-e414880ad636-kube-api-access-m6vcq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d77tb\" (UID: \"46fc9ef8-4427-4bbe-8933-e414880ad636\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d77tb" Jun 11 16:42:11.724149 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:11.724111 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d77tb" Jun 11 16:42:11.868975 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:11.868924 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d77tb"] Jun 11 16:42:11.873290 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:42:11.873261 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46fc9ef8_4427_4bbe_8933_e414880ad636.slice/crio-b79242f47b75e0ceb548e0dac05946d5f41770b2735d58080464cedda448ead9 WatchSource:0}: Error finding container b79242f47b75e0ceb548e0dac05946d5f41770b2735d58080464cedda448ead9: Status 404 returned error can't find the container with id b79242f47b75e0ceb548e0dac05946d5f41770b2735d58080464cedda448ead9 Jun 11 16:42:12.093885 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:12.093791 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d77tb" event={"ID":"46fc9ef8-4427-4bbe-8933-e414880ad636","Type":"ContainerStarted","Data":"b79242f47b75e0ceb548e0dac05946d5f41770b2735d58080464cedda448ead9"} Jun 11 16:42:18.074777 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:18.074742 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ppvjt" Jun 11 16:42:19.129989 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:19.129954 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d77tb" event={"ID":"46fc9ef8-4427-4bbe-8933-e414880ad636","Type":"ContainerStarted","Data":"08966a793f6b68b5f244ab864ddcd2262da56d622267baea5b85a9086516d442"} Jun 11 16:42:19.130484 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:19.130033 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d77tb" Jun 11 16:42:19.157646 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:19.157591 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d77tb" podStartSLOduration=1.756076514 podStartE2EDuration="8.157574768s" totalImagesPullingTime="6.401498254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:42:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:42:19.154841641 +0000 UTC m=+667.223111677" watchObservedRunningTime="2026-06-11 16:42:19.157574768 +0000 UTC m=+667.225844821" Jun 11 16:42:21.089918 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:21.089883 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2sblm" Jun 11 16:42:30.136734 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:30.136699 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d77tb" Jun 11 16:42:31.869245 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:31.869206 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d77tb"] Jun 11 16:42:31.869664 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:31.869419 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d77tb" podUID="46fc9ef8-4427-4bbe-8933-e414880ad636" containerName="manager" containerID="cri-o://08966a793f6b68b5f244ab864ddcd2262da56d622267baea5b85a9086516d442" gracePeriod=2 Jun 11 16:42:31.872069 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:42:31.872018 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d77tb\" is forbidden: User \"system:node:ip-10-0-135-188.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-188.ec2.internal' and this object" podUID="46fc9ef8-4427-4bbe-8933-e414880ad636" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d77tb" Jun 11 16:42:31.872922 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:31.872892 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d77tb"] Jun 11 16:42:31.893560 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:31.893532 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jtcb5"] Jun 11 16:42:31.893897 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:31.893882 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46fc9ef8-4427-4bbe-8933-e414880ad636" containerName="manager" Jun 11 16:42:31.893897 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:31.893896 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="46fc9ef8-4427-4bbe-8933-e414880ad636" containerName="manager" Jun 11 16:42:31.894078 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:31.893970 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="46fc9ef8-4427-4bbe-8933-e414880ad636" containerName="manager" Jun 11 16:42:31.896904 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:31.896882 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jtcb5" Jun 11 16:42:31.900015 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:42:31.899978 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d77tb\" is forbidden: User \"system:node:ip-10-0-135-188.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-188.ec2.internal' and this object" podUID="46fc9ef8-4427-4bbe-8933-e414880ad636" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d77tb" Jun 11 16:42:31.911071 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:31.911030 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jtcb5"] Jun 11 16:42:31.985775 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:31.985729 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5cml\" (UniqueName: \"kubernetes.io/projected/68c833c9-0554-4fa9-a6e6-2425bfa744e0-kube-api-access-n5cml\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jtcb5\" (UID: \"68c833c9-0554-4fa9-a6e6-2425bfa744e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jtcb5" Jun 11 16:42:31.985924 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:31.985864 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68c833c9-0554-4fa9-a6e6-2425bfa744e0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jtcb5\" (UID: \"68c833c9-0554-4fa9-a6e6-2425bfa744e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jtcb5" Jun 11 16:42:32.086715 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:32.086668 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68c833c9-0554-4fa9-a6e6-2425bfa744e0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jtcb5\" (UID: \"68c833c9-0554-4fa9-a6e6-2425bfa744e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jtcb5" Jun 11 16:42:32.086897 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:32.086759 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5cml\" (UniqueName: \"kubernetes.io/projected/68c833c9-0554-4fa9-a6e6-2425bfa744e0-kube-api-access-n5cml\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jtcb5\" (UID: \"68c833c9-0554-4fa9-a6e6-2425bfa744e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jtcb5" Jun 11 16:42:32.087145 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:32.087123 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68c833c9-0554-4fa9-a6e6-2425bfa744e0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jtcb5\" (UID: \"68c833c9-0554-4fa9-a6e6-2425bfa744e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jtcb5" Jun 11 16:42:32.095680 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:32.095649 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5cml\" (UniqueName: \"kubernetes.io/projected/68c833c9-0554-4fa9-a6e6-2425bfa744e0-kube-api-access-n5cml\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jtcb5\" (UID: \"68c833c9-0554-4fa9-a6e6-2425bfa744e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jtcb5" Jun 11 16:42:32.125248 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:32.125176 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d77tb" Jun 11 16:42:32.127450 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:42:32.127418 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d77tb\" is forbidden: User \"system:node:ip-10-0-135-188.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-188.ec2.internal' and this object" podUID="46fc9ef8-4427-4bbe-8933-e414880ad636" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d77tb" Jun 11 16:42:32.197101 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:32.197031 2569 generic.go:356] "Generic (PLEG): container finished" podID="46fc9ef8-4427-4bbe-8933-e414880ad636" containerID="08966a793f6b68b5f244ab864ddcd2262da56d622267baea5b85a9086516d442" exitCode=0 Jun 11 16:42:32.197101 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:32.197101 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d77tb" Jun 11 16:42:32.197316 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:32.197133 2569 scope.go:117] "RemoveContainer" containerID="08966a793f6b68b5f244ab864ddcd2262da56d622267baea5b85a9086516d442" Jun 11 16:42:32.199495 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:42:32.199468 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d77tb\" is forbidden: User \"system:node:ip-10-0-135-188.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-188.ec2.internal' and this object" podUID="46fc9ef8-4427-4bbe-8933-e414880ad636" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d77tb" Jun 11 16:42:32.206867 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:32.206844 2569 scope.go:117] "RemoveContainer" containerID="08966a793f6b68b5f244ab864ddcd2262da56d622267baea5b85a9086516d442" Jun 11 16:42:32.207233 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:42:32.207211 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08966a793f6b68b5f244ab864ddcd2262da56d622267baea5b85a9086516d442\": container with ID starting with 08966a793f6b68b5f244ab864ddcd2262da56d622267baea5b85a9086516d442 not found: ID does not exist" containerID="08966a793f6b68b5f244ab864ddcd2262da56d622267baea5b85a9086516d442" Jun 11 16:42:32.207297 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:32.207246 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08966a793f6b68b5f244ab864ddcd2262da56d622267baea5b85a9086516d442"} err="failed to get container status \"08966a793f6b68b5f244ab864ddcd2262da56d622267baea5b85a9086516d442\": rpc error: code = NotFound desc = could not find container \"08966a793f6b68b5f244ab864ddcd2262da56d622267baea5b85a9086516d442\": container with ID starting with 08966a793f6b68b5f244ab864ddcd2262da56d622267baea5b85a9086516d442 not found: ID does not exist" Jun 11 16:42:32.251789 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:32.251748 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jtcb5" Jun 11 16:42:32.290321 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:32.290280 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46fc9ef8-4427-4bbe-8933-e414880ad636-extensions-socket-volume\") pod \"46fc9ef8-4427-4bbe-8933-e414880ad636\" (UID: \"46fc9ef8-4427-4bbe-8933-e414880ad636\") " Jun 11 16:42:32.290495 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:32.290338 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6vcq\" (UniqueName: \"kubernetes.io/projected/46fc9ef8-4427-4bbe-8933-e414880ad636-kube-api-access-m6vcq\") pod \"46fc9ef8-4427-4bbe-8933-e414880ad636\" (UID: \"46fc9ef8-4427-4bbe-8933-e414880ad636\") " Jun 11 16:42:32.290815 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:32.290787 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46fc9ef8-4427-4bbe-8933-e414880ad636-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "46fc9ef8-4427-4bbe-8933-e414880ad636" (UID: "46fc9ef8-4427-4bbe-8933-e414880ad636"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:42:32.292677 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:32.292649 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46fc9ef8-4427-4bbe-8933-e414880ad636-kube-api-access-m6vcq" (OuterVolumeSpecName: "kube-api-access-m6vcq") pod "46fc9ef8-4427-4bbe-8933-e414880ad636" (UID: "46fc9ef8-4427-4bbe-8933-e414880ad636"). InnerVolumeSpecName "kube-api-access-m6vcq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:42:32.361789 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:42:32.361745 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d77tb\" is forbidden: User \"system:node:ip-10-0-135-188.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-188.ec2.internal' and this object" podUID="46fc9ef8-4427-4bbe-8933-e414880ad636" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d77tb" Jun 11 16:42:32.364324 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:32.364297 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46fc9ef8-4427-4bbe-8933-e414880ad636" path="/var/lib/kubelet/pods/46fc9ef8-4427-4bbe-8933-e414880ad636/volumes" Jun 11 16:42:32.391547 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:32.391458 2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46fc9ef8-4427-4bbe-8933-e414880ad636-extensions-socket-volume\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:42:32.391547 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:32.391490 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6vcq\" (UniqueName: \"kubernetes.io/projected/46fc9ef8-4427-4bbe-8933-e414880ad636-kube-api-access-m6vcq\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:42:32.408808 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:32.408779 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jtcb5"] Jun 11 16:42:32.411788 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:42:32.411756 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68c833c9_0554_4fa9_a6e6_2425bfa744e0.slice/crio-7b0078094f99b01692baf6a03faa2fefa804b7592cdd999b9db74616eb2dae93 WatchSource:0}: Error finding container 7b0078094f99b01692baf6a03faa2fefa804b7592cdd999b9db74616eb2dae93: Status 404 returned error can't find the container with id 7b0078094f99b01692baf6a03faa2fefa804b7592cdd999b9db74616eb2dae93 Jun 11 16:42:33.203652 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:33.203605 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jtcb5" event={"ID":"68c833c9-0554-4fa9-a6e6-2425bfa744e0","Type":"ContainerStarted","Data":"2cadb0c0824dda4e9dfa015cf75d78c139d0413360c980c2bb2938f02e0dc8d2"} Jun 11 16:42:33.204170 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:33.203676 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jtcb5" event={"ID":"68c833c9-0554-4fa9-a6e6-2425bfa744e0","Type":"ContainerStarted","Data":"7b0078094f99b01692baf6a03faa2fefa804b7592cdd999b9db74616eb2dae93"} Jun 11 16:42:33.204170 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:33.203812 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jtcb5" Jun 11 16:42:33.223784 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:33.223731 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jtcb5" podStartSLOduration=2.223714303 podStartE2EDuration="2.223714303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:42:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:42:33.22124795 +0000 UTC m=+681.289517985" watchObservedRunningTime="2026-06-11 16:42:33.223714303 +0000 UTC m=+681.291984402" Jun 11 16:42:44.213742 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:44.213710 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jtcb5" Jun 11 16:42:47.855005 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:47.854971 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jtcb5"] Jun 11 16:42:47.855466 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:47.855181 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jtcb5" podUID="68c833c9-0554-4fa9-a6e6-2425bfa744e0" containerName="manager" containerID="cri-o://2cadb0c0824dda4e9dfa015cf75d78c139d0413360c980c2bb2938f02e0dc8d2" gracePeriod=10 Jun 11 16:42:48.084805 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:48.084775 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vbnjs"] Jun 11 16:42:48.088353 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:48.088333 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vbnjs" Jun 11 16:42:48.102966 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:48.102939 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vbnjs"] Jun 11 16:42:48.115275 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:48.115251 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jtcb5" Jun 11 16:42:48.128348 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:48.128321 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srb67\" (UniqueName: \"kubernetes.io/projected/3efd7b2d-d1c7-45d7-8157-f09e66ea6d65-kube-api-access-srb67\") pod \"kuadrant-operator-controller-manager-86878c769f-vbnjs\" (UID: \"3efd7b2d-d1c7-45d7-8157-f09e66ea6d65\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vbnjs" Jun 11 16:42:48.128495 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:48.128434 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3efd7b2d-d1c7-45d7-8157-f09e66ea6d65-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vbnjs\" (UID: \"3efd7b2d-d1c7-45d7-8157-f09e66ea6d65\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vbnjs" Jun 11 16:42:48.229293 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:48.229254 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68c833c9-0554-4fa9-a6e6-2425bfa744e0-extensions-socket-volume\") pod \"68c833c9-0554-4fa9-a6e6-2425bfa744e0\" (UID: \"68c833c9-0554-4fa9-a6e6-2425bfa744e0\") " Jun 11 16:42:48.229541 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:48.229312 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5cml\" (UniqueName: \"kubernetes.io/projected/68c833c9-0554-4fa9-a6e6-2425bfa744e0-kube-api-access-n5cml\") pod \"68c833c9-0554-4fa9-a6e6-2425bfa744e0\" (UID: \"68c833c9-0554-4fa9-a6e6-2425bfa744e0\") " Jun 11 16:42:48.229541 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:48.229433 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3efd7b2d-d1c7-45d7-8157-f09e66ea6d65-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vbnjs\" (UID: \"3efd7b2d-d1c7-45d7-8157-f09e66ea6d65\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vbnjs" Jun 11 16:42:48.229541 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:48.229501 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srb67\" (UniqueName: \"kubernetes.io/projected/3efd7b2d-d1c7-45d7-8157-f09e66ea6d65-kube-api-access-srb67\") pod \"kuadrant-operator-controller-manager-86878c769f-vbnjs\" (UID: \"3efd7b2d-d1c7-45d7-8157-f09e66ea6d65\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vbnjs" Jun 11 16:42:48.229704 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:48.229669 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68c833c9-0554-4fa9-a6e6-2425bfa744e0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "68c833c9-0554-4fa9-a6e6-2425bfa744e0" (UID: "68c833c9-0554-4fa9-a6e6-2425bfa744e0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:42:48.229847 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:48.229831 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3efd7b2d-d1c7-45d7-8157-f09e66ea6d65-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vbnjs\" (UID: \"3efd7b2d-d1c7-45d7-8157-f09e66ea6d65\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vbnjs" Jun 11 16:42:48.231524 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:48.231501 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68c833c9-0554-4fa9-a6e6-2425bfa744e0-kube-api-access-n5cml" (OuterVolumeSpecName: "kube-api-access-n5cml") pod "68c833c9-0554-4fa9-a6e6-2425bfa744e0" (UID: "68c833c9-0554-4fa9-a6e6-2425bfa744e0"). InnerVolumeSpecName "kube-api-access-n5cml". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:42:48.238181 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:48.238163 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srb67\" (UniqueName: \"kubernetes.io/projected/3efd7b2d-d1c7-45d7-8157-f09e66ea6d65-kube-api-access-srb67\") pod \"kuadrant-operator-controller-manager-86878c769f-vbnjs\" (UID: \"3efd7b2d-d1c7-45d7-8157-f09e66ea6d65\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vbnjs" Jun 11 16:42:48.277157 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:48.277122 2569 generic.go:356] "Generic (PLEG): container finished" podID="68c833c9-0554-4fa9-a6e6-2425bfa744e0" containerID="2cadb0c0824dda4e9dfa015cf75d78c139d0413360c980c2bb2938f02e0dc8d2" exitCode=0 Jun 11 16:42:48.277361 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:48.277173 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jtcb5" Jun 11 16:42:48.277361 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:48.277214 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jtcb5" event={"ID":"68c833c9-0554-4fa9-a6e6-2425bfa744e0","Type":"ContainerDied","Data":"2cadb0c0824dda4e9dfa015cf75d78c139d0413360c980c2bb2938f02e0dc8d2"} Jun 11 16:42:48.277361 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:48.277268 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jtcb5" event={"ID":"68c833c9-0554-4fa9-a6e6-2425bfa744e0","Type":"ContainerDied","Data":"7b0078094f99b01692baf6a03faa2fefa804b7592cdd999b9db74616eb2dae93"} Jun 11 16:42:48.277361 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:48.277297 2569 scope.go:117] "RemoveContainer" containerID="2cadb0c0824dda4e9dfa015cf75d78c139d0413360c980c2bb2938f02e0dc8d2" Jun 11 16:42:48.292541 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:48.292524 2569 scope.go:117] "RemoveContainer" containerID="2cadb0c0824dda4e9dfa015cf75d78c139d0413360c980c2bb2938f02e0dc8d2" Jun 11 16:42:48.292834 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:42:48.292813 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cadb0c0824dda4e9dfa015cf75d78c139d0413360c980c2bb2938f02e0dc8d2\": container with ID starting with 2cadb0c0824dda4e9dfa015cf75d78c139d0413360c980c2bb2938f02e0dc8d2 not found: ID does not exist" containerID="2cadb0c0824dda4e9dfa015cf75d78c139d0413360c980c2bb2938f02e0dc8d2" Jun 11 16:42:48.292872 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:48.292844 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cadb0c0824dda4e9dfa015cf75d78c139d0413360c980c2bb2938f02e0dc8d2"} err="failed to get container status \"2cadb0c0824dda4e9dfa015cf75d78c139d0413360c980c2bb2938f02e0dc8d2\": rpc error: code = NotFound desc = could not find container \"2cadb0c0824dda4e9dfa015cf75d78c139d0413360c980c2bb2938f02e0dc8d2\": container with ID starting with 2cadb0c0824dda4e9dfa015cf75d78c139d0413360c980c2bb2938f02e0dc8d2 not found: ID does not exist" Jun 11 16:42:48.304048 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:48.304011 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jtcb5"] Jun 11 16:42:48.309852 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:48.309831 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jtcb5"] Jun 11 16:42:48.330454 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:48.330425 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5cml\" (UniqueName: \"kubernetes.io/projected/68c833c9-0554-4fa9-a6e6-2425bfa744e0-kube-api-access-n5cml\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:42:48.330454 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:48.330451 2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68c833c9-0554-4fa9-a6e6-2425bfa744e0-extensions-socket-volume\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:42:48.361128 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:48.361042 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68c833c9-0554-4fa9-a6e6-2425bfa744e0" path="/var/lib/kubelet/pods/68c833c9-0554-4fa9-a6e6-2425bfa744e0/volumes" Jun 11 16:42:48.411214 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:48.411180 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vbnjs" Jun 11 16:42:48.556169 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:48.556140 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vbnjs"] Jun 11 16:42:48.558830 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:42:48.558803 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3efd7b2d_d1c7_45d7_8157_f09e66ea6d65.slice/crio-af43658d20efeb8ad76751c00c9e1c4e7a0b2f7210d7ce912579eeef11aa0489 WatchSource:0}: Error finding container af43658d20efeb8ad76751c00c9e1c4e7a0b2f7210d7ce912579eeef11aa0489: Status 404 returned error can't find the container with id af43658d20efeb8ad76751c00c9e1c4e7a0b2f7210d7ce912579eeef11aa0489 Jun 11 16:42:49.285330 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:49.285294 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vbnjs" event={"ID":"3efd7b2d-d1c7-45d7-8157-f09e66ea6d65","Type":"ContainerStarted","Data":"a8fecb80b8d1fd01a207f2aa3e8a4c654479cf9dd8ad4456d1b3dc0b09397447"} Jun 11 16:42:49.285879 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:49.285851 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vbnjs" Jun 11 16:42:49.285988 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:49.285886 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vbnjs" event={"ID":"3efd7b2d-d1c7-45d7-8157-f09e66ea6d65","Type":"ContainerStarted","Data":"af43658d20efeb8ad76751c00c9e1c4e7a0b2f7210d7ce912579eeef11aa0489"} Jun 11 16:42:49.351145 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:42:49.351087 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vbnjs" podStartSLOduration=1.351071624 podStartE2EDuration="1.351071624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:42:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:42:49.347957338 +0000 UTC m=+697.416227373" watchObservedRunningTime="2026-06-11 16:42:49.351071624 +0000 UTC m=+697.419341651" Jun 11 16:43:00.292723 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:00.292633 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vbnjs" Jun 11 16:43:04.132439 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.132405 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt"] Jun 11 16:43:04.132966 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.132945 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68c833c9-0554-4fa9-a6e6-2425bfa744e0" containerName="manager" Jun 11 16:43:04.133040 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.132969 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="68c833c9-0554-4fa9-a6e6-2425bfa744e0" containerName="manager" Jun 11 16:43:04.133120 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.133098 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="68c833c9-0554-4fa9-a6e6-2425bfa744e0" containerName="manager" Jun 11 16:43:04.136259 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.136236 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:04.138757 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.138735 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-5whbk\"" Jun 11 16:43:04.148861 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.148837 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt"] Jun 11 16:43:04.273997 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.273956 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44b3a188-8104-49ee-9d23-6ace2e1b19f0-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-frzlt\" (UID: \"44b3a188-8104-49ee-9d23-6ace2e1b19f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:04.273997 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.273999 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dchkk\" (UniqueName: \"kubernetes.io/projected/44b3a188-8104-49ee-9d23-6ace2e1b19f0-kube-api-access-dchkk\") pod \"maas-default-gateway-openshift-default-8559cd5744-frzlt\" (UID: \"44b3a188-8104-49ee-9d23-6ace2e1b19f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:04.274217 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.274021 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44b3a188-8104-49ee-9d23-6ace2e1b19f0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-frzlt\" (UID: \"44b3a188-8104-49ee-9d23-6ace2e1b19f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:04.274217 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.274088 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44b3a188-8104-49ee-9d23-6ace2e1b19f0-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-frzlt\" (UID: \"44b3a188-8104-49ee-9d23-6ace2e1b19f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:04.274217 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.274112 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44b3a188-8104-49ee-9d23-6ace2e1b19f0-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-frzlt\" (UID: \"44b3a188-8104-49ee-9d23-6ace2e1b19f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:04.274217 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.274136 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44b3a188-8104-49ee-9d23-6ace2e1b19f0-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-frzlt\" (UID: \"44b3a188-8104-49ee-9d23-6ace2e1b19f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:04.274217 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.274156 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44b3a188-8104-49ee-9d23-6ace2e1b19f0-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-frzlt\" (UID: \"44b3a188-8104-49ee-9d23-6ace2e1b19f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:04.274375 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.274231 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44b3a188-8104-49ee-9d23-6ace2e1b19f0-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-frzlt\" (UID: \"44b3a188-8104-49ee-9d23-6ace2e1b19f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:04.274375 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.274282 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44b3a188-8104-49ee-9d23-6ace2e1b19f0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-frzlt\" (UID: \"44b3a188-8104-49ee-9d23-6ace2e1b19f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:04.374720 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.374685 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44b3a188-8104-49ee-9d23-6ace2e1b19f0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-frzlt\" (UID: \"44b3a188-8104-49ee-9d23-6ace2e1b19f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:04.374720 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.374723 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44b3a188-8104-49ee-9d23-6ace2e1b19f0-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-frzlt\" (UID: \"44b3a188-8104-49ee-9d23-6ace2e1b19f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:04.374982 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.374743 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44b3a188-8104-49ee-9d23-6ace2e1b19f0-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-frzlt\" (UID: \"44b3a188-8104-49ee-9d23-6ace2e1b19f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:04.374982 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.374872 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44b3a188-8104-49ee-9d23-6ace2e1b19f0-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-frzlt\" (UID: \"44b3a188-8104-49ee-9d23-6ace2e1b19f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:04.374982 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.374910 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44b3a188-8104-49ee-9d23-6ace2e1b19f0-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-frzlt\" (UID: \"44b3a188-8104-49ee-9d23-6ace2e1b19f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:04.374982 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.374977 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44b3a188-8104-49ee-9d23-6ace2e1b19f0-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-frzlt\" (UID: \"44b3a188-8104-49ee-9d23-6ace2e1b19f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:04.375222 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.375049 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44b3a188-8104-49ee-9d23-6ace2e1b19f0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-frzlt\" (UID: \"44b3a188-8104-49ee-9d23-6ace2e1b19f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:04.375222 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.375132 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44b3a188-8104-49ee-9d23-6ace2e1b19f0-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-frzlt\" (UID: \"44b3a188-8104-49ee-9d23-6ace2e1b19f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:04.375222 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.375133 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44b3a188-8104-49ee-9d23-6ace2e1b19f0-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-frzlt\" (UID: \"44b3a188-8104-49ee-9d23-6ace2e1b19f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:04.375222 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.375167 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44b3a188-8104-49ee-9d23-6ace2e1b19f0-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-frzlt\" (UID: \"44b3a188-8104-49ee-9d23-6ace2e1b19f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:04.375222 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.375190 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dchkk\" (UniqueName: \"kubernetes.io/projected/44b3a188-8104-49ee-9d23-6ace2e1b19f0-kube-api-access-dchkk\") pod \"maas-default-gateway-openshift-default-8559cd5744-frzlt\" (UID: \"44b3a188-8104-49ee-9d23-6ace2e1b19f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:04.375416 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.375397 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44b3a188-8104-49ee-9d23-6ace2e1b19f0-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-frzlt\" (UID: \"44b3a188-8104-49ee-9d23-6ace2e1b19f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:04.375458 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.375424 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44b3a188-8104-49ee-9d23-6ace2e1b19f0-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-frzlt\" (UID: \"44b3a188-8104-49ee-9d23-6ace2e1b19f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:04.375774 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.375756 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44b3a188-8104-49ee-9d23-6ace2e1b19f0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-frzlt\" (UID: \"44b3a188-8104-49ee-9d23-6ace2e1b19f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:04.377422 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.377399 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44b3a188-8104-49ee-9d23-6ace2e1b19f0-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-frzlt\" (UID: \"44b3a188-8104-49ee-9d23-6ace2e1b19f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:04.377422 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.377410 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44b3a188-8104-49ee-9d23-6ace2e1b19f0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-frzlt\" (UID: \"44b3a188-8104-49ee-9d23-6ace2e1b19f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:04.383332 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.383276 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44b3a188-8104-49ee-9d23-6ace2e1b19f0-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-frzlt\" (UID: \"44b3a188-8104-49ee-9d23-6ace2e1b19f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:04.383702 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.383681 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dchkk\" (UniqueName: \"kubernetes.io/projected/44b3a188-8104-49ee-9d23-6ace2e1b19f0-kube-api-access-dchkk\") pod \"maas-default-gateway-openshift-default-8559cd5744-frzlt\" (UID: \"44b3a188-8104-49ee-9d23-6ace2e1b19f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:04.447605 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.447566 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:04.587327 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.587296 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt"] Jun 11 16:43:04.589858 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:43:04.589830 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44b3a188_8104_49ee_9d23_6ace2e1b19f0.slice/crio-0e74c66b915294b59904af4803ea2185f9a006c470cb6ef48a99b3adb801498d WatchSource:0}: Error finding container 0e74c66b915294b59904af4803ea2185f9a006c470cb6ef48a99b3adb801498d: Status 404 returned error can't find the container with id 0e74c66b915294b59904af4803ea2185f9a006c470cb6ef48a99b3adb801498d Jun 11 16:43:04.592103 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.592070 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Jun 11 16:43:04.592224 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.592153 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Jun 11 16:43:04.592224 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:04.592195 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Jun 11 16:43:05.358429 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:05.358393 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" event={"ID":"44b3a188-8104-49ee-9d23-6ace2e1b19f0","Type":"ContainerStarted","Data":"bca20e171721ddd4254164b9d4e374d821e8cbfe668ed551976f5738a46ab7c2"} Jun 11 16:43:05.358805 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:05.358443 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" event={"ID":"44b3a188-8104-49ee-9d23-6ace2e1b19f0","Type":"ContainerStarted","Data":"0e74c66b915294b59904af4803ea2185f9a006c470cb6ef48a99b3adb801498d"} Jun 11 16:43:05.386807 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:05.386744 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" podStartSLOduration=1.386724363 podStartE2EDuration="1.386724363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:43:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:43:05.3859846 +0000 UTC m=+713.454254637" watchObservedRunningTime="2026-06-11 16:43:05.386724363 +0000 UTC m=+713.454994400" Jun 11 16:43:05.448709 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:05.448671 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:05.453443 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:05.453415 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:06.365639 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:06.365598 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:06.366707 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:06.366683 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:43:19.714454 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:19.714418 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-5gxsb"] Jun 11 16:43:19.719128 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:19.719112 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5gxsb" Jun 11 16:43:19.721625 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:19.721604 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2hxg2\"" Jun 11 16:43:19.724164 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:19.724140 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5gxsb"] Jun 11 16:43:19.820163 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:19.820121 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wd26\" (UniqueName: \"kubernetes.io/projected/bd3d5629-8408-4663-98b5-34ff9986cc15-kube-api-access-5wd26\") pod \"authorino-75d556bd77-5gxsb\" (UID: \"bd3d5629-8408-4663-98b5-34ff9986cc15\") " pod="kuadrant-system/authorino-75d556bd77-5gxsb" Jun 11 16:43:19.921031 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:19.920982 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wd26\" (UniqueName: \"kubernetes.io/projected/bd3d5629-8408-4663-98b5-34ff9986cc15-kube-api-access-5wd26\") pod \"authorino-75d556bd77-5gxsb\" (UID: \"bd3d5629-8408-4663-98b5-34ff9986cc15\") " pod="kuadrant-system/authorino-75d556bd77-5gxsb" Jun 11 16:43:19.928979 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:19.928938 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wd26\" (UniqueName: \"kubernetes.io/projected/bd3d5629-8408-4663-98b5-34ff9986cc15-kube-api-access-5wd26\") pod \"authorino-75d556bd77-5gxsb\" (UID: \"bd3d5629-8408-4663-98b5-34ff9986cc15\") " pod="kuadrant-system/authorino-75d556bd77-5gxsb" Jun 11 16:43:20.029347 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:20.029258 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5gxsb" Jun 11 16:43:20.164174 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:20.164126 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5gxsb"] Jun 11 16:43:20.168104 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:43:20.168076 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd3d5629_8408_4663_98b5_34ff9986cc15.slice/crio-3c0f2652a6f7dd6cafd5fb28134647797f093a6ebee3e463f8df53c7185e3fa7 WatchSource:0}: Error finding container 3c0f2652a6f7dd6cafd5fb28134647797f093a6ebee3e463f8df53c7185e3fa7: Status 404 returned error can't find the container with id 3c0f2652a6f7dd6cafd5fb28134647797f093a6ebee3e463f8df53c7185e3fa7 Jun 11 16:43:20.432738 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:20.432703 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5gxsb" event={"ID":"bd3d5629-8408-4663-98b5-34ff9986cc15","Type":"ContainerStarted","Data":"3c0f2652a6f7dd6cafd5fb28134647797f093a6ebee3e463f8df53c7185e3fa7"} Jun 11 16:43:23.449939 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:23.449902 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5gxsb" event={"ID":"bd3d5629-8408-4663-98b5-34ff9986cc15","Type":"ContainerStarted","Data":"178566e2867c0f128db4e4f1337216a5a8a94315ec2770a1c9e39d6de25c4be6"} Jun 11 16:43:23.463320 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:43:23.463262 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-5gxsb" podStartSLOduration=1.258734751 podStartE2EDuration="4.463241697s" totalImagesPullingTime="3.204506946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:43:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:43:23.463155218 +0000 UTC m=+731.531425268" watchObservedRunningTime="2026-06-11 16:43:23.463241697 +0000 UTC m=+731.531511735" Jun 11 16:44:42.124334 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:42.124242 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r2mtp"] Jun 11 16:44:42.128437 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:42.128413 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-r2mtp" Jun 11 16:44:42.136268 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:42.136239 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r2mtp"] Jun 11 16:44:42.294397 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:42.294366 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm5x6\" (UniqueName: \"kubernetes.io/projected/3fa627b7-2301-45b5-b3a5-f355036aec6b-kube-api-access-bm5x6\") pod \"authorino-5d4b67c446-r2mtp\" (UID: \"3fa627b7-2301-45b5-b3a5-f355036aec6b\") " pod="kuadrant-system/authorino-5d4b67c446-r2mtp" Jun 11 16:44:42.368646 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:42.368610 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r2mtp"] Jun 11 16:44:42.368932 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:44:42.368907 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-bm5x6], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-r2mtp" podUID="3fa627b7-2301-45b5-b3a5-f355036aec6b" Jun 11 16:44:42.378564 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:42.378494 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-86b56fff48-smsxp"] Jun 11 16:44:42.382235 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:42.382218 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86b56fff48-smsxp" Jun 11 16:44:42.388479 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:42.388454 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86b56fff48-smsxp"] Jun 11 16:44:42.395873 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:42.395843 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm5x6\" (UniqueName: \"kubernetes.io/projected/3fa627b7-2301-45b5-b3a5-f355036aec6b-kube-api-access-bm5x6\") pod \"authorino-5d4b67c446-r2mtp\" (UID: \"3fa627b7-2301-45b5-b3a5-f355036aec6b\") " pod="kuadrant-system/authorino-5d4b67c446-r2mtp" Jun 11 16:44:42.403810 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:42.403784 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm5x6\" (UniqueName: \"kubernetes.io/projected/3fa627b7-2301-45b5-b3a5-f355036aec6b-kube-api-access-bm5x6\") pod \"authorino-5d4b67c446-r2mtp\" (UID: \"3fa627b7-2301-45b5-b3a5-f355036aec6b\") " pod="kuadrant-system/authorino-5d4b67c446-r2mtp" Jun 11 16:44:42.476390 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:42.476358 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-86b56fff48-smsxp"] Jun 11 16:44:42.476676 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:44:42.476656 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-cmh49], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-86b56fff48-smsxp" podUID="ce57edeb-39d2-4eb3-b962-0191be62e6ca" Jun 11 16:44:42.496393 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:42.496359 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmh49\" (UniqueName: \"kubernetes.io/projected/ce57edeb-39d2-4eb3-b962-0191be62e6ca-kube-api-access-cmh49\") pod \"authorino-86b56fff48-smsxp\" (UID: \"ce57edeb-39d2-4eb3-b962-0191be62e6ca\") " pod="kuadrant-system/authorino-86b56fff48-smsxp" Jun 11 16:44:42.597777 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:42.597745 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmh49\" (UniqueName: \"kubernetes.io/projected/ce57edeb-39d2-4eb3-b962-0191be62e6ca-kube-api-access-cmh49\") pod \"authorino-86b56fff48-smsxp\" (UID: \"ce57edeb-39d2-4eb3-b962-0191be62e6ca\") " pod="kuadrant-system/authorino-86b56fff48-smsxp" Jun 11 16:44:42.606113 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:42.606079 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmh49\" (UniqueName: \"kubernetes.io/projected/ce57edeb-39d2-4eb3-b962-0191be62e6ca-kube-api-access-cmh49\") pod \"authorino-86b56fff48-smsxp\" (UID: \"ce57edeb-39d2-4eb3-b962-0191be62e6ca\") " pod="kuadrant-system/authorino-86b56fff48-smsxp" Jun 11 16:44:42.827611 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:42.827581 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86b56fff48-smsxp" Jun 11 16:44:42.827799 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:42.827581 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-r2mtp" Jun 11 16:44:42.835122 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:42.835100 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86b56fff48-smsxp" Jun 11 16:44:42.838006 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:42.837987 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-r2mtp" Jun 11 16:44:43.000470 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:43.000434 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bm5x6\" (UniqueName: \"kubernetes.io/projected/3fa627b7-2301-45b5-b3a5-f355036aec6b-kube-api-access-bm5x6\") pod \"3fa627b7-2301-45b5-b3a5-f355036aec6b\" (UID: \"3fa627b7-2301-45b5-b3a5-f355036aec6b\") " Jun 11 16:44:43.000648 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:43.000502 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmh49\" (UniqueName: \"kubernetes.io/projected/ce57edeb-39d2-4eb3-b962-0191be62e6ca-kube-api-access-cmh49\") pod \"ce57edeb-39d2-4eb3-b962-0191be62e6ca\" (UID: \"ce57edeb-39d2-4eb3-b962-0191be62e6ca\") " Jun 11 16:44:43.002905 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:43.002875 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce57edeb-39d2-4eb3-b962-0191be62e6ca-kube-api-access-cmh49" (OuterVolumeSpecName: "kube-api-access-cmh49") pod "ce57edeb-39d2-4eb3-b962-0191be62e6ca" (UID: "ce57edeb-39d2-4eb3-b962-0191be62e6ca"). InnerVolumeSpecName "kube-api-access-cmh49". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:44:43.003022 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:43.002931 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fa627b7-2301-45b5-b3a5-f355036aec6b-kube-api-access-bm5x6" (OuterVolumeSpecName: "kube-api-access-bm5x6") pod "3fa627b7-2301-45b5-b3a5-f355036aec6b" (UID: "3fa627b7-2301-45b5-b3a5-f355036aec6b"). InnerVolumeSpecName "kube-api-access-bm5x6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:44:43.101826 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:43.101742 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmh49\" (UniqueName: \"kubernetes.io/projected/ce57edeb-39d2-4eb3-b962-0191be62e6ca-kube-api-access-cmh49\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:44:43.101826 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:43.101773 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bm5x6\" (UniqueName: \"kubernetes.io/projected/3fa627b7-2301-45b5-b3a5-f355036aec6b-kube-api-access-bm5x6\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:44:43.831693 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:43.831661 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86b56fff48-smsxp" Jun 11 16:44:43.832117 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:43.831661 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-r2mtp" Jun 11 16:44:43.862808 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:43.862774 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-86b56fff48-smsxp"] Jun 11 16:44:43.868503 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:43.868476 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-86b56fff48-smsxp"] Jun 11 16:44:43.887924 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:43.887897 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r2mtp"] Jun 11 16:44:43.889647 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:43.889620 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r2mtp"] Jun 11 16:44:44.264807 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:44.264775 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5gxsb"] Jun 11 16:44:44.264986 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:44.264954 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-5gxsb" podUID="bd3d5629-8408-4663-98b5-34ff9986cc15" containerName="authorino" containerID="cri-o://178566e2867c0f128db4e4f1337216a5a8a94315ec2770a1c9e39d6de25c4be6" gracePeriod=30 Jun 11 16:44:44.361695 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:44.361663 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fa627b7-2301-45b5-b3a5-f355036aec6b" path="/var/lib/kubelet/pods/3fa627b7-2301-45b5-b3a5-f355036aec6b/volumes" Jun 11 16:44:44.361893 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:44.361882 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce57edeb-39d2-4eb3-b962-0191be62e6ca" path="/var/lib/kubelet/pods/ce57edeb-39d2-4eb3-b962-0191be62e6ca/volumes" Jun 11 16:44:44.519984 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:44.519908 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5gxsb" Jun 11 16:44:44.716907 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:44.716873 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wd26\" (UniqueName: \"kubernetes.io/projected/bd3d5629-8408-4663-98b5-34ff9986cc15-kube-api-access-5wd26\") pod \"bd3d5629-8408-4663-98b5-34ff9986cc15\" (UID: \"bd3d5629-8408-4663-98b5-34ff9986cc15\") " Jun 11 16:44:44.719238 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:44.719204 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd3d5629-8408-4663-98b5-34ff9986cc15-kube-api-access-5wd26" (OuterVolumeSpecName: "kube-api-access-5wd26") pod "bd3d5629-8408-4663-98b5-34ff9986cc15" (UID: "bd3d5629-8408-4663-98b5-34ff9986cc15"). InnerVolumeSpecName "kube-api-access-5wd26". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:44:44.817776 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:44.817690 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wd26\" (UniqueName: \"kubernetes.io/projected/bd3d5629-8408-4663-98b5-34ff9986cc15-kube-api-access-5wd26\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:44:44.837015 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:44.836983 2569 generic.go:356] "Generic (PLEG): container finished" podID="bd3d5629-8408-4663-98b5-34ff9986cc15" containerID="178566e2867c0f128db4e4f1337216a5a8a94315ec2770a1c9e39d6de25c4be6" exitCode=0 Jun 11 16:44:44.837407 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:44.837018 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5gxsb" Jun 11 16:44:44.837407 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:44.837082 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5gxsb" event={"ID":"bd3d5629-8408-4663-98b5-34ff9986cc15","Type":"ContainerDied","Data":"178566e2867c0f128db4e4f1337216a5a8a94315ec2770a1c9e39d6de25c4be6"} Jun 11 16:44:44.837407 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:44.837122 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5gxsb" event={"ID":"bd3d5629-8408-4663-98b5-34ff9986cc15","Type":"ContainerDied","Data":"3c0f2652a6f7dd6cafd5fb28134647797f093a6ebee3e463f8df53c7185e3fa7"} Jun 11 16:44:44.837407 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:44.837141 2569 scope.go:117] "RemoveContainer" containerID="178566e2867c0f128db4e4f1337216a5a8a94315ec2770a1c9e39d6de25c4be6" Jun 11 16:44:44.846578 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:44.846554 2569 scope.go:117] "RemoveContainer" containerID="178566e2867c0f128db4e4f1337216a5a8a94315ec2770a1c9e39d6de25c4be6" Jun 11 16:44:44.846837 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:44:44.846817 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"178566e2867c0f128db4e4f1337216a5a8a94315ec2770a1c9e39d6de25c4be6\": container with ID starting with 178566e2867c0f128db4e4f1337216a5a8a94315ec2770a1c9e39d6de25c4be6 not found: ID does not exist" containerID="178566e2867c0f128db4e4f1337216a5a8a94315ec2770a1c9e39d6de25c4be6" Jun 11 16:44:44.846886 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:44.846846 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"178566e2867c0f128db4e4f1337216a5a8a94315ec2770a1c9e39d6de25c4be6"} err="failed to get container status \"178566e2867c0f128db4e4f1337216a5a8a94315ec2770a1c9e39d6de25c4be6\": rpc error: code = NotFound desc = could not find container \"178566e2867c0f128db4e4f1337216a5a8a94315ec2770a1c9e39d6de25c4be6\": container with ID starting with 178566e2867c0f128db4e4f1337216a5a8a94315ec2770a1c9e39d6de25c4be6 not found: ID does not exist" Jun 11 16:44:44.861448 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:44.861418 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5gxsb"] Jun 11 16:44:44.872217 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:44.872191 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5gxsb"] Jun 11 16:44:46.362762 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:46.362730 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd3d5629-8408-4663-98b5-34ff9986cc15" path="/var/lib/kubelet/pods/bd3d5629-8408-4663-98b5-34ff9986cc15/volumes" Jun 11 16:44:47.747607 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:47.747569 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-69b744c9df-b949j"] Jun 11 16:44:47.748089 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:47.747954 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd3d5629-8408-4663-98b5-34ff9986cc15" containerName="authorino" Jun 11 16:44:47.748089 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:47.747966 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd3d5629-8408-4663-98b5-34ff9986cc15" containerName="authorino" Jun 11 16:44:47.748089 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:47.748039 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd3d5629-8408-4663-98b5-34ff9986cc15" containerName="authorino" Jun 11 16:44:47.752210 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:47.752189 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69b744c9df-b949j" Jun 11 16:44:47.755355 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:47.755333 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 16:44:47.755828 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:47.755813 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fcgkn\"" Jun 11 16:44:47.756513 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:47.756498 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 16:44:47.763643 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:47.763621 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69b744c9df-b949j"] Jun 11 16:44:47.839472 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:47.839434 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtbwg\" (UniqueName: \"kubernetes.io/projected/14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb-kube-api-access-wtbwg\") pod \"maas-controller-69b744c9df-b949j\" (UID: \"14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb\") " pod="opendatahub/maas-controller-69b744c9df-b949j" Jun 11 16:44:47.839640 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:47.839550 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb-webhook-cert\") pod \"maas-controller-69b744c9df-b949j\" (UID: \"14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb\") " pod="opendatahub/maas-controller-69b744c9df-b949j" Jun 11 16:44:47.930379 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:47.930344 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d574849d-cscls"] Jun 11 16:44:47.933762 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:47.933745 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d574849d-cscls" Jun 11 16:44:47.940475 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:47.940232 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjqvc\" (UniqueName: \"kubernetes.io/projected/51c1bfb6-954b-421a-9061-ec503a7fecc1-kube-api-access-mjqvc\") pod \"maas-controller-6d574849d-cscls\" (UID: \"51c1bfb6-954b-421a-9061-ec503a7fecc1\") " pod="opendatahub/maas-controller-6d574849d-cscls" Jun 11 16:44:47.940475 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:47.940302 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb-webhook-cert\") pod \"maas-controller-69b744c9df-b949j\" (UID: \"14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb\") " pod="opendatahub/maas-controller-69b744c9df-b949j" Jun 11 16:44:47.940475 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:47.940377 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtbwg\" (UniqueName: \"kubernetes.io/projected/14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb-kube-api-access-wtbwg\") pod \"maas-controller-69b744c9df-b949j\" (UID: \"14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb\") " pod="opendatahub/maas-controller-69b744c9df-b949j" Jun 11 16:44:47.940475 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:44:47.940426 2569 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 11 16:44:47.940714 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:44:47.940489 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb-webhook-cert podName:14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb nodeName:}" failed. No retries permitted until 2026-06-11 16:44:48.440468793 +0000 UTC m=+816.508738808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb-webhook-cert") pod "maas-controller-69b744c9df-b949j" (UID: "14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb") : secret "maas-controller-webhook-cert" not found Jun 11 16:44:47.940785 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:47.940751 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51c1bfb6-954b-421a-9061-ec503a7fecc1-webhook-cert\") pod \"maas-controller-6d574849d-cscls\" (UID: \"51c1bfb6-954b-421a-9061-ec503a7fecc1\") " pod="opendatahub/maas-controller-6d574849d-cscls" Jun 11 16:44:47.943919 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:47.943892 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d574849d-cscls"] Jun 11 16:44:47.948997 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:47.948972 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtbwg\" (UniqueName: \"kubernetes.io/projected/14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb-kube-api-access-wtbwg\") pod \"maas-controller-69b744c9df-b949j\" (UID: \"14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb\") " pod="opendatahub/maas-controller-69b744c9df-b949j" Jun 11 16:44:48.041420 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:48.041328 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51c1bfb6-954b-421a-9061-ec503a7fecc1-webhook-cert\") pod \"maas-controller-6d574849d-cscls\" (UID: \"51c1bfb6-954b-421a-9061-ec503a7fecc1\") " pod="opendatahub/maas-controller-6d574849d-cscls" Jun 11 16:44:48.041420 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:48.041393 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjqvc\" (UniqueName: \"kubernetes.io/projected/51c1bfb6-954b-421a-9061-ec503a7fecc1-kube-api-access-mjqvc\") pod \"maas-controller-6d574849d-cscls\" (UID: \"51c1bfb6-954b-421a-9061-ec503a7fecc1\") " pod="opendatahub/maas-controller-6d574849d-cscls" Jun 11 16:44:48.044031 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:48.044007 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51c1bfb6-954b-421a-9061-ec503a7fecc1-webhook-cert\") pod \"maas-controller-6d574849d-cscls\" (UID: \"51c1bfb6-954b-421a-9061-ec503a7fecc1\") " pod="opendatahub/maas-controller-6d574849d-cscls" Jun 11 16:44:48.049885 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:48.049862 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjqvc\" (UniqueName: \"kubernetes.io/projected/51c1bfb6-954b-421a-9061-ec503a7fecc1-kube-api-access-mjqvc\") pod \"maas-controller-6d574849d-cscls\" (UID: \"51c1bfb6-954b-421a-9061-ec503a7fecc1\") " pod="opendatahub/maas-controller-6d574849d-cscls" Jun 11 16:44:48.245408 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:48.245370 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d574849d-cscls" Jun 11 16:44:48.380351 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:48.380326 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d574849d-cscls"] Jun 11 16:44:48.382815 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:44:48.382783 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51c1bfb6_954b_421a_9061_ec503a7fecc1.slice/crio-29606dccc5feb54a1d6c386a82669ffa334ac30d26ef3d70bbb10d59c43fe448 WatchSource:0}: Error finding container 29606dccc5feb54a1d6c386a82669ffa334ac30d26ef3d70bbb10d59c43fe448: Status 404 returned error can't find the container with id 29606dccc5feb54a1d6c386a82669ffa334ac30d26ef3d70bbb10d59c43fe448 Jun 11 16:44:48.445863 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:48.445827 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb-webhook-cert\") pod \"maas-controller-69b744c9df-b949j\" (UID: \"14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb\") " pod="opendatahub/maas-controller-69b744c9df-b949j" Jun 11 16:44:48.448458 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:48.448441 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb-webhook-cert\") pod \"maas-controller-69b744c9df-b949j\" (UID: \"14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb\") " pod="opendatahub/maas-controller-69b744c9df-b949j" Jun 11 16:44:48.663408 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:48.663328 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69b744c9df-b949j" Jun 11 16:44:48.799383 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:48.799359 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69b744c9df-b949j"] Jun 11 16:44:48.801279 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:44:48.801254 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14961b5b_e5a1_46ae_a8af_1ebfc7d7f3eb.slice/crio-89c1bec03b58fb1a07b2c6145bdcc9b8f120904fb733f3a419cae9cb7f663391 WatchSource:0}: Error finding container 89c1bec03b58fb1a07b2c6145bdcc9b8f120904fb733f3a419cae9cb7f663391: Status 404 returned error can't find the container with id 89c1bec03b58fb1a07b2c6145bdcc9b8f120904fb733f3a419cae9cb7f663391 Jun 11 16:44:48.862209 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:48.862173 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69b744c9df-b949j" event={"ID":"14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb","Type":"ContainerStarted","Data":"89c1bec03b58fb1a07b2c6145bdcc9b8f120904fb733f3a419cae9cb7f663391"} Jun 11 16:44:48.863355 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:48.863326 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d574849d-cscls" event={"ID":"51c1bfb6-954b-421a-9061-ec503a7fecc1","Type":"ContainerStarted","Data":"29606dccc5feb54a1d6c386a82669ffa334ac30d26ef3d70bbb10d59c43fe448"} Jun 11 16:44:51.884392 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:51.884352 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69b744c9df-b949j" event={"ID":"14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb","Type":"ContainerStarted","Data":"3452cd5c1c5e393dfbb47e6a66c4389434f31346ad7f2461e4085ebf04f7480c"} Jun 11 16:44:51.884840 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:51.884421 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-69b744c9df-b949j" Jun 11 16:44:51.885691 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:51.885669 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d574849d-cscls" event={"ID":"51c1bfb6-954b-421a-9061-ec503a7fecc1","Type":"ContainerStarted","Data":"69e520cf17eb07b14506bf952b362018682688025416e998078df2d6f1760693"} Jun 11 16:44:51.885813 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:51.885783 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d574849d-cscls" Jun 11 16:44:51.904299 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:51.904257 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-69b744c9df-b949j" podStartSLOduration=2.653120757 podStartE2EDuration="4.904243236s" totalImagesPullingTime="2.251122479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:44:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:44:51.901470689 +0000 UTC m=+819.969740724" watchObservedRunningTime="2026-06-11 16:44:51.904243236 +0000 UTC m=+819.972513271" Jun 11 16:44:51.919005 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:44:51.918942 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6d574849d-cscls" podStartSLOduration=2.263045688 podStartE2EDuration="4.918926337s" totalImagesPullingTime="2.655880649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:44:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:44:51.917347534 +0000 UTC m=+819.985617572" watchObservedRunningTime="2026-06-11 16:44:51.918926337 +0000 UTC m=+819.987196399" Jun 11 16:45:02.895785 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:02.895756 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d574849d-cscls" Jun 11 16:45:02.896263 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:02.896245 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-69b744c9df-b949j" Jun 11 16:45:02.953076 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:02.953023 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69b744c9df-b949j"] Jun 11 16:45:02.953299 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:02.953274 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-69b744c9df-b949j" podUID="14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb" containerName="manager" containerID="cri-o://3452cd5c1c5e393dfbb47e6a66c4389434f31346ad7f2461e4085ebf04f7480c" gracePeriod=30 Jun 11 16:45:03.198491 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:03.198464 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69b744c9df-b949j" Jun 11 16:45:03.282465 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:03.282429 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtbwg\" (UniqueName: \"kubernetes.io/projected/14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb-kube-api-access-wtbwg\") pod \"14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb\" (UID: \"14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb\") " Jun 11 16:45:03.282660 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:03.282547 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb-webhook-cert\") pod \"14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb\" (UID: \"14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb\") " Jun 11 16:45:03.284853 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:03.284824 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb-kube-api-access-wtbwg" (OuterVolumeSpecName: "kube-api-access-wtbwg") pod "14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb" (UID: "14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb"). InnerVolumeSpecName "kube-api-access-wtbwg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:45:03.284853 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:03.284824 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb" (UID: "14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:45:03.384004 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:03.383966 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtbwg\" (UniqueName: \"kubernetes.io/projected/14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb-kube-api-access-wtbwg\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:45:03.384004 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:03.384006 2569 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb-webhook-cert\") on node \"ip-10-0-135-188.ec2.internal\" DevicePath \"\"" Jun 11 16:45:03.944689 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:03.944647 2569 generic.go:356] "Generic (PLEG): container finished" podID="14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb" containerID="3452cd5c1c5e393dfbb47e6a66c4389434f31346ad7f2461e4085ebf04f7480c" exitCode=0 Jun 11 16:45:03.944689 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:03.944692 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69b744c9df-b949j" Jun 11 16:45:03.945263 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:03.944728 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69b744c9df-b949j" event={"ID":"14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb","Type":"ContainerDied","Data":"3452cd5c1c5e393dfbb47e6a66c4389434f31346ad7f2461e4085ebf04f7480c"} Jun 11 16:45:03.945263 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:03.944782 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69b744c9df-b949j" event={"ID":"14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb","Type":"ContainerDied","Data":"89c1bec03b58fb1a07b2c6145bdcc9b8f120904fb733f3a419cae9cb7f663391"} Jun 11 16:45:03.945263 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:03.944804 2569 scope.go:117] "RemoveContainer" containerID="3452cd5c1c5e393dfbb47e6a66c4389434f31346ad7f2461e4085ebf04f7480c" Jun 11 16:45:03.954833 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:03.954630 2569 scope.go:117] "RemoveContainer" containerID="3452cd5c1c5e393dfbb47e6a66c4389434f31346ad7f2461e4085ebf04f7480c" Jun 11 16:45:03.954928 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:45:03.954912 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3452cd5c1c5e393dfbb47e6a66c4389434f31346ad7f2461e4085ebf04f7480c\": container with ID starting with 3452cd5c1c5e393dfbb47e6a66c4389434f31346ad7f2461e4085ebf04f7480c not found: ID does not exist" containerID="3452cd5c1c5e393dfbb47e6a66c4389434f31346ad7f2461e4085ebf04f7480c" Jun 11 16:45:03.954973 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:03.954937 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3452cd5c1c5e393dfbb47e6a66c4389434f31346ad7f2461e4085ebf04f7480c"} err="failed to get container status \"3452cd5c1c5e393dfbb47e6a66c4389434f31346ad7f2461e4085ebf04f7480c\": rpc error: code = NotFound desc = could not find container \"3452cd5c1c5e393dfbb47e6a66c4389434f31346ad7f2461e4085ebf04f7480c\": container with ID starting with 3452cd5c1c5e393dfbb47e6a66c4389434f31346ad7f2461e4085ebf04f7480c not found: ID does not exist" Jun 11 16:45:03.965531 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:03.965503 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69b744c9df-b949j"] Jun 11 16:45:03.969764 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:03.969745 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-69b744c9df-b949j"] Jun 11 16:45:04.361228 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:04.361144 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb" path="/var/lib/kubelet/pods/14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb/volumes" Jun 11 16:45:20.527195 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:20.527158 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7fbc7cc44-285sz"] Jun 11 16:45:20.527777 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:20.527747 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb" containerName="manager" Jun 11 16:45:20.527777 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:20.527768 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb" containerName="manager" Jun 11 16:45:20.527900 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:20.527854 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="14961b5b-e5a1-46ae-a8af-1ebfc7d7f3eb" containerName="manager" Jun 11 16:45:20.535213 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:20.535188 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7fbc7cc44-285sz" Jun 11 16:45:20.538159 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:20.538135 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 11 16:45:20.538981 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:20.538955 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-hbptz\"" Jun 11 16:45:20.540362 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:20.540340 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7fbc7cc44-285sz"] Jun 11 16:45:20.641549 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:20.641514 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaafdfe7-1ca9-4e70-b052-478cdd7a0835-maas-api-tls\") pod \"maas-api-7fbc7cc44-285sz\" (UID: \"eaafdfe7-1ca9-4e70-b052-478cdd7a0835\") " pod="opendatahub/maas-api-7fbc7cc44-285sz" Jun 11 16:45:20.641549 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:20.641553 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaafdfe7-1ca9-4e70-b052-478cdd7a0835-openshift-service-ca\") pod \"maas-api-7fbc7cc44-285sz\" (UID: \"eaafdfe7-1ca9-4e70-b052-478cdd7a0835\") " pod="opendatahub/maas-api-7fbc7cc44-285sz" Jun 11 16:45:20.641798 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:20.641658 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqrpq\" (UniqueName: \"kubernetes.io/projected/eaafdfe7-1ca9-4e70-b052-478cdd7a0835-kube-api-access-vqrpq\") pod \"maas-api-7fbc7cc44-285sz\" (UID: \"eaafdfe7-1ca9-4e70-b052-478cdd7a0835\") " pod="opendatahub/maas-api-7fbc7cc44-285sz" Jun 11 16:45:20.742608 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:20.742571 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaafdfe7-1ca9-4e70-b052-478cdd7a0835-maas-api-tls\") pod \"maas-api-7fbc7cc44-285sz\" (UID: \"eaafdfe7-1ca9-4e70-b052-478cdd7a0835\") " pod="opendatahub/maas-api-7fbc7cc44-285sz" Jun 11 16:45:20.742833 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:20.742613 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaafdfe7-1ca9-4e70-b052-478cdd7a0835-openshift-service-ca\") pod \"maas-api-7fbc7cc44-285sz\" (UID: \"eaafdfe7-1ca9-4e70-b052-478cdd7a0835\") " pod="opendatahub/maas-api-7fbc7cc44-285sz" Jun 11 16:45:20.742833 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:20.742682 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqrpq\" (UniqueName: \"kubernetes.io/projected/eaafdfe7-1ca9-4e70-b052-478cdd7a0835-kube-api-access-vqrpq\") pod \"maas-api-7fbc7cc44-285sz\" (UID: \"eaafdfe7-1ca9-4e70-b052-478cdd7a0835\") " pod="opendatahub/maas-api-7fbc7cc44-285sz" Jun 11 16:45:20.742833 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:45:20.742736 2569 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 11 16:45:20.742833 ip-10-0-135-188 kubenswrapper[2569]: E0611 16:45:20.742819 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaafdfe7-1ca9-4e70-b052-478cdd7a0835-maas-api-tls podName:eaafdfe7-1ca9-4e70-b052-478cdd7a0835 nodeName:}" failed. No retries permitted until 2026-06-11 16:45:21.242797932 +0000 UTC m=+849.311067952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/eaafdfe7-1ca9-4e70-b052-478cdd7a0835-maas-api-tls") pod "maas-api-7fbc7cc44-285sz" (UID: "eaafdfe7-1ca9-4e70-b052-478cdd7a0835") : secret "maas-api-serving-cert" not found Jun 11 16:45:20.743418 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:20.743393 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaafdfe7-1ca9-4e70-b052-478cdd7a0835-openshift-service-ca\") pod \"maas-api-7fbc7cc44-285sz\" (UID: \"eaafdfe7-1ca9-4e70-b052-478cdd7a0835\") " pod="opendatahub/maas-api-7fbc7cc44-285sz" Jun 11 16:45:20.751789 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:20.751767 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqrpq\" (UniqueName: \"kubernetes.io/projected/eaafdfe7-1ca9-4e70-b052-478cdd7a0835-kube-api-access-vqrpq\") pod \"maas-api-7fbc7cc44-285sz\" (UID: \"eaafdfe7-1ca9-4e70-b052-478cdd7a0835\") " pod="opendatahub/maas-api-7fbc7cc44-285sz" Jun 11 16:45:21.065331 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:21.065291 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-ljx4x"] Jun 11 16:45:21.069849 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:21.069827 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-ljx4x" Jun 11 16:45:21.072498 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:21.072479 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 16:45:21.072636 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:21.072481 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-rnqc5\"" Jun 11 16:45:21.076646 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:21.076625 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-2rxfc"] Jun 11 16:45:21.080033 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:21.080011 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-ljx4x"] Jun 11 16:45:21.080160 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:21.080141 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-2rxfc" Jun 11 16:45:21.091446 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:21.091324 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-2rxfc"] Jun 11 16:45:21.247544 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:21.247504 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaafdfe7-1ca9-4e70-b052-478cdd7a0835-maas-api-tls\") pod \"maas-api-7fbc7cc44-285sz\" (UID: \"eaafdfe7-1ca9-4e70-b052-478cdd7a0835\") " pod="opendatahub/maas-api-7fbc7cc44-285sz" Jun 11 16:45:21.247735 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:21.247584 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2v55\" (UniqueName: \"kubernetes.io/projected/c3d16bc6-9965-4aaa-bd34-08049be71121-kube-api-access-s2v55\") pod \"payload-pre-processing-579785bc64-ljx4x\" (UID: \"c3d16bc6-9965-4aaa-bd34-08049be71121\") " pod="openshift-ingress/payload-pre-processing-579785bc64-ljx4x" Jun 11 16:45:21.247785 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:21.247743 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jmxg\" (UniqueName: \"kubernetes.io/projected/604abe18-465b-41a1-8da2-cec500d376c1-kube-api-access-4jmxg\") pod \"payload-processing-699b6cd6c-2rxfc\" (UID: \"604abe18-465b-41a1-8da2-cec500d376c1\") " pod="openshift-ingress/payload-processing-699b6cd6c-2rxfc" Jun 11 16:45:21.250218 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:21.250195 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaafdfe7-1ca9-4e70-b052-478cdd7a0835-maas-api-tls\") pod \"maas-api-7fbc7cc44-285sz\" (UID: \"eaafdfe7-1ca9-4e70-b052-478cdd7a0835\") " pod="opendatahub/maas-api-7fbc7cc44-285sz" Jun 11 16:45:21.348287 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:21.348198 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jmxg\" (UniqueName: \"kubernetes.io/projected/604abe18-465b-41a1-8da2-cec500d376c1-kube-api-access-4jmxg\") pod \"payload-processing-699b6cd6c-2rxfc\" (UID: \"604abe18-465b-41a1-8da2-cec500d376c1\") " pod="openshift-ingress/payload-processing-699b6cd6c-2rxfc" Jun 11 16:45:21.348287 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:21.348252 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2v55\" (UniqueName: \"kubernetes.io/projected/c3d16bc6-9965-4aaa-bd34-08049be71121-kube-api-access-s2v55\") pod \"payload-pre-processing-579785bc64-ljx4x\" (UID: \"c3d16bc6-9965-4aaa-bd34-08049be71121\") " pod="openshift-ingress/payload-pre-processing-579785bc64-ljx4x" Jun 11 16:45:21.357239 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:21.357203 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jmxg\" (UniqueName: \"kubernetes.io/projected/604abe18-465b-41a1-8da2-cec500d376c1-kube-api-access-4jmxg\") pod \"payload-processing-699b6cd6c-2rxfc\" (UID: \"604abe18-465b-41a1-8da2-cec500d376c1\") " pod="openshift-ingress/payload-processing-699b6cd6c-2rxfc" Jun 11 16:45:21.357375 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:21.357325 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2v55\" (UniqueName: \"kubernetes.io/projected/c3d16bc6-9965-4aaa-bd34-08049be71121-kube-api-access-s2v55\") pod \"payload-pre-processing-579785bc64-ljx4x\" (UID: \"c3d16bc6-9965-4aaa-bd34-08049be71121\") " pod="openshift-ingress/payload-pre-processing-579785bc64-ljx4x" Jun 11 16:45:21.382379 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:21.382342 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-ljx4x" Jun 11 16:45:21.393428 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:21.393372 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-2rxfc" Jun 11 16:45:21.447952 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:21.447515 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7fbc7cc44-285sz" Jun 11 16:45:21.550487 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:21.550370 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-ljx4x"] Jun 11 16:45:21.553623 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:45:21.553584 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3d16bc6_9965_4aaa_bd34_08049be71121.slice/crio-c7167d15a3eed500acb1f36afdb4cdd5191f5d0e9714cd7da570d3d60d948bf9 WatchSource:0}: Error finding container c7167d15a3eed500acb1f36afdb4cdd5191f5d0e9714cd7da570d3d60d948bf9: Status 404 returned error can't find the container with id c7167d15a3eed500acb1f36afdb4cdd5191f5d0e9714cd7da570d3d60d948bf9 Jun 11 16:45:21.555841 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:21.555821 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:45:21.581645 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:21.581595 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-2rxfc"] Jun 11 16:45:21.584109 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:45:21.583998 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod604abe18_465b_41a1_8da2_cec500d376c1.slice/crio-edaea49b486030fd10019571a9b8e9e3fc66b3e7546c96a8653f47dbeb8a42a0 WatchSource:0}: Error finding container edaea49b486030fd10019571a9b8e9e3fc66b3e7546c96a8653f47dbeb8a42a0: Status 404 returned error can't find the container with id edaea49b486030fd10019571a9b8e9e3fc66b3e7546c96a8653f47dbeb8a42a0 Jun 11 16:45:21.620979 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:21.620945 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7fbc7cc44-285sz"] Jun 11 16:45:21.623544 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:45:21.623516 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaafdfe7_1ca9_4e70_b052_478cdd7a0835.slice/crio-82bc07702666fbb1078d52c04a07723831417ea627a9c709716937c68f50de03 WatchSource:0}: Error finding container 82bc07702666fbb1078d52c04a07723831417ea627a9c709716937c68f50de03: Status 404 returned error can't find the container with id 82bc07702666fbb1078d52c04a07723831417ea627a9c709716937c68f50de03 Jun 11 16:45:22.033666 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:22.033631 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7fbc7cc44-285sz" event={"ID":"eaafdfe7-1ca9-4e70-b052-478cdd7a0835","Type":"ContainerStarted","Data":"82bc07702666fbb1078d52c04a07723831417ea627a9c709716937c68f50de03"} Jun 11 16:45:22.034941 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:22.034913 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-2rxfc" event={"ID":"604abe18-465b-41a1-8da2-cec500d376c1","Type":"ContainerStarted","Data":"edaea49b486030fd10019571a9b8e9e3fc66b3e7546c96a8653f47dbeb8a42a0"} Jun 11 16:45:22.036193 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:22.036173 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-ljx4x" event={"ID":"c3d16bc6-9965-4aaa-bd34-08049be71121","Type":"ContainerStarted","Data":"c7167d15a3eed500acb1f36afdb4cdd5191f5d0e9714cd7da570d3d60d948bf9"} Jun 11 16:45:26.076263 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:26.076225 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-ljx4x" event={"ID":"c3d16bc6-9965-4aaa-bd34-08049be71121","Type":"ContainerStarted","Data":"aba8208bd3f603d723b85241a14c52c36893ace3e1c2300283084c4ef80058e8"} Jun 11 16:45:26.076691 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:26.076293 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-ljx4x" Jun 11 16:45:26.077895 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:26.077866 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7fbc7cc44-285sz" event={"ID":"eaafdfe7-1ca9-4e70-b052-478cdd7a0835","Type":"ContainerStarted","Data":"2c1e4d5cfe1754b99b9d60157b4b22efba35f9a0ce969d4711510344a36b5263"} Jun 11 16:45:26.078030 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:26.077966 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7fbc7cc44-285sz" Jun 11 16:45:26.079448 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:26.079425 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-2rxfc" event={"ID":"604abe18-465b-41a1-8da2-cec500d376c1","Type":"ContainerStarted","Data":"812ae2102d895f07a180040dfbda0027f1b45bef212b09ff97cd3dcd17852262"} Jun 11 16:45:26.079559 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:26.079471 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-2rxfc" Jun 11 16:45:26.093660 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:26.093607 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-ljx4x" podStartSLOduration=1.4015536659999999 podStartE2EDuration="5.0935895s" totalImagesPullingTime="3.692035834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:45:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:45:26.090676266 +0000 UTC m=+854.158946304" watchObservedRunningTime="2026-06-11 16:45:26.0935895 +0000 UTC m=+854.161859538" Jun 11 16:45:26.107740 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:26.107692 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-7fbc7cc44-285sz" podStartSLOduration=2.584951803 podStartE2EDuration="6.107678399s" totalImagesPullingTime="3.522726596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:45:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:45:26.107137951 +0000 UTC m=+854.175407987" watchObservedRunningTime="2026-06-11 16:45:26.107678399 +0000 UTC m=+854.175948437" Jun 11 16:45:26.123294 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:26.123251 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-2rxfc" podStartSLOduration=1.473283806 podStartE2EDuration="5.123232809s" totalImagesPullingTime="3.649949003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:45:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:45:26.122165958 +0000 UTC m=+854.190435991" watchObservedRunningTime="2026-06-11 16:45:26.123232809 +0000 UTC m=+854.191502846" Jun 11 16:45:29.096532 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:29.096457 2569 generic.go:356] "Generic (PLEG): container finished" podID="44b3a188-8104-49ee-9d23-6ace2e1b19f0" containerID="bca20e171721ddd4254164b9d4e374d821e8cbfe668ed551976f5738a46ab7c2" exitCode=0 Jun 11 16:45:29.096947 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:29.096526 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" event={"ID":"44b3a188-8104-49ee-9d23-6ace2e1b19f0","Type":"ContainerDied","Data":"bca20e171721ddd4254164b9d4e374d821e8cbfe668ed551976f5738a46ab7c2"} Jun 11 16:45:29.097015 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:29.096947 2569 scope.go:117] "RemoveContainer" containerID="bca20e171721ddd4254164b9d4e374d821e8cbfe668ed551976f5738a46ab7c2" Jun 11 16:45:29.097994 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:29.097968 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Jun 11 16:45:29.098120 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:29.098036 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Jun 11 16:45:29.098178 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:29.098120 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Jun 11 16:45:30.108340 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:30.108306 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" event={"ID":"44b3a188-8104-49ee-9d23-6ace2e1b19f0","Type":"ContainerStarted","Data":"de3d940281a0b958af3a3ce9abc76350392cd08fd7dc7c70edcd6d955bfd9a9b"} Jun 11 16:45:30.448112 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:30.448070 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:45:30.448349 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:30.448325 2569 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-frzlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jun 11 16:45:30.448433 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:30.448399 2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" podUID="44b3a188-8104-49ee-9d23-6ace2e1b19f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jun 11 16:45:31.448365 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:31.448330 2569 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-frzlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jun 11 16:45:31.448753 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:31.448387 2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" podUID="44b3a188-8104-49ee-9d23-6ace2e1b19f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jun 11 16:45:32.097485 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:32.097439 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7fbc7cc44-285sz" Jun 11 16:45:32.448306 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:32.448267 2569 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-frzlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jun 11 16:45:32.448469 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:32.448335 2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" podUID="44b3a188-8104-49ee-9d23-6ace2e1b19f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jun 11 16:45:33.448288 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:33.448247 2569 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-frzlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jun 11 16:45:33.448485 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:33.448323 2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" podUID="44b3a188-8104-49ee-9d23-6ace2e1b19f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jun 11 16:45:34.451854 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:34.451826 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:45:34.452286 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:34.452102 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:45:34.452796 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:34.452779 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-frzlt" Jun 11 16:45:37.087760 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:37.087729 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-2rxfc" Jun 11 16:45:37.088270 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:45:37.087799 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-ljx4x" Jun 11 16:48:14.228436 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:14.228401 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-66dd5798d6-5fdd4"] Jun 11 16:48:14.231886 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:14.231866 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66dd5798d6-5fdd4" Jun 11 16:48:14.235965 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:14.235943 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2hxg2\"" Jun 11 16:48:14.236226 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:14.235959 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 11 16:48:14.236427 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:14.235994 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 11 16:48:14.238602 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:14.238581 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66dd5798d6-5fdd4"] Jun 11 16:48:14.378449 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:14.378422 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wppgt\" (UniqueName: \"kubernetes.io/projected/79b1393e-722c-4cea-93f7-14e2d94aeee3-kube-api-access-wppgt\") pod \"authorino-66dd5798d6-5fdd4\" (UID: \"79b1393e-722c-4cea-93f7-14e2d94aeee3\") " pod="kuadrant-system/authorino-66dd5798d6-5fdd4" Jun 11 16:48:14.378621 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:14.378478 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/79b1393e-722c-4cea-93f7-14e2d94aeee3-tls-cert\") pod \"authorino-66dd5798d6-5fdd4\" (UID: \"79b1393e-722c-4cea-93f7-14e2d94aeee3\") " pod="kuadrant-system/authorino-66dd5798d6-5fdd4" Jun 11 16:48:14.378621 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:14.378561 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/79b1393e-722c-4cea-93f7-14e2d94aeee3-oidc-ca\") pod \"authorino-66dd5798d6-5fdd4\" (UID: \"79b1393e-722c-4cea-93f7-14e2d94aeee3\") " pod="kuadrant-system/authorino-66dd5798d6-5fdd4" Jun 11 16:48:14.479982 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:14.479889 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/79b1393e-722c-4cea-93f7-14e2d94aeee3-oidc-ca\") pod \"authorino-66dd5798d6-5fdd4\" (UID: \"79b1393e-722c-4cea-93f7-14e2d94aeee3\") " pod="kuadrant-system/authorino-66dd5798d6-5fdd4" Jun 11 16:48:14.479982 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:14.479952 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wppgt\" (UniqueName: \"kubernetes.io/projected/79b1393e-722c-4cea-93f7-14e2d94aeee3-kube-api-access-wppgt\") pod \"authorino-66dd5798d6-5fdd4\" (UID: \"79b1393e-722c-4cea-93f7-14e2d94aeee3\") " pod="kuadrant-system/authorino-66dd5798d6-5fdd4" Jun 11 16:48:14.480224 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:14.479997 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/79b1393e-722c-4cea-93f7-14e2d94aeee3-tls-cert\") pod \"authorino-66dd5798d6-5fdd4\" (UID: \"79b1393e-722c-4cea-93f7-14e2d94aeee3\") " pod="kuadrant-system/authorino-66dd5798d6-5fdd4" Jun 11 16:48:14.480599 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:14.480563 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/79b1393e-722c-4cea-93f7-14e2d94aeee3-oidc-ca\") pod \"authorino-66dd5798d6-5fdd4\" (UID: \"79b1393e-722c-4cea-93f7-14e2d94aeee3\") " pod="kuadrant-system/authorino-66dd5798d6-5fdd4" Jun 11 16:48:14.482596 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:14.482576 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/79b1393e-722c-4cea-93f7-14e2d94aeee3-tls-cert\") pod \"authorino-66dd5798d6-5fdd4\" (UID: \"79b1393e-722c-4cea-93f7-14e2d94aeee3\") " pod="kuadrant-system/authorino-66dd5798d6-5fdd4" Jun 11 16:48:14.489122 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:14.489100 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wppgt\" (UniqueName: \"kubernetes.io/projected/79b1393e-722c-4cea-93f7-14e2d94aeee3-kube-api-access-wppgt\") pod \"authorino-66dd5798d6-5fdd4\" (UID: \"79b1393e-722c-4cea-93f7-14e2d94aeee3\") " pod="kuadrant-system/authorino-66dd5798d6-5fdd4" Jun 11 16:48:14.542571 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:14.542535 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66dd5798d6-5fdd4" Jun 11 16:48:14.686344 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:14.686314 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66dd5798d6-5fdd4"] Jun 11 16:48:14.689260 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:48:14.689224 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79b1393e_722c_4cea_93f7_14e2d94aeee3.slice/crio-03e77a1674d052ae8c1d09a4e6cc089acff8932caf233838a370ff0112117cf5 WatchSource:0}: Error finding container 03e77a1674d052ae8c1d09a4e6cc089acff8932caf233838a370ff0112117cf5: Status 404 returned error can't find the container with id 03e77a1674d052ae8c1d09a4e6cc089acff8932caf233838a370ff0112117cf5 Jun 11 16:48:14.913133 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:14.913005 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66dd5798d6-5fdd4" event={"ID":"79b1393e-722c-4cea-93f7-14e2d94aeee3","Type":"ContainerStarted","Data":"03e77a1674d052ae8c1d09a4e6cc089acff8932caf233838a370ff0112117cf5"} Jun 11 16:48:15.919693 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:15.919659 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66dd5798d6-5fdd4" event={"ID":"79b1393e-722c-4cea-93f7-14e2d94aeee3","Type":"ContainerStarted","Data":"17c49ac72d7d809fa844431f3e679eb3022e9e3f384251c01998610f44befbf8"} Jun 11 16:48:15.933852 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:15.933802 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-66dd5798d6-5fdd4" podStartSLOduration=1.489589375 podStartE2EDuration="1.933787132s" totalImagesPullingTime="444.197757ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:48:15.932356197 +0000 UTC m=+1024.000626233" watchObservedRunningTime="2026-06-11 16:48:15.933787132 +0000 UTC m=+1024.002057168" Jun 11 16:48:42.037695 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:42.037661 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m"] Jun 11 16:48:42.041655 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:42.041496 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m" Jun 11 16:48:42.045255 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:42.045227 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wrp74\"" Jun 11 16:48:42.045397 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:42.045228 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 16:48:42.045397 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:42.045237 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 16:48:42.045570 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:42.045543 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 11 16:48:42.051487 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:42.051462 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m"] Jun 11 16:48:42.142178 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:42.142137 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa05295f-04f3-418b-b462-b625a2ef7ed6-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m\" (UID: \"aa05295f-04f3-418b-b462-b625a2ef7ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m" Jun 11 16:48:42.142362 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:42.142183 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa05295f-04f3-418b-b462-b625a2ef7ed6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m\" (UID: \"aa05295f-04f3-418b-b462-b625a2ef7ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m" Jun 11 16:48:42.142362 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:42.142209 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frlwj\" (UniqueName: \"kubernetes.io/projected/aa05295f-04f3-418b-b462-b625a2ef7ed6-kube-api-access-frlwj\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m\" (UID: \"aa05295f-04f3-418b-b462-b625a2ef7ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m" Jun 11 16:48:42.142362 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:42.142276 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa05295f-04f3-418b-b462-b625a2ef7ed6-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m\" (UID: \"aa05295f-04f3-418b-b462-b625a2ef7ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m" Jun 11 16:48:42.142362 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:42.142323 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa05295f-04f3-418b-b462-b625a2ef7ed6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m\" (UID: \"aa05295f-04f3-418b-b462-b625a2ef7ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m" Jun 11 16:48:42.142519 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:42.142363 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aa05295f-04f3-418b-b462-b625a2ef7ed6-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m\" (UID: \"aa05295f-04f3-418b-b462-b625a2ef7ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m" Jun 11 16:48:42.243317 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:42.243274 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa05295f-04f3-418b-b462-b625a2ef7ed6-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m\" (UID: \"aa05295f-04f3-418b-b462-b625a2ef7ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m" Jun 11 16:48:42.243526 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:42.243325 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa05295f-04f3-418b-b462-b625a2ef7ed6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m\" (UID: \"aa05295f-04f3-418b-b462-b625a2ef7ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m" Jun 11 16:48:42.243526 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:42.243362 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aa05295f-04f3-418b-b462-b625a2ef7ed6-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m\" (UID: \"aa05295f-04f3-418b-b462-b625a2ef7ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m" Jun 11 16:48:42.243526 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:42.243476 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa05295f-04f3-418b-b462-b625a2ef7ed6-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m\" (UID: \"aa05295f-04f3-418b-b462-b625a2ef7ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m" Jun 11 16:48:42.243526 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:42.243500 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa05295f-04f3-418b-b462-b625a2ef7ed6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m\" (UID: \"aa05295f-04f3-418b-b462-b625a2ef7ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m" Jun 11 16:48:42.243526 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:42.243523 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frlwj\" (UniqueName: \"kubernetes.io/projected/aa05295f-04f3-418b-b462-b625a2ef7ed6-kube-api-access-frlwj\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m\" (UID: \"aa05295f-04f3-418b-b462-b625a2ef7ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m" Jun 11 16:48:42.243861 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:42.243834 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aa05295f-04f3-418b-b462-b625a2ef7ed6-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m\" (UID: \"aa05295f-04f3-418b-b462-b625a2ef7ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m" Jun 11 16:48:42.243991 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:42.243886 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa05295f-04f3-418b-b462-b625a2ef7ed6-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m\" (UID: \"aa05295f-04f3-418b-b462-b625a2ef7ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m" Jun 11 16:48:42.243991 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:42.243944 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa05295f-04f3-418b-b462-b625a2ef7ed6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m\" (UID: \"aa05295f-04f3-418b-b462-b625a2ef7ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m" Jun 11 16:48:42.245740 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:42.245711 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa05295f-04f3-418b-b462-b625a2ef7ed6-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m\" (UID: \"aa05295f-04f3-418b-b462-b625a2ef7ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m" Jun 11 16:48:42.246082 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:42.246029 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa05295f-04f3-418b-b462-b625a2ef7ed6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m\" (UID: \"aa05295f-04f3-418b-b462-b625a2ef7ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m" Jun 11 16:48:42.251974 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:42.251950 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frlwj\" (UniqueName: \"kubernetes.io/projected/aa05295f-04f3-418b-b462-b625a2ef7ed6-kube-api-access-frlwj\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m\" (UID: \"aa05295f-04f3-418b-b462-b625a2ef7ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m" Jun 11 16:48:42.357647 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:42.357549 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m" Jun 11 16:48:42.503468 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:42.503443 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m"] Jun 11 16:48:42.506639 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:48:42.506607 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa05295f_04f3_418b_b462_b625a2ef7ed6.slice/crio-0ce28982d7421e9f70fac15bc11682df1c7bd11b8def660afa636b7d763db3cd WatchSource:0}: Error finding container 0ce28982d7421e9f70fac15bc11682df1c7bd11b8def660afa636b7d763db3cd: Status 404 returned error can't find the container with id 0ce28982d7421e9f70fac15bc11682df1c7bd11b8def660afa636b7d763db3cd Jun 11 16:48:43.063714 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:43.063676 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m" event={"ID":"aa05295f-04f3-418b-b462-b625a2ef7ed6","Type":"ContainerStarted","Data":"0ce28982d7421e9f70fac15bc11682df1c7bd11b8def660afa636b7d763db3cd"} Jun 11 16:48:46.088294 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:48:46.088203 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m" event={"ID":"aa05295f-04f3-418b-b462-b625a2ef7ed6","Type":"ContainerStarted","Data":"bad6f34a52681c87b094ccb0022ad4aca5b7013237d67f10f81a58679f8bb9f1"} Jun 11 16:53:20.652878 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:20.652831 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66dd5798d6-5fdd4_79b1393e-722c-4cea-93f7-14e2d94aeee3/authorino/0.log" Jun 11 16:53:25.031485 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:25.031445 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-79b7c87c7f-tb5db_85f78129-7241-499c-be81-ef4342515bfd/nginx/0.log" Jun 11 16:53:25.489923 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:25.489883 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7fbc7cc44-285sz_eaafdfe7-1ca9-4e70-b052-478cdd7a0835/maas-api/0.log" Jun 11 16:53:25.603466 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:25.603436 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6d574849d-cscls_51c1bfb6-954b-421a-9061-ec503a7fecc1/manager/0.log" Jun 11 16:53:25.937948 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:25.937925 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74d99d69cd-645bl_76a585b0-4596-4280-9d77-b31d8dcc303f/copy-manifests/0.log" Jun 11 16:53:25.944713 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:25.944686 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74d99d69cd-645bl_76a585b0-4596-4280-9d77-b31d8dcc303f/manager/0.log" Jun 11 16:53:27.510879 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:27.510837 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66dd5798d6-5fdd4_79b1393e-722c-4cea-93f7-14e2d94aeee3/authorino/0.log" Jun 11 16:53:27.621632 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:27.621602 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ppvjt_53bba977-ba03-4403-8be8-248e9d92e264/manager/0.log" Jun 11 16:53:27.729705 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:27.729668 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-2sblm_a129be54-0708-4179-83e7-2c9d4783ea02/manager/0.log" Jun 11 16:53:27.944409 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:27.944373 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-lflck_8db13793-72d0-42bd-b411-23696cf7aadb/registry-server/0.log" Jun 11 16:53:28.060353 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:28.060325 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-vbnjs_3efd7b2d-d1c7-45d7-8157-f09e66ea6d65/manager/0.log" Jun 11 16:53:28.618163 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:28.618137 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcpfsbc_c0cdb506-3a94-4f23-918b-bbbd5e04157a/istio-proxy/0.log" Jun 11 16:53:29.058744 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:29.058713 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-frzlt_44b3a188-8104-49ee-9d23-6ace2e1b19f0/istio-proxy/1.log" Jun 11 16:53:29.166673 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:29.166638 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-ljx4x_c3d16bc6-9965-4aaa-bd34-08049be71121/payload-pre-processing/0.log" Jun 11 16:53:29.286224 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:29.286191 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-2rxfc_604abe18-465b-41a1-8da2-cec500d376c1/payload-processing/0.log" Jun 11 16:53:29.957211 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:29.957145 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-n5b9m_aa05295f-04f3-418b-b462-b625a2ef7ed6/storage-initializer/0.log" Jun 11 16:53:34.536716 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:34.536686 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9sdk2/must-gather-b2vj2"] Jun 11 16:53:34.540941 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:34.540920 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9sdk2/must-gather-b2vj2" Jun 11 16:53:34.543760 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:34.543743 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9sdk2\"/\"default-dockercfg-5grv2\"" Jun 11 16:53:34.543837 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:34.543758 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9sdk2\"/\"kube-root-ca.crt\"" Jun 11 16:53:34.544912 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:34.544896 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9sdk2\"/\"openshift-service-ca.crt\"" Jun 11 16:53:34.558741 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:34.558712 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9sdk2/must-gather-b2vj2"] Jun 11 16:53:34.615967 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:34.615927 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d425ba10-7e81-4421-a6a3-52102bf8cb73-must-gather-output\") pod \"must-gather-b2vj2\" (UID: \"d425ba10-7e81-4421-a6a3-52102bf8cb73\") " pod="openshift-must-gather-9sdk2/must-gather-b2vj2" Jun 11 16:53:34.616182 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:34.615992 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpf9s\" (UniqueName: \"kubernetes.io/projected/d425ba10-7e81-4421-a6a3-52102bf8cb73-kube-api-access-jpf9s\") pod \"must-gather-b2vj2\" (UID: \"d425ba10-7e81-4421-a6a3-52102bf8cb73\") " pod="openshift-must-gather-9sdk2/must-gather-b2vj2" Jun 11 16:53:34.717399 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:34.717356 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d425ba10-7e81-4421-a6a3-52102bf8cb73-must-gather-output\") pod \"must-gather-b2vj2\" (UID: \"d425ba10-7e81-4421-a6a3-52102bf8cb73\") " pod="openshift-must-gather-9sdk2/must-gather-b2vj2" Jun 11 16:53:34.717582 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:34.717434 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpf9s\" (UniqueName: \"kubernetes.io/projected/d425ba10-7e81-4421-a6a3-52102bf8cb73-kube-api-access-jpf9s\") pod \"must-gather-b2vj2\" (UID: \"d425ba10-7e81-4421-a6a3-52102bf8cb73\") " pod="openshift-must-gather-9sdk2/must-gather-b2vj2" Jun 11 16:53:34.717732 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:34.717714 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d425ba10-7e81-4421-a6a3-52102bf8cb73-must-gather-output\") pod \"must-gather-b2vj2\" (UID: \"d425ba10-7e81-4421-a6a3-52102bf8cb73\") " pod="openshift-must-gather-9sdk2/must-gather-b2vj2" Jun 11 16:53:34.726431 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:34.726397 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpf9s\" (UniqueName: \"kubernetes.io/projected/d425ba10-7e81-4421-a6a3-52102bf8cb73-kube-api-access-jpf9s\") pod \"must-gather-b2vj2\" (UID: \"d425ba10-7e81-4421-a6a3-52102bf8cb73\") " pod="openshift-must-gather-9sdk2/must-gather-b2vj2" Jun 11 16:53:34.851988 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:34.851900 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9sdk2/must-gather-b2vj2" Jun 11 16:53:34.992928 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:34.992906 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9sdk2/must-gather-b2vj2"] Jun 11 16:53:34.996016 ip-10-0-135-188 kubenswrapper[2569]: W0611 16:53:34.995981 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd425ba10_7e81_4421_a6a3_52102bf8cb73.slice/crio-4692a3dd2d74bba6a006578110ab16ec20a0140d518c7e67c16cdb6ba501729d WatchSource:0}: Error finding container 4692a3dd2d74bba6a006578110ab16ec20a0140d518c7e67c16cdb6ba501729d: Status 404 returned error can't find the container with id 4692a3dd2d74bba6a006578110ab16ec20a0140d518c7e67c16cdb6ba501729d Jun 11 16:53:34.998291 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:34.998266 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:53:35.558726 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:35.558682 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9sdk2/must-gather-b2vj2" event={"ID":"d425ba10-7e81-4421-a6a3-52102bf8cb73","Type":"ContainerStarted","Data":"4692a3dd2d74bba6a006578110ab16ec20a0140d518c7e67c16cdb6ba501729d"} Jun 11 16:53:36.568164 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:36.568120 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9sdk2/must-gather-b2vj2" event={"ID":"d425ba10-7e81-4421-a6a3-52102bf8cb73","Type":"ContainerStarted","Data":"9573abc4d8e993d16e86a306efe1ee4d6debecf12d0dfb0d0d48a503799b23eb"} Jun 11 16:53:36.568653 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:36.568181 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9sdk2/must-gather-b2vj2" event={"ID":"d425ba10-7e81-4421-a6a3-52102bf8cb73","Type":"ContainerStarted","Data":"2f8f1b2ce94cb35a6065dec4c6dea1b71a251569a76276b1b9902e0449c8118e"} Jun 11 16:53:36.583892 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:36.583838 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9sdk2/must-gather-b2vj2" podStartSLOduration=1.8162027090000001 podStartE2EDuration="2.583820647s" totalImagesPullingTime="767.617938ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:53:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:53:36.583674464 +0000 UTC m=+1344.651944502" watchObservedRunningTime="2026-06-11 16:53:36.583820647 +0000 UTC m=+1344.652090684" Jun 11 16:53:37.383993 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:37.383968 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qxtrm_ae57bac1-3c7a-4bd9-8f95-98cb5f6bad55/global-pull-secret-syncer/0.log" Jun 11 16:53:37.525140 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:37.525101 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sdlpn_dac311a1-e919-4bbe-825a-621ae8045c7c/konnectivity-agent/0.log" Jun 11 16:53:37.595558 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:37.595530 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-188.ec2.internal_39f5ba962028041c64db3920f82c6d5e/haproxy/0.log" Jun 11 16:53:42.034561 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:42.034526 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66dd5798d6-5fdd4_79b1393e-722c-4cea-93f7-14e2d94aeee3/authorino/0.log" Jun 11 16:53:42.110888 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:42.110859 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ppvjt_53bba977-ba03-4403-8be8-248e9d92e264/manager/0.log" Jun 11 16:53:42.141299 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:42.141265 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-2sblm_a129be54-0708-4179-83e7-2c9d4783ea02/manager/0.log" Jun 11 16:53:42.210751 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:42.210725 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-lflck_8db13793-72d0-42bd-b411-23696cf7aadb/registry-server/0.log" Jun 11 16:53:42.251417 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:42.251354 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-vbnjs_3efd7b2d-d1c7-45d7-8157-f09e66ea6d65/manager/0.log" Jun 11 16:53:44.132110 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:44.131992 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5414b4ed-7c62-4d38-9802-516f25d0a76a/alertmanager/0.log" Jun 11 16:53:44.155536 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:44.155507 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5414b4ed-7c62-4d38-9802-516f25d0a76a/config-reloader/0.log" Jun 11 16:53:44.177484 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:44.177418 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5414b4ed-7c62-4d38-9802-516f25d0a76a/kube-rbac-proxy-web/0.log" Jun 11 16:53:44.200673 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:44.199666 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5414b4ed-7c62-4d38-9802-516f25d0a76a/kube-rbac-proxy/0.log" Jun 11 16:53:44.224454 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:44.224429 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5414b4ed-7c62-4d38-9802-516f25d0a76a/kube-rbac-proxy-metric/0.log" Jun 11 16:53:44.253577 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:44.253554 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5414b4ed-7c62-4d38-9802-516f25d0a76a/prom-label-proxy/0.log" Jun 11 16:53:44.279007 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:44.278969 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5414b4ed-7c62-4d38-9802-516f25d0a76a/init-config-reloader/0.log" Jun 11 16:53:44.455149 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:44.455105 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-6pnqb_2bec74cd-b2ee-432c-a68c-eee82ac4b08a/monitoring-plugin/0.log" Jun 11 16:53:44.485134 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:44.485102 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pzjft_f5ae726b-5718-439a-a58d-d26a0dd8c442/node-exporter/0.log" Jun 11 16:53:44.505997 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:44.505967 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pzjft_f5ae726b-5718-439a-a58d-d26a0dd8c442/kube-rbac-proxy/0.log" Jun 11 16:53:44.530293 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:44.530263 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pzjft_f5ae726b-5718-439a-a58d-d26a0dd8c442/init-textfile/0.log" Jun 11 16:53:44.837068 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:44.837027 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e71f196a-e2e4-4f4f-860d-e3027493896e/prometheus/0.log" Jun 11 16:53:44.865202 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:44.863729 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e71f196a-e2e4-4f4f-860d-e3027493896e/config-reloader/0.log" Jun 11 16:53:44.888928 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:44.888898 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e71f196a-e2e4-4f4f-860d-e3027493896e/thanos-sidecar/0.log" Jun 11 16:53:44.912558 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:44.912531 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e71f196a-e2e4-4f4f-860d-e3027493896e/kube-rbac-proxy-web/0.log" Jun 11 16:53:44.935017 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:44.934488 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e71f196a-e2e4-4f4f-860d-e3027493896e/kube-rbac-proxy/0.log" Jun 11 16:53:44.972696 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:44.972672 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e71f196a-e2e4-4f4f-860d-e3027493896e/kube-rbac-proxy-thanos/0.log" Jun 11 16:53:44.994240 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:44.994200 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e71f196a-e2e4-4f4f-860d-e3027493896e/init-config-reloader/0.log" Jun 11 16:53:45.036217 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:45.036101 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-gptdq_d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4/prometheus-operator/0.log" Jun 11 16:53:45.059259 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:45.059223 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-gptdq_d1ec7efd-6cca-4b4c-816e-4a6c0e34e5e4/kube-rbac-proxy/0.log" Jun 11 16:53:45.086611 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:45.086584 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-vf2mk_f6878e6f-105f-4b95-a976-67173395f4d1/prometheus-operator-admission-webhook/0.log" Jun 11 16:53:45.233697 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:45.233666 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-689b7c9588-474jg_fb4efb1d-c77a-4ce2-a5b3-8cc963f72508/thanos-query/0.log" Jun 11 16:53:45.255722 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:45.255698 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-689b7c9588-474jg_fb4efb1d-c77a-4ce2-a5b3-8cc963f72508/kube-rbac-proxy-web/0.log" Jun 11 16:53:45.308530 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:45.308440 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-689b7c9588-474jg_fb4efb1d-c77a-4ce2-a5b3-8cc963f72508/kube-rbac-proxy/0.log" Jun 11 16:53:45.372079 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:45.372029 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-689b7c9588-474jg_fb4efb1d-c77a-4ce2-a5b3-8cc963f72508/prom-label-proxy/0.log" Jun 11 16:53:45.403906 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:45.403795 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-689b7c9588-474jg_fb4efb1d-c77a-4ce2-a5b3-8cc963f72508/kube-rbac-proxy-rules/0.log" Jun 11 16:53:45.425579 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:45.425545 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-689b7c9588-474jg_fb4efb1d-c77a-4ce2-a5b3-8cc963f72508/kube-rbac-proxy-metrics/0.log" Jun 11 16:53:47.026743 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:47.026713 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-gf2qf_c68b7331-ae32-4a9e-9687-1321770eab37/networking-console-plugin/0.log" Jun 11 16:53:49.226148 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:49.226107 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9sdk2/perf-node-gather-daemonset-z9ggc"] Jun 11 16:53:49.232189 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:49.232157 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-z9ggc" Jun 11 16:53:49.239640 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:49.239590 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9sdk2/perf-node-gather-daemonset-z9ggc"] Jun 11 16:53:49.387686 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:49.387653 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvw4x\" (UniqueName: \"kubernetes.io/projected/8df432cb-b270-47cd-b51c-02e16fa53988-kube-api-access-xvw4x\") pod \"perf-node-gather-daemonset-z9ggc\" (UID: \"8df432cb-b270-47cd-b51c-02e16fa53988\") " pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-z9ggc" Jun 11 16:53:49.387866 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:49.387779 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8df432cb-b270-47cd-b51c-02e16fa53988-sys\") pod \"perf-node-gather-daemonset-z9ggc\" (UID: \"8df432cb-b270-47cd-b51c-02e16fa53988\") " pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-z9ggc" Jun 11 16:53:49.387866 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:49.387823 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8df432cb-b270-47cd-b51c-02e16fa53988-podres\") pod \"perf-node-gather-daemonset-z9ggc\" (UID: \"8df432cb-b270-47cd-b51c-02e16fa53988\") " pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-z9ggc" Jun 11 16:53:49.387992 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:49.387893 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8df432cb-b270-47cd-b51c-02e16fa53988-proc\") pod \"perf-node-gather-daemonset-z9ggc\" (UID: \"8df432cb-b270-47cd-b51c-02e16fa53988\") " pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-z9ggc" Jun 11 16:53:49.387992 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:49.387971 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8df432cb-b270-47cd-b51c-02e16fa53988-lib-modules\") pod \"perf-node-gather-daemonset-z9ggc\" (UID: \"8df432cb-b270-47cd-b51c-02e16fa53988\") " pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-z9ggc" Jun 11 16:53:49.488971 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:49.488885 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8df432cb-b270-47cd-b51c-02e16fa53988-sys\") pod \"perf-node-gather-daemonset-z9ggc\" (UID: \"8df432cb-b270-47cd-b51c-02e16fa53988\") " pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-z9ggc" Jun 11 16:53:49.488971 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:49.488928 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8df432cb-b270-47cd-b51c-02e16fa53988-podres\") pod \"perf-node-gather-daemonset-z9ggc\" (UID: \"8df432cb-b270-47cd-b51c-02e16fa53988\") " pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-z9ggc" Jun 11 16:53:49.489236 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:49.489071 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8df432cb-b270-47cd-b51c-02e16fa53988-sys\") pod \"perf-node-gather-daemonset-z9ggc\" (UID: \"8df432cb-b270-47cd-b51c-02e16fa53988\") " pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-z9ggc" Jun 11 16:53:49.489236 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:49.489124 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8df432cb-b270-47cd-b51c-02e16fa53988-podres\") pod \"perf-node-gather-daemonset-z9ggc\" (UID: \"8df432cb-b270-47cd-b51c-02e16fa53988\") " pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-z9ggc" Jun 11 16:53:49.489236 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:49.489159 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8df432cb-b270-47cd-b51c-02e16fa53988-proc\") pod \"perf-node-gather-daemonset-z9ggc\" (UID: \"8df432cb-b270-47cd-b51c-02e16fa53988\") " pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-z9ggc" Jun 11 16:53:49.489236 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:49.489218 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8df432cb-b270-47cd-b51c-02e16fa53988-lib-modules\") pod \"perf-node-gather-daemonset-z9ggc\" (UID: \"8df432cb-b270-47cd-b51c-02e16fa53988\") " pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-z9ggc" Jun 11 16:53:49.489525 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:49.489297 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvw4x\" (UniqueName: \"kubernetes.io/projected/8df432cb-b270-47cd-b51c-02e16fa53988-kube-api-access-xvw4x\") pod \"perf-node-gather-daemonset-z9ggc\" (UID: \"8df432cb-b270-47cd-b51c-02e16fa53988\") " pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-z9ggc" Jun 11 16:53:49.489525 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:49.489301 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8df432cb-b270-47cd-b51c-02e16fa53988-proc\") pod \"perf-node-gather-daemonset-z9ggc\" (UID: \"8df432cb-b270-47cd-b51c-02e16fa53988\") " pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-z9ggc" Jun 11 16:53:49.489525 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:49.489466 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8df432cb-b270-47cd-b51c-02e16fa53988-lib-modules\") pod \"perf-node-gather-daemonset-z9ggc\" (UID: \"8df432cb-b270-47cd-b51c-02e16fa53988\") " pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-z9ggc" Jun 11 16:53:49.498459 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:49.498429 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvw4x\" (UniqueName: \"kubernetes.io/projected/8df432cb-b270-47cd-b51c-02e16fa53988-kube-api-access-xvw4x\") pod \"perf-node-gather-daemonset-z9ggc\" (UID: \"8df432cb-b270-47cd-b51c-02e16fa53988\") " pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-z9ggc" Jun 11 16:53:49.545793 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:49.545522 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-z9ggc" Jun 11 16:53:49.738547 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:49.738234 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9sdk2/perf-node-gather-daemonset-z9ggc"] Jun 11 16:53:50.327908 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:50.327884 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lxkqq_305a9021-ddf2-4eca-8df5-2fbe025ac9bd/dns/0.log" Jun 11 16:53:50.348619 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:50.348592 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lxkqq_305a9021-ddf2-4eca-8df5-2fbe025ac9bd/kube-rbac-proxy/0.log" Jun 11 16:53:50.446487 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:50.446463 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8h74q_66a0433d-006a-4974-960f-30704fb9949d/dns-node-resolver/0.log" Jun 11 16:53:50.670014 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:50.669977 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-z9ggc" event={"ID":"8df432cb-b270-47cd-b51c-02e16fa53988","Type":"ContainerStarted","Data":"d5fc4b0c072c1bafa849f92211dd1a552420989a312a5b3f745935fd314aa5db"} Jun 11 16:53:50.670279 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:50.670030 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-z9ggc" event={"ID":"8df432cb-b270-47cd-b51c-02e16fa53988","Type":"ContainerStarted","Data":"98d30d7b1031e48442ff3600d726447943e31b0954736d36e2c116ca148e2ca2"} Jun 11 16:53:50.670279 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:50.670080 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-z9ggc" Jun 11 16:53:50.687857 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:50.687797 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-z9ggc" podStartSLOduration=1.687776617 podStartE2EDuration="1.687776617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:53:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:53:50.686481647 +0000 UTC m=+1358.754751708" watchObservedRunningTime="2026-06-11 16:53:50.687776617 +0000 UTC m=+1358.756046653" Jun 11 16:53:51.021750 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:51.021670 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lvfpt_2ac98822-4208-4aec-9b86-0bc5aecbd145/node-ca/0.log" Jun 11 16:53:52.024692 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:52.024660 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcpfsbc_c0cdb506-3a94-4f23-918b-bbbd5e04157a/istio-proxy/0.log" Jun 11 16:53:52.161404 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:52.161375 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-frzlt_44b3a188-8104-49ee-9d23-6ace2e1b19f0/istio-proxy/1.log" Jun 11 16:53:52.161728 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:52.161709 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-frzlt_44b3a188-8104-49ee-9d23-6ace2e1b19f0/istio-proxy/0.log" Jun 11 16:53:52.181098 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:52.181071 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-ljx4x_c3d16bc6-9965-4aaa-bd34-08049be71121/payload-pre-processing/0.log" Jun 11 16:53:52.205228 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:52.205202 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-2rxfc_604abe18-465b-41a1-8da2-cec500d376c1/payload-processing/0.log" Jun 11 16:53:52.895746 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:52.895711 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s2gvs_6ba18fd1-dd09-45d8-81c7-8796fde2340e/serve-healthcheck-canary/0.log" Jun 11 16:53:53.445231 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:53.445204 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cmls4_32ab30e6-d587-4805-b34f-ddc36849d83f/kube-rbac-proxy/0.log" Jun 11 16:53:53.465887 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:53.465852 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cmls4_32ab30e6-d587-4805-b34f-ddc36849d83f/exporter/0.log" Jun 11 16:53:53.488090 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:53.488047 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cmls4_32ab30e6-d587-4805-b34f-ddc36849d83f/extractor/0.log" Jun 11 16:53:55.793246 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:55.793207 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-79b7c87c7f-tb5db_85f78129-7241-499c-be81-ef4342515bfd/nginx/0.log" Jun 11 16:53:55.904325 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:55.904298 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7fbc7cc44-285sz_eaafdfe7-1ca9-4e70-b052-478cdd7a0835/maas-api/0.log" Jun 11 16:53:55.931887 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:55.931850 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6d574849d-cscls_51c1bfb6-954b-421a-9061-ec503a7fecc1/manager/0.log" Jun 11 16:53:56.038391 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:56.038363 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74d99d69cd-645bl_76a585b0-4596-4280-9d77-b31d8dcc303f/manager/0.log" Jun 11 16:53:56.061232 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:56.061145 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74d99d69cd-645bl_76a585b0-4596-4280-9d77-b31d8dcc303f/copy-manifests/0.log" Jun 11 16:53:56.688988 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:56.688939 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-z9ggc" Jun 11 16:53:57.732551 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:53:57.732520 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5d6f6b5548-brzvm_279eb59e-9db9-4121-9847-ac12a6ef37a4/manager/0.log" Jun 11 16:54:03.236452 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:03.236419 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcpfsbc_c0cdb506-3a94-4f23-918b-bbbd5e04157a/istio-proxy/0.log" Jun 11 16:54:03.337456 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:03.337407 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-frzlt_44b3a188-8104-49ee-9d23-6ace2e1b19f0/istio-proxy/1.log" Jun 11 16:54:03.337932 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:03.337909 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-frzlt_44b3a188-8104-49ee-9d23-6ace2e1b19f0/istio-proxy/0.log" Jun 11 16:54:03.348428 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:03.348374 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-ljx4x_c3d16bc6-9965-4aaa-bd34-08049be71121/payload-pre-processing/0.log" Jun 11 16:54:03.367647 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:03.367620 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-2rxfc_604abe18-465b-41a1-8da2-cec500d376c1/payload-processing/0.log" Jun 11 16:54:04.484781 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:04.484752 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcpfsbc_c0cdb506-3a94-4f23-918b-bbbd5e04157a/istio-proxy/0.log" Jun 11 16:54:04.589915 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:04.589872 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-frzlt_44b3a188-8104-49ee-9d23-6ace2e1b19f0/istio-proxy/1.log" Jun 11 16:54:04.590522 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:04.590500 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-frzlt_44b3a188-8104-49ee-9d23-6ace2e1b19f0/istio-proxy/0.log" Jun 11 16:54:04.609895 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:04.609870 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-ljx4x_c3d16bc6-9965-4aaa-bd34-08049be71121/payload-pre-processing/0.log" Jun 11 16:54:04.624888 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:04.624857 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-2rxfc_604abe18-465b-41a1-8da2-cec500d376c1/payload-processing/0.log" Jun 11 16:54:04.994880 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:04.994853 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7vskf_faa4a854-0eca-4d38-9ce1-5fcf03623d6b/kube-multus/0.log" Jun 11 16:54:05.020225 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:05.020197 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-829vm_06cfb41e-30d2-4adf-b24d-84281d21e078/kube-multus-additional-cni-plugins/0.log" Jun 11 16:54:05.043026 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:05.042990 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-829vm_06cfb41e-30d2-4adf-b24d-84281d21e078/egress-router-binary-copy/0.log" Jun 11 16:54:05.064234 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:05.064201 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-829vm_06cfb41e-30d2-4adf-b24d-84281d21e078/cni-plugins/0.log" Jun 11 16:54:05.084116 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:05.084080 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-829vm_06cfb41e-30d2-4adf-b24d-84281d21e078/bond-cni-plugin/0.log" Jun 11 16:54:05.104009 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:05.103986 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-829vm_06cfb41e-30d2-4adf-b24d-84281d21e078/routeoverride-cni/0.log" Jun 11 16:54:05.123786 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:05.123763 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-829vm_06cfb41e-30d2-4adf-b24d-84281d21e078/whereabouts-cni-bincopy/0.log" Jun 11 16:54:05.146515 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:05.146489 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-829vm_06cfb41e-30d2-4adf-b24d-84281d21e078/whereabouts-cni/0.log" Jun 11 16:54:05.512762 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:05.512732 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6k5sj_941f2a27-1f4c-400e-a50e-8a541e5fb4a7/network-metrics-daemon/0.log" Jun 11 16:54:05.531822 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:05.531797 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6k5sj_941f2a27-1f4c-400e-a50e-8a541e5fb4a7/kube-rbac-proxy/0.log" Jun 11 16:54:06.213484 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:06.213445 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcpfsbc_c0cdb506-3a94-4f23-918b-bbbd5e04157a/istio-proxy/0.log" Jun 11 16:54:06.338423 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:06.338392 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-frzlt_44b3a188-8104-49ee-9d23-6ace2e1b19f0/istio-proxy/1.log" Jun 11 16:54:06.338881 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:06.338861 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-frzlt_44b3a188-8104-49ee-9d23-6ace2e1b19f0/istio-proxy/0.log" Jun 11 16:54:06.349797 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:06.349772 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-ljx4x_c3d16bc6-9965-4aaa-bd34-08049be71121/payload-pre-processing/0.log" Jun 11 16:54:06.368442 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:06.368418 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-2rxfc_604abe18-465b-41a1-8da2-cec500d376c1/payload-processing/0.log" Jun 11 16:54:06.897593 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:06.897563 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dctg2_9719af52-db4f-4e83-83e9-070c2ed86687/ovn-controller/0.log" Jun 11 16:54:06.918531 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:06.918501 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dctg2_9719af52-db4f-4e83-83e9-070c2ed86687/ovn-acl-logging/0.log" Jun 11 16:54:06.943075 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:06.943031 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dctg2_9719af52-db4f-4e83-83e9-070c2ed86687/kube-rbac-proxy-node/0.log" Jun 11 16:54:06.963537 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:06.963508 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dctg2_9719af52-db4f-4e83-83e9-070c2ed86687/kube-rbac-proxy-ovn-metrics/0.log" Jun 11 16:54:06.982974 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:06.982950 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dctg2_9719af52-db4f-4e83-83e9-070c2ed86687/northd/0.log" Jun 11 16:54:07.004544 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:07.004514 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dctg2_9719af52-db4f-4e83-83e9-070c2ed86687/nbdb/0.log" Jun 11 16:54:07.027351 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:07.027292 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dctg2_9719af52-db4f-4e83-83e9-070c2ed86687/sbdb/0.log" Jun 11 16:54:07.078822 ip-10-0-135-188 kubenswrapper[2569]: I0611 16:54:07.078791 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dctg2_9719af52-db4f-4e83-83e9-070c2ed86687/ovnkube-controller/0.log"