Sep 11 18:48:14.330663 ip-10-0-133-25 systemd[1]: Starting Kubernetes Kubelet... Sep 11 18:48:14.727112 ip-10-0-133-25 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 11 18:48:14.727112 ip-10-0-133-25 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 11 18:48:14.727112 ip-10-0-133-25 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 11 18:48:14.727112 ip-10-0-133-25 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 11 18:48:14.727112 ip-10-0-133-25 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 11 18:48:14.729969 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.729853 2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 11 18:48:14.733236 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733221 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 18:48:14.733236 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733237 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 18:48:14.733309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733241 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 18:48:14.733309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733246 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 18:48:14.733309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733249 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 18:48:14.733309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733251 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 18:48:14.733309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733254 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 18:48:14.733309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733259 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 18:48:14.733309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733263 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 18:48:14.733309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733266 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 18:48:14.733309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733269 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 18:48:14.733309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733272 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 18:48:14.733309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733275 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 18:48:14.733309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733278 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 18:48:14.733309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733281 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 18:48:14.733309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733284 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 18:48:14.733309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733287 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 18:48:14.733309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733289 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 18:48:14.733309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733292 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 18:48:14.733309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733295 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 18:48:14.733309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733298 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 18:48:14.733309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733305 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 18:48:14.733808 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733308 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 18:48:14.733808 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733311 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 18:48:14.733808 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733314 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 18:48:14.733808 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733316 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 18:48:14.733808 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733320 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 18:48:14.733808 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733330 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 18:48:14.733808 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733334 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 18:48:14.733808 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733336 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 18:48:14.733808 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733339 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 18:48:14.733808 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733342 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 18:48:14.733808 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733345 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 18:48:14.733808 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733348 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 18:48:14.733808 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733363 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 18:48:14.733808 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733366 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 18:48:14.733808 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733368 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 18:48:14.733808 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733371 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 18:48:14.733808 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733373 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 18:48:14.733808 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733376 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 18:48:14.733808 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733379 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 18:48:14.734309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733381 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 18:48:14.734309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733384 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 18:48:14.734309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733386 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 18:48:14.734309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733389 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 18:48:14.734309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733391 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 18:48:14.734309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733394 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 18:48:14.734309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733396 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 18:48:14.734309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733399 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 18:48:14.734309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733401 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 18:48:14.734309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733404 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 18:48:14.734309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733406 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 18:48:14.734309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733409 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 18:48:14.734309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733411 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 18:48:14.734309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733414 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 18:48:14.734309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733419 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 18:48:14.734309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733422 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 18:48:14.734309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733424 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 18:48:14.734309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733427 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 18:48:14.734309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733429 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 18:48:14.734309 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733432 2583 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 18:48:14.734812 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733435 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 18:48:14.734812 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733439 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 18:48:14.734812 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733443 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 18:48:14.734812 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733445 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 18:48:14.734812 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733448 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 18:48:14.734812 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733451 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 18:48:14.734812 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733453 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 18:48:14.734812 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733456 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 18:48:14.734812 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733460 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 18:48:14.734812 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733463 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 18:48:14.734812 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733466 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 18:48:14.734812 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733469 2583 feature_gate.go:328] unrecognized feature gate: Example Sep 11 18:48:14.734812 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733472 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 18:48:14.734812 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733474 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 18:48:14.734812 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733478 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 18:48:14.734812 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733481 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 18:48:14.734812 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733483 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 18:48:14.734812 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733486 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 18:48:14.734812 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733489 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 18:48:14.735261 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733491 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 18:48:14.735261 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733494 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 18:48:14.735261 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733496 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 18:48:14.735261 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733499 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 18:48:14.735261 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733501 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 18:48:14.735261 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733504 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 18:48:14.735261 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733506 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 18:48:14.735261 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733510 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 18:48:14.735261 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733513 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 18:48:14.735261 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733515 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 18:48:14.735261 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733518 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 18:48:14.735261 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733521 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 18:48:14.735261 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733523 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 18:48:14.735261 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733526 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 18:48:14.735261 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733528 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 18:48:14.735261 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733531 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 18:48:14.735261 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733534 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 18:48:14.735261 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733536 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 18:48:14.735261 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.733539 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 18:48:14.735261 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734227 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 18:48:14.735771 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734233 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 18:48:14.735771 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734236 2583 feature_gate.go:328] unrecognized feature gate: Example Sep 11 18:48:14.735771 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734239 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 18:48:14.735771 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734242 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 18:48:14.735771 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734245 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 18:48:14.735771 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734247 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 18:48:14.735771 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734250 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 18:48:14.735771 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734253 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 18:48:14.735771 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734255 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 18:48:14.735771 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734257 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 18:48:14.735771 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734260 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 18:48:14.735771 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734262 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 18:48:14.735771 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734265 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 18:48:14.735771 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734268 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 18:48:14.735771 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734270 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 18:48:14.735771 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734273 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 18:48:14.735771 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734275 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 18:48:14.735771 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734278 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 18:48:14.735771 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734281 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 18:48:14.735771 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734284 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 18:48:14.736259 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734287 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 18:48:14.736259 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734290 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 18:48:14.736259 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734293 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 18:48:14.736259 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734295 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 18:48:14.736259 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734298 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 18:48:14.736259 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734300 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 18:48:14.736259 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734304 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 18:48:14.736259 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734306 2583 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 18:48:14.736259 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734309 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 18:48:14.736259 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734311 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 18:48:14.736259 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734314 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 18:48:14.736259 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734317 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 18:48:14.736259 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734320 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 18:48:14.736259 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734323 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 18:48:14.736259 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734326 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 18:48:14.736259 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734328 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 18:48:14.736259 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734331 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 18:48:14.736259 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734334 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 18:48:14.736259 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734336 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 18:48:14.736259 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734339 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 18:48:14.736761 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734341 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 18:48:14.736761 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734344 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 18:48:14.736761 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734346 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 18:48:14.736761 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734349 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 18:48:14.736761 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734367 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 18:48:14.736761 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734369 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 18:48:14.736761 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734372 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 18:48:14.736761 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734376 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 18:48:14.736761 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734380 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 18:48:14.736761 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734384 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 18:48:14.736761 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734387 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 18:48:14.736761 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734391 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 18:48:14.736761 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734394 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 18:48:14.736761 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734397 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 18:48:14.736761 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734400 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 18:48:14.736761 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734402 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 18:48:14.736761 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734406 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 18:48:14.736761 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734410 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 18:48:14.737231 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734413 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 18:48:14.737231 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734415 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 18:48:14.737231 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734418 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 18:48:14.737231 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734420 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 18:48:14.737231 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734425 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 18:48:14.737231 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734429 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 18:48:14.737231 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734431 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 18:48:14.737231 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734434 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 18:48:14.737231 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734437 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 18:48:14.737231 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734440 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 18:48:14.737231 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734442 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 18:48:14.737231 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734445 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 18:48:14.737231 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734447 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 18:48:14.737231 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734450 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 18:48:14.737231 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734452 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 18:48:14.737231 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734455 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 18:48:14.737231 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734457 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 18:48:14.737231 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734460 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 18:48:14.737231 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734462 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 18:48:14.737231 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734464 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 18:48:14.737973 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734467 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 18:48:14.737973 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734470 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 18:48:14.737973 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734473 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 18:48:14.737973 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734476 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 18:48:14.737973 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734478 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 18:48:14.737973 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734481 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 18:48:14.737973 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734483 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 18:48:14.737973 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734486 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 18:48:14.737973 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734489 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 18:48:14.737973 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734491 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 18:48:14.737973 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734494 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 18:48:14.737973 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734496 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 18:48:14.737973 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734499 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 18:48:14.737973 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734501 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 18:48:14.737973 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734504 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 18:48:14.737973 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734506 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 18:48:14.737973 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734509 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 18:48:14.737973 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734511 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 18:48:14.737973 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734513 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 18:48:14.737973 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734516 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 18:48:14.738521 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734936 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 18:48:14.738521 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734941 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 18:48:14.738521 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734944 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 18:48:14.738521 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734947 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 18:48:14.738521 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734950 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 18:48:14.738521 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734952 2583 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 18:48:14.738521 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734955 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 18:48:14.738521 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734957 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 18:48:14.738521 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734960 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 18:48:14.738521 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734962 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 18:48:14.738521 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734965 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 18:48:14.738521 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734968 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 18:48:14.738521 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734970 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 18:48:14.738521 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734973 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 18:48:14.738521 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734978 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 18:48:14.738521 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734981 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 18:48:14.738521 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734983 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 18:48:14.738521 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734986 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 18:48:14.738521 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734989 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 18:48:14.738521 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734992 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 18:48:14.739145 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734995 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 18:48:14.739145 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.734997 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 18:48:14.739145 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735000 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 18:48:14.739145 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735002 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 18:48:14.739145 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735005 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 18:48:14.739145 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735008 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 18:48:14.739145 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735010 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 18:48:14.739145 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735013 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 18:48:14.739145 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735015 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 18:48:14.739145 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735018 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 18:48:14.739145 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735021 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 18:48:14.739145 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735023 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 18:48:14.739145 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735026 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 18:48:14.739145 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735028 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 18:48:14.739145 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735031 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 18:48:14.739145 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735033 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 18:48:14.739145 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735036 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 18:48:14.739145 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735038 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 18:48:14.739145 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735041 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 18:48:14.739145 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735043 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 18:48:14.739693 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735046 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 18:48:14.739693 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735048 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 18:48:14.739693 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735051 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 18:48:14.739693 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735053 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 18:48:14.739693 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735056 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 18:48:14.739693 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735058 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 18:48:14.739693 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735062 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 18:48:14.739693 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735066 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 18:48:14.739693 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735069 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 18:48:14.739693 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735072 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 18:48:14.739693 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735076 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 18:48:14.739693 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735079 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 18:48:14.739693 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735082 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 18:48:14.739693 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735085 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 18:48:14.739693 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735088 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 18:48:14.739693 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735090 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 18:48:14.739693 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735093 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 18:48:14.739693 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735096 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 18:48:14.739693 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735098 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 18:48:14.740225 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735101 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 18:48:14.740225 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735103 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 18:48:14.740225 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735106 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 18:48:14.740225 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735108 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 18:48:14.740225 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735111 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 18:48:14.740225 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735113 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 18:48:14.740225 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735118 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 18:48:14.740225 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735120 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 18:48:14.740225 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735123 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 18:48:14.740225 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735126 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 18:48:14.740225 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735129 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 18:48:14.740225 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735132 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 18:48:14.740225 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735135 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 18:48:14.740225 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735137 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 18:48:14.740225 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735140 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 18:48:14.740225 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735142 2583 feature_gate.go:328] unrecognized feature gate: Example Sep 11 18:48:14.740225 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735145 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 18:48:14.740225 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735147 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 18:48:14.740225 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735150 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 18:48:14.740225 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735153 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 18:48:14.740762 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735156 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 18:48:14.740762 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735158 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 18:48:14.740762 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735161 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 18:48:14.740762 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735164 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 18:48:14.740762 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735166 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 18:48:14.740762 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735169 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 18:48:14.740762 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735171 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 18:48:14.740762 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735174 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 18:48:14.740762 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735179 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 18:48:14.740762 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735182 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 18:48:14.740762 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735185 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 18:48:14.740762 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735187 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 18:48:14.740762 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735190 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 18:48:14.740762 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735192 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 18:48:14.740762 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735195 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 18:48:14.740762 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735197 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 18:48:14.740762 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735200 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 18:48:14.740762 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735203 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 18:48:14.740762 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735205 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 18:48:14.740762 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735208 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 18:48:14.741272 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735283 2583 flags.go:64] FLAG: --address="0.0.0.0" Sep 11 18:48:14.741272 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735312 2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 11 18:48:14.741272 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735318 2583 flags.go:64] FLAG: --anonymous-auth="true" Sep 11 18:48:14.741272 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735322 2583 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 11 18:48:14.741272 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735326 2583 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 11 18:48:14.741272 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735330 2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 11 18:48:14.741272 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735334 2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 11 18:48:14.741272 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735338 2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 11 18:48:14.741272 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735341 2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 11 18:48:14.741272 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735344 2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 11 18:48:14.741272 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735347 2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 11 18:48:14.741272 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735367 2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 11 18:48:14.741272 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735372 2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 11 18:48:14.741272 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735377 2583 flags.go:64] FLAG: --cgroup-root="" Sep 11 18:48:14.741272 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735383 2583 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 11 18:48:14.741272 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735386 2583 flags.go:64] FLAG: --client-ca-file="" Sep 11 18:48:14.741272 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735389 2583 flags.go:64] FLAG: --cloud-provider="external" Sep 11 18:48:14.741272 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735392 2583 flags.go:64] FLAG: --cluster-dns="[]" Sep 11 18:48:14.741272 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735395 2583 flags.go:64] FLAG: --cluster-domain="" Sep 11 18:48:14.741272 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735398 2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 11 18:48:14.741272 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735402 2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 11 18:48:14.741272 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735405 2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 11 18:48:14.741272 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735409 2583 flags.go:64] FLAG: --container-log-max-files="5" Sep 11 18:48:14.741272 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735412 2583 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 11 18:48:14.741931 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735416 2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 11 18:48:14.741931 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735419 2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 11 18:48:14.741931 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735422 2583 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 11 18:48:14.741931 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735425 2583 flags.go:64] FLAG: --contention-profiling="false" Sep 11 18:48:14.741931 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735427 2583 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 11 18:48:14.741931 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735431 2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 11 18:48:14.741931 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735434 2583 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 11 18:48:14.741931 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735437 2583 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 11 18:48:14.741931 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735440 2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 11 18:48:14.741931 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735443 2583 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 11 18:48:14.741931 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735446 2583 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 11 18:48:14.741931 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735449 2583 flags.go:64] FLAG: --enable-load-reader="false" Sep 11 18:48:14.741931 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735452 2583 flags.go:64] FLAG: --enable-server="true" Sep 11 18:48:14.741931 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735455 2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 11 18:48:14.741931 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735459 2583 flags.go:64] FLAG: --event-burst="100" Sep 11 18:48:14.741931 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735462 2583 flags.go:64] FLAG: --event-qps="50" Sep 11 18:48:14.741931 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735465 2583 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 11 18:48:14.741931 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735468 2583 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 11 18:48:14.741931 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735471 2583 flags.go:64] FLAG: --eviction-hard="" Sep 11 18:48:14.741931 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735476 2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 11 18:48:14.741931 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735479 2583 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 11 18:48:14.741931 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735482 2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 11 18:48:14.741931 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735487 2583 flags.go:64] FLAG: --eviction-soft="" Sep 11 18:48:14.741931 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735489 2583 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 11 18:48:14.741931 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735492 2583 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 11 18:48:14.742571 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735495 2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 11 18:48:14.742571 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735498 2583 flags.go:64] FLAG: --experimental-mounter-path="" Sep 11 18:48:14.742571 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735501 2583 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 11 18:48:14.742571 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735504 2583 flags.go:64] FLAG: --fail-swap-on="true" Sep 11 18:48:14.742571 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735507 2583 flags.go:64] FLAG: --feature-gates="" Sep 11 18:48:14.742571 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735511 2583 flags.go:64] FLAG: --file-check-frequency="20s" Sep 11 18:48:14.742571 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735514 2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 11 18:48:14.742571 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735517 2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 11 18:48:14.742571 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735520 2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 11 18:48:14.742571 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735523 2583 flags.go:64] FLAG: --healthz-port="10248" Sep 11 18:48:14.742571 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735526 2583 flags.go:64] FLAG: --help="false" Sep 11 18:48:14.742571 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735529 2583 flags.go:64] FLAG: --hostname-override="ip-10-0-133-25.ec2.internal" Sep 11 18:48:14.742571 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735532 2583 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 11 18:48:14.742571 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735535 2583 flags.go:64] FLAG: --http-check-frequency="20s" Sep 11 18:48:14.742571 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735537 2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 11 18:48:14.742571 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735541 2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 11 18:48:14.742571 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735544 2583 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 11 18:48:14.742571 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735547 2583 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 11 18:48:14.742571 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735549 2583 flags.go:64] FLAG: --image-service-endpoint="" Sep 11 18:48:14.742571 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735552 2583 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 11 18:48:14.742571 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735556 2583 flags.go:64] FLAG: --kube-api-burst="100" Sep 11 18:48:14.742571 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735565 2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 11 18:48:14.742571 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735569 2583 flags.go:64] FLAG: --kube-api-qps="50" Sep 11 18:48:14.742571 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735572 2583 flags.go:64] FLAG: --kube-reserved="" Sep 11 18:48:14.743158 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735575 2583 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 11 18:48:14.743158 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735577 2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 11 18:48:14.743158 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735582 2583 flags.go:64] FLAG: --kubelet-cgroups="" Sep 11 18:48:14.743158 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735585 2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 11 18:48:14.743158 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735587 2583 flags.go:64] FLAG: --lock-file="" Sep 11 18:48:14.743158 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735593 2583 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 11 18:48:14.743158 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735596 2583 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 11 18:48:14.743158 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735599 2583 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 11 18:48:14.743158 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735604 2583 flags.go:64] FLAG: --log-json-split-stream="false" Sep 11 18:48:14.743158 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735607 2583 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 11 18:48:14.743158 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735610 2583 flags.go:64] FLAG: --log-text-split-stream="false" Sep 11 18:48:14.743158 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735613 2583 flags.go:64] FLAG: --logging-format="text" Sep 11 18:48:14.743158 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735616 2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 11 18:48:14.743158 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735620 2583 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 11 18:48:14.743158 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735623 2583 flags.go:64] FLAG: --manifest-url="" Sep 11 18:48:14.743158 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735625 2583 flags.go:64] FLAG: --manifest-url-header="" Sep 11 18:48:14.743158 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735629 2583 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 11 18:48:14.743158 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735632 2583 flags.go:64] FLAG: --max-open-files="1000000" Sep 11 18:48:14.743158 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735636 2583 flags.go:64] FLAG: --max-pods="110" Sep 11 18:48:14.743158 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735639 2583 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 11 18:48:14.743158 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735643 2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 11 18:48:14.743158 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735645 2583 flags.go:64] FLAG: --memory-manager-policy="None" Sep 11 18:48:14.743158 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735648 2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 11 18:48:14.743158 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735651 2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 11 18:48:14.743158 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735655 2583 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 11 18:48:14.743785 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735658 2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 11 18:48:14.743785 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735664 2583 flags.go:64] FLAG: --node-status-max-images="50" Sep 11 18:48:14.743785 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735668 2583 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 11 18:48:14.743785 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735671 2583 flags.go:64] FLAG: --oom-score-adj="-999" Sep 11 18:48:14.743785 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735674 2583 flags.go:64] FLAG: --pod-cidr="" Sep 11 18:48:14.743785 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735677 2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 11 18:48:14.743785 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735683 2583 flags.go:64] FLAG: --pod-manifest-path="" Sep 11 18:48:14.743785 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735686 2583 flags.go:64] FLAG: --pod-max-pids="-1" Sep 11 18:48:14.743785 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735689 2583 flags.go:64] FLAG: --pods-per-core="0" Sep 11 18:48:14.743785 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735692 2583 flags.go:64] FLAG: --port="10250" Sep 11 18:48:14.743785 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735696 2583 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 11 18:48:14.743785 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735699 2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-061d6e1a1406c7daf" Sep 11 18:48:14.743785 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735704 2583 flags.go:64] FLAG: --qos-reserved="" Sep 11 18:48:14.743785 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735707 2583 flags.go:64] FLAG: --read-only-port="10255" Sep 11 18:48:14.743785 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735710 2583 flags.go:64] FLAG: --register-node="true" Sep 11 18:48:14.743785 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735713 2583 flags.go:64] FLAG: --register-with-taints="" Sep 11 18:48:14.743785 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735716 2583 flags.go:64] FLAG: --registry-burst="10" Sep 11 18:48:14.743785 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735719 2583 flags.go:64] FLAG: --registry-qps="5" Sep 11 18:48:14.743785 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735722 2583 flags.go:64] FLAG: --reserved-cpus="" Sep 11 18:48:14.743785 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735725 2583 flags.go:64] FLAG: --reserved-memory="" Sep 11 18:48:14.743785 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735729 2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 11 18:48:14.743785 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735732 2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 11 18:48:14.743785 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735736 2583 flags.go:64] FLAG: --rotate-certificates="false" Sep 11 18:48:14.743785 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735738 2583 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 11 18:48:14.743785 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735741 2583 flags.go:64] FLAG: --runonce="false" Sep 11 18:48:14.744418 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735744 2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 11 18:48:14.744418 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735747 2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 11 18:48:14.744418 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735750 2583 flags.go:64] FLAG: --seccomp-default="false" Sep 11 18:48:14.744418 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735753 2583 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 11 18:48:14.744418 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735756 2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 11 18:48:14.744418 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735759 2583 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 11 18:48:14.744418 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735762 2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 11 18:48:14.744418 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735765 2583 flags.go:64] FLAG: --storage-driver-password="root" Sep 11 18:48:14.744418 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735768 2583 flags.go:64] FLAG: --storage-driver-secure="false" Sep 11 18:48:14.744418 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735771 2583 flags.go:64] FLAG: --storage-driver-table="stats" Sep 11 18:48:14.744418 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735774 2583 flags.go:64] FLAG: --storage-driver-user="root" Sep 11 18:48:14.744418 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735777 2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 11 18:48:14.744418 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735780 2583 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 11 18:48:14.744418 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735783 2583 flags.go:64] FLAG: --system-cgroups="" Sep 11 18:48:14.744418 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735786 2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 11 18:48:14.744418 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735791 2583 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 11 18:48:14.744418 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735794 2583 flags.go:64] FLAG: --tls-cert-file="" Sep 11 18:48:14.744418 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735798 2583 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 11 18:48:14.744418 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735801 2583 flags.go:64] FLAG: --tls-min-version="" Sep 11 18:48:14.744418 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735806 2583 flags.go:64] FLAG: --tls-private-key-file="" Sep 11 18:48:14.744418 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735808 2583 flags.go:64] FLAG: --topology-manager-policy="none" Sep 11 18:48:14.744418 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735811 2583 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 11 18:48:14.744418 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735814 2583 flags.go:64] FLAG: --topology-manager-scope="container" Sep 11 18:48:14.744418 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735817 2583 flags.go:64] FLAG: --v="2" Sep 11 18:48:14.744418 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735821 2583 flags.go:64] FLAG: --version="false" Sep 11 18:48:14.745052 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735830 2583 flags.go:64] FLAG: --vmodule="" Sep 11 18:48:14.745052 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735834 2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 11 18:48:14.745052 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.735837 2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 11 18:48:14.745052 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735954 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 18:48:14.745052 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735958 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 18:48:14.745052 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735961 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 18:48:14.745052 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735964 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 18:48:14.745052 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735967 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 18:48:14.745052 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735969 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 18:48:14.745052 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735972 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 18:48:14.745052 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735974 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 18:48:14.745052 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735977 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 18:48:14.745052 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735980 2583 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 18:48:14.745052 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735982 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 18:48:14.745052 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735985 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 18:48:14.745052 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735987 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 18:48:14.745052 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735990 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 18:48:14.745052 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735992 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 18:48:14.745052 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735995 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 18:48:14.745052 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.735999 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 18:48:14.745554 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736003 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 18:48:14.745554 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736006 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 18:48:14.745554 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736009 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 18:48:14.745554 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736012 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 18:48:14.745554 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736015 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 18:48:14.745554 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736018 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 18:48:14.745554 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736023 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 18:48:14.745554 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736026 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 18:48:14.745554 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736030 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 18:48:14.745554 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736033 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 18:48:14.745554 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736036 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 18:48:14.745554 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736039 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 18:48:14.745554 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736042 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 18:48:14.745554 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736045 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 18:48:14.745554 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736048 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 18:48:14.745554 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736050 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 18:48:14.745554 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736053 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 18:48:14.745554 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736056 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 18:48:14.745554 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736059 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 18:48:14.745554 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736062 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 18:48:14.746043 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736065 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 18:48:14.746043 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736067 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 18:48:14.746043 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736070 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 18:48:14.746043 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736072 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 18:48:14.746043 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736075 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 18:48:14.746043 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736077 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 18:48:14.746043 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736080 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 18:48:14.746043 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736083 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 18:48:14.746043 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736085 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 18:48:14.746043 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736088 2583 feature_gate.go:328] unrecognized feature gate: Example Sep 11 18:48:14.746043 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736091 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 18:48:14.746043 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736093 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 18:48:14.746043 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736096 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 18:48:14.746043 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736098 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 18:48:14.746043 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736101 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 18:48:14.746043 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736104 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 18:48:14.746043 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736106 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 18:48:14.746043 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736109 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 18:48:14.746043 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736113 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 18:48:14.746043 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736116 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 18:48:14.746043 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736118 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 18:48:14.746725 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736121 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 18:48:14.746725 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736123 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 18:48:14.746725 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736126 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 18:48:14.746725 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736128 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 18:48:14.746725 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736131 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 18:48:14.746725 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736133 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 18:48:14.746725 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736136 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 18:48:14.746725 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736139 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 18:48:14.746725 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736142 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 18:48:14.746725 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736146 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 18:48:14.746725 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736149 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 18:48:14.746725 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736152 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 18:48:14.746725 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736155 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 18:48:14.746725 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736157 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 18:48:14.746725 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736160 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 18:48:14.746725 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736163 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 18:48:14.746725 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736165 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 18:48:14.746725 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736168 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 18:48:14.746725 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736170 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 18:48:14.747550 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736173 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 18:48:14.747550 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736175 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 18:48:14.747550 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736178 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 18:48:14.747550 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736180 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 18:48:14.747550 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736183 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 18:48:14.747550 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736186 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 18:48:14.747550 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736189 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 18:48:14.747550 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736191 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 18:48:14.747550 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736200 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 18:48:14.747550 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736203 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 18:48:14.747550 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736208 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 18:48:14.747550 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736210 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 18:48:14.747550 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736213 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 18:48:14.747550 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736215 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 18:48:14.747550 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736218 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 18:48:14.747550 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736221 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 18:48:14.747550 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736223 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 18:48:14.747550 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736226 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 18:48:14.747550 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736229 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 18:48:14.748373 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736231 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 18:48:14.748373 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736234 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 18:48:14.748373 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.736237 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 18:48:14.748373 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.736963 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 11 18:48:14.748638 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.748618 2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 11 18:48:14.748638 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.748638 2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 11 18:48:14.748740 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.748664 2583 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 11 18:48:14.748740 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.748678 2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 11 18:48:14.748836 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748761 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 18:48:14.748836 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748769 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 18:48:14.748836 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748774 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 18:48:14.748836 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748779 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 18:48:14.748836 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748783 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 18:48:14.748836 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748788 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 18:48:14.748836 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748793 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 18:48:14.748836 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748798 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 18:48:14.748836 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748803 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 18:48:14.748836 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748808 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 18:48:14.748836 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748812 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 18:48:14.748836 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748817 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 18:48:14.748836 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748821 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 18:48:14.748836 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748825 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 18:48:14.748836 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748830 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 18:48:14.748836 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748834 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 18:48:14.748836 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748838 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 18:48:14.748836 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748842 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 18:48:14.749633 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748847 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 18:48:14.749633 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748851 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 18:48:14.749633 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748855 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 18:48:14.749633 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748859 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 18:48:14.749633 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748864 2583 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 18:48:14.749633 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748869 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 18:48:14.749633 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748873 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 18:48:14.749633 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748877 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 18:48:14.749633 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748882 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 18:48:14.749633 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748886 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 18:48:14.749633 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748890 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 18:48:14.749633 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748894 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 18:48:14.749633 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748900 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 18:48:14.749633 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748907 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 18:48:14.749633 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748911 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 18:48:14.749633 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748916 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 18:48:14.749633 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748920 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 18:48:14.749633 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748924 2583 feature_gate.go:328] unrecognized feature gate: Example Sep 11 18:48:14.749633 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748928 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 18:48:14.749633 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748932 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 18:48:14.750418 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748936 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 18:48:14.750418 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748940 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 18:48:14.750418 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748944 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 18:48:14.750418 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748949 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 18:48:14.750418 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748953 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 18:48:14.750418 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748958 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 18:48:14.750418 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748962 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 18:48:14.750418 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748966 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 18:48:14.750418 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748971 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 18:48:14.750418 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748975 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 18:48:14.750418 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748982 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 18:48:14.750418 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748988 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 18:48:14.750418 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748993 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 18:48:14.750418 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.748998 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 18:48:14.750418 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749003 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 18:48:14.750418 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749008 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 18:48:14.750418 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749012 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 18:48:14.750418 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749017 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 18:48:14.750418 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749021 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 18:48:14.750971 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749025 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 18:48:14.750971 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749030 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 18:48:14.750971 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749034 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 18:48:14.750971 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749038 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 18:48:14.750971 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749042 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 18:48:14.750971 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749047 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 18:48:14.750971 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749051 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 18:48:14.750971 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749056 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 18:48:14.750971 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749060 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 18:48:14.750971 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749063 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 18:48:14.750971 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749068 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 18:48:14.750971 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749072 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 18:48:14.750971 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749077 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 18:48:14.750971 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749081 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 18:48:14.750971 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749085 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 18:48:14.750971 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749090 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 18:48:14.750971 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749094 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 18:48:14.750971 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749098 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 18:48:14.750971 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749102 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 18:48:14.750971 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749106 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 18:48:14.751650 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749111 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 18:48:14.751650 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749117 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 18:48:14.751650 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749121 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 18:48:14.751650 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749126 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 18:48:14.751650 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749130 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 18:48:14.751650 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749134 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 18:48:14.751650 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749139 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 18:48:14.751650 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749145 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 18:48:14.751650 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749151 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 18:48:14.751650 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749156 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 18:48:14.751650 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749161 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 18:48:14.751650 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749165 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 18:48:14.751650 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749170 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 18:48:14.751650 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749175 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 18:48:14.751650 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749180 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 18:48:14.751650 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749184 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 18:48:14.751650 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749189 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 18:48:14.751650 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749193 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 18:48:14.751650 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749198 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 18:48:14.752113 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749202 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 18:48:14.752113 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749207 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 18:48:14.752113 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749211 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 18:48:14.752113 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.749220 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 11 18:48:14.752113 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749436 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 18:48:14.752113 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749448 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 18:48:14.752113 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749453 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 18:48:14.752113 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749457 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 18:48:14.752113 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749462 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 18:48:14.752113 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749466 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 18:48:14.752113 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749471 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 18:48:14.752113 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749476 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 18:48:14.752113 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749481 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 18:48:14.752113 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749485 2583 feature_gate.go:328] unrecognized feature gate: Example Sep 11 18:48:14.752113 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749490 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 18:48:14.752638 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749499 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 18:48:14.752638 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749505 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 18:48:14.752638 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749510 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 18:48:14.752638 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749515 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 18:48:14.752638 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749520 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 18:48:14.752638 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749524 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 18:48:14.752638 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749529 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 18:48:14.752638 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749533 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 18:48:14.752638 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749537 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 18:48:14.752638 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749541 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 18:48:14.752638 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749545 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 18:48:14.752638 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749549 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 18:48:14.752638 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749554 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 18:48:14.752638 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749558 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 18:48:14.752638 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749562 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 18:48:14.752638 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749567 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 18:48:14.752638 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749571 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 18:48:14.752638 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749575 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 18:48:14.752638 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749580 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 18:48:14.752638 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749584 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 18:48:14.753124 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749588 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 18:48:14.753124 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749592 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 18:48:14.753124 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749596 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 18:48:14.753124 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749601 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 18:48:14.753124 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749605 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 18:48:14.753124 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749609 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 18:48:14.753124 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749614 2583 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 18:48:14.753124 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749618 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 18:48:14.753124 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749622 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 18:48:14.753124 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749626 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 18:48:14.753124 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749630 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 18:48:14.753124 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749634 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 18:48:14.753124 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749638 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 18:48:14.753124 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749643 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 18:48:14.753124 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749647 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 18:48:14.753124 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749652 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 18:48:14.753124 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749656 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 18:48:14.753124 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749660 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 18:48:14.753124 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749664 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 18:48:14.753124 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749669 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 18:48:14.753649 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749673 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 18:48:14.753649 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749677 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 18:48:14.753649 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749682 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 18:48:14.753649 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749686 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 18:48:14.753649 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749690 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 18:48:14.753649 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749694 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 18:48:14.753649 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749698 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 18:48:14.753649 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749702 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 18:48:14.753649 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749707 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 18:48:14.753649 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749711 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 18:48:14.753649 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749715 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 18:48:14.753649 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749719 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 18:48:14.753649 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749723 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 18:48:14.753649 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749728 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 18:48:14.753649 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749732 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 18:48:14.753649 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749736 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 18:48:14.753649 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749741 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 18:48:14.753649 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749745 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 18:48:14.753649 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749749 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 18:48:14.753649 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749753 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 18:48:14.754130 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749758 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 18:48:14.754130 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749762 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 18:48:14.754130 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749766 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 18:48:14.754130 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749771 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 18:48:14.754130 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749775 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 18:48:14.754130 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749779 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 18:48:14.754130 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749787 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 18:48:14.754130 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749792 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 18:48:14.754130 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749797 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 18:48:14.754130 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749801 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 18:48:14.754130 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749805 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 18:48:14.754130 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749810 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 18:48:14.754130 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749814 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 18:48:14.754130 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749817 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 18:48:14.754130 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749821 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 18:48:14.754130 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749826 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 18:48:14.754130 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749830 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 18:48:14.754130 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749834 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 18:48:14.754130 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749838 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 18:48:14.754130 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749842 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 18:48:14.754625 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749846 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 18:48:14.754625 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749850 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 18:48:14.754625 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749855 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 18:48:14.754625 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749859 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 18:48:14.754625 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749863 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 18:48:14.754625 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749869 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 18:48:14.754625 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749876 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 18:48:14.754625 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:14.749882 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 18:48:14.754625 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.749890 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 11 18:48:14.754625 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.750043 2583 server.go:962] "Client rotation is on, will bootstrap in background" Sep 11 18:48:14.754874 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.754674 2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 11 18:48:14.755708 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.755696 2583 server.go:1019] "Starting client certificate rotation" Sep 11 18:48:14.755806 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.755789 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 11 18:48:14.755838 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.755828 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 11 18:48:14.758532 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.758519 2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 11 18:48:14.759653 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.759637 2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 11 18:48:14.772538 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.772423 2583 log.go:25] "Validated CRI v1 runtime API" Sep 11 18:48:14.776996 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.776975 2583 log.go:25] "Validated CRI v1 image API" Sep 11 18:48:14.778493 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.778473 2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 11 18:48:14.783576 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.783556 2583 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9dc770e4-5ccb-4414-9f4d-59d67ae5d838:/dev/nvme0n1p3 b5e9cb0c-7642-4b48-9d2b-a1c48a68954c:/dev/nvme0n1p4] Sep 11 18:48:14.783639 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.783575 2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 11 18:48:14.787692 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.787675 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 11 18:48:14.788791 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.788688 2583 manager.go:216] Machine: {Timestamp:2026-09-11 18:48:14.788203381 +0000 UTC m=+0.367364434 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096747 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2eb68e59b2bd4e2182a9b4bf0f076f SystemUUID:ec2eb68e-59b2-bd4e-2182-a9b4bf0f076f BootID:90208845-30ad-48a3-a685-dd56f973a3c0 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5d:1e:ab:58:c3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5d:1e:ab:58:c3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:1c:e3:79:4c:5c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 11 18:48:14.788791 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.788790 2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 11 18:48:14.788898 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.788867 2583 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 11 18:48:14.791467 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.791442 2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 11 18:48:14.791600 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.791470 2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-25.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 11 18:48:14.792389 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.792368 2583 topology_manager.go:138] "Creating topology manager with none policy" Sep 11 18:48:14.792389 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.792391 2583 container_manager_linux.go:309] "Creating device plugin manager" Sep 11 18:48:14.792463 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.792399 2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 11 18:48:14.793208 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.793198 2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 11 18:48:14.794440 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.794430 2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 11 18:48:14.799111 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.799099 2583 state_mem.go:36] "Initialized new in-memory state store" Sep 11 18:48:14.799241 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.799231 2583 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 11 18:48:14.799271 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.799264 2583 kubelet.go:486] "Attempting to sync node with API server" Sep 11 18:48:14.799304 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.799274 2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 11 18:48:14.799304 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.799285 2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 11 18:48:14.799304 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.799294 2583 kubelet.go:398] "Adding apiserver pod source" Sep 11 18:48:14.799304 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.799303 2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 11 18:48:14.800392 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.800379 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 11 18:48:14.800448 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.800404 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 11 18:48:14.802794 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.802778 2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 11 18:48:14.805628 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.805615 2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 11 18:48:14.805672 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.805646 2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 11 18:48:14.807659 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.807647 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 11 18:48:14.807694 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.807670 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 11 18:48:14.807694 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.807679 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 11 18:48:14.807694 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.807687 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 11 18:48:14.807854 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.807699 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 11 18:48:14.807854 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.807710 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 11 18:48:14.807854 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.807729 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 11 18:48:14.807854 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.807737 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 11 18:48:14.807854 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.807746 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 11 18:48:14.807854 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.807754 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 11 18:48:14.807854 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.807782 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 11 18:48:14.807854 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.807792 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 11 18:48:14.807854 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.807821 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 11 18:48:14.807854 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.807829 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 11 18:48:14.809484 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.809458 2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-25.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 11 18:48:14.810190 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:14.810169 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 11 18:48:14.810232 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:14.810167 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-25.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 11 18:48:14.811784 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.811771 2583 server.go:1268] "Started kubelet" Sep 11 18:48:14.811917 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.811871 2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 11 18:48:14.811960 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.811938 2583 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 11 18:48:14.812624 ip-10-0-133-25 systemd[1]: Started Kubernetes Kubelet. Sep 11 18:48:14.812740 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.812657 2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 11 18:48:14.813593 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.813396 2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 11 18:48:14.814363 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.814333 2583 server.go:310] "Adding debug handlers to kubelet server" Sep 11 18:48:14.819318 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:14.819287 2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 11 18:48:14.822737 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.822721 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 11 18:48:14.823402 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.823383 2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 11 18:48:14.823538 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:14.823518 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-25.ec2.internal\" not found" Sep 11 18:48:14.824166 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.824149 2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 11 18:48:14.824166 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.824154 2583 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 11 18:48:14.824258 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.824176 2583 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 11 18:48:14.824293 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.824259 2583 reconstruct.go:97] "Volume reconstruction finished" Sep 11 18:48:14.824293 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.824266 2583 reconciler.go:29] "Reconciler: start to sync state" Sep 11 18:48:14.824718 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.824697 2583 factory.go:55] Registering systemd factory Sep 11 18:48:14.824718 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.824717 2583 factory.go:223] Registration of the systemd container factory successfully Sep 11 18:48:14.824919 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.824907 2583 factory.go:153] Registering CRI-O factory Sep 11 18:48:14.824954 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.824922 2583 factory.go:223] Registration of the crio container factory successfully Sep 11 18:48:14.824986 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.824975 2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 11 18:48:14.825016 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.824991 2583 factory.go:103] Registering Raw factory Sep 11 18:48:14.825016 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.825001 2583 manager.go:1196] Started watching for new ooms in manager Sep 11 18:48:14.825432 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.825416 2583 manager.go:349] Starting recovery of all containers Sep 11 18:48:14.829126 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:14.825393 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-25.ec2.internal.18d458b6f6420b83 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-25.ec2.internal,UID:ip-10-0-133-25.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-25.ec2.internal,},FirstTimestamp:2026-09-11 18:48:14.811745155 +0000 UTC m=+0.390906208,LastTimestamp:2026-09-11 18:48:14.811745155 +0000 UTC m=+0.390906208,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-25.ec2.internal,}" Sep 11 18:48:14.829573 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:14.829548 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 11 18:48:14.829686 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:14.829547 2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-25.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 11 18:48:14.840606 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.840591 2583 manager.go:354] Recovery completed Sep 11 18:48:14.845796 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.845783 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 18:48:14.847304 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.847282 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cnjls" Sep 11 18:48:14.847502 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.847486 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasSufficientMemory" Sep 11 18:48:14.847590 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.847521 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 18:48:14.847590 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.847538 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasSufficientPID" Sep 11 18:48:14.848128 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.848112 2583 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 11 18:48:14.848128 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.848123 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 18:48:14.848128 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.848129 2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 11 18:48:14.848253 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.848143 2583 state_mem.go:36] "Initialized new in-memory state store" Sep 11 18:48:14.848790 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.848774 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasSufficientMemory" Sep 11 18:48:14.848876 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.848805 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 18:48:14.848876 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.848819 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasSufficientPID" Sep 11 18:48:14.850285 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.850271 2583 policy_none.go:49] "None policy: Start" Sep 11 18:48:14.850340 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.850288 2583 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 11 18:48:14.850340 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.850298 2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 11 18:48:14.852269 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.852255 2583 policy_none.go:47] "Start" Sep 11 18:48:14.856596 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:14.856516 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-25.ec2.internal.18d458b6f863b085 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-25.ec2.internal,UID:ip-10-0-133-25.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-25.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-25.ec2.internal,},FirstTimestamp:2026-09-11 18:48:14.847504517 +0000 UTC m=+0.426665574,LastTimestamp:2026-09-11 18:48:14.847504517 +0000 UTC m=+0.426665574,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-25.ec2.internal,}" Sep 11 18:48:14.858835 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.858818 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cnjls" Sep 11 18:48:14.899262 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.883936 2583 manager.go:337] "Starting Device Plugin manager" Sep 11 18:48:14.899262 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:14.883969 2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 11 18:48:14.899262 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.883981 2583 server.go:87] "Starting device plugin registration server" Sep 11 18:48:14.899262 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.884279 2583 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 11 18:48:14.899262 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.884293 2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 11 18:48:14.899262 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.884496 2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 11 18:48:14.899262 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.884595 2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 11 18:48:14.899262 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.884606 2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 11 18:48:14.899262 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:14.885051 2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 11 18:48:14.899262 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:14.885100 2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-25.ec2.internal\" not found" Sep 11 18:48:14.950758 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.950711 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 11 18:48:14.952142 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.952125 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 11 18:48:14.952209 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.952181 2583 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 11 18:48:14.952209 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.952208 2583 kubelet.go:2448] "Starting kubelet main sync loop" Sep 11 18:48:14.952299 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:14.952254 2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 11 18:48:14.955009 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.954992 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 18:48:14.985492 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.985401 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 18:48:14.986405 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.986389 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasSufficientMemory" Sep 11 18:48:14.986510 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.986422 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 18:48:14.986510 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.986436 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasSufficientPID" Sep 11 18:48:14.986510 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.986463 2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-25.ec2.internal" Sep 11 18:48:14.995855 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:14.995836 2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-25.ec2.internal" Sep 11 18:48:14.995920 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:14.995859 2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-25.ec2.internal\": node \"ip-10-0-133-25.ec2.internal\" not found" Sep 11 18:48:15.051546 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:15.051519 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-25.ec2.internal\" not found" Sep 11 18:48:15.052526 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:15.052511 2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-25.ec2.internal"] Sep 11 18:48:15.052579 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:15.052571 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 18:48:15.054089 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:15.054063 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasSufficientMemory" Sep 11 18:48:15.054089 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:15.054093 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 18:48:15.054238 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:15.054106 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasSufficientPID" Sep 11 18:48:15.056480 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:15.056468 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 18:48:15.056933 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:15.056916 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal" Sep 11 18:48:15.057016 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:15.056945 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 18:48:15.057255 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:15.057228 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasSufficientMemory" Sep 11 18:48:15.057305 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:15.057260 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 18:48:15.057305 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:15.057273 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasSufficientPID" Sep 11 18:48:15.057651 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:15.057634 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasSufficientMemory" Sep 11 18:48:15.057742 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:15.057658 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 18:48:15.057742 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:15.057673 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasSufficientPID" Sep 11 18:48:15.059506 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:15.059489 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-25.ec2.internal" Sep 11 18:48:15.059607 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:15.059518 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 18:48:15.060262 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:15.060247 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasSufficientMemory" Sep 11 18:48:15.060335 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:15.060278 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 18:48:15.060335 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:15.060293 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasSufficientPID" Sep 11 18:48:15.083899 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:15.083879 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-25.ec2.internal\" not found" node="ip-10-0-133-25.ec2.internal" Sep 11 18:48:15.088548 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:15.088533 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-25.ec2.internal\" not found" node="ip-10-0-133-25.ec2.internal" Sep 11 18:48:15.125773 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:15.125745 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71a1dd5c650117ac0b955acbf1e0db7c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal\" (UID: \"71a1dd5c650117ac0b955acbf1e0db7c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal" Sep 11 18:48:15.125868 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:15.125802 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0c8d5dd7e1a7979f39ff552b2657e9d3-config\") pod \"kube-apiserver-proxy-ip-10-0-133-25.ec2.internal\" (UID: \"0c8d5dd7e1a7979f39ff552b2657e9d3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-25.ec2.internal" Sep 11 18:48:15.125868 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:15.125824 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71a1dd5c650117ac0b955acbf1e0db7c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal\" (UID: \"71a1dd5c650117ac0b955acbf1e0db7c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal" Sep 11 18:48:15.151783 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:15.151761 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-25.ec2.internal\" not found" Sep 11 18:48:15.226248 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:15.226210 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0c8d5dd7e1a7979f39ff552b2657e9d3-config\") pod \"kube-apiserver-proxy-ip-10-0-133-25.ec2.internal\" (UID: \"0c8d5dd7e1a7979f39ff552b2657e9d3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-25.ec2.internal" Sep 11 18:48:15.227808 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:15.226130 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0c8d5dd7e1a7979f39ff552b2657e9d3-config\") pod \"kube-apiserver-proxy-ip-10-0-133-25.ec2.internal\" (UID: \"0c8d5dd7e1a7979f39ff552b2657e9d3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-25.ec2.internal" Sep 11 18:48:15.227808 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:15.226543 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71a1dd5c650117ac0b955acbf1e0db7c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal\" (UID: \"71a1dd5c650117ac0b955acbf1e0db7c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal" Sep 11 18:48:15.227808 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:15.226584 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71a1dd5c650117ac0b955acbf1e0db7c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal\" (UID: \"71a1dd5c650117ac0b955acbf1e0db7c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal" Sep 11 18:48:15.227808 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:15.226632 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71a1dd5c650117ac0b955acbf1e0db7c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal\" (UID: \"71a1dd5c650117ac0b955acbf1e0db7c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal" Sep 11 18:48:15.227808 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:15.226674 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71a1dd5c650117ac0b955acbf1e0db7c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal\" (UID: \"71a1dd5c650117ac0b955acbf1e0db7c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal" Sep 11 18:48:15.251936 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:15.251877 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-25.ec2.internal\" not found" Sep 11 18:48:15.352158 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:15.352125 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-25.ec2.internal\" not found" Sep 11 18:48:15.386318 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:15.386295 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal" Sep 11 18:48:15.391156 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:15.391063 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-25.ec2.internal" Sep 11 18:48:16.852364 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:16.852325 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-25.ec2.internal\" not found" Sep 11 18:48:16.952842 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:16.952765 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-25.ec2.internal\" not found" Sep 11 18:48:17.053346 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:17.053319 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-25.ec2.internal\" not found" Sep 11 18:48:17.066621 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:17.066595 2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 18:48:17.089590 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:17.089568 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 18:48:17.154070 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:17.154042 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-25.ec2.internal\" not found" Sep 11 18:48:17.155137 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:17.155120 2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 11 18:48:17.155277 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:17.155255 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 11 18:48:17.155330 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:17.155276 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 11 18:48:17.155330 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:17.155300 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 11 18:48:17.254920 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:17.254754 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-25.ec2.internal\" not found" Sep 11 18:48:17.263915 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:17.263884 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 18:43:16 +0000 UTC" deadline="2028-05-13 07:08:09.378969957 +0000 UTC" Sep 11 18:48:17.263915 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:17.263912 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14628h19m52.115061406s" Sep 11 18:48:17.270055 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:17.270039 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 18:48:17.271189 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:17.271172 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasSufficientMemory" Sep 11 18:48:17.271256 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:17.271200 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 18:48:17.271256 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:17.271210 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeHasSufficientPID" Sep 11 18:48:17.355199 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:17.355173 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-25.ec2.internal\" not found" Sep 11 18:48:17.359660 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:17.359617 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c8d5dd7e1a7979f39ff552b2657e9d3.slice/crio-43c9aab5f8aafbc6b4aa0e70d16fad20227cd6f776c0ba3c8cfa9dd069fe37b3 WatchSource:0}: Error finding container 43c9aab5f8aafbc6b4aa0e70d16fad20227cd6f776c0ba3c8cfa9dd069fe37b3: Status 404 returned error can't find the container with id 43c9aab5f8aafbc6b4aa0e70d16fad20227cd6f776c0ba3c8cfa9dd069fe37b3 Sep 11 18:48:17.359952 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:17.359933 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a1dd5c650117ac0b955acbf1e0db7c.slice/crio-0b1d6985864806064de1df22adaf190384915daac42ccdadfc62ad83fa710718 WatchSource:0}: Error finding container 0b1d6985864806064de1df22adaf190384915daac42ccdadfc62ad83fa710718: Status 404 returned error can't find the container with id 0b1d6985864806064de1df22adaf190384915daac42ccdadfc62ad83fa710718 Sep 11 18:48:17.364306 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:17.364292 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 11 18:48:17.455730 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:17.455640 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-25.ec2.internal\" not found" Sep 11 18:48:17.486989 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:17.486968 2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 18:48:17.523134 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:17.523110 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal" Sep 11 18:48:17.537654 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:17.537634 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 11 18:48:17.538400 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:17.538387 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-25.ec2.internal" Sep 11 18:48:17.551017 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:17.550994 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 11 18:48:18.042728 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.042693 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 18:48:18.200107 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.200074 2583 apiserver.go:52] "Watching apiserver" Sep 11 18:48:18.209728 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.209698 2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 11 18:48:18.210116 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.210081 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-kltxq","kube-system/konnectivity-agent-zsn78","kube-system/kube-apiserver-proxy-ip-10-0-133-25.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhbrj","openshift-image-registry/node-ca-8w6hj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal","openshift-multus/multus-vk2x8","openshift-network-operator/iptables-alerter-d4zx8","openshift-cluster-node-tuning-operator/tuned-lfnmv","openshift-dns/node-resolver-c7t7x","openshift-multus/multus-additional-cni-plugins-tdxsn","openshift-multus/network-metrics-daemon-gl55g","openshift-network-diagnostics/network-check-target-ndw4m","openshift-ovn-kubernetes/ovnkube-node-6cqpn"] Sep 11 18:48:18.212707 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.212682 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.215093 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.214830 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:48:18.215093 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:18.214903 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndw4m" podUID="ba212e38-0ab7-4e51-a8a3-fb8efcc87945" Sep 11 18:48:18.215798 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.215607 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 11 18:48:18.215798 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.215630 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 11 18:48:18.215798 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.215608 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 11 18:48:18.215798 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.215686 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bsgxk\"" Sep 11 18:48:18.215798 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.215637 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 11 18:48:18.217369 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.217228 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.219491 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.219472 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhbrj" Sep 11 18:48:18.220141 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.220119 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 11 18:48:18.220247 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.220152 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 11 18:48:18.222488 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.221678 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 11 18:48:18.222488 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.221712 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 11 18:48:18.222488 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.221734 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vjgf8\"" Sep 11 18:48:18.222488 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.221776 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 11 18:48:18.222488 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.222015 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 11 18:48:18.222488 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.222143 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 11 18:48:18.222488 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.222268 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 11 18:48:18.223171 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.222521 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 11 18:48:18.223604 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.223415 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hszbn\"" Sep 11 18:48:18.223966 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.223820 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 11 18:48:18.227120 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.227097 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8w6hj" Sep 11 18:48:18.229507 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.229114 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d4zx8" Sep 11 18:48:18.230199 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.230180 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 11 18:48:18.230288 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.230242 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5dztz\"" Sep 11 18:48:18.230352 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.230183 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 11 18:48:18.230402 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.230183 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 11 18:48:18.231311 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.231214 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.231856 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.231834 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 11 18:48:18.231948 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.231835 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 11 18:48:18.233331 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.233311 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:18.233448 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:18.233426 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kltxq" podUID="06964030-e916-4d42-a39f-96727c8c77a1" Sep 11 18:48:18.234144 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.233856 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-z88kt\"" Sep 11 18:48:18.234144 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.234003 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 11 18:48:18.234392 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.234364 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vc48c\"" Sep 11 18:48:18.234618 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.234602 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 11 18:48:18.234760 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.234741 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-system-cni-dir\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.234839 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.234776 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-host-run-k8s-cni-cncf-io\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.234839 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.234800 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-multus-conf-dir\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.234839 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.234824 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-host-kubelet\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.234991 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.234863 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-host-slash\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.234991 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.234894 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-var-lib-openvswitch\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.234991 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.234919 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-host-run-netns\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.234991 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.234945 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-etc-openvswitch\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.234991 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.234966 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-host-cni-netd\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.235216 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235011 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.235216 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235036 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/42cf544f-ba18-4ec6-ac81-fa3b106949a9-ovn-node-metrics-cert\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.235216 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235058 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf4m2\" (UniqueName: \"kubernetes.io/projected/42cf544f-ba18-4ec6-ac81-fa3b106949a9-kube-api-access-pf4m2\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.235216 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235080 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3d14dfd0-53b3-444d-8c92-f75d361e7a7f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jhbrj\" (UID: \"3d14dfd0-53b3-444d-8c92-f75d361e7a7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhbrj" Sep 11 18:48:18.235216 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235131 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3d14dfd0-53b3-444d-8c92-f75d361e7a7f-registration-dir\") pod \"aws-ebs-csi-driver-node-jhbrj\" (UID: \"3d14dfd0-53b3-444d-8c92-f75d361e7a7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhbrj" Sep 11 18:48:18.235216 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235183 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3d14dfd0-53b3-444d-8c92-f75d361e7a7f-etc-selinux\") pod \"aws-ebs-csi-driver-node-jhbrj\" (UID: \"3d14dfd0-53b3-444d-8c92-f75d361e7a7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhbrj" Sep 11 18:48:18.235216 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235209 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3d14dfd0-53b3-444d-8c92-f75d361e7a7f-sys-fs\") pod \"aws-ebs-csi-driver-node-jhbrj\" (UID: \"3d14dfd0-53b3-444d-8c92-f75d361e7a7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhbrj" Sep 11 18:48:18.235536 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235239 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb79h\" (UniqueName: \"kubernetes.io/projected/074bae97-de81-4f57-ba67-4790e60c0f2a-kube-api-access-sb79h\") pod \"node-ca-8w6hj\" (UID: \"074bae97-de81-4f57-ba67-4790e60c0f2a\") " pod="openshift-image-registry/node-ca-8w6hj" Sep 11 18:48:18.235536 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235252 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 11 18:48:18.235536 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235263 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-cnibin\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.235536 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235337 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/67efd0ce-7b5b-4d41-97e2-b166489e08e9-cni-binary-copy\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.235536 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235355 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-host-var-lib-cni-bin\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.235536 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235370 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq28z\" (UniqueName: \"kubernetes.io/projected/67efd0ce-7b5b-4d41-97e2-b166489e08e9-kube-api-access-kq28z\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.235536 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235411 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/42cf544f-ba18-4ec6-ac81-fa3b106949a9-ovnkube-config\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.235536 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235443 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/42cf544f-ba18-4ec6-ac81-fa3b106949a9-ovnkube-script-lib\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.235536 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235472 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3d14dfd0-53b3-444d-8c92-f75d361e7a7f-device-dir\") pod \"aws-ebs-csi-driver-node-jhbrj\" (UID: \"3d14dfd0-53b3-444d-8c92-f75d361e7a7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhbrj" Sep 11 18:48:18.235536 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235495 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/074bae97-de81-4f57-ba67-4790e60c0f2a-serviceca\") pod \"node-ca-8w6hj\" (UID: \"074bae97-de81-4f57-ba67-4790e60c0f2a\") " pod="openshift-image-registry/node-ca-8w6hj" Sep 11 18:48:18.235536 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235519 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-host-var-lib-kubelet\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.235536 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235541 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-systemd-units\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.236152 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235562 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-run-systemd\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.236152 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235604 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-run-openvswitch\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.236152 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235626 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-run-ovn\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.236152 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235648 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-node-log\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.236152 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235671 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-host-cni-bin\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.236152 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235693 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-etc-kubernetes\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.236152 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235715 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5594\" (UniqueName: \"kubernetes.io/projected/ba212e38-0ab7-4e51-a8a3-fb8efcc87945-kube-api-access-m5594\") pod \"network-check-target-ndw4m\" (UID: \"ba212e38-0ab7-4e51-a8a3-fb8efcc87945\") " pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:48:18.236152 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235738 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-host-run-netns\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.236152 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235761 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-log-socket\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.236152 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235813 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-host-run-ovn-kubernetes\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.236152 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235863 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbgxz\" (UniqueName: \"kubernetes.io/projected/3d14dfd0-53b3-444d-8c92-f75d361e7a7f-kube-api-access-hbgxz\") pod \"aws-ebs-csi-driver-node-jhbrj\" (UID: \"3d14dfd0-53b3-444d-8c92-f75d361e7a7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhbrj" Sep 11 18:48:18.236152 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235895 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-host-var-lib-cni-multus\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.236152 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235918 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-hostroot\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.236152 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235922 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zsn78" Sep 11 18:48:18.236152 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.235954 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3d14dfd0-53b3-444d-8c92-f75d361e7a7f-socket-dir\") pod \"aws-ebs-csi-driver-node-jhbrj\" (UID: \"3d14dfd0-53b3-444d-8c92-f75d361e7a7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhbrj" Sep 11 18:48:18.236849 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.236178 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/074bae97-de81-4f57-ba67-4790e60c0f2a-host\") pod \"node-ca-8w6hj\" (UID: \"074bae97-de81-4f57-ba67-4790e60c0f2a\") " pod="openshift-image-registry/node-ca-8w6hj" Sep 11 18:48:18.236849 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.236204 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-multus-cni-dir\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.236849 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.236229 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-multus-socket-dir-parent\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.236849 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.236253 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/67efd0ce-7b5b-4d41-97e2-b166489e08e9-multus-daemon-config\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.236849 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.236277 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-host-run-multus-certs\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.236849 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.236340 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/42cf544f-ba18-4ec6-ac81-fa3b106949a9-env-overrides\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.238953 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.238356 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c7t7x" Sep 11 18:48:18.239873 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.239447 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 11 18:48:18.239873 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.239668 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-s52vw\"" Sep 11 18:48:18.239873 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.239705 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 11 18:48:18.240425 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.240397 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 11 18:48:18.241629 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.241091 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tdxsn" Sep 11 18:48:18.241629 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.241454 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 11 18:48:18.242003 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.241988 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vpcgl\"" Sep 11 18:48:18.242249 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.242229 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 11 18:48:18.243465 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.243449 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:48:18.243560 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:18.243513 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl55g" podUID="bb6e0205-703f-4dec-af35-283ccc740b37" Sep 11 18:48:18.244472 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.244024 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 11 18:48:18.244472 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.244081 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 11 18:48:18.244472 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.244368 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kb6wd\"" Sep 11 18:48:18.271100 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.271074 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7prwv" Sep 11 18:48:18.280085 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.280064 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7prwv" Sep 11 18:48:18.325027 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.324959 2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 11 18:48:18.336658 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.336628 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5594\" (UniqueName: \"kubernetes.io/projected/ba212e38-0ab7-4e51-a8a3-fb8efcc87945-kube-api-access-m5594\") pod \"network-check-target-ndw4m\" (UID: \"ba212e38-0ab7-4e51-a8a3-fb8efcc87945\") " pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:48:18.336800 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.336670 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-host-run-netns\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.336800 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.336759 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-host-run-netns\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.336927 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.336803 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbgxz\" (UniqueName: \"kubernetes.io/projected/3d14dfd0-53b3-444d-8c92-f75d361e7a7f-kube-api-access-hbgxz\") pod \"aws-ebs-csi-driver-node-jhbrj\" (UID: \"3d14dfd0-53b3-444d-8c92-f75d361e7a7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhbrj" Sep 11 18:48:18.336927 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.336855 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-etc-sysctl-d\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.336927 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.336884 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-hostroot\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.337103 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.336931 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3d14dfd0-53b3-444d-8c92-f75d361e7a7f-socket-dir\") pod \"aws-ebs-csi-driver-node-jhbrj\" (UID: \"3d14dfd0-53b3-444d-8c92-f75d361e7a7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhbrj" Sep 11 18:48:18.337103 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.336978 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-hostroot\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.337103 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.336986 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-host-run-multus-certs\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.337103 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337041 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/06964030-e916-4d42-a39f-96727c8c77a1-dbus\") pod \"global-pull-secret-syncer-kltxq\" (UID: \"06964030-e916-4d42-a39f-96727c8c77a1\") " pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:18.337103 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337073 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-host-kubelet\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.337103 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337100 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-etc-openvswitch\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.337380 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337120 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3d14dfd0-53b3-444d-8c92-f75d361e7a7f-socket-dir\") pod \"aws-ebs-csi-driver-node-jhbrj\" (UID: \"3d14dfd0-53b3-444d-8c92-f75d361e7a7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhbrj" Sep 11 18:48:18.337380 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337130 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/42cf544f-ba18-4ec6-ac81-fa3b106949a9-ovn-node-metrics-cert\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.337380 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337162 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3d14dfd0-53b3-444d-8c92-f75d361e7a7f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jhbrj\" (UID: \"3d14dfd0-53b3-444d-8c92-f75d361e7a7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhbrj" Sep 11 18:48:18.337380 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337180 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-host-kubelet\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.337380 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337198 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-etc-openvswitch\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.337380 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337215 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2lx6\" (UniqueName: \"kubernetes.io/projected/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-kube-api-access-m2lx6\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.337380 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337165 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-host-run-multus-certs\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.337380 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337278 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3d14dfd0-53b3-444d-8c92-f75d361e7a7f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jhbrj\" (UID: \"3d14dfd0-53b3-444d-8c92-f75d361e7a7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhbrj" Sep 11 18:48:18.337380 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337304 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-run\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.337380 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337326 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-var-lib-kubelet\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.337380 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337353 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b54490f-a110-4af8-b98c-3bc94b89030b-system-cni-dir\") pod \"multus-additional-cni-plugins-tdxsn\" (UID: \"0b54490f-a110-4af8-b98c-3bc94b89030b\") " pod="openshift-multus/multus-additional-cni-plugins-tdxsn" Sep 11 18:48:18.337957 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337377 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3d14dfd0-53b3-444d-8c92-f75d361e7a7f-etc-selinux\") pod \"aws-ebs-csi-driver-node-jhbrj\" (UID: \"3d14dfd0-53b3-444d-8c92-f75d361e7a7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhbrj" Sep 11 18:48:18.337957 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337429 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb79h\" (UniqueName: \"kubernetes.io/projected/074bae97-de81-4f57-ba67-4790e60c0f2a-kube-api-access-sb79h\") pod \"node-ca-8w6hj\" (UID: \"074bae97-de81-4f57-ba67-4790e60c0f2a\") " pod="openshift-image-registry/node-ca-8w6hj" Sep 11 18:48:18.337957 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337459 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-etc-systemd\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.337957 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337498 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3d14dfd0-53b3-444d-8c92-f75d361e7a7f-etc-selinux\") pod \"aws-ebs-csi-driver-node-jhbrj\" (UID: \"3d14dfd0-53b3-444d-8c92-f75d361e7a7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhbrj" Sep 11 18:48:18.337957 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337483 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2d05796-e12c-4be6-a44b-f221b91594e3-konnectivity-ca\") pod \"konnectivity-agent-zsn78\" (UID: \"d2d05796-e12c-4be6-a44b-f221b91594e3\") " pod="kube-system/konnectivity-agent-zsn78" Sep 11 18:48:18.337957 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337536 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b54490f-a110-4af8-b98c-3bc94b89030b-cni-binary-copy\") pod \"multus-additional-cni-plugins-tdxsn\" (UID: \"0b54490f-a110-4af8-b98c-3bc94b89030b\") " pod="openshift-multus/multus-additional-cni-plugins-tdxsn" Sep 11 18:48:18.337957 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337563 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-cnibin\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.337957 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337621 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-host-var-lib-cni-bin\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.337957 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337645 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/42cf544f-ba18-4ec6-ac81-fa3b106949a9-ovnkube-script-lib\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.337957 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337647 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-cnibin\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.337957 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337671 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjzs4\" (UniqueName: \"kubernetes.io/projected/df77fbc6-2613-4a23-b1da-c0dd94f680eb-kube-api-access-pjzs4\") pod \"node-resolver-c7t7x\" (UID: \"df77fbc6-2613-4a23-b1da-c0dd94f680eb\") " pod="openshift-dns/node-resolver-c7t7x" Sep 11 18:48:18.337957 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337690 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-host-var-lib-cni-bin\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.337957 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337695 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-etc-kubernetes\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.337957 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337718 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-etc-sysctl-conf\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.337957 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337784 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-host\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.337957 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337832 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-host-var-lib-kubelet\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.337957 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337881 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-host-var-lib-kubelet\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.338753 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337897 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-systemd-units\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.338753 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337926 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-run-openvswitch\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.338753 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337941 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-systemd-units\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.338753 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337950 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b54490f-a110-4af8-b98c-3bc94b89030b-cnibin\") pod \"multus-additional-cni-plugins-tdxsn\" (UID: \"0b54490f-a110-4af8-b98c-3bc94b89030b\") " pod="openshift-multus/multus-additional-cni-plugins-tdxsn" Sep 11 18:48:18.338753 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.337995 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-log-socket\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.338753 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.338023 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-log-socket\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.338753 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.338001 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-run-openvswitch\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.338753 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.338032 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-host-run-ovn-kubernetes\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.338753 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.338057 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-host-run-ovn-kubernetes\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.338753 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.338065 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50cbb7b2-fa0c-4628-8940-2bee31f3a80d-host-slash\") pod \"iptables-alerter-d4zx8\" (UID: \"50cbb7b2-fa0c-4628-8940-2bee31f3a80d\") " pod="openshift-network-operator/iptables-alerter-d4zx8" Sep 11 18:48:18.338753 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.338082 2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 11 18:48:18.338753 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.338096 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-tmp\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.338753 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.338122 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b54490f-a110-4af8-b98c-3bc94b89030b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tdxsn\" (UID: \"0b54490f-a110-4af8-b98c-3bc94b89030b\") " pod="openshift-multus/multus-additional-cni-plugins-tdxsn" Sep 11 18:48:18.338753 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.338148 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-host-var-lib-cni-multus\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.338753 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.338170 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/074bae97-de81-4f57-ba67-4790e60c0f2a-host\") pod \"node-ca-8w6hj\" (UID: \"074bae97-de81-4f57-ba67-4790e60c0f2a\") " pod="openshift-image-registry/node-ca-8w6hj" Sep 11 18:48:18.338753 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.338193 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb6e0205-703f-4dec-af35-283ccc740b37-metrics-certs\") pod \"network-metrics-daemon-gl55g\" (UID: \"bb6e0205-703f-4dec-af35-283ccc740b37\") " pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:48:18.338753 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.338236 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/42cf544f-ba18-4ec6-ac81-fa3b106949a9-ovnkube-script-lib\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.338753 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.338748 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/074bae97-de81-4f57-ba67-4790e60c0f2a-host\") pod \"node-ca-8w6hj\" (UID: \"074bae97-de81-4f57-ba67-4790e60c0f2a\") " pod="openshift-image-registry/node-ca-8w6hj" Sep 11 18:48:18.339592 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.338238 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-etc-sysconfig\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.339592 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.338220 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-host-var-lib-cni-multus\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.339592 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.338818 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0b54490f-a110-4af8-b98c-3bc94b89030b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tdxsn\" (UID: \"0b54490f-a110-4af8-b98c-3bc94b89030b\") " pod="openshift-multus/multus-additional-cni-plugins-tdxsn" Sep 11 18:48:18.339592 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.338864 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-multus-cni-dir\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.339592 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.338933 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-multus-socket-dir-parent\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.339592 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.338965 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/67efd0ce-7b5b-4d41-97e2-b166489e08e9-multus-daemon-config\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.339592 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.338994 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/42cf544f-ba18-4ec6-ac81-fa3b106949a9-env-overrides\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.339592 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.339064 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-multus-cni-dir\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.339592 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.339069 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-multus-socket-dir-parent\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.339592 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.339205 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-etc-modprobe-d\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.339592 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.339249 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2d05796-e12c-4be6-a44b-f221b91594e3-agent-certs\") pod \"konnectivity-agent-zsn78\" (UID: \"d2d05796-e12c-4be6-a44b-f221b91594e3\") " pod="kube-system/konnectivity-agent-zsn78" Sep 11 18:48:18.339592 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.339283 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0b54490f-a110-4af8-b98c-3bc94b89030b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tdxsn\" (UID: \"0b54490f-a110-4af8-b98c-3bc94b89030b\") " pod="openshift-multus/multus-additional-cni-plugins-tdxsn" Sep 11 18:48:18.339592 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.339319 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3d14dfd0-53b3-444d-8c92-f75d361e7a7f-device-dir\") pod \"aws-ebs-csi-driver-node-jhbrj\" (UID: \"3d14dfd0-53b3-444d-8c92-f75d361e7a7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhbrj" Sep 11 18:48:18.339592 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.339349 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/074bae97-de81-4f57-ba67-4790e60c0f2a-serviceca\") pod \"node-ca-8w6hj\" (UID: \"074bae97-de81-4f57-ba67-4790e60c0f2a\") " pod="openshift-image-registry/node-ca-8w6hj" Sep 11 18:48:18.339592 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.339384 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9dg4\" (UniqueName: \"kubernetes.io/projected/50cbb7b2-fa0c-4628-8940-2bee31f3a80d-kube-api-access-t9dg4\") pod \"iptables-alerter-d4zx8\" (UID: \"50cbb7b2-fa0c-4628-8940-2bee31f3a80d\") " pod="openshift-network-operator/iptables-alerter-d4zx8" Sep 11 18:48:18.339592 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.339410 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-system-cni-dir\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.339592 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.339439 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-host-run-k8s-cni-cncf-io\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.340330 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.339467 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-multus-conf-dir\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.340330 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.339496 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-host-slash\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.340330 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.339519 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-var-lib-openvswitch\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.340330 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.339547 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-host-run-netns\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.340330 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.339563 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/42cf544f-ba18-4ec6-ac81-fa3b106949a9-env-overrides\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.340330 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.339649 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-host-cni-netd\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.340330 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.339601 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/67efd0ce-7b5b-4d41-97e2-b166489e08e9-multus-daemon-config\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.340330 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.339708 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-system-cni-dir\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.340330 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.339745 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-var-lib-openvswitch\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.340330 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.339598 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-host-cni-netd\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.340330 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.339756 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-host-run-k8s-cni-cncf-io\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.340330 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.339791 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-host-run-netns\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.340330 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.339814 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-multus-conf-dir\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.340330 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.339852 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3d14dfd0-53b3-444d-8c92-f75d361e7a7f-device-dir\") pod \"aws-ebs-csi-driver-node-jhbrj\" (UID: \"3d14dfd0-53b3-444d-8c92-f75d361e7a7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhbrj" Sep 11 18:48:18.340330 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.339928 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.340330 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.339960 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf4m2\" (UniqueName: \"kubernetes.io/projected/42cf544f-ba18-4ec6-ac81-fa3b106949a9-kube-api-access-pf4m2\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.340330 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.339988 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3d14dfd0-53b3-444d-8c92-f75d361e7a7f-registration-dir\") pod \"aws-ebs-csi-driver-node-jhbrj\" (UID: \"3d14dfd0-53b3-444d-8c92-f75d361e7a7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhbrj" Sep 11 18:48:18.341076 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.340013 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3d14dfd0-53b3-444d-8c92-f75d361e7a7f-sys-fs\") pod \"aws-ebs-csi-driver-node-jhbrj\" (UID: \"3d14dfd0-53b3-444d-8c92-f75d361e7a7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhbrj" Sep 11 18:48:18.341076 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.340041 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/50cbb7b2-fa0c-4628-8940-2bee31f3a80d-iptables-alerter-script\") pod \"iptables-alerter-d4zx8\" (UID: \"50cbb7b2-fa0c-4628-8940-2bee31f3a80d\") " pod="openshift-network-operator/iptables-alerter-d4zx8" Sep 11 18:48:18.341076 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.340069 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/06964030-e916-4d42-a39f-96727c8c77a1-kubelet-config\") pod \"global-pull-secret-syncer-kltxq\" (UID: \"06964030-e916-4d42-a39f-96727c8c77a1\") " pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:18.341076 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.340097 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06964030-e916-4d42-a39f-96727c8c77a1-original-pull-secret\") pod \"global-pull-secret-syncer-kltxq\" (UID: \"06964030-e916-4d42-a39f-96727c8c77a1\") " pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:18.341076 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.340119 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/df77fbc6-2613-4a23-b1da-c0dd94f680eb-hosts-file\") pod \"node-resolver-c7t7x\" (UID: \"df77fbc6-2613-4a23-b1da-c0dd94f680eb\") " pod="openshift-dns/node-resolver-c7t7x" Sep 11 18:48:18.341076 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.340146 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6gql\" (UniqueName: \"kubernetes.io/projected/0b54490f-a110-4af8-b98c-3bc94b89030b-kube-api-access-j6gql\") pod \"multus-additional-cni-plugins-tdxsn\" (UID: \"0b54490f-a110-4af8-b98c-3bc94b89030b\") " pod="openshift-multus/multus-additional-cni-plugins-tdxsn" Sep 11 18:48:18.341076 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.340175 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/67efd0ce-7b5b-4d41-97e2-b166489e08e9-cni-binary-copy\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.341076 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.340202 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq28z\" (UniqueName: \"kubernetes.io/projected/67efd0ce-7b5b-4d41-97e2-b166489e08e9-kube-api-access-kq28z\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.341076 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.340231 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/42cf544f-ba18-4ec6-ac81-fa3b106949a9-ovnkube-config\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.341076 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.340254 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df77fbc6-2613-4a23-b1da-c0dd94f680eb-tmp-dir\") pod \"node-resolver-c7t7x\" (UID: \"df77fbc6-2613-4a23-b1da-c0dd94f680eb\") " pod="openshift-dns/node-resolver-c7t7x" Sep 11 18:48:18.341076 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.340285 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-lib-modules\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.341076 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.340539 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3d14dfd0-53b3-444d-8c92-f75d361e7a7f-registration-dir\") pod \"aws-ebs-csi-driver-node-jhbrj\" (UID: \"3d14dfd0-53b3-444d-8c92-f75d361e7a7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhbrj" Sep 11 18:48:18.341076 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.340642 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3d14dfd0-53b3-444d-8c92-f75d361e7a7f-sys-fs\") pod \"aws-ebs-csi-driver-node-jhbrj\" (UID: \"3d14dfd0-53b3-444d-8c92-f75d361e7a7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhbrj" Sep 11 18:48:18.341076 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.340682 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-etc-tuned\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.341076 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.340732 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-run-systemd\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.341076 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.340761 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-run-ovn\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.341076 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.340791 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-node-log\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.341856 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.340819 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-host-cni-bin\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.341856 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.340821 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/67efd0ce-7b5b-4d41-97e2-b166489e08e9-cni-binary-copy\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.341856 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.340845 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65zhn\" (UniqueName: \"kubernetes.io/projected/bb6e0205-703f-4dec-af35-283ccc740b37-kube-api-access-65zhn\") pod \"network-metrics-daemon-gl55g\" (UID: \"bb6e0205-703f-4dec-af35-283ccc740b37\") " pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:48:18.341856 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.340905 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-run-systemd\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.341856 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.340936 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-sys\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.341856 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.340965 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-etc-kubernetes\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.341856 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.341054 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67efd0ce-7b5b-4d41-97e2-b166489e08e9-etc-kubernetes\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.341856 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.341098 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-run-ovn\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.341856 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.341153 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-node-log\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.341856 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.341196 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-host-cni-bin\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.341856 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.341274 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/42cf544f-ba18-4ec6-ac81-fa3b106949a9-ovnkube-config\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.341856 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.341345 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.341856 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.341799 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/074bae97-de81-4f57-ba67-4790e60c0f2a-serviceca\") pod \"node-ca-8w6hj\" (UID: \"074bae97-de81-4f57-ba67-4790e60c0f2a\") " pod="openshift-image-registry/node-ca-8w6hj" Sep 11 18:48:18.341856 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.341854 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42cf544f-ba18-4ec6-ac81-fa3b106949a9-host-slash\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.343340 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:18.343316 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 18:48:18.343340 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:18.343340 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 18:48:18.343489 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:18.343351 2583 projected.go:196] Error preparing data for projected volume kube-api-access-m5594 for pod openshift-network-diagnostics/network-check-target-ndw4m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 18:48:18.343489 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:18.343404 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba212e38-0ab7-4e51-a8a3-fb8efcc87945-kube-api-access-m5594 podName:ba212e38-0ab7-4e51-a8a3-fb8efcc87945 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:18.843388241 +0000 UTC m=+3.023320948 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-m5594" (UniqueName: "kubernetes.io/projected/ba212e38-0ab7-4e51-a8a3-fb8efcc87945-kube-api-access-m5594") pod "network-check-target-ndw4m" (UID: "ba212e38-0ab7-4e51-a8a3-fb8efcc87945") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 18:48:18.345321 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.345298 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/42cf544f-ba18-4ec6-ac81-fa3b106949a9-ovn-node-metrics-cert\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.345888 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.345842 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbgxz\" (UniqueName: \"kubernetes.io/projected/3d14dfd0-53b3-444d-8c92-f75d361e7a7f-kube-api-access-hbgxz\") pod \"aws-ebs-csi-driver-node-jhbrj\" (UID: \"3d14dfd0-53b3-444d-8c92-f75d361e7a7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhbrj" Sep 11 18:48:18.346415 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.346398 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb79h\" (UniqueName: \"kubernetes.io/projected/074bae97-de81-4f57-ba67-4790e60c0f2a-kube-api-access-sb79h\") pod \"node-ca-8w6hj\" (UID: \"074bae97-de81-4f57-ba67-4790e60c0f2a\") " pod="openshift-image-registry/node-ca-8w6hj" Sep 11 18:48:18.349079 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.349038 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf4m2\" (UniqueName: \"kubernetes.io/projected/42cf544f-ba18-4ec6-ac81-fa3b106949a9-kube-api-access-pf4m2\") pod \"ovnkube-node-6cqpn\" (UID: \"42cf544f-ba18-4ec6-ac81-fa3b106949a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.349599 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.349547 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq28z\" (UniqueName: \"kubernetes.io/projected/67efd0ce-7b5b-4d41-97e2-b166489e08e9-kube-api-access-kq28z\") pod \"multus-vk2x8\" (UID: \"67efd0ce-7b5b-4d41-97e2-b166489e08e9\") " pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.357363 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.357319 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal" event={"ID":"71a1dd5c650117ac0b955acbf1e0db7c","Type":"ContainerStarted","Data":"0b1d6985864806064de1df22adaf190384915daac42ccdadfc62ad83fa710718"} Sep 11 18:48:18.358380 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.358353 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-25.ec2.internal" event={"ID":"0c8d5dd7e1a7979f39ff552b2657e9d3","Type":"ContainerStarted","Data":"43c9aab5f8aafbc6b4aa0e70d16fad20227cd6f776c0ba3c8cfa9dd069fe37b3"} Sep 11 18:48:18.441392 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.441356 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/50cbb7b2-fa0c-4628-8940-2bee31f3a80d-iptables-alerter-script\") pod \"iptables-alerter-d4zx8\" (UID: \"50cbb7b2-fa0c-4628-8940-2bee31f3a80d\") " pod="openshift-network-operator/iptables-alerter-d4zx8" Sep 11 18:48:18.441392 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.441397 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/06964030-e916-4d42-a39f-96727c8c77a1-kubelet-config\") pod \"global-pull-secret-syncer-kltxq\" (UID: \"06964030-e916-4d42-a39f-96727c8c77a1\") " pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:18.441646 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.441421 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06964030-e916-4d42-a39f-96727c8c77a1-original-pull-secret\") pod \"global-pull-secret-syncer-kltxq\" (UID: \"06964030-e916-4d42-a39f-96727c8c77a1\") " pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:18.441646 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.441503 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/06964030-e916-4d42-a39f-96727c8c77a1-kubelet-config\") pod \"global-pull-secret-syncer-kltxq\" (UID: \"06964030-e916-4d42-a39f-96727c8c77a1\") " pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:18.441646 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:18.441507 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 18:48:18.441646 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.441533 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/df77fbc6-2613-4a23-b1da-c0dd94f680eb-hosts-file\") pod \"node-resolver-c7t7x\" (UID: \"df77fbc6-2613-4a23-b1da-c0dd94f680eb\") " pod="openshift-dns/node-resolver-c7t7x" Sep 11 18:48:18.441646 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.441569 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6gql\" (UniqueName: \"kubernetes.io/projected/0b54490f-a110-4af8-b98c-3bc94b89030b-kube-api-access-j6gql\") pod \"multus-additional-cni-plugins-tdxsn\" (UID: \"0b54490f-a110-4af8-b98c-3bc94b89030b\") " pod="openshift-multus/multus-additional-cni-plugins-tdxsn" Sep 11 18:48:18.441646 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:18.441609 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06964030-e916-4d42-a39f-96727c8c77a1-original-pull-secret podName:06964030-e916-4d42-a39f-96727c8c77a1 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:18.941577159 +0000 UTC m=+3.121509865 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06964030-e916-4d42-a39f-96727c8c77a1-original-pull-secret") pod "global-pull-secret-syncer-kltxq" (UID: "06964030-e916-4d42-a39f-96727c8c77a1") : object "kube-system"/"original-pull-secret" not registered Sep 11 18:48:18.441646 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.441638 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df77fbc6-2613-4a23-b1da-c0dd94f680eb-tmp-dir\") pod \"node-resolver-c7t7x\" (UID: \"df77fbc6-2613-4a23-b1da-c0dd94f680eb\") " pod="openshift-dns/node-resolver-c7t7x" Sep 11 18:48:18.441900 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.441665 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-lib-modules\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.441900 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.441687 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-etc-tuned\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.441900 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.441714 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65zhn\" (UniqueName: \"kubernetes.io/projected/bb6e0205-703f-4dec-af35-283ccc740b37-kube-api-access-65zhn\") pod \"network-metrics-daemon-gl55g\" (UID: \"bb6e0205-703f-4dec-af35-283ccc740b37\") " pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:48:18.441900 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.441638 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/df77fbc6-2613-4a23-b1da-c0dd94f680eb-hosts-file\") pod \"node-resolver-c7t7x\" (UID: \"df77fbc6-2613-4a23-b1da-c0dd94f680eb\") " pod="openshift-dns/node-resolver-c7t7x" Sep 11 18:48:18.441900 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.441739 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-sys\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.441900 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.441788 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-etc-sysctl-d\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.441900 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.441821 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/06964030-e916-4d42-a39f-96727c8c77a1-dbus\") pod \"global-pull-secret-syncer-kltxq\" (UID: \"06964030-e916-4d42-a39f-96727c8c77a1\") " pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:18.441900 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.441851 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2lx6\" (UniqueName: \"kubernetes.io/projected/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-kube-api-access-m2lx6\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.441900 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.441880 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-run\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.442255 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.441903 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-var-lib-kubelet\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.442255 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.441926 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b54490f-a110-4af8-b98c-3bc94b89030b-system-cni-dir\") pod \"multus-additional-cni-plugins-tdxsn\" (UID: \"0b54490f-a110-4af8-b98c-3bc94b89030b\") " pod="openshift-multus/multus-additional-cni-plugins-tdxsn" Sep 11 18:48:18.442255 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.441953 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-etc-systemd\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.442255 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.441980 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2d05796-e12c-4be6-a44b-f221b91594e3-konnectivity-ca\") pod \"konnectivity-agent-zsn78\" (UID: \"d2d05796-e12c-4be6-a44b-f221b91594e3\") " pod="kube-system/konnectivity-agent-zsn78" Sep 11 18:48:18.442255 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442003 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b54490f-a110-4af8-b98c-3bc94b89030b-cni-binary-copy\") pod \"multus-additional-cni-plugins-tdxsn\" (UID: \"0b54490f-a110-4af8-b98c-3bc94b89030b\") " pod="openshift-multus/multus-additional-cni-plugins-tdxsn" Sep 11 18:48:18.442255 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442022 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/50cbb7b2-fa0c-4628-8940-2bee31f3a80d-iptables-alerter-script\") pod \"iptables-alerter-d4zx8\" (UID: \"50cbb7b2-fa0c-4628-8940-2bee31f3a80d\") " pod="openshift-network-operator/iptables-alerter-d4zx8" Sep 11 18:48:18.442255 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442030 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjzs4\" (UniqueName: \"kubernetes.io/projected/df77fbc6-2613-4a23-b1da-c0dd94f680eb-kube-api-access-pjzs4\") pod \"node-resolver-c7t7x\" (UID: \"df77fbc6-2613-4a23-b1da-c0dd94f680eb\") " pod="openshift-dns/node-resolver-c7t7x" Sep 11 18:48:18.442255 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442052 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-etc-kubernetes\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.442255 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442069 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df77fbc6-2613-4a23-b1da-c0dd94f680eb-tmp-dir\") pod \"node-resolver-c7t7x\" (UID: \"df77fbc6-2613-4a23-b1da-c0dd94f680eb\") " pod="openshift-dns/node-resolver-c7t7x" Sep 11 18:48:18.442255 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442088 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-run\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.442255 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442112 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-etc-kubernetes\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.442255 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442144 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-var-lib-kubelet\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.442255 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442145 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-sys\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.442255 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442197 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b54490f-a110-4af8-b98c-3bc94b89030b-system-cni-dir\") pod \"multus-additional-cni-plugins-tdxsn\" (UID: \"0b54490f-a110-4af8-b98c-3bc94b89030b\") " pod="openshift-multus/multus-additional-cni-plugins-tdxsn" Sep 11 18:48:18.442906 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442266 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-etc-sysctl-d\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.442906 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.441855 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-lib-modules\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.442906 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442306 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-etc-sysctl-conf\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.442906 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442333 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-host\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.442906 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442378 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b54490f-a110-4af8-b98c-3bc94b89030b-cnibin\") pod \"multus-additional-cni-plugins-tdxsn\" (UID: \"0b54490f-a110-4af8-b98c-3bc94b89030b\") " pod="openshift-multus/multus-additional-cni-plugins-tdxsn" Sep 11 18:48:18.442906 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442398 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50cbb7b2-fa0c-4628-8940-2bee31f3a80d-host-slash\") pod \"iptables-alerter-d4zx8\" (UID: \"50cbb7b2-fa0c-4628-8940-2bee31f3a80d\") " pod="openshift-network-operator/iptables-alerter-d4zx8" Sep 11 18:48:18.442906 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442417 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-tmp\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.442906 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442441 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b54490f-a110-4af8-b98c-3bc94b89030b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tdxsn\" (UID: \"0b54490f-a110-4af8-b98c-3bc94b89030b\") " pod="openshift-multus/multus-additional-cni-plugins-tdxsn" Sep 11 18:48:18.442906 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442455 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-etc-sysctl-conf\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.442906 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442469 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb6e0205-703f-4dec-af35-283ccc740b37-metrics-certs\") pod \"network-metrics-daemon-gl55g\" (UID: \"bb6e0205-703f-4dec-af35-283ccc740b37\") " pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:48:18.442906 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442494 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-etc-sysconfig\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.442906 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442494 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/06964030-e916-4d42-a39f-96727c8c77a1-dbus\") pod \"global-pull-secret-syncer-kltxq\" (UID: \"06964030-e916-4d42-a39f-96727c8c77a1\") " pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:18.442906 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442500 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50cbb7b2-fa0c-4628-8940-2bee31f3a80d-host-slash\") pod \"iptables-alerter-d4zx8\" (UID: \"50cbb7b2-fa0c-4628-8940-2bee31f3a80d\") " pod="openshift-network-operator/iptables-alerter-d4zx8" Sep 11 18:48:18.442906 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442527 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2d05796-e12c-4be6-a44b-f221b91594e3-konnectivity-ca\") pod \"konnectivity-agent-zsn78\" (UID: \"d2d05796-e12c-4be6-a44b-f221b91594e3\") " pod="kube-system/konnectivity-agent-zsn78" Sep 11 18:48:18.442906 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442535 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b54490f-a110-4af8-b98c-3bc94b89030b-cnibin\") pod \"multus-additional-cni-plugins-tdxsn\" (UID: \"0b54490f-a110-4af8-b98c-3bc94b89030b\") " pod="openshift-multus/multus-additional-cni-plugins-tdxsn" Sep 11 18:48:18.442906 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442546 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-etc-sysconfig\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.442906 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442603 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b54490f-a110-4af8-b98c-3bc94b89030b-cni-binary-copy\") pod \"multus-additional-cni-plugins-tdxsn\" (UID: \"0b54490f-a110-4af8-b98c-3bc94b89030b\") " pod="openshift-multus/multus-additional-cni-plugins-tdxsn" Sep 11 18:48:18.443532 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442612 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-etc-systemd\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.443532 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442606 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-host\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.443532 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442641 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0b54490f-a110-4af8-b98c-3bc94b89030b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tdxsn\" (UID: \"0b54490f-a110-4af8-b98c-3bc94b89030b\") " pod="openshift-multus/multus-additional-cni-plugins-tdxsn" Sep 11 18:48:18.443532 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442674 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-etc-modprobe-d\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.443532 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:18.442690 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 18:48:18.443532 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442697 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2d05796-e12c-4be6-a44b-f221b91594e3-agent-certs\") pod \"konnectivity-agent-zsn78\" (UID: \"d2d05796-e12c-4be6-a44b-f221b91594e3\") " pod="kube-system/konnectivity-agent-zsn78" Sep 11 18:48:18.443532 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442722 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0b54490f-a110-4af8-b98c-3bc94b89030b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tdxsn\" (UID: \"0b54490f-a110-4af8-b98c-3bc94b89030b\") " pod="openshift-multus/multus-additional-cni-plugins-tdxsn" Sep 11 18:48:18.443532 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442728 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b54490f-a110-4af8-b98c-3bc94b89030b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tdxsn\" (UID: \"0b54490f-a110-4af8-b98c-3bc94b89030b\") " pod="openshift-multus/multus-additional-cni-plugins-tdxsn" Sep 11 18:48:18.443532 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:18.442754 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb6e0205-703f-4dec-af35-283ccc740b37-metrics-certs podName:bb6e0205-703f-4dec-af35-283ccc740b37 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:18.942720711 +0000 UTC m=+3.122653399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb6e0205-703f-4dec-af35-283ccc740b37-metrics-certs") pod "network-metrics-daemon-gl55g" (UID: "bb6e0205-703f-4dec-af35-283ccc740b37") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 18:48:18.443532 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442796 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9dg4\" (UniqueName: \"kubernetes.io/projected/50cbb7b2-fa0c-4628-8940-2bee31f3a80d-kube-api-access-t9dg4\") pod \"iptables-alerter-d4zx8\" (UID: \"50cbb7b2-fa0c-4628-8940-2bee31f3a80d\") " pod="openshift-network-operator/iptables-alerter-d4zx8" Sep 11 18:48:18.443532 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.442809 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-etc-modprobe-d\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.443532 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.443186 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0b54490f-a110-4af8-b98c-3bc94b89030b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tdxsn\" (UID: \"0b54490f-a110-4af8-b98c-3bc94b89030b\") " pod="openshift-multus/multus-additional-cni-plugins-tdxsn" Sep 11 18:48:18.443532 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.443230 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0b54490f-a110-4af8-b98c-3bc94b89030b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tdxsn\" (UID: \"0b54490f-a110-4af8-b98c-3bc94b89030b\") " pod="openshift-multus/multus-additional-cni-plugins-tdxsn" Sep 11 18:48:18.444160 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.444139 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-etc-tuned\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.444907 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.444885 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-tmp\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.445109 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.445087 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2d05796-e12c-4be6-a44b-f221b91594e3-agent-certs\") pod \"konnectivity-agent-zsn78\" (UID: \"d2d05796-e12c-4be6-a44b-f221b91594e3\") " pod="kube-system/konnectivity-agent-zsn78" Sep 11 18:48:18.452387 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.452361 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9dg4\" (UniqueName: \"kubernetes.io/projected/50cbb7b2-fa0c-4628-8940-2bee31f3a80d-kube-api-access-t9dg4\") pod \"iptables-alerter-d4zx8\" (UID: \"50cbb7b2-fa0c-4628-8940-2bee31f3a80d\") " pod="openshift-network-operator/iptables-alerter-d4zx8" Sep 11 18:48:18.452481 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.452358 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6gql\" (UniqueName: \"kubernetes.io/projected/0b54490f-a110-4af8-b98c-3bc94b89030b-kube-api-access-j6gql\") pod \"multus-additional-cni-plugins-tdxsn\" (UID: \"0b54490f-a110-4af8-b98c-3bc94b89030b\") " pod="openshift-multus/multus-additional-cni-plugins-tdxsn" Sep 11 18:48:18.453070 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.453050 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjzs4\" (UniqueName: \"kubernetes.io/projected/df77fbc6-2613-4a23-b1da-c0dd94f680eb-kube-api-access-pjzs4\") pod \"node-resolver-c7t7x\" (UID: \"df77fbc6-2613-4a23-b1da-c0dd94f680eb\") " pod="openshift-dns/node-resolver-c7t7x" Sep 11 18:48:18.453379 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.453362 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65zhn\" (UniqueName: \"kubernetes.io/projected/bb6e0205-703f-4dec-af35-283ccc740b37-kube-api-access-65zhn\") pod \"network-metrics-daemon-gl55g\" (UID: \"bb6e0205-703f-4dec-af35-283ccc740b37\") " pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:48:18.453823 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.453800 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2lx6\" (UniqueName: \"kubernetes.io/projected/0000052d-9d2f-4efa-a4b4-f3f864ee8d18-kube-api-access-m2lx6\") pod \"tuned-lfnmv\" (UID: \"0000052d-9d2f-4efa-a4b4-f3f864ee8d18\") " pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.528007 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.527974 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vk2x8" Sep 11 18:48:18.536015 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.535989 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:18.546887 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.546863 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhbrj" Sep 11 18:48:18.552648 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.552629 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8w6hj" Sep 11 18:48:18.562288 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.562268 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d4zx8" Sep 11 18:48:18.568991 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.568961 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" Sep 11 18:48:18.576534 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.576478 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zsn78" Sep 11 18:48:18.584077 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.584049 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c7t7x" Sep 11 18:48:18.589649 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.589624 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tdxsn" Sep 11 18:48:18.845808 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.845738 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5594\" (UniqueName: \"kubernetes.io/projected/ba212e38-0ab7-4e51-a8a3-fb8efcc87945-kube-api-access-m5594\") pod \"network-check-target-ndw4m\" (UID: \"ba212e38-0ab7-4e51-a8a3-fb8efcc87945\") " pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:48:18.845936 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:18.845869 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 18:48:18.845936 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:18.845887 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 18:48:18.845936 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:18.845898 2583 projected.go:196] Error preparing data for projected volume kube-api-access-m5594 for pod openshift-network-diagnostics/network-check-target-ndw4m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 18:48:18.846026 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:18.845950 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba212e38-0ab7-4e51-a8a3-fb8efcc87945-kube-api-access-m5594 podName:ba212e38-0ab7-4e51-a8a3-fb8efcc87945 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:19.845934168 +0000 UTC m=+4.025866854 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-m5594" (UniqueName: "kubernetes.io/projected/ba212e38-0ab7-4e51-a8a3-fb8efcc87945-kube-api-access-m5594") pod "network-check-target-ndw4m" (UID: "ba212e38-0ab7-4e51-a8a3-fb8efcc87945") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 18:48:18.946657 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.946617 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb6e0205-703f-4dec-af35-283ccc740b37-metrics-certs\") pod \"network-metrics-daemon-gl55g\" (UID: \"bb6e0205-703f-4dec-af35-283ccc740b37\") " pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:48:18.946820 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.946692 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06964030-e916-4d42-a39f-96727c8c77a1-original-pull-secret\") pod \"global-pull-secret-syncer-kltxq\" (UID: \"06964030-e916-4d42-a39f-96727c8c77a1\") " pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:18.946820 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:18.946805 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 18:48:18.946938 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:18.946838 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 18:48:18.946938 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:18.946872 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb6e0205-703f-4dec-af35-283ccc740b37-metrics-certs podName:bb6e0205-703f-4dec-af35-283ccc740b37 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:19.946855046 +0000 UTC m=+4.126787735 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb6e0205-703f-4dec-af35-283ccc740b37-metrics-certs") pod "network-metrics-daemon-gl55g" (UID: "bb6e0205-703f-4dec-af35-283ccc740b37") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 18:48:18.946938 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:18.946898 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06964030-e916-4d42-a39f-96727c8c77a1-original-pull-secret podName:06964030-e916-4d42-a39f-96727c8c77a1 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:19.946880125 +0000 UTC m=+4.126812815 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06964030-e916-4d42-a39f-96727c8c77a1-original-pull-secret") pod "global-pull-secret-syncer-kltxq" (UID: "06964030-e916-4d42-a39f-96727c8c77a1") : object "kube-system"/"original-pull-secret" not registered Sep 11 18:48:18.970347 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:18.970314 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 18:48:19.002714 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:19.002687 2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 18:48:19.211365 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:19.211339 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67efd0ce_7b5b_4d41_97e2_b166489e08e9.slice/crio-636d1af3eefa54c3df9f49e3482defe309db39f24bd8ba704abbbad30b4a4016 WatchSource:0}: Error finding container 636d1af3eefa54c3df9f49e3482defe309db39f24bd8ba704abbbad30b4a4016: Status 404 returned error can't find the container with id 636d1af3eefa54c3df9f49e3482defe309db39f24bd8ba704abbbad30b4a4016 Sep 11 18:48:19.213029 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:19.213007 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b54490f_a110_4af8_b98c_3bc94b89030b.slice/crio-06811ae48605841825c27ac978a390cd6be40d7ab0d999f65a6885a81a8fc9f1 WatchSource:0}: Error finding container 06811ae48605841825c27ac978a390cd6be40d7ab0d999f65a6885a81a8fc9f1: Status 404 returned error can't find the container with id 06811ae48605841825c27ac978a390cd6be40d7ab0d999f65a6885a81a8fc9f1 Sep 11 18:48:19.215513 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:19.215484 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d14dfd0_53b3_444d_8c92_f75d361e7a7f.slice/crio-d2780a90bf15c9607060719ca4ab5d573af7037541bdb751670719a66e87abfe WatchSource:0}: Error finding container d2780a90bf15c9607060719ca4ab5d573af7037541bdb751670719a66e87abfe: Status 404 returned error can't find the container with id d2780a90bf15c9607060719ca4ab5d573af7037541bdb751670719a66e87abfe Sep 11 18:48:19.237935 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:19.237913 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf77fbc6_2613_4a23_b1da_c0dd94f680eb.slice/crio-2ddea92ae4a3e248a31517001493ba3af7e8ebe06aae171a07b5e33c3b1dad02 WatchSource:0}: Error finding container 2ddea92ae4a3e248a31517001493ba3af7e8ebe06aae171a07b5e33c3b1dad02: Status 404 returned error can't find the container with id 2ddea92ae4a3e248a31517001493ba3af7e8ebe06aae171a07b5e33c3b1dad02 Sep 11 18:48:19.238623 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:19.238597 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2d05796_e12c_4be6_a44b_f221b91594e3.slice/crio-732b602731af1f0125fc148960fdaa118cbbfd4db2f709f7e4ee4b3e57233d65 WatchSource:0}: Error finding container 732b602731af1f0125fc148960fdaa118cbbfd4db2f709f7e4ee4b3e57233d65: Status 404 returned error can't find the container with id 732b602731af1f0125fc148960fdaa118cbbfd4db2f709f7e4ee4b3e57233d65 Sep 11 18:48:19.239883 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:19.239865 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50cbb7b2_fa0c_4628_8940_2bee31f3a80d.slice/crio-3f264f407b7adbd578cea04257bfa461339e9fa78c7b2f48c81db6ff3d379d1a WatchSource:0}: Error finding container 3f264f407b7adbd578cea04257bfa461339e9fa78c7b2f48c81db6ff3d379d1a: Status 404 returned error can't find the container with id 3f264f407b7adbd578cea04257bfa461339e9fa78c7b2f48c81db6ff3d379d1a Sep 11 18:48:19.240851 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:19.240821 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42cf544f_ba18_4ec6_ac81_fa3b106949a9.slice/crio-e74bf9b847bce34c0ff8b2bb43ea61c44de96305161ff6cc054f76c1d2087b39 WatchSource:0}: Error finding container e74bf9b847bce34c0ff8b2bb43ea61c44de96305161ff6cc054f76c1d2087b39: Status 404 returned error can't find the container with id e74bf9b847bce34c0ff8b2bb43ea61c44de96305161ff6cc054f76c1d2087b39 Sep 11 18:48:19.242992 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:19.242971 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod074bae97_de81_4f57_ba67_4790e60c0f2a.slice/crio-a270fe8e2241ac9d2a2e9d369847905417cb2ee79f6631b7af0038844f4aa9d9 WatchSource:0}: Error finding container a270fe8e2241ac9d2a2e9d369847905417cb2ee79f6631b7af0038844f4aa9d9: Status 404 returned error can't find the container with id a270fe8e2241ac9d2a2e9d369847905417cb2ee79f6631b7af0038844f4aa9d9 Sep 11 18:48:19.283229 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:19.283130 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 18:43:18 +0000 UTC" deadline="2028-02-07 02:31:06.775820247 +0000 UTC" Sep 11 18:48:19.283229 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:19.283183 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12319h42m47.492641911s" Sep 11 18:48:19.352656 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:19.352628 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:19.352834 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:19.352670 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:48:19.352834 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:19.352751 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kltxq" podUID="06964030-e916-4d42-a39f-96727c8c77a1" Sep 11 18:48:19.352966 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:19.352855 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndw4m" podUID="ba212e38-0ab7-4e51-a8a3-fb8efcc87945" Sep 11 18:48:19.361354 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:19.361321 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" event={"ID":"0000052d-9d2f-4efa-a4b4-f3f864ee8d18","Type":"ContainerStarted","Data":"c4ea152fd8393eb8bbbe245b41ef1d6aa206ae713fb6d7fb0e40bfc1da4f99f9"} Sep 11 18:48:19.362510 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:19.362481 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8w6hj" event={"ID":"074bae97-de81-4f57-ba67-4790e60c0f2a","Type":"ContainerStarted","Data":"a270fe8e2241ac9d2a2e9d369847905417cb2ee79f6631b7af0038844f4aa9d9"} Sep 11 18:48:19.363630 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:19.363607 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zsn78" event={"ID":"d2d05796-e12c-4be6-a44b-f221b91594e3","Type":"ContainerStarted","Data":"732b602731af1f0125fc148960fdaa118cbbfd4db2f709f7e4ee4b3e57233d65"} Sep 11 18:48:19.365920 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:19.365885 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-25.ec2.internal" event={"ID":"0c8d5dd7e1a7979f39ff552b2657e9d3","Type":"ContainerStarted","Data":"08e9351edb281b1a02bf5c9b5c65c93201342ffb4dbd7814cb60f88138e87f05"} Sep 11 18:48:19.367234 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:19.367214 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" event={"ID":"42cf544f-ba18-4ec6-ac81-fa3b106949a9","Type":"ContainerStarted","Data":"e74bf9b847bce34c0ff8b2bb43ea61c44de96305161ff6cc054f76c1d2087b39"} Sep 11 18:48:19.368367 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:19.368318 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d4zx8" event={"ID":"50cbb7b2-fa0c-4628-8940-2bee31f3a80d","Type":"ContainerStarted","Data":"3f264f407b7adbd578cea04257bfa461339e9fa78c7b2f48c81db6ff3d379d1a"} Sep 11 18:48:19.369539 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:19.369518 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c7t7x" event={"ID":"df77fbc6-2613-4a23-b1da-c0dd94f680eb","Type":"ContainerStarted","Data":"2ddea92ae4a3e248a31517001493ba3af7e8ebe06aae171a07b5e33c3b1dad02"} Sep 11 18:48:19.370729 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:19.370707 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhbrj" event={"ID":"3d14dfd0-53b3-444d-8c92-f75d361e7a7f","Type":"ContainerStarted","Data":"d2780a90bf15c9607060719ca4ab5d573af7037541bdb751670719a66e87abfe"} Sep 11 18:48:19.371873 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:19.371852 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tdxsn" event={"ID":"0b54490f-a110-4af8-b98c-3bc94b89030b","Type":"ContainerStarted","Data":"06811ae48605841825c27ac978a390cd6be40d7ab0d999f65a6885a81a8fc9f1"} Sep 11 18:48:19.373012 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:19.372989 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vk2x8" event={"ID":"67efd0ce-7b5b-4d41-97e2-b166489e08e9","Type":"ContainerStarted","Data":"636d1af3eefa54c3df9f49e3482defe309db39f24bd8ba704abbbad30b4a4016"} Sep 11 18:48:19.382046 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:19.382009 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-25.ec2.internal" podStartSLOduration=2.381997719 podStartE2EDuration="2.381997719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:48:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:48:19.381928406 +0000 UTC m=+3.561861113" watchObservedRunningTime="2026-09-11 18:48:19.381997719 +0000 UTC m=+3.561930427" Sep 11 18:48:19.855246 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:19.855153 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5594\" (UniqueName: \"kubernetes.io/projected/ba212e38-0ab7-4e51-a8a3-fb8efcc87945-kube-api-access-m5594\") pod \"network-check-target-ndw4m\" (UID: \"ba212e38-0ab7-4e51-a8a3-fb8efcc87945\") " pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:48:19.855404 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:19.855349 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 18:48:19.855404 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:19.855369 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 18:48:19.855404 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:19.855381 2583 projected.go:196] Error preparing data for projected volume kube-api-access-m5594 for pod openshift-network-diagnostics/network-check-target-ndw4m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 18:48:19.855558 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:19.855439 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba212e38-0ab7-4e51-a8a3-fb8efcc87945-kube-api-access-m5594 podName:ba212e38-0ab7-4e51-a8a3-fb8efcc87945 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:21.855421598 +0000 UTC m=+6.035354287 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-m5594" (UniqueName: "kubernetes.io/projected/ba212e38-0ab7-4e51-a8a3-fb8efcc87945-kube-api-access-m5594") pod "network-check-target-ndw4m" (UID: "ba212e38-0ab7-4e51-a8a3-fb8efcc87945") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 18:48:19.957051 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:19.957011 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb6e0205-703f-4dec-af35-283ccc740b37-metrics-certs\") pod \"network-metrics-daemon-gl55g\" (UID: \"bb6e0205-703f-4dec-af35-283ccc740b37\") " pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:48:19.957233 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:19.957072 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06964030-e916-4d42-a39f-96727c8c77a1-original-pull-secret\") pod \"global-pull-secret-syncer-kltxq\" (UID: \"06964030-e916-4d42-a39f-96727c8c77a1\") " pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:19.957233 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:19.957212 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 18:48:19.957342 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:19.957273 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06964030-e916-4d42-a39f-96727c8c77a1-original-pull-secret podName:06964030-e916-4d42-a39f-96727c8c77a1 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:21.957254869 +0000 UTC m=+6.137187556 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06964030-e916-4d42-a39f-96727c8c77a1-original-pull-secret") pod "global-pull-secret-syncer-kltxq" (UID: "06964030-e916-4d42-a39f-96727c8c77a1") : object "kube-system"/"original-pull-secret" not registered Sep 11 18:48:19.957342 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:19.957338 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 18:48:19.957449 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:19.957374 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb6e0205-703f-4dec-af35-283ccc740b37-metrics-certs podName:bb6e0205-703f-4dec-af35-283ccc740b37 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:21.957361369 +0000 UTC m=+6.137294055 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb6e0205-703f-4dec-af35-283ccc740b37-metrics-certs") pod "network-metrics-daemon-gl55g" (UID: "bb6e0205-703f-4dec-af35-283ccc740b37") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 18:48:20.283615 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:20.283510 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 18:43:18 +0000 UTC" deadline="2028-06-02 03:57:08.642629746 +0000 UTC" Sep 11 18:48:20.283615 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:20.283552 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15105h8m48.359081818s" Sep 11 18:48:20.352018 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:20.351953 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:48:20.352194 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:20.352103 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl55g" podUID="bb6e0205-703f-4dec-af35-283ccc740b37" Sep 11 18:48:20.391051 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:20.391013 2583 generic.go:356] "Generic (PLEG): container finished" podID="71a1dd5c650117ac0b955acbf1e0db7c" containerID="6feeabf2bd55863d49a417862edf30718c9516120178d45ec29553a3b6e366e4" exitCode=0 Sep 11 18:48:20.391679 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:20.391552 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal" event={"ID":"71a1dd5c650117ac0b955acbf1e0db7c","Type":"ContainerDied","Data":"6feeabf2bd55863d49a417862edf30718c9516120178d45ec29553a3b6e366e4"} Sep 11 18:48:21.353014 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:21.352244 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:48:21.353014 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:21.352383 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndw4m" podUID="ba212e38-0ab7-4e51-a8a3-fb8efcc87945" Sep 11 18:48:21.353014 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:21.352789 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:21.353014 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:21.352889 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kltxq" podUID="06964030-e916-4d42-a39f-96727c8c77a1" Sep 11 18:48:21.412452 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:21.412414 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal" event={"ID":"71a1dd5c650117ac0b955acbf1e0db7c","Type":"ContainerStarted","Data":"70cd484a1b3200166860ee0f6d8de0474e181aa6375e25f11afbc8e428d51b6f"} Sep 11 18:48:21.874987 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:21.874737 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5594\" (UniqueName: \"kubernetes.io/projected/ba212e38-0ab7-4e51-a8a3-fb8efcc87945-kube-api-access-m5594\") pod \"network-check-target-ndw4m\" (UID: \"ba212e38-0ab7-4e51-a8a3-fb8efcc87945\") " pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:48:21.874987 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:21.874901 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 18:48:21.874987 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:21.874921 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 18:48:21.874987 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:21.874933 2583 projected.go:196] Error preparing data for projected volume kube-api-access-m5594 for pod openshift-network-diagnostics/network-check-target-ndw4m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 18:48:21.874987 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:21.874993 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba212e38-0ab7-4e51-a8a3-fb8efcc87945-kube-api-access-m5594 podName:ba212e38-0ab7-4e51-a8a3-fb8efcc87945 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:25.874973996 +0000 UTC m=+10.054906696 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-m5594" (UniqueName: "kubernetes.io/projected/ba212e38-0ab7-4e51-a8a3-fb8efcc87945-kube-api-access-m5594") pod "network-check-target-ndw4m" (UID: "ba212e38-0ab7-4e51-a8a3-fb8efcc87945") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 18:48:21.975432 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:21.975389 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06964030-e916-4d42-a39f-96727c8c77a1-original-pull-secret\") pod \"global-pull-secret-syncer-kltxq\" (UID: \"06964030-e916-4d42-a39f-96727c8c77a1\") " pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:21.975640 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:21.975489 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb6e0205-703f-4dec-af35-283ccc740b37-metrics-certs\") pod \"network-metrics-daemon-gl55g\" (UID: \"bb6e0205-703f-4dec-af35-283ccc740b37\") " pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:48:21.975640 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:21.975630 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 18:48:21.975757 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:21.975691 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb6e0205-703f-4dec-af35-283ccc740b37-metrics-certs podName:bb6e0205-703f-4dec-af35-283ccc740b37 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:25.975674093 +0000 UTC m=+10.155606781 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb6e0205-703f-4dec-af35-283ccc740b37-metrics-certs") pod "network-metrics-daemon-gl55g" (UID: "bb6e0205-703f-4dec-af35-283ccc740b37") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 18:48:21.976142 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:21.976122 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 18:48:21.976253 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:21.976221 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06964030-e916-4d42-a39f-96727c8c77a1-original-pull-secret podName:06964030-e916-4d42-a39f-96727c8c77a1 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:25.97620546 +0000 UTC m=+10.156138150 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06964030-e916-4d42-a39f-96727c8c77a1-original-pull-secret") pod "global-pull-secret-syncer-kltxq" (UID: "06964030-e916-4d42-a39f-96727c8c77a1") : object "kube-system"/"original-pull-secret" not registered Sep 11 18:48:22.352786 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:22.352347 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:48:22.352786 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:22.352505 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl55g" podUID="bb6e0205-703f-4dec-af35-283ccc740b37" Sep 11 18:48:23.352902 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:23.352381 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:23.352902 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:23.352380 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:48:23.352902 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:23.352531 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kltxq" podUID="06964030-e916-4d42-a39f-96727c8c77a1" Sep 11 18:48:23.352902 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:23.352669 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndw4m" podUID="ba212e38-0ab7-4e51-a8a3-fb8efcc87945" Sep 11 18:48:24.352737 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:24.352693 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:48:24.352932 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:24.352845 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl55g" podUID="bb6e0205-703f-4dec-af35-283ccc740b37" Sep 11 18:48:25.352067 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:25.351993 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:48:25.352235 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:25.351993 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:25.352235 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:25.352164 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndw4m" podUID="ba212e38-0ab7-4e51-a8a3-fb8efcc87945" Sep 11 18:48:25.352535 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:25.352453 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kltxq" podUID="06964030-e916-4d42-a39f-96727c8c77a1" Sep 11 18:48:25.911420 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:25.911377 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5594\" (UniqueName: \"kubernetes.io/projected/ba212e38-0ab7-4e51-a8a3-fb8efcc87945-kube-api-access-m5594\") pod \"network-check-target-ndw4m\" (UID: \"ba212e38-0ab7-4e51-a8a3-fb8efcc87945\") " pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:48:25.912030 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:25.911535 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 18:48:25.912030 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:25.911556 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 18:48:25.912030 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:25.911569 2583 projected.go:196] Error preparing data for projected volume kube-api-access-m5594 for pod openshift-network-diagnostics/network-check-target-ndw4m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 18:48:25.912030 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:25.911642 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba212e38-0ab7-4e51-a8a3-fb8efcc87945-kube-api-access-m5594 podName:ba212e38-0ab7-4e51-a8a3-fb8efcc87945 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:33.911624229 +0000 UTC m=+18.091556929 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-m5594" (UniqueName: "kubernetes.io/projected/ba212e38-0ab7-4e51-a8a3-fb8efcc87945-kube-api-access-m5594") pod "network-check-target-ndw4m" (UID: "ba212e38-0ab7-4e51-a8a3-fb8efcc87945") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 18:48:26.011768 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:26.011734 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06964030-e916-4d42-a39f-96727c8c77a1-original-pull-secret\") pod \"global-pull-secret-syncer-kltxq\" (UID: \"06964030-e916-4d42-a39f-96727c8c77a1\") " pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:26.011962 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:26.011829 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb6e0205-703f-4dec-af35-283ccc740b37-metrics-certs\") pod \"network-metrics-daemon-gl55g\" (UID: \"bb6e0205-703f-4dec-af35-283ccc740b37\") " pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:48:26.011962 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:26.011951 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 18:48:26.012068 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:26.012010 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb6e0205-703f-4dec-af35-283ccc740b37-metrics-certs podName:bb6e0205-703f-4dec-af35-283ccc740b37 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:34.011991822 +0000 UTC m=+18.191924511 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb6e0205-703f-4dec-af35-283ccc740b37-metrics-certs") pod "network-metrics-daemon-gl55g" (UID: "bb6e0205-703f-4dec-af35-283ccc740b37") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 18:48:26.012536 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:26.012508 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 18:48:26.012637 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:26.012574 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06964030-e916-4d42-a39f-96727c8c77a1-original-pull-secret podName:06964030-e916-4d42-a39f-96727c8c77a1 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:34.012556986 +0000 UTC m=+18.192489676 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06964030-e916-4d42-a39f-96727c8c77a1-original-pull-secret") pod "global-pull-secret-syncer-kltxq" (UID: "06964030-e916-4d42-a39f-96727c8c77a1") : object "kube-system"/"original-pull-secret" not registered Sep 11 18:48:26.354228 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:26.354148 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:48:26.354416 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:26.354297 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl55g" podUID="bb6e0205-703f-4dec-af35-283ccc740b37" Sep 11 18:48:27.352150 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:27.351866 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:48:27.352150 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:27.351989 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndw4m" podUID="ba212e38-0ab7-4e51-a8a3-fb8efcc87945" Sep 11 18:48:27.352150 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:27.352043 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:27.352150 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:27.352120 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kltxq" podUID="06964030-e916-4d42-a39f-96727c8c77a1" Sep 11 18:48:28.351975 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:28.351930 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:48:28.352145 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:28.352072 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl55g" podUID="bb6e0205-703f-4dec-af35-283ccc740b37" Sep 11 18:48:29.352264 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:29.352222 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:29.352710 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:29.352327 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kltxq" podUID="06964030-e916-4d42-a39f-96727c8c77a1" Sep 11 18:48:29.352710 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:29.352390 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:48:29.352710 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:29.352504 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndw4m" podUID="ba212e38-0ab7-4e51-a8a3-fb8efcc87945" Sep 11 18:48:30.352138 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:30.352100 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:48:30.352350 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:30.352254 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl55g" podUID="bb6e0205-703f-4dec-af35-283ccc740b37" Sep 11 18:48:31.351898 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:31.351860 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:48:31.352109 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:31.351869 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:31.352109 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:31.351988 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndw4m" podUID="ba212e38-0ab7-4e51-a8a3-fb8efcc87945" Sep 11 18:48:31.352221 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:31.352125 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kltxq" podUID="06964030-e916-4d42-a39f-96727c8c77a1" Sep 11 18:48:32.352594 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:32.352536 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:48:32.353011 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:32.352757 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl55g" podUID="bb6e0205-703f-4dec-af35-283ccc740b37" Sep 11 18:48:33.351930 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:33.351899 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:48:33.351930 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:33.351917 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:33.352207 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:33.352018 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndw4m" podUID="ba212e38-0ab7-4e51-a8a3-fb8efcc87945" Sep 11 18:48:33.352207 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:33.352139 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kltxq" podUID="06964030-e916-4d42-a39f-96727c8c77a1" Sep 11 18:48:33.971621 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:33.971575 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5594\" (UniqueName: \"kubernetes.io/projected/ba212e38-0ab7-4e51-a8a3-fb8efcc87945-kube-api-access-m5594\") pod \"network-check-target-ndw4m\" (UID: \"ba212e38-0ab7-4e51-a8a3-fb8efcc87945\") " pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:48:33.972019 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:33.971734 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 18:48:33.972019 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:33.971765 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 18:48:33.972019 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:33.971780 2583 projected.go:196] Error preparing data for projected volume kube-api-access-m5594 for pod openshift-network-diagnostics/network-check-target-ndw4m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 18:48:33.972019 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:33.971846 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba212e38-0ab7-4e51-a8a3-fb8efcc87945-kube-api-access-m5594 podName:ba212e38-0ab7-4e51-a8a3-fb8efcc87945 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:49.971825355 +0000 UTC m=+34.151758042 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-m5594" (UniqueName: "kubernetes.io/projected/ba212e38-0ab7-4e51-a8a3-fb8efcc87945-kube-api-access-m5594") pod "network-check-target-ndw4m" (UID: "ba212e38-0ab7-4e51-a8a3-fb8efcc87945") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 18:48:34.072071 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:34.072038 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb6e0205-703f-4dec-af35-283ccc740b37-metrics-certs\") pod \"network-metrics-daemon-gl55g\" (UID: \"bb6e0205-703f-4dec-af35-283ccc740b37\") " pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:48:34.072240 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:34.072096 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06964030-e916-4d42-a39f-96727c8c77a1-original-pull-secret\") pod \"global-pull-secret-syncer-kltxq\" (UID: \"06964030-e916-4d42-a39f-96727c8c77a1\") " pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:34.072240 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:34.072199 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 18:48:34.072240 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:34.072223 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 18:48:34.072372 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:34.072266 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb6e0205-703f-4dec-af35-283ccc740b37-metrics-certs podName:bb6e0205-703f-4dec-af35-283ccc740b37 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:50.072251298 +0000 UTC m=+34.252183983 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb6e0205-703f-4dec-af35-283ccc740b37-metrics-certs") pod "network-metrics-daemon-gl55g" (UID: "bb6e0205-703f-4dec-af35-283ccc740b37") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 18:48:34.072372 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:34.072281 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06964030-e916-4d42-a39f-96727c8c77a1-original-pull-secret podName:06964030-e916-4d42-a39f-96727c8c77a1 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:50.072275105 +0000 UTC m=+34.252207791 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06964030-e916-4d42-a39f-96727c8c77a1-original-pull-secret") pod "global-pull-secret-syncer-kltxq" (UID: "06964030-e916-4d42-a39f-96727c8c77a1") : object "kube-system"/"original-pull-secret" not registered Sep 11 18:48:34.351857 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:34.351784 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:48:34.352010 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:34.351914 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl55g" podUID="bb6e0205-703f-4dec-af35-283ccc740b37" Sep 11 18:48:35.352405 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:35.352368 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:35.352405 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:35.352401 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:48:35.352956 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:35.352511 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kltxq" podUID="06964030-e916-4d42-a39f-96727c8c77a1" Sep 11 18:48:35.352956 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:35.352669 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndw4m" podUID="ba212e38-0ab7-4e51-a8a3-fb8efcc87945" Sep 11 18:48:36.353208 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:36.353169 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:48:36.353692 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:36.353299 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl55g" podUID="bb6e0205-703f-4dec-af35-283ccc740b37" Sep 11 18:48:37.352254 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:37.352212 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:48:37.352372 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:37.352341 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndw4m" podUID="ba212e38-0ab7-4e51-a8a3-fb8efcc87945" Sep 11 18:48:37.352435 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:37.352379 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:37.352499 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:37.352453 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kltxq" podUID="06964030-e916-4d42-a39f-96727c8c77a1" Sep 11 18:48:37.449030 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:37.448768 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" event={"ID":"42cf544f-ba18-4ec6-ac81-fa3b106949a9","Type":"ContainerStarted","Data":"f323f84bf632d9677493b1a5890cef7f044c23ae1f9a7efc821ce65ca616fe8c"} Sep 11 18:48:37.449748 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:37.449112 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" event={"ID":"42cf544f-ba18-4ec6-ac81-fa3b106949a9","Type":"ContainerStarted","Data":"ae09e21909ab29c118be4eb6bf7e80110e04f4a21e202440019687d18e448e46"} Sep 11 18:48:37.449748 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:37.449172 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" event={"ID":"42cf544f-ba18-4ec6-ac81-fa3b106949a9","Type":"ContainerStarted","Data":"8ede87442da4f3f55189c0ee83e86b42cf2d23bea930f91a5771b8a9a58dd50f"} Sep 11 18:48:37.450363 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:37.450335 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c7t7x" event={"ID":"df77fbc6-2613-4a23-b1da-c0dd94f680eb","Type":"ContainerStarted","Data":"b5ffd00000ec8a03d93db0a52741f5670c2e426264a47e7f9e8582e9e4b6d678"} Sep 11 18:48:37.452085 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:37.452061 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhbrj" event={"ID":"3d14dfd0-53b3-444d-8c92-f75d361e7a7f","Type":"ContainerStarted","Data":"77913f770e58d1e15f4f078a1db0b1c7a6630efd693f79386af827ebe878ab7f"} Sep 11 18:48:37.453687 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:37.453657 2583 generic.go:356] "Generic (PLEG): container finished" podID="0b54490f-a110-4af8-b98c-3bc94b89030b" containerID="3bcb35d052b40539b6d6f0b67ad380010d5e2e62c5ae2c4c1832871148f59e36" exitCode=0 Sep 11 18:48:37.453783 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:37.453688 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tdxsn" event={"ID":"0b54490f-a110-4af8-b98c-3bc94b89030b","Type":"ContainerDied","Data":"3bcb35d052b40539b6d6f0b67ad380010d5e2e62c5ae2c4c1832871148f59e36"} Sep 11 18:48:37.457478 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:37.457390 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vk2x8" event={"ID":"67efd0ce-7b5b-4d41-97e2-b166489e08e9","Type":"ContainerStarted","Data":"e461499e242c40f4d89ffb83f3a7da8b9b624d4634f4b1d12836f6520a8c8149"} Sep 11 18:48:37.459713 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:37.459691 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" event={"ID":"0000052d-9d2f-4efa-a4b4-f3f864ee8d18","Type":"ContainerStarted","Data":"153e4ef8a6be13fd54a7c0b66b1e06bfe86f232264bee8645399bbccf8fcd4a7"} Sep 11 18:48:37.461464 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:37.461445 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8w6hj" event={"ID":"074bae97-de81-4f57-ba67-4790e60c0f2a","Type":"ContainerStarted","Data":"27bc61151967469ac8ebf87cab52770dbc6d8cf88fb47922658cc1b5a25d25c2"} Sep 11 18:48:37.462914 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:37.462895 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zsn78" event={"ID":"d2d05796-e12c-4be6-a44b-f221b91594e3","Type":"ContainerStarted","Data":"5ec70cae618a512344075fccf073fc94d6b129d98efc4e45d4024c8dfa81476f"} Sep 11 18:48:37.468499 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:37.468462 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-25.ec2.internal" podStartSLOduration=20.468451243 podStartE2EDuration="20.468451243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:48:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:48:21.42939446 +0000 UTC m=+5.609327167" watchObservedRunningTime="2026-09-11 18:48:37.468451243 +0000 UTC m=+21.648383951" Sep 11 18:48:37.468755 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:37.468721 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-c7t7x" podStartSLOduration=3.647889901 podStartE2EDuration="21.468714698s" totalImagesPullingTime="17.820824797s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:48:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:48:37.467902328 +0000 UTC m=+21.647835033" watchObservedRunningTime="2026-09-11 18:48:37.468714698 +0000 UTC m=+21.648647405" Sep 11 18:48:37.514886 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:37.514844 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lfnmv" podStartSLOduration=3.696303582 podStartE2EDuration="21.514826631s" totalImagesPullingTime="17.818523049s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:48:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:48:37.514210369 +0000 UTC m=+21.694143078" watchObservedRunningTime="2026-09-11 18:48:37.514826631 +0000 UTC m=+21.694759340" Sep 11 18:48:37.531018 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:37.530975 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zsn78" podStartSLOduration=11.204973008 podStartE2EDuration="21.530960514s" totalImagesPullingTime="10.325987506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:48:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:48:37.530766496 +0000 UTC m=+21.710699214" watchObservedRunningTime="2026-09-11 18:48:37.530960514 +0000 UTC m=+21.710893221" Sep 11 18:48:37.590883 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:37.590837 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vk2x8" podStartSLOduration=3.6311448200000003 podStartE2EDuration="21.590822397s" totalImagesPullingTime="17.959677577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:48:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:48:37.55801969 +0000 UTC m=+21.737952399" watchObservedRunningTime="2026-09-11 18:48:37.590822397 +0000 UTC m=+21.770755128" Sep 11 18:48:38.352627 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:38.352524 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:48:38.352808 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:38.352696 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl55g" podUID="bb6e0205-703f-4dec-af35-283ccc740b37" Sep 11 18:48:38.467314 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:38.467279 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d4zx8" event={"ID":"50cbb7b2-fa0c-4628-8940-2bee31f3a80d","Type":"ContainerStarted","Data":"d6fe6780f7a8dc64311467f4fb561ce2755a3c510ca63602e2b1cca172f94985"} Sep 11 18:48:38.471009 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:38.470981 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" event={"ID":"42cf544f-ba18-4ec6-ac81-fa3b106949a9","Type":"ContainerStarted","Data":"e5c603da4a216f3043da73654fe9c8be0a740a414a9dbcda769486666cfb7900"} Sep 11 18:48:38.471169 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:38.471068 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" event={"ID":"42cf544f-ba18-4ec6-ac81-fa3b106949a9","Type":"ContainerStarted","Data":"9a601bae796deeed4574fdd954f4c690b0bbd117cb2d37c76a5251822a058872"} Sep 11 18:48:38.471169 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:38.471114 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" event={"ID":"42cf544f-ba18-4ec6-ac81-fa3b106949a9","Type":"ContainerStarted","Data":"3c0c2f4025a109e660621aaae73f72d9d6a92cbd0d7ec0863f820b9eb69b2f2f"} Sep 11 18:48:38.487778 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:38.487725 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8w6hj" podStartSLOduration=4.668662781 podStartE2EDuration="22.487703238s" totalImagesPullingTime="17.819040457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:48:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:48:37.590975295 +0000 UTC m=+21.770908004" watchObservedRunningTime="2026-09-11 18:48:38.487703238 +0000 UTC m=+22.667635948" Sep 11 18:48:38.488025 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:38.487995 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-d4zx8" podStartSLOduration=4.667370255 podStartE2EDuration="22.487983824s" totalImagesPullingTime="17.820613569s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:48:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:48:38.487667727 +0000 UTC m=+22.667600437" watchObservedRunningTime="2026-09-11 18:48:38.487983824 +0000 UTC m=+22.667916534" Sep 11 18:48:38.619677 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:38.619645 2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 11 18:48:39.296223 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:39.296093 2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T18:48:38.619668007Z","UUID":"061a97ca-cb6a-48ea-b911-77fe123ef061","Handler":null,"Name":"","Endpoint":""} Sep 11 18:48:39.297944 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:39.297919 2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 11 18:48:39.298089 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:39.297959 2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 11 18:48:39.352617 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:39.352527 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:48:39.352777 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:39.352670 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndw4m" podUID="ba212e38-0ab7-4e51-a8a3-fb8efcc87945" Sep 11 18:48:39.352847 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:39.352776 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:39.352900 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:39.352861 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kltxq" podUID="06964030-e916-4d42-a39f-96727c8c77a1" Sep 11 18:48:39.475702 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:39.475669 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhbrj" event={"ID":"3d14dfd0-53b3-444d-8c92-f75d361e7a7f","Type":"ContainerStarted","Data":"430548f90b4966284d74b068e6ae5fe1839094a947731945b14b97c35debbb8a"} Sep 11 18:48:40.352084 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:40.352045 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:48:40.352265 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:40.352174 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl55g" podUID="bb6e0205-703f-4dec-af35-283ccc740b37" Sep 11 18:48:40.481034 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:40.480998 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhbrj" event={"ID":"3d14dfd0-53b3-444d-8c92-f75d361e7a7f","Type":"ContainerStarted","Data":"84cdce646e3256e1c53a07ad0c3eda157cee7753236eb4f768712e068a373b54"} Sep 11 18:48:40.485217 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:40.485183 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" event={"ID":"42cf544f-ba18-4ec6-ac81-fa3b106949a9","Type":"ContainerStarted","Data":"71f089c52cb53c793a1fdbfeec55d91fd735984eecf754c952710a15fb3e3062"} Sep 11 18:48:40.500948 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:40.500892 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhbrj" podStartSLOduration=4.519169589 podStartE2EDuration="24.50087234s" totalImagesPullingTime="19.981702751s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:48:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:48:40.500257114 +0000 UTC m=+24.680189834" watchObservedRunningTime="2026-09-11 18:48:40.50087234 +0000 UTC m=+24.680805052" Sep 11 18:48:41.352516 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:41.352476 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:41.352516 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:41.352498 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:48:41.352771 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:41.352621 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kltxq" podUID="06964030-e916-4d42-a39f-96727c8c77a1" Sep 11 18:48:41.352771 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:41.352744 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndw4m" podUID="ba212e38-0ab7-4e51-a8a3-fb8efcc87945" Sep 11 18:48:41.455295 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:41.455256 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zsn78" Sep 11 18:48:41.455914 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:41.455891 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zsn78" Sep 11 18:48:41.487629 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:41.487574 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zsn78" Sep 11 18:48:41.488024 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:41.487894 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zsn78" Sep 11 18:48:42.352002 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:42.351920 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:48:42.352129 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:42.352037 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl55g" podUID="bb6e0205-703f-4dec-af35-283ccc740b37" Sep 11 18:48:42.491758 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:42.491721 2583 generic.go:356] "Generic (PLEG): container finished" podID="0b54490f-a110-4af8-b98c-3bc94b89030b" containerID="bcce47def762327ed25a35a626a84bb4fe83e8702361e3e5d330f6757f8cbede" exitCode=0 Sep 11 18:48:42.492554 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:42.491814 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tdxsn" event={"ID":"0b54490f-a110-4af8-b98c-3bc94b89030b","Type":"ContainerDied","Data":"bcce47def762327ed25a35a626a84bb4fe83e8702361e3e5d330f6757f8cbede"} Sep 11 18:48:42.495718 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:42.495685 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" event={"ID":"42cf544f-ba18-4ec6-ac81-fa3b106949a9","Type":"ContainerStarted","Data":"e84fbee922fb1eec66af97f7a16458807376b167727b2414690cc457f8053bf1"} Sep 11 18:48:42.495970 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:42.495955 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:42.496030 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:42.496019 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:42.496081 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:42.496070 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:42.511385 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:42.511359 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:42.511505 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:42.511464 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:48:42.577711 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:42.577663 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" podStartSLOduration=8.737778844 podStartE2EDuration="26.577646342s" totalImagesPullingTime="17.839867498s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:48:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:48:42.577135734 +0000 UTC m=+26.757068441" watchObservedRunningTime="2026-09-11 18:48:42.577646342 +0000 UTC m=+26.757579049" Sep 11 18:48:43.352393 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:43.352363 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:48:43.352557 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:43.352472 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndw4m" podUID="ba212e38-0ab7-4e51-a8a3-fb8efcc87945" Sep 11 18:48:43.352557 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:43.352527 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:43.352707 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:43.352662 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kltxq" podUID="06964030-e916-4d42-a39f-96727c8c77a1" Sep 11 18:48:43.839427 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:43.839235 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ndw4m"] Sep 11 18:48:43.839809 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:43.839517 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:48:43.839809 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:43.839621 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndw4m" podUID="ba212e38-0ab7-4e51-a8a3-fb8efcc87945" Sep 11 18:48:43.842733 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:43.842685 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kltxq"] Sep 11 18:48:43.842873 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:43.842792 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:43.842927 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:43.842881 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kltxq" podUID="06964030-e916-4d42-a39f-96727c8c77a1" Sep 11 18:48:43.843406 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:43.843379 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gl55g"] Sep 11 18:48:43.843507 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:43.843483 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:48:43.843625 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:43.843602 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl55g" podUID="bb6e0205-703f-4dec-af35-283ccc740b37" Sep 11 18:48:44.502637 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:44.502603 2583 generic.go:356] "Generic (PLEG): container finished" podID="0b54490f-a110-4af8-b98c-3bc94b89030b" containerID="6aa2534d829f931589bf58731452729f29175caefc2116be0eca517b111e29ea" exitCode=0 Sep 11 18:48:44.502783 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:44.502680 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tdxsn" event={"ID":"0b54490f-a110-4af8-b98c-3bc94b89030b","Type":"ContainerDied","Data":"6aa2534d829f931589bf58731452729f29175caefc2116be0eca517b111e29ea"} Sep 11 18:48:45.352065 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:45.352025 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:45.352426 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:45.352075 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:48:45.352426 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:45.352031 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:48:45.352426 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:45.352146 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kltxq" podUID="06964030-e916-4d42-a39f-96727c8c77a1" Sep 11 18:48:45.352426 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:45.352190 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndw4m" podUID="ba212e38-0ab7-4e51-a8a3-fb8efcc87945" Sep 11 18:48:45.352426 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:45.352248 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl55g" podUID="bb6e0205-703f-4dec-af35-283ccc740b37" Sep 11 18:48:46.509356 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:46.509326 2583 generic.go:356] "Generic (PLEG): container finished" podID="0b54490f-a110-4af8-b98c-3bc94b89030b" containerID="0a044eba2b7cc504bd772fbbafcad420723e4af0f0a9ad023a73bc5e95a1578d" exitCode=0 Sep 11 18:48:46.509717 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:46.509365 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tdxsn" event={"ID":"0b54490f-a110-4af8-b98c-3bc94b89030b","Type":"ContainerDied","Data":"0a044eba2b7cc504bd772fbbafcad420723e4af0f0a9ad023a73bc5e95a1578d"} Sep 11 18:48:47.352001 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:47.351960 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:48:47.352001 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:47.352000 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:48:47.352248 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:47.351960 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:47.352248 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:47.352099 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl55g" podUID="bb6e0205-703f-4dec-af35-283ccc740b37" Sep 11 18:48:47.352248 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:47.352157 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kltxq" podUID="06964030-e916-4d42-a39f-96727c8c77a1" Sep 11 18:48:47.352248 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:47.352207 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndw4m" podUID="ba212e38-0ab7-4e51-a8a3-fb8efcc87945" Sep 11 18:48:49.352514 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:49.352473 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:48:49.352514 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:49.352509 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:49.353139 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:49.352509 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:48:49.353139 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:49.352652 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl55g" podUID="bb6e0205-703f-4dec-af35-283ccc740b37" Sep 11 18:48:49.353139 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:49.352743 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kltxq" podUID="06964030-e916-4d42-a39f-96727c8c77a1" Sep 11 18:48:49.353139 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:49.352826 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndw4m" podUID="ba212e38-0ab7-4e51-a8a3-fb8efcc87945" Sep 11 18:48:49.988498 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:49.988457 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5594\" (UniqueName: \"kubernetes.io/projected/ba212e38-0ab7-4e51-a8a3-fb8efcc87945-kube-api-access-m5594\") pod \"network-check-target-ndw4m\" (UID: \"ba212e38-0ab7-4e51-a8a3-fb8efcc87945\") " pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:48:49.988702 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:49.988657 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 18:48:49.988702 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:49.988683 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 18:48:49.988702 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:49.988697 2583 projected.go:196] Error preparing data for projected volume kube-api-access-m5594 for pod openshift-network-diagnostics/network-check-target-ndw4m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 18:48:49.988846 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:49.988765 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba212e38-0ab7-4e51-a8a3-fb8efcc87945-kube-api-access-m5594 podName:ba212e38-0ab7-4e51-a8a3-fb8efcc87945 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:21.988746531 +0000 UTC m=+66.168679232 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-m5594" (UniqueName: "kubernetes.io/projected/ba212e38-0ab7-4e51-a8a3-fb8efcc87945-kube-api-access-m5594") pod "network-check-target-ndw4m" (UID: "ba212e38-0ab7-4e51-a8a3-fb8efcc87945") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 18:48:50.089434 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.089400 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb6e0205-703f-4dec-af35-283ccc740b37-metrics-certs\") pod \"network-metrics-daemon-gl55g\" (UID: \"bb6e0205-703f-4dec-af35-283ccc740b37\") " pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:48:50.089614 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.089463 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06964030-e916-4d42-a39f-96727c8c77a1-original-pull-secret\") pod \"global-pull-secret-syncer-kltxq\" (UID: \"06964030-e916-4d42-a39f-96727c8c77a1\") " pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:50.089614 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:50.089554 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 18:48:50.089614 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:50.089575 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 18:48:50.089768 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:50.089652 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb6e0205-703f-4dec-af35-283ccc740b37-metrics-certs podName:bb6e0205-703f-4dec-af35-283ccc740b37 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:22.089628951 +0000 UTC m=+66.269561646 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb6e0205-703f-4dec-af35-283ccc740b37-metrics-certs") pod "network-metrics-daemon-gl55g" (UID: "bb6e0205-703f-4dec-af35-283ccc740b37") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 18:48:50.089768 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:50.089673 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06964030-e916-4d42-a39f-96727c8c77a1-original-pull-secret podName:06964030-e916-4d42-a39f-96727c8c77a1 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:22.089663631 +0000 UTC m=+66.269596318 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06964030-e916-4d42-a39f-96727c8c77a1-original-pull-secret") pod "global-pull-secret-syncer-kltxq" (UID: "06964030-e916-4d42-a39f-96727c8c77a1") : object "kube-system"/"original-pull-secret" not registered Sep 11 18:48:50.116977 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.116951 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-25.ec2.internal" event="NodeReady" Sep 11 18:48:50.117122 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.117093 2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 11 18:48:50.156290 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.156252 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-94bfd4bf6-fcrbl"] Sep 11 18:48:50.160849 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.160826 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:48:50.164035 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.163833 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 11 18:48:50.164035 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.163848 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 11 18:48:50.164218 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.164111 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 11 18:48:50.164462 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.164360 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6x27g\"" Sep 11 18:48:50.172777 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.172694 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 11 18:48:50.175486 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.173291 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-94bfd4bf6-fcrbl"] Sep 11 18:48:50.177236 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.177212 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5mls5"] Sep 11 18:48:50.180284 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.180267 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kjvqf"] Sep 11 18:48:50.180399 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.180382 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5mls5" Sep 11 18:48:50.183356 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.183337 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kjvqf" Sep 11 18:48:50.184160 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.184140 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 11 18:48:50.184160 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.184151 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 11 18:48:50.184442 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.184424 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r5955\"" Sep 11 18:48:50.186216 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.186173 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qs8n2\"" Sep 11 18:48:50.186421 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.186374 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 11 18:48:50.186421 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.186399 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 11 18:48:50.186556 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.186414 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 11 18:48:50.192642 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.192438 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5mls5"] Sep 11 18:48:50.193487 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.193467 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kjvqf"] Sep 11 18:48:50.291525 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.291444 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjp7f\" (UniqueName: \"kubernetes.io/projected/fafb9edb-7b18-4285-bfbc-e44847347967-kube-api-access-qjp7f\") pod \"dns-default-5mls5\" (UID: \"fafb9edb-7b18-4285-bfbc-e44847347967\") " pod="openshift-dns/dns-default-5mls5" Sep 11 18:48:50.291525 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.291487 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-certificates\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:48:50.291762 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.291535 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbt6s\" (UniqueName: \"kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-kube-api-access-sbt6s\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:48:50.291762 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.291559 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/efce9264-857f-4ebe-9412-3ef1b95ec9f7-image-registry-private-configuration\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:48:50.291762 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.291601 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-tls\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:48:50.291762 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.291650 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc3f63b6-c621-4d27-9e27-4a9709ef75f6-cert\") pod \"ingress-canary-kjvqf\" (UID: \"dc3f63b6-c621-4d27-9e27-4a9709ef75f6\") " pod="openshift-ingress-canary/ingress-canary-kjvqf" Sep 11 18:48:50.291762 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.291724 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/efce9264-857f-4ebe-9412-3ef1b95ec9f7-trusted-ca\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:48:50.291762 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.291757 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/efce9264-857f-4ebe-9412-3ef1b95ec9f7-installation-pull-secrets\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:48:50.291990 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.291803 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fafb9edb-7b18-4285-bfbc-e44847347967-config-volume\") pod \"dns-default-5mls5\" (UID: \"fafb9edb-7b18-4285-bfbc-e44847347967\") " pod="openshift-dns/dns-default-5mls5" Sep 11 18:48:50.291990 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.291842 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fafb9edb-7b18-4285-bfbc-e44847347967-tmp-dir\") pod \"dns-default-5mls5\" (UID: \"fafb9edb-7b18-4285-bfbc-e44847347967\") " pod="openshift-dns/dns-default-5mls5" Sep 11 18:48:50.291990 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.291880 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-bound-sa-token\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:48:50.291990 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.291918 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/efce9264-857f-4ebe-9412-3ef1b95ec9f7-ca-trust-extracted\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:48:50.292139 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.291989 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fafb9edb-7b18-4285-bfbc-e44847347967-metrics-tls\") pod \"dns-default-5mls5\" (UID: \"fafb9edb-7b18-4285-bfbc-e44847347967\") " pod="openshift-dns/dns-default-5mls5" Sep 11 18:48:50.292139 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.292014 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrc5h\" (UniqueName: \"kubernetes.io/projected/dc3f63b6-c621-4d27-9e27-4a9709ef75f6-kube-api-access-mrc5h\") pod \"ingress-canary-kjvqf\" (UID: \"dc3f63b6-c621-4d27-9e27-4a9709ef75f6\") " pod="openshift-ingress-canary/ingress-canary-kjvqf" Sep 11 18:48:50.335156 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.335108 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zsn78_d2d05796-e12c-4be6-a44b-f221b91594e3/konnectivity-agent/0.log" limit=1024 Sep 11 18:48:50.392811 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.392774 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fafb9edb-7b18-4285-bfbc-e44847347967-tmp-dir\") pod \"dns-default-5mls5\" (UID: \"fafb9edb-7b18-4285-bfbc-e44847347967\") " pod="openshift-dns/dns-default-5mls5" Sep 11 18:48:50.392811 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.392814 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-bound-sa-token\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:48:50.393310 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.392839 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/efce9264-857f-4ebe-9412-3ef1b95ec9f7-ca-trust-extracted\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:48:50.393310 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.392904 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fafb9edb-7b18-4285-bfbc-e44847347967-metrics-tls\") pod \"dns-default-5mls5\" (UID: \"fafb9edb-7b18-4285-bfbc-e44847347967\") " pod="openshift-dns/dns-default-5mls5" Sep 11 18:48:50.393310 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.392933 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrc5h\" (UniqueName: \"kubernetes.io/projected/dc3f63b6-c621-4d27-9e27-4a9709ef75f6-kube-api-access-mrc5h\") pod \"ingress-canary-kjvqf\" (UID: \"dc3f63b6-c621-4d27-9e27-4a9709ef75f6\") " pod="openshift-ingress-canary/ingress-canary-kjvqf" Sep 11 18:48:50.393310 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.392965 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjp7f\" (UniqueName: \"kubernetes.io/projected/fafb9edb-7b18-4285-bfbc-e44847347967-kube-api-access-qjp7f\") pod \"dns-default-5mls5\" (UID: \"fafb9edb-7b18-4285-bfbc-e44847347967\") " pod="openshift-dns/dns-default-5mls5" Sep 11 18:48:50.393310 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.392992 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-certificates\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:48:50.393310 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:50.393010 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 18:48:50.393310 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.393030 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbt6s\" (UniqueName: \"kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-kube-api-access-sbt6s\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:48:50.393310 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.393058 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/efce9264-857f-4ebe-9412-3ef1b95ec9f7-image-registry-private-configuration\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:48:50.393310 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:50.393086 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fafb9edb-7b18-4285-bfbc-e44847347967-metrics-tls podName:fafb9edb-7b18-4285-bfbc-e44847347967 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:50.893066484 +0000 UTC m=+35.072999182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fafb9edb-7b18-4285-bfbc-e44847347967-metrics-tls") pod "dns-default-5mls5" (UID: "fafb9edb-7b18-4285-bfbc-e44847347967") : secret "dns-default-metrics-tls" not found Sep 11 18:48:50.393310 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.393122 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-tls\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:48:50.393310 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.393140 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fafb9edb-7b18-4285-bfbc-e44847347967-tmp-dir\") pod \"dns-default-5mls5\" (UID: \"fafb9edb-7b18-4285-bfbc-e44847347967\") " pod="openshift-dns/dns-default-5mls5" Sep 11 18:48:50.393310 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.393148 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc3f63b6-c621-4d27-9e27-4a9709ef75f6-cert\") pod \"ingress-canary-kjvqf\" (UID: \"dc3f63b6-c621-4d27-9e27-4a9709ef75f6\") " pod="openshift-ingress-canary/ingress-canary-kjvqf" Sep 11 18:48:50.393310 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.393174 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/efce9264-857f-4ebe-9412-3ef1b95ec9f7-trusted-ca\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:48:50.393310 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.393200 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/efce9264-857f-4ebe-9412-3ef1b95ec9f7-installation-pull-secrets\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:48:50.393310 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.393233 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fafb9edb-7b18-4285-bfbc-e44847347967-config-volume\") pod \"dns-default-5mls5\" (UID: \"fafb9edb-7b18-4285-bfbc-e44847347967\") " pod="openshift-dns/dns-default-5mls5" Sep 11 18:48:50.393310 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.393239 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/efce9264-857f-4ebe-9412-3ef1b95ec9f7-ca-trust-extracted\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:48:50.394035 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:50.393430 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 11 18:48:50.394035 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:50.393445 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-94bfd4bf6-fcrbl: secret "image-registry-tls" not found Sep 11 18:48:50.394035 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:50.393490 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-tls podName:efce9264-857f-4ebe-9412-3ef1b95ec9f7 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:50.8934746 +0000 UTC m=+35.073407287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-tls") pod "image-registry-94bfd4bf6-fcrbl" (UID: "efce9264-857f-4ebe-9412-3ef1b95ec9f7") : secret "image-registry-tls" not found Sep 11 18:48:50.394035 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.393724 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-certificates\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:48:50.394035 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.393899 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fafb9edb-7b18-4285-bfbc-e44847347967-config-volume\") pod \"dns-default-5mls5\" (UID: \"fafb9edb-7b18-4285-bfbc-e44847347967\") " pod="openshift-dns/dns-default-5mls5" Sep 11 18:48:50.394253 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.394227 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/efce9264-857f-4ebe-9412-3ef1b95ec9f7-trusted-ca\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:48:50.397402 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.397298 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/efce9264-857f-4ebe-9412-3ef1b95ec9f7-installation-pull-secrets\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:48:50.397506 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.397298 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/efce9264-857f-4ebe-9412-3ef1b95ec9f7-image-registry-private-configuration\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:48:50.397506 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.397375 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc3f63b6-c621-4d27-9e27-4a9709ef75f6-cert\") pod \"ingress-canary-kjvqf\" (UID: \"dc3f63b6-c621-4d27-9e27-4a9709ef75f6\") " pod="openshift-ingress-canary/ingress-canary-kjvqf" Sep 11 18:48:50.405125 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.405095 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjp7f\" (UniqueName: \"kubernetes.io/projected/fafb9edb-7b18-4285-bfbc-e44847347967-kube-api-access-qjp7f\") pod \"dns-default-5mls5\" (UID: \"fafb9edb-7b18-4285-bfbc-e44847347967\") " pod="openshift-dns/dns-default-5mls5" Sep 11 18:48:50.405519 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.405501 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrc5h\" (UniqueName: \"kubernetes.io/projected/dc3f63b6-c621-4d27-9e27-4a9709ef75f6-kube-api-access-mrc5h\") pod \"ingress-canary-kjvqf\" (UID: \"dc3f63b6-c621-4d27-9e27-4a9709ef75f6\") " pod="openshift-ingress-canary/ingress-canary-kjvqf" Sep 11 18:48:50.405602 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.405574 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-bound-sa-token\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:48:50.405772 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.405751 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbt6s\" (UniqueName: \"kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-kube-api-access-sbt6s\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:48:50.427670 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.427643 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zsn78_d2d05796-e12c-4be6-a44b-f221b91594e3/konnectivity-agent/0.log" limit=1024 Sep 11 18:48:50.498453 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.498427 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kjvqf" Sep 11 18:48:50.522309 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.522274 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tdxsn" event={"ID":"0b54490f-a110-4af8-b98c-3bc94b89030b","Type":"ContainerStarted","Data":"7a881bb703cdf7ca2346b7718f00ea8ff4da4fc44baae291d612d14b8897d361"} Sep 11 18:48:50.777216 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.777189 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kjvqf"] Sep 11 18:48:50.780112 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:48:50.780086 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc3f63b6_c621_4d27_9e27_4a9709ef75f6.slice/crio-a07809720e4704d13befa493e3d438ffa5f666cbfe6ca9c252a4c1be56828dd1 WatchSource:0}: Error finding container a07809720e4704d13befa493e3d438ffa5f666cbfe6ca9c252a4c1be56828dd1: Status 404 returned error can't find the container with id a07809720e4704d13befa493e3d438ffa5f666cbfe6ca9c252a4c1be56828dd1 Sep 11 18:48:50.898561 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.898518 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fafb9edb-7b18-4285-bfbc-e44847347967-metrics-tls\") pod \"dns-default-5mls5\" (UID: \"fafb9edb-7b18-4285-bfbc-e44847347967\") " pod="openshift-dns/dns-default-5mls5" Sep 11 18:48:50.898749 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:50.898602 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-tls\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:48:50.898749 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:50.898692 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 18:48:50.898830 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:50.898759 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fafb9edb-7b18-4285-bfbc-e44847347967-metrics-tls podName:fafb9edb-7b18-4285-bfbc-e44847347967 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:51.898744101 +0000 UTC m=+36.078676787 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fafb9edb-7b18-4285-bfbc-e44847347967-metrics-tls") pod "dns-default-5mls5" (UID: "fafb9edb-7b18-4285-bfbc-e44847347967") : secret "dns-default-metrics-tls" not found Sep 11 18:48:50.898830 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:50.898764 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 11 18:48:50.898830 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:50.898781 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-94bfd4bf6-fcrbl: secret "image-registry-tls" not found Sep 11 18:48:50.898927 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:50.898832 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-tls podName:efce9264-857f-4ebe-9412-3ef1b95ec9f7 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:51.898819994 +0000 UTC m=+36.078752680 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-tls") pod "image-registry-94bfd4bf6-fcrbl" (UID: "efce9264-857f-4ebe-9412-3ef1b95ec9f7") : secret "image-registry-tls" not found Sep 11 18:48:51.351924 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:51.351887 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:48:51.351924 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:51.351929 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:48:51.352169 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:51.351887 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:48:51.354983 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:51.354962 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nqpv8\"" Sep 11 18:48:51.356273 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:51.356253 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b95w2\"" Sep 11 18:48:51.356390 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:51.356280 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 11 18:48:51.356390 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:51.356319 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 11 18:48:51.356559 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:51.356531 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 11 18:48:51.356676 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:51.356598 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 11 18:48:51.532677 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:51.532639 2583 generic.go:356] "Generic (PLEG): container finished" podID="0b54490f-a110-4af8-b98c-3bc94b89030b" containerID="7a881bb703cdf7ca2346b7718f00ea8ff4da4fc44baae291d612d14b8897d361" exitCode=0 Sep 11 18:48:51.533478 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:51.532742 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tdxsn" event={"ID":"0b54490f-a110-4af8-b98c-3bc94b89030b","Type":"ContainerDied","Data":"7a881bb703cdf7ca2346b7718f00ea8ff4da4fc44baae291d612d14b8897d361"} Sep 11 18:48:51.534769 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:51.534743 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kjvqf" event={"ID":"dc3f63b6-c621-4d27-9e27-4a9709ef75f6","Type":"ContainerStarted","Data":"a07809720e4704d13befa493e3d438ffa5f666cbfe6ca9c252a4c1be56828dd1"} Sep 11 18:48:51.908277 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:51.908185 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fafb9edb-7b18-4285-bfbc-e44847347967-metrics-tls\") pod \"dns-default-5mls5\" (UID: \"fafb9edb-7b18-4285-bfbc-e44847347967\") " pod="openshift-dns/dns-default-5mls5" Sep 11 18:48:51.908441 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:51.908309 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-tls\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:48:51.908441 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:51.908357 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 18:48:51.908441 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:51.908428 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 11 18:48:51.908627 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:51.908449 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-94bfd4bf6-fcrbl: secret "image-registry-tls" not found Sep 11 18:48:51.908627 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:51.908433 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fafb9edb-7b18-4285-bfbc-e44847347967-metrics-tls podName:fafb9edb-7b18-4285-bfbc-e44847347967 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:53.908413547 +0000 UTC m=+38.088346249 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fafb9edb-7b18-4285-bfbc-e44847347967-metrics-tls") pod "dns-default-5mls5" (UID: "fafb9edb-7b18-4285-bfbc-e44847347967") : secret "dns-default-metrics-tls" not found Sep 11 18:48:51.908627 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:51.908512 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-tls podName:efce9264-857f-4ebe-9412-3ef1b95ec9f7 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:53.908494591 +0000 UTC m=+38.088427277 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-tls") pod "image-registry-94bfd4bf6-fcrbl" (UID: "efce9264-857f-4ebe-9412-3ef1b95ec9f7") : secret "image-registry-tls" not found Sep 11 18:48:52.541410 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:52.541373 2583 generic.go:356] "Generic (PLEG): container finished" podID="0b54490f-a110-4af8-b98c-3bc94b89030b" containerID="a0ed4e2cf27efa25aeaef34647fa2869d967a79a551a7a1e8354f241b4dcc52a" exitCode=0 Sep 11 18:48:52.541883 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:52.541429 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tdxsn" event={"ID":"0b54490f-a110-4af8-b98c-3bc94b89030b","Type":"ContainerDied","Data":"a0ed4e2cf27efa25aeaef34647fa2869d967a79a551a7a1e8354f241b4dcc52a"} Sep 11 18:48:53.546907 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:53.546871 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tdxsn" event={"ID":"0b54490f-a110-4af8-b98c-3bc94b89030b","Type":"ContainerStarted","Data":"4b76f71ed02f41a0da66a21dca57511a2634c58ba9f853004b5bc8bf0d5d470a"} Sep 11 18:48:53.548225 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:53.548203 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kjvqf" event={"ID":"dc3f63b6-c621-4d27-9e27-4a9709ef75f6","Type":"ContainerStarted","Data":"c2f5cdda22ec183c38b04c68c0f0f2f634d6d3808168afa6c5429ba6c4d0ccb9"} Sep 11 18:48:53.576251 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:53.576209 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tdxsn" podStartSLOduration=9.21490113 podStartE2EDuration="37.57619439s" totalImagesPullingTime="28.36129326s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:48:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:48:53.574512922 +0000 UTC m=+37.754445630" watchObservedRunningTime="2026-09-11 18:48:53.57619439 +0000 UTC m=+37.756127098" Sep 11 18:48:53.595220 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:53.595177 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kjvqf" podStartSLOduration=1.418720368 podStartE2EDuration="3.595161347s" totalImagesPullingTime="2.176440979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:48:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:48:53.594569503 +0000 UTC m=+37.774502211" watchObservedRunningTime="2026-09-11 18:48:53.595161347 +0000 UTC m=+37.775094055" Sep 11 18:48:53.710175 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:53.710091 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zsn78_d2d05796-e12c-4be6-a44b-f221b91594e3/konnectivity-agent/0.log" limit=1024 Sep 11 18:48:53.809248 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:53.809214 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zsn78_d2d05796-e12c-4be6-a44b-f221b91594e3/konnectivity-agent/0.log" limit=1024 Sep 11 18:48:53.924880 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:53.924845 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fafb9edb-7b18-4285-bfbc-e44847347967-metrics-tls\") pod \"dns-default-5mls5\" (UID: \"fafb9edb-7b18-4285-bfbc-e44847347967\") " pod="openshift-dns/dns-default-5mls5" Sep 11 18:48:53.925035 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:53.924892 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-tls\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:48:53.925035 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:53.924984 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 11 18:48:53.925035 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:53.924995 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-94bfd4bf6-fcrbl: secret "image-registry-tls" not found Sep 11 18:48:53.925152 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:53.925040 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-tls podName:efce9264-857f-4ebe-9412-3ef1b95ec9f7 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:57.925026546 +0000 UTC m=+42.104959236 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-tls") pod "image-registry-94bfd4bf6-fcrbl" (UID: "efce9264-857f-4ebe-9412-3ef1b95ec9f7") : secret "image-registry-tls" not found Sep 11 18:48:53.925152 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:53.924984 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 18:48:53.925152 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:53.925124 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fafb9edb-7b18-4285-bfbc-e44847347967-metrics-tls podName:fafb9edb-7b18-4285-bfbc-e44847347967 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:57.925111142 +0000 UTC m=+42.105043827 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fafb9edb-7b18-4285-bfbc-e44847347967-metrics-tls") pod "dns-default-5mls5" (UID: "fafb9edb-7b18-4285-bfbc-e44847347967") : secret "dns-default-metrics-tls" not found Sep 11 18:48:57.952196 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:57.952151 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-tls\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:48:57.952759 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:48:57.952251 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fafb9edb-7b18-4285-bfbc-e44847347967-metrics-tls\") pod \"dns-default-5mls5\" (UID: \"fafb9edb-7b18-4285-bfbc-e44847347967\") " pod="openshift-dns/dns-default-5mls5" Sep 11 18:48:57.952759 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:57.952323 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 11 18:48:57.952759 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:57.952343 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-94bfd4bf6-fcrbl: secret "image-registry-tls" not found Sep 11 18:48:57.952759 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:57.952370 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 18:48:57.952759 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:57.952402 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-tls podName:efce9264-857f-4ebe-9412-3ef1b95ec9f7 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:05.952384096 +0000 UTC m=+50.132316798 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-tls") pod "image-registry-94bfd4bf6-fcrbl" (UID: "efce9264-857f-4ebe-9412-3ef1b95ec9f7") : secret "image-registry-tls" not found Sep 11 18:48:57.952759 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:48:57.952417 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fafb9edb-7b18-4285-bfbc-e44847347967-metrics-tls podName:fafb9edb-7b18-4285-bfbc-e44847347967 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:05.952411243 +0000 UTC m=+50.132343929 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fafb9edb-7b18-4285-bfbc-e44847347967-metrics-tls") pod "dns-default-5mls5" (UID: "fafb9edb-7b18-4285-bfbc-e44847347967") : secret "dns-default-metrics-tls" not found Sep 11 18:49:05.078344 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:05.078312 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-597d5b6488-czf89"] Sep 11 18:49:05.107423 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:05.107401 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-597d5b6488-czf89"] Sep 11 18:49:05.107553 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:05.107489 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:49:05.111008 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:05.110986 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 11 18:49:05.111121 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:05.110988 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 11 18:49:05.111121 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:05.111032 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 11 18:49:05.111121 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:05.110988 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 11 18:49:05.111525 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:05.111509 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 11 18:49:05.111773 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:05.111756 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-2jzhd\"" Sep 11 18:49:05.112126 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:05.112113 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 11 18:49:05.203089 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:05.203051 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a3662ef-c0c0-4673-a66c-173e38736517-service-ca-bundle\") pod \"router-default-597d5b6488-czf89\" (UID: \"1a3662ef-c0c0-4673-a66c-173e38736517\") " pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:49:05.203089 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:05.203090 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1a3662ef-c0c0-4673-a66c-173e38736517-default-certificate\") pod \"router-default-597d5b6488-czf89\" (UID: \"1a3662ef-c0c0-4673-a66c-173e38736517\") " pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:49:05.203400 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:05.203117 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a3662ef-c0c0-4673-a66c-173e38736517-metrics-certs\") pod \"router-default-597d5b6488-czf89\" (UID: \"1a3662ef-c0c0-4673-a66c-173e38736517\") " pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:49:05.203400 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:05.203209 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1a3662ef-c0c0-4673-a66c-173e38736517-stats-auth\") pod \"router-default-597d5b6488-czf89\" (UID: \"1a3662ef-c0c0-4673-a66c-173e38736517\") " pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:49:05.203400 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:05.203236 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctrbs\" (UniqueName: \"kubernetes.io/projected/1a3662ef-c0c0-4673-a66c-173e38736517-kube-api-access-ctrbs\") pod \"router-default-597d5b6488-czf89\" (UID: \"1a3662ef-c0c0-4673-a66c-173e38736517\") " pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:49:05.307644 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:05.307607 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a3662ef-c0c0-4673-a66c-173e38736517-service-ca-bundle\") pod \"router-default-597d5b6488-czf89\" (UID: \"1a3662ef-c0c0-4673-a66c-173e38736517\") " pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:49:05.307644 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:05.307647 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1a3662ef-c0c0-4673-a66c-173e38736517-default-certificate\") pod \"router-default-597d5b6488-czf89\" (UID: \"1a3662ef-c0c0-4673-a66c-173e38736517\") " pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:49:05.307861 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:05.307680 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a3662ef-c0c0-4673-a66c-173e38736517-metrics-certs\") pod \"router-default-597d5b6488-czf89\" (UID: \"1a3662ef-c0c0-4673-a66c-173e38736517\") " pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:49:05.307861 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:05.307711 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1a3662ef-c0c0-4673-a66c-173e38736517-stats-auth\") pod \"router-default-597d5b6488-czf89\" (UID: \"1a3662ef-c0c0-4673-a66c-173e38736517\") " pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:49:05.307861 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:05.307725 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctrbs\" (UniqueName: \"kubernetes.io/projected/1a3662ef-c0c0-4673-a66c-173e38736517-kube-api-access-ctrbs\") pod \"router-default-597d5b6488-czf89\" (UID: \"1a3662ef-c0c0-4673-a66c-173e38736517\") " pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:49:05.307861 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:05.307789 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1a3662ef-c0c0-4673-a66c-173e38736517-service-ca-bundle podName:1a3662ef-c0c0-4673-a66c-173e38736517 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:05.807765012 +0000 UTC m=+49.987697719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1a3662ef-c0c0-4673-a66c-173e38736517-service-ca-bundle") pod "router-default-597d5b6488-czf89" (UID: "1a3662ef-c0c0-4673-a66c-173e38736517") : configmap references non-existent config key: service-ca.crt Sep 11 18:49:05.307861 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:05.307826 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 11 18:49:05.308098 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:05.307900 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a3662ef-c0c0-4673-a66c-173e38736517-metrics-certs podName:1a3662ef-c0c0-4673-a66c-173e38736517 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:05.807883235 +0000 UTC m=+49.987815935 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a3662ef-c0c0-4673-a66c-173e38736517-metrics-certs") pod "router-default-597d5b6488-czf89" (UID: "1a3662ef-c0c0-4673-a66c-173e38736517") : secret "router-metrics-certs-default" not found Sep 11 18:49:05.311172 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:05.311146 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1a3662ef-c0c0-4673-a66c-173e38736517-stats-auth\") pod \"router-default-597d5b6488-czf89\" (UID: \"1a3662ef-c0c0-4673-a66c-173e38736517\") " pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:49:05.311281 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:05.311184 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1a3662ef-c0c0-4673-a66c-173e38736517-default-certificate\") pod \"router-default-597d5b6488-czf89\" (UID: \"1a3662ef-c0c0-4673-a66c-173e38736517\") " pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:49:05.322818 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:05.322792 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctrbs\" (UniqueName: \"kubernetes.io/projected/1a3662ef-c0c0-4673-a66c-173e38736517-kube-api-access-ctrbs\") pod \"router-default-597d5b6488-czf89\" (UID: \"1a3662ef-c0c0-4673-a66c-173e38736517\") " pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:49:05.812283 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:05.812241 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a3662ef-c0c0-4673-a66c-173e38736517-service-ca-bundle\") pod \"router-default-597d5b6488-czf89\" (UID: \"1a3662ef-c0c0-4673-a66c-173e38736517\") " pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:49:05.812283 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:05.812294 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a3662ef-c0c0-4673-a66c-173e38736517-metrics-certs\") pod \"router-default-597d5b6488-czf89\" (UID: \"1a3662ef-c0c0-4673-a66c-173e38736517\") " pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:49:05.812572 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:05.812395 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 11 18:49:05.812572 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:05.812431 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1a3662ef-c0c0-4673-a66c-173e38736517-service-ca-bundle podName:1a3662ef-c0c0-4673-a66c-173e38736517 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:06.812412967 +0000 UTC m=+50.992345656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1a3662ef-c0c0-4673-a66c-173e38736517-service-ca-bundle") pod "router-default-597d5b6488-czf89" (UID: "1a3662ef-c0c0-4673-a66c-173e38736517") : configmap references non-existent config key: service-ca.crt Sep 11 18:49:05.812572 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:05.812458 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a3662ef-c0c0-4673-a66c-173e38736517-metrics-certs podName:1a3662ef-c0c0-4673-a66c-173e38736517 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:06.812451428 +0000 UTC m=+50.992384114 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a3662ef-c0c0-4673-a66c-173e38736517-metrics-certs") pod "router-default-597d5b6488-czf89" (UID: "1a3662ef-c0c0-4673-a66c-173e38736517") : secret "router-metrics-certs-default" not found Sep 11 18:49:06.014312 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:06.014273 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fafb9edb-7b18-4285-bfbc-e44847347967-metrics-tls\") pod \"dns-default-5mls5\" (UID: \"fafb9edb-7b18-4285-bfbc-e44847347967\") " pod="openshift-dns/dns-default-5mls5" Sep 11 18:49:06.014471 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:06.014336 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-tls\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:49:06.014471 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:06.014420 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 18:49:06.014542 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:06.014482 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fafb9edb-7b18-4285-bfbc-e44847347967-metrics-tls podName:fafb9edb-7b18-4285-bfbc-e44847347967 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:22.014467683 +0000 UTC m=+66.194400370 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fafb9edb-7b18-4285-bfbc-e44847347967-metrics-tls") pod "dns-default-5mls5" (UID: "fafb9edb-7b18-4285-bfbc-e44847347967") : secret "dns-default-metrics-tls" not found Sep 11 18:49:06.014542 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:06.014423 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 11 18:49:06.014542 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:06.014523 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-94bfd4bf6-fcrbl: secret "image-registry-tls" not found Sep 11 18:49:06.014664 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:06.014575 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-tls podName:efce9264-857f-4ebe-9412-3ef1b95ec9f7 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:22.014559484 +0000 UTC m=+66.194492174 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-tls") pod "image-registry-94bfd4bf6-fcrbl" (UID: "efce9264-857f-4ebe-9412-3ef1b95ec9f7") : secret "image-registry-tls" not found Sep 11 18:49:06.820365 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:06.820329 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a3662ef-c0c0-4673-a66c-173e38736517-service-ca-bundle\") pod \"router-default-597d5b6488-czf89\" (UID: \"1a3662ef-c0c0-4673-a66c-173e38736517\") " pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:49:06.820776 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:06.820379 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a3662ef-c0c0-4673-a66c-173e38736517-metrics-certs\") pod \"router-default-597d5b6488-czf89\" (UID: \"1a3662ef-c0c0-4673-a66c-173e38736517\") " pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:49:06.820776 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:06.820451 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1a3662ef-c0c0-4673-a66c-173e38736517-service-ca-bundle podName:1a3662ef-c0c0-4673-a66c-173e38736517 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:08.820433787 +0000 UTC m=+53.000366485 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1a3662ef-c0c0-4673-a66c-173e38736517-service-ca-bundle") pod "router-default-597d5b6488-czf89" (UID: "1a3662ef-c0c0-4673-a66c-173e38736517") : configmap references non-existent config key: service-ca.crt Sep 11 18:49:06.820776 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:06.820502 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 11 18:49:06.820776 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:06.820556 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a3662ef-c0c0-4673-a66c-173e38736517-metrics-certs podName:1a3662ef-c0c0-4673-a66c-173e38736517 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:08.820534194 +0000 UTC m=+53.000466892 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a3662ef-c0c0-4673-a66c-173e38736517-metrics-certs") pod "router-default-597d5b6488-czf89" (UID: "1a3662ef-c0c0-4673-a66c-173e38736517") : secret "router-metrics-certs-default" not found Sep 11 18:49:08.836366 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:08.836323 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a3662ef-c0c0-4673-a66c-173e38736517-service-ca-bundle\") pod \"router-default-597d5b6488-czf89\" (UID: \"1a3662ef-c0c0-4673-a66c-173e38736517\") " pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:49:08.836781 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:08.836382 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a3662ef-c0c0-4673-a66c-173e38736517-metrics-certs\") pod \"router-default-597d5b6488-czf89\" (UID: \"1a3662ef-c0c0-4673-a66c-173e38736517\") " pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:49:08.836781 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:08.836493 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 11 18:49:08.836781 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:08.836520 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1a3662ef-c0c0-4673-a66c-173e38736517-service-ca-bundle podName:1a3662ef-c0c0-4673-a66c-173e38736517 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:12.836500518 +0000 UTC m=+57.016433205 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1a3662ef-c0c0-4673-a66c-173e38736517-service-ca-bundle") pod "router-default-597d5b6488-czf89" (UID: "1a3662ef-c0c0-4673-a66c-173e38736517") : configmap references non-existent config key: service-ca.crt Sep 11 18:49:08.836781 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:08.836546 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a3662ef-c0c0-4673-a66c-173e38736517-metrics-certs podName:1a3662ef-c0c0-4673-a66c-173e38736517 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:12.836531607 +0000 UTC m=+57.016464296 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a3662ef-c0c0-4673-a66c-173e38736517-metrics-certs") pod "router-default-597d5b6488-czf89" (UID: "1a3662ef-c0c0-4673-a66c-173e38736517") : secret "router-metrics-certs-default" not found Sep 11 18:49:10.333802 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:10.333763 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-d7msf"] Sep 11 18:49:10.338646 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:10.338624 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d7msf" Sep 11 18:49:10.341408 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:10.341386 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 11 18:49:10.341697 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:10.341680 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 11 18:49:10.341793 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:10.341755 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9lhvm\"" Sep 11 18:49:10.341793 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:10.341785 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 11 18:49:10.342730 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:10.342712 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 11 18:49:10.347963 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:10.347942 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d7msf"] Sep 11 18:49:10.450210 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:10.450179 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4d126684-1402-472d-b32f-44bfdbc5eb82-crio-socket\") pod \"insights-runtime-extractor-d7msf\" (UID: \"4d126684-1402-472d-b32f-44bfdbc5eb82\") " pod="openshift-insights/insights-runtime-extractor-d7msf" Sep 11 18:49:10.450391 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:10.450233 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ptbm\" (UniqueName: \"kubernetes.io/projected/4d126684-1402-472d-b32f-44bfdbc5eb82-kube-api-access-8ptbm\") pod \"insights-runtime-extractor-d7msf\" (UID: \"4d126684-1402-472d-b32f-44bfdbc5eb82\") " pod="openshift-insights/insights-runtime-extractor-d7msf" Sep 11 18:49:10.450391 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:10.450271 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d126684-1402-472d-b32f-44bfdbc5eb82-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d7msf\" (UID: \"4d126684-1402-472d-b32f-44bfdbc5eb82\") " pod="openshift-insights/insights-runtime-extractor-d7msf" Sep 11 18:49:10.450391 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:10.450315 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d126684-1402-472d-b32f-44bfdbc5eb82-data-volume\") pod \"insights-runtime-extractor-d7msf\" (UID: \"4d126684-1402-472d-b32f-44bfdbc5eb82\") " pod="openshift-insights/insights-runtime-extractor-d7msf" Sep 11 18:49:10.450391 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:10.450338 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d126684-1402-472d-b32f-44bfdbc5eb82-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d7msf\" (UID: \"4d126684-1402-472d-b32f-44bfdbc5eb82\") " pod="openshift-insights/insights-runtime-extractor-d7msf" Sep 11 18:49:10.551563 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:10.551528 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4d126684-1402-472d-b32f-44bfdbc5eb82-crio-socket\") pod \"insights-runtime-extractor-d7msf\" (UID: \"4d126684-1402-472d-b32f-44bfdbc5eb82\") " pod="openshift-insights/insights-runtime-extractor-d7msf" Sep 11 18:49:10.551682 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:10.551660 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4d126684-1402-472d-b32f-44bfdbc5eb82-crio-socket\") pod \"insights-runtime-extractor-d7msf\" (UID: \"4d126684-1402-472d-b32f-44bfdbc5eb82\") " pod="openshift-insights/insights-runtime-extractor-d7msf" Sep 11 18:49:10.551722 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:10.551696 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ptbm\" (UniqueName: \"kubernetes.io/projected/4d126684-1402-472d-b32f-44bfdbc5eb82-kube-api-access-8ptbm\") pod \"insights-runtime-extractor-d7msf\" (UID: \"4d126684-1402-472d-b32f-44bfdbc5eb82\") " pod="openshift-insights/insights-runtime-extractor-d7msf" Sep 11 18:49:10.551754 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:10.551736 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d126684-1402-472d-b32f-44bfdbc5eb82-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d7msf\" (UID: \"4d126684-1402-472d-b32f-44bfdbc5eb82\") " pod="openshift-insights/insights-runtime-extractor-d7msf" Sep 11 18:49:10.551787 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:10.551765 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d126684-1402-472d-b32f-44bfdbc5eb82-data-volume\") pod \"insights-runtime-extractor-d7msf\" (UID: \"4d126684-1402-472d-b32f-44bfdbc5eb82\") " pod="openshift-insights/insights-runtime-extractor-d7msf" Sep 11 18:49:10.551787 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:10.551780 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d126684-1402-472d-b32f-44bfdbc5eb82-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d7msf\" (UID: \"4d126684-1402-472d-b32f-44bfdbc5eb82\") " pod="openshift-insights/insights-runtime-extractor-d7msf" Sep 11 18:49:10.551893 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:10.551878 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 18:49:10.551926 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:10.551915 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 11 18:49:10.551957 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:10.551943 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d126684-1402-472d-b32f-44bfdbc5eb82-insights-runtime-extractor-tls podName:4d126684-1402-472d-b32f-44bfdbc5eb82 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:11.051922423 +0000 UTC m=+55.231855109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4d126684-1402-472d-b32f-44bfdbc5eb82-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d7msf" (UID: "4d126684-1402-472d-b32f-44bfdbc5eb82") : secret "insights-runtime-extractor-tls" not found Sep 11 18:49:10.551998 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:10.551964 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d126684-1402-472d-b32f-44bfdbc5eb82-kube-rbac-proxy-cm podName:4d126684-1402-472d-b32f-44bfdbc5eb82 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:11.051949423 +0000 UTC m=+55.231882119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4d126684-1402-472d-b32f-44bfdbc5eb82-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d7msf" (UID: "4d126684-1402-472d-b32f-44bfdbc5eb82") : configmap "kube-rbac-proxy" not found Sep 11 18:49:10.552127 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:10.552112 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d126684-1402-472d-b32f-44bfdbc5eb82-data-volume\") pod \"insights-runtime-extractor-d7msf\" (UID: \"4d126684-1402-472d-b32f-44bfdbc5eb82\") " pod="openshift-insights/insights-runtime-extractor-d7msf" Sep 11 18:49:10.560620 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:10.560576 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ptbm\" (UniqueName: \"kubernetes.io/projected/4d126684-1402-472d-b32f-44bfdbc5eb82-kube-api-access-8ptbm\") pod \"insights-runtime-extractor-d7msf\" (UID: \"4d126684-1402-472d-b32f-44bfdbc5eb82\") " pod="openshift-insights/insights-runtime-extractor-d7msf" Sep 11 18:49:11.057098 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:11.057066 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d126684-1402-472d-b32f-44bfdbc5eb82-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d7msf\" (UID: \"4d126684-1402-472d-b32f-44bfdbc5eb82\") " pod="openshift-insights/insights-runtime-extractor-d7msf" Sep 11 18:49:11.057098 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:11.057109 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d126684-1402-472d-b32f-44bfdbc5eb82-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d7msf\" (UID: \"4d126684-1402-472d-b32f-44bfdbc5eb82\") " pod="openshift-insights/insights-runtime-extractor-d7msf" Sep 11 18:49:11.057303 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:11.057202 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 18:49:11.057303 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:11.057251 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 11 18:49:11.057303 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:11.057273 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d126684-1402-472d-b32f-44bfdbc5eb82-insights-runtime-extractor-tls podName:4d126684-1402-472d-b32f-44bfdbc5eb82 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:12.057257674 +0000 UTC m=+56.237190360 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4d126684-1402-472d-b32f-44bfdbc5eb82-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d7msf" (UID: "4d126684-1402-472d-b32f-44bfdbc5eb82") : secret "insights-runtime-extractor-tls" not found Sep 11 18:49:11.057303 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:11.057295 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d126684-1402-472d-b32f-44bfdbc5eb82-kube-rbac-proxy-cm podName:4d126684-1402-472d-b32f-44bfdbc5eb82 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:12.057284305 +0000 UTC m=+56.237216996 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4d126684-1402-472d-b32f-44bfdbc5eb82-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d7msf" (UID: "4d126684-1402-472d-b32f-44bfdbc5eb82") : configmap "kube-rbac-proxy" not found Sep 11 18:49:12.065658 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:12.065608 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d126684-1402-472d-b32f-44bfdbc5eb82-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d7msf\" (UID: \"4d126684-1402-472d-b32f-44bfdbc5eb82\") " pod="openshift-insights/insights-runtime-extractor-d7msf" Sep 11 18:49:12.065658 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:12.065661 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d126684-1402-472d-b32f-44bfdbc5eb82-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d7msf\" (UID: \"4d126684-1402-472d-b32f-44bfdbc5eb82\") " pod="openshift-insights/insights-runtime-extractor-d7msf" Sep 11 18:49:12.066091 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:12.065752 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 18:49:12.066091 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:12.065820 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d126684-1402-472d-b32f-44bfdbc5eb82-insights-runtime-extractor-tls podName:4d126684-1402-472d-b32f-44bfdbc5eb82 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:14.065806022 +0000 UTC m=+58.245738708 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4d126684-1402-472d-b32f-44bfdbc5eb82-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d7msf" (UID: "4d126684-1402-472d-b32f-44bfdbc5eb82") : secret "insights-runtime-extractor-tls" not found Sep 11 18:49:12.066091 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:12.065859 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 11 18:49:12.066091 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:12.065901 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d126684-1402-472d-b32f-44bfdbc5eb82-kube-rbac-proxy-cm podName:4d126684-1402-472d-b32f-44bfdbc5eb82 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:14.065890904 +0000 UTC m=+58.245823590 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4d126684-1402-472d-b32f-44bfdbc5eb82-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d7msf" (UID: "4d126684-1402-472d-b32f-44bfdbc5eb82") : configmap "kube-rbac-proxy" not found Sep 11 18:49:12.247188 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:12.247164 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c7t7x_df77fbc6-2613-4a23-b1da-c0dd94f680eb/dns-node-resolver/0.log" Sep 11 18:49:12.847016 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:12.846989 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8w6hj_074bae97-de81-4f57-ba67-4790e60c0f2a/node-ca/0.log" Sep 11 18:49:12.871360 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:12.871332 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a3662ef-c0c0-4673-a66c-173e38736517-service-ca-bundle\") pod \"router-default-597d5b6488-czf89\" (UID: \"1a3662ef-c0c0-4673-a66c-173e38736517\") " pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:49:12.871498 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:12.871387 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a3662ef-c0c0-4673-a66c-173e38736517-metrics-certs\") pod \"router-default-597d5b6488-czf89\" (UID: \"1a3662ef-c0c0-4673-a66c-173e38736517\") " pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:49:12.871498 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:12.871488 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1a3662ef-c0c0-4673-a66c-173e38736517-service-ca-bundle podName:1a3662ef-c0c0-4673-a66c-173e38736517 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:20.871467514 +0000 UTC m=+65.051400211 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1a3662ef-c0c0-4673-a66c-173e38736517-service-ca-bundle") pod "router-default-597d5b6488-czf89" (UID: "1a3662ef-c0c0-4673-a66c-173e38736517") : configmap references non-existent config key: service-ca.crt Sep 11 18:49:12.871573 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:12.871537 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 11 18:49:12.871647 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:12.871609 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a3662ef-c0c0-4673-a66c-173e38736517-metrics-certs podName:1a3662ef-c0c0-4673-a66c-173e38736517 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:20.871574091 +0000 UTC m=+65.051506781 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a3662ef-c0c0-4673-a66c-173e38736517-metrics-certs") pod "router-default-597d5b6488-czf89" (UID: "1a3662ef-c0c0-4673-a66c-173e38736517") : secret "router-metrics-certs-default" not found Sep 11 18:49:13.846091 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:13.846058 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kjvqf_dc3f63b6-c621-4d27-9e27-4a9709ef75f6/serve-healthcheck-canary/0.log" Sep 11 18:49:14.081225 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:14.081184 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d126684-1402-472d-b32f-44bfdbc5eb82-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d7msf\" (UID: \"4d126684-1402-472d-b32f-44bfdbc5eb82\") " pod="openshift-insights/insights-runtime-extractor-d7msf" Sep 11 18:49:14.081225 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:14.081230 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d126684-1402-472d-b32f-44bfdbc5eb82-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d7msf\" (UID: \"4d126684-1402-472d-b32f-44bfdbc5eb82\") " pod="openshift-insights/insights-runtime-extractor-d7msf" Sep 11 18:49:14.081464 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:14.081312 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 11 18:49:14.081464 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:14.081356 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 18:49:14.081464 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:14.081361 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d126684-1402-472d-b32f-44bfdbc5eb82-kube-rbac-proxy-cm podName:4d126684-1402-472d-b32f-44bfdbc5eb82 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:18.081349431 +0000 UTC m=+62.261282117 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4d126684-1402-472d-b32f-44bfdbc5eb82-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d7msf" (UID: "4d126684-1402-472d-b32f-44bfdbc5eb82") : configmap "kube-rbac-proxy" not found Sep 11 18:49:14.081464 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:14.081429 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d126684-1402-472d-b32f-44bfdbc5eb82-insights-runtime-extractor-tls podName:4d126684-1402-472d-b32f-44bfdbc5eb82 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:18.081411587 +0000 UTC m=+62.261344276 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4d126684-1402-472d-b32f-44bfdbc5eb82-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d7msf" (UID: "4d126684-1402-472d-b32f-44bfdbc5eb82") : secret "insights-runtime-extractor-tls" not found Sep 11 18:49:14.515968 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:14.515940 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6cqpn" Sep 11 18:49:18.107766 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:18.107728 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d126684-1402-472d-b32f-44bfdbc5eb82-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d7msf\" (UID: \"4d126684-1402-472d-b32f-44bfdbc5eb82\") " pod="openshift-insights/insights-runtime-extractor-d7msf" Sep 11 18:49:18.107766 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:18.107773 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d126684-1402-472d-b32f-44bfdbc5eb82-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d7msf\" (UID: \"4d126684-1402-472d-b32f-44bfdbc5eb82\") " pod="openshift-insights/insights-runtime-extractor-d7msf" Sep 11 18:49:18.108273 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:18.107850 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 11 18:49:18.108273 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:18.107895 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 18:49:18.108273 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:18.107905 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d126684-1402-472d-b32f-44bfdbc5eb82-kube-rbac-proxy-cm podName:4d126684-1402-472d-b32f-44bfdbc5eb82 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:26.107887445 +0000 UTC m=+70.287820141 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4d126684-1402-472d-b32f-44bfdbc5eb82-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d7msf" (UID: "4d126684-1402-472d-b32f-44bfdbc5eb82") : configmap "kube-rbac-proxy" not found Sep 11 18:49:18.108273 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:18.107989 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d126684-1402-472d-b32f-44bfdbc5eb82-insights-runtime-extractor-tls podName:4d126684-1402-472d-b32f-44bfdbc5eb82 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:26.107972525 +0000 UTC m=+70.287905211 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4d126684-1402-472d-b32f-44bfdbc5eb82-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d7msf" (UID: "4d126684-1402-472d-b32f-44bfdbc5eb82") : secret "insights-runtime-extractor-tls" not found Sep 11 18:49:20.934641 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:20.934601 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a3662ef-c0c0-4673-a66c-173e38736517-service-ca-bundle\") pod \"router-default-597d5b6488-czf89\" (UID: \"1a3662ef-c0c0-4673-a66c-173e38736517\") " pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:49:20.935036 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:20.934658 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a3662ef-c0c0-4673-a66c-173e38736517-metrics-certs\") pod \"router-default-597d5b6488-czf89\" (UID: \"1a3662ef-c0c0-4673-a66c-173e38736517\") " pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:49:20.935036 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:20.934767 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 11 18:49:20.935036 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:20.934811 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1a3662ef-c0c0-4673-a66c-173e38736517-service-ca-bundle podName:1a3662ef-c0c0-4673-a66c-173e38736517 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:36.934789088 +0000 UTC m=+81.114721798 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1a3662ef-c0c0-4673-a66c-173e38736517-service-ca-bundle") pod "router-default-597d5b6488-czf89" (UID: "1a3662ef-c0c0-4673-a66c-173e38736517") : configmap references non-existent config key: service-ca.crt Sep 11 18:49:20.935036 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:20.934830 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a3662ef-c0c0-4673-a66c-173e38736517-metrics-certs podName:1a3662ef-c0c0-4673-a66c-173e38736517 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:36.934822619 +0000 UTC m=+81.114755305 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a3662ef-c0c0-4673-a66c-173e38736517-metrics-certs") pod "router-default-597d5b6488-czf89" (UID: "1a3662ef-c0c0-4673-a66c-173e38736517") : secret "router-metrics-certs-default" not found Sep 11 18:49:22.044123 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:22.044089 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fafb9edb-7b18-4285-bfbc-e44847347967-metrics-tls\") pod \"dns-default-5mls5\" (UID: \"fafb9edb-7b18-4285-bfbc-e44847347967\") " pod="openshift-dns/dns-default-5mls5" Sep 11 18:49:22.044669 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:22.044139 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5594\" (UniqueName: \"kubernetes.io/projected/ba212e38-0ab7-4e51-a8a3-fb8efcc87945-kube-api-access-m5594\") pod \"network-check-target-ndw4m\" (UID: \"ba212e38-0ab7-4e51-a8a3-fb8efcc87945\") " pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:49:22.044669 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:22.044167 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-tls\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:49:22.044669 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:22.044294 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 11 18:49:22.044669 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:22.044304 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-94bfd4bf6-fcrbl: secret "image-registry-tls" not found Sep 11 18:49:22.044669 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:22.044310 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 18:49:22.044669 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:22.044372 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-tls podName:efce9264-857f-4ebe-9412-3ef1b95ec9f7 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:54.044356811 +0000 UTC m=+98.224289499 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-tls") pod "image-registry-94bfd4bf6-fcrbl" (UID: "efce9264-857f-4ebe-9412-3ef1b95ec9f7") : secret "image-registry-tls" not found Sep 11 18:49:22.044669 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:22.044385 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fafb9edb-7b18-4285-bfbc-e44847347967-metrics-tls podName:fafb9edb-7b18-4285-bfbc-e44847347967 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:54.044379353 +0000 UTC m=+98.224312039 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fafb9edb-7b18-4285-bfbc-e44847347967-metrics-tls") pod "dns-default-5mls5" (UID: "fafb9edb-7b18-4285-bfbc-e44847347967") : secret "dns-default-metrics-tls" not found Sep 11 18:49:22.047041 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:22.047027 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 11 18:49:22.057356 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:22.057329 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 11 18:49:22.068091 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:22.068066 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5594\" (UniqueName: \"kubernetes.io/projected/ba212e38-0ab7-4e51-a8a3-fb8efcc87945-kube-api-access-m5594\") pod \"network-check-target-ndw4m\" (UID: \"ba212e38-0ab7-4e51-a8a3-fb8efcc87945\") " pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:49:22.145220 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:22.145185 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb6e0205-703f-4dec-af35-283ccc740b37-metrics-certs\") pod \"network-metrics-daemon-gl55g\" (UID: \"bb6e0205-703f-4dec-af35-283ccc740b37\") " pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:49:22.145388 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:22.145232 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06964030-e916-4d42-a39f-96727c8c77a1-original-pull-secret\") pod \"global-pull-secret-syncer-kltxq\" (UID: \"06964030-e916-4d42-a39f-96727c8c77a1\") " pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:49:22.148632 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:22.148610 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 11 18:49:22.148632 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:22.148629 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 11 18:49:22.156301 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:22.156283 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 11 18:49:22.156361 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:22.156350 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb6e0205-703f-4dec-af35-283ccc740b37-metrics-certs podName:bb6e0205-703f-4dec-af35-283ccc740b37 nodeName:}" failed. No retries permitted until 2026-09-11 18:50:26.156334861 +0000 UTC m=+130.336267552 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb6e0205-703f-4dec-af35-283ccc740b37-metrics-certs") pod "network-metrics-daemon-gl55g" (UID: "bb6e0205-703f-4dec-af35-283ccc740b37") : secret "metrics-daemon-secret" not found Sep 11 18:49:22.158327 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:22.158305 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06964030-e916-4d42-a39f-96727c8c77a1-original-pull-secret\") pod \"global-pull-secret-syncer-kltxq\" (UID: \"06964030-e916-4d42-a39f-96727c8c77a1\") " pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:49:22.264617 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:22.264570 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kltxq" Sep 11 18:49:22.280185 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:22.280162 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b95w2\"" Sep 11 18:49:22.287743 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:22.287721 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:49:22.563730 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:22.563656 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kltxq"] Sep 11 18:49:22.568612 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:49:22.568570 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06964030_e916_4d42_a39f_96727c8c77a1.slice/crio-e7a4c33c0b808b5b7be1eca384971bdfd74233a4b7dd9ec6abb3ce9e17c05ba9 WatchSource:0}: Error finding container e7a4c33c0b808b5b7be1eca384971bdfd74233a4b7dd9ec6abb3ce9e17c05ba9: Status 404 returned error can't find the container with id e7a4c33c0b808b5b7be1eca384971bdfd74233a4b7dd9ec6abb3ce9e17c05ba9 Sep 11 18:49:22.591788 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:22.591736 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ndw4m"] Sep 11 18:49:22.594911 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:49:22.594886 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba212e38_0ab7_4e51_a8a3_fb8efcc87945.slice/crio-3b97bf0b8fd5b48a127aad53b784ced4125cafb040581c02d6f0e54df53f6001 WatchSource:0}: Error finding container 3b97bf0b8fd5b48a127aad53b784ced4125cafb040581c02d6f0e54df53f6001: Status 404 returned error can't find the container with id 3b97bf0b8fd5b48a127aad53b784ced4125cafb040581c02d6f0e54df53f6001 Sep 11 18:49:22.617493 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:22.617465 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kltxq" event={"ID":"06964030-e916-4d42-a39f-96727c8c77a1","Type":"ContainerStarted","Data":"e7a4c33c0b808b5b7be1eca384971bdfd74233a4b7dd9ec6abb3ce9e17c05ba9"} Sep 11 18:49:22.618448 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:22.618428 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ndw4m" event={"ID":"ba212e38-0ab7-4e51-a8a3-fb8efcc87945","Type":"ContainerStarted","Data":"3b97bf0b8fd5b48a127aad53b784ced4125cafb040581c02d6f0e54df53f6001"} Sep 11 18:49:26.181389 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:26.181341 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d126684-1402-472d-b32f-44bfdbc5eb82-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d7msf\" (UID: \"4d126684-1402-472d-b32f-44bfdbc5eb82\") " pod="openshift-insights/insights-runtime-extractor-d7msf" Sep 11 18:49:26.181891 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:26.181485 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d126684-1402-472d-b32f-44bfdbc5eb82-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d7msf\" (UID: \"4d126684-1402-472d-b32f-44bfdbc5eb82\") " pod="openshift-insights/insights-runtime-extractor-d7msf" Sep 11 18:49:26.181891 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:26.181615 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 18:49:26.181891 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:26.181689 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d126684-1402-472d-b32f-44bfdbc5eb82-insights-runtime-extractor-tls podName:4d126684-1402-472d-b32f-44bfdbc5eb82 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:42.181668234 +0000 UTC m=+86.361600940 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4d126684-1402-472d-b32f-44bfdbc5eb82-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d7msf" (UID: "4d126684-1402-472d-b32f-44bfdbc5eb82") : secret "insights-runtime-extractor-tls" not found Sep 11 18:49:26.182063 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:26.181984 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d126684-1402-472d-b32f-44bfdbc5eb82-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d7msf\" (UID: \"4d126684-1402-472d-b32f-44bfdbc5eb82\") " pod="openshift-insights/insights-runtime-extractor-d7msf" Sep 11 18:49:27.635397 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:27.635357 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ndw4m" event={"ID":"ba212e38-0ab7-4e51-a8a3-fb8efcc87945","Type":"ContainerStarted","Data":"c5bcc263a63ce29ee7e1ac2db92e8327675038210ca1f125b19042ae08966c02"} Sep 11 18:49:27.635847 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:27.635459 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:49:27.636812 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:27.636791 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kltxq" event={"ID":"06964030-e916-4d42-a39f-96727c8c77a1","Type":"ContainerStarted","Data":"daa7394096a881b163f44e46ec4814772ba855c69f07976bcbd63d2ab80507a1"} Sep 11 18:49:27.652421 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:27.652378 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ndw4m" podStartSLOduration=67.396079341 podStartE2EDuration="1m11.652365245s" totalImagesPullingTime="4.256285904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:48:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:49:27.651725543 +0000 UTC m=+71.831658250" watchObservedRunningTime="2026-09-11 18:49:27.652365245 +0000 UTC m=+71.832297984" Sep 11 18:49:27.666655 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:27.666615 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kltxq" podStartSLOduration=67.379399468 podStartE2EDuration="1m11.666600811s" totalImagesPullingTime="4.287201343s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:48:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:49:27.666150694 +0000 UTC m=+71.846083402" watchObservedRunningTime="2026-09-11 18:49:27.666600811 +0000 UTC m=+71.846533513" Sep 11 18:49:36.967218 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:36.967174 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a3662ef-c0c0-4673-a66c-173e38736517-service-ca-bundle\") pod \"router-default-597d5b6488-czf89\" (UID: \"1a3662ef-c0c0-4673-a66c-173e38736517\") " pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:49:36.967218 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:36.967220 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a3662ef-c0c0-4673-a66c-173e38736517-metrics-certs\") pod \"router-default-597d5b6488-czf89\" (UID: \"1a3662ef-c0c0-4673-a66c-173e38736517\") " pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:49:36.967767 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:36.967313 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 11 18:49:36.967767 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:36.967352 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1a3662ef-c0c0-4673-a66c-173e38736517-service-ca-bundle podName:1a3662ef-c0c0-4673-a66c-173e38736517 nodeName:}" failed. No retries permitted until 2026-09-11 18:50:08.967334682 +0000 UTC m=+113.147267379 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1a3662ef-c0c0-4673-a66c-173e38736517-service-ca-bundle") pod "router-default-597d5b6488-czf89" (UID: "1a3662ef-c0c0-4673-a66c-173e38736517") : configmap references non-existent config key: service-ca.crt Sep 11 18:49:36.967767 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:49:36.967377 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a3662ef-c0c0-4673-a66c-173e38736517-metrics-certs podName:1a3662ef-c0c0-4673-a66c-173e38736517 nodeName:}" failed. No retries permitted until 2026-09-11 18:50:08.967369817 +0000 UTC m=+113.147302503 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a3662ef-c0c0-4673-a66c-173e38736517-metrics-certs") pod "router-default-597d5b6488-czf89" (UID: "1a3662ef-c0c0-4673-a66c-173e38736517") : secret "router-metrics-certs-default" not found Sep 11 18:49:42.208183 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:42.208039 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d126684-1402-472d-b32f-44bfdbc5eb82-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d7msf\" (UID: \"4d126684-1402-472d-b32f-44bfdbc5eb82\") " pod="openshift-insights/insights-runtime-extractor-d7msf" Sep 11 18:49:42.210510 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:42.210484 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d126684-1402-472d-b32f-44bfdbc5eb82-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d7msf\" (UID: \"4d126684-1402-472d-b32f-44bfdbc5eb82\") " pod="openshift-insights/insights-runtime-extractor-d7msf" Sep 11 18:49:42.450913 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:42.450881 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9lhvm\"" Sep 11 18:49:42.458482 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:42.458424 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d7msf" Sep 11 18:49:42.730100 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:42.730070 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d7msf"] Sep 11 18:49:42.732466 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:49:42.732439 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d126684_1402_472d_b32f_44bfdbc5eb82.slice/crio-bc5fa2775395f8f884fbc1ffdd6dae01e0da5af7a183f19c1f9ce4f3fc6c01f3 WatchSource:0}: Error finding container bc5fa2775395f8f884fbc1ffdd6dae01e0da5af7a183f19c1f9ce4f3fc6c01f3: Status 404 returned error can't find the container with id bc5fa2775395f8f884fbc1ffdd6dae01e0da5af7a183f19c1f9ce4f3fc6c01f3 Sep 11 18:49:43.676111 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:43.676069 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d7msf" event={"ID":"4d126684-1402-472d-b32f-44bfdbc5eb82","Type":"ContainerStarted","Data":"4fd989596c8044c50a1645c53901c366561cf2c6c878fcaf7c703c861b03c3cd"} Sep 11 18:49:43.676481 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:43.676124 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d7msf" event={"ID":"4d126684-1402-472d-b32f-44bfdbc5eb82","Type":"ContainerStarted","Data":"31671a4a6681d26bcf4f2bf7af624685ab1e20c96be5983ec86ac6d04b54e606"} Sep 11 18:49:43.676481 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:43.676142 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d7msf" event={"ID":"4d126684-1402-472d-b32f-44bfdbc5eb82","Type":"ContainerStarted","Data":"bc5fa2775395f8f884fbc1ffdd6dae01e0da5af7a183f19c1f9ce4f3fc6c01f3"} Sep 11 18:49:45.684203 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:45.684163 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d7msf" event={"ID":"4d126684-1402-472d-b32f-44bfdbc5eb82","Type":"ContainerStarted","Data":"fb8d58b9f958f7a2c23c756379a97ef9a876a0ade3b2fc38498f8e9258da5dc6"} Sep 11 18:49:45.706382 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:45.706333 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-d7msf" podStartSLOduration=33.493400105 podStartE2EDuration="35.706315396s" totalImagesPullingTime="2.212915291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:49:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:49:45.704945557 +0000 UTC m=+89.884878268" watchObservedRunningTime="2026-09-11 18:49:45.706315396 +0000 UTC m=+89.886248102" Sep 11 18:49:52.922761 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:52.922724 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-p55rt"] Sep 11 18:49:52.925626 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:52.925604 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-p55rt" Sep 11 18:49:52.931124 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:52.931101 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6p45s\"" Sep 11 18:49:52.931124 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:52.931113 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 11 18:49:52.931299 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:52.931157 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 11 18:49:52.935149 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:52.935125 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59ddcb46-ftws6"] Sep 11 18:49:52.937992 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:52.937973 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59ddcb46-ftws6" Sep 11 18:49:52.943476 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:52.943428 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 11 18:49:52.943554 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:52.943490 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 11 18:49:52.943666 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:52.943642 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 11 18:49:52.943757 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:52.943737 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 11 18:49:52.943817 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:52.943747 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 11 18:49:52.944072 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:52.944054 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 11 18:49:52.944247 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:52.944150 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 11 18:49:52.944409 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:52.944388 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-p55rt"] Sep 11 18:49:52.968743 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:52.968715 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59ddcb46-ftws6"] Sep 11 18:49:53.094069 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:53.094036 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/26a66f34-c7ab-46fa-9311-eccbefb30770-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-p55rt\" (UID: \"26a66f34-c7ab-46fa-9311-eccbefb30770\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-p55rt" Sep 11 18:49:53.094069 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:53.094072 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5f6p\" (UniqueName: \"kubernetes.io/projected/7f7da847-dbe3-4cde-a1b8-d87706abbbff-kube-api-access-z5f6p\") pod \"cluster-proxy-proxy-agent-59ddcb46-ftws6\" (UID: \"7f7da847-dbe3-4cde-a1b8-d87706abbbff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59ddcb46-ftws6" Sep 11 18:49:53.094285 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:53.094166 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/26a66f34-c7ab-46fa-9311-eccbefb30770-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-p55rt\" (UID: \"26a66f34-c7ab-46fa-9311-eccbefb30770\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-p55rt" Sep 11 18:49:53.094285 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:53.094196 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7f7da847-dbe3-4cde-a1b8-d87706abbbff-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-59ddcb46-ftws6\" (UID: \"7f7da847-dbe3-4cde-a1b8-d87706abbbff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59ddcb46-ftws6" Sep 11 18:49:53.094285 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:53.094215 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7f7da847-dbe3-4cde-a1b8-d87706abbbff-ca\") pod \"cluster-proxy-proxy-agent-59ddcb46-ftws6\" (UID: \"7f7da847-dbe3-4cde-a1b8-d87706abbbff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59ddcb46-ftws6" Sep 11 18:49:53.094285 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:53.094260 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f7da847-dbe3-4cde-a1b8-d87706abbbff-additional-service-ca\") pod \"cluster-proxy-proxy-agent-59ddcb46-ftws6\" (UID: \"7f7da847-dbe3-4cde-a1b8-d87706abbbff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59ddcb46-ftws6" Sep 11 18:49:53.094469 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:53.094320 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7f7da847-dbe3-4cde-a1b8-d87706abbbff-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-59ddcb46-ftws6\" (UID: \"7f7da847-dbe3-4cde-a1b8-d87706abbbff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59ddcb46-ftws6" Sep 11 18:49:53.094469 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:53.094365 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7f7da847-dbe3-4cde-a1b8-d87706abbbff-hub\") pod \"cluster-proxy-proxy-agent-59ddcb46-ftws6\" (UID: \"7f7da847-dbe3-4cde-a1b8-d87706abbbff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59ddcb46-ftws6" Sep 11 18:49:53.195563 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:53.195465 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/26a66f34-c7ab-46fa-9311-eccbefb30770-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-p55rt\" (UID: \"26a66f34-c7ab-46fa-9311-eccbefb30770\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-p55rt" Sep 11 18:49:53.195563 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:53.195504 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7f7da847-dbe3-4cde-a1b8-d87706abbbff-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-59ddcb46-ftws6\" (UID: \"7f7da847-dbe3-4cde-a1b8-d87706abbbff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59ddcb46-ftws6" Sep 11 18:49:53.195563 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:53.195520 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7f7da847-dbe3-4cde-a1b8-d87706abbbff-ca\") pod \"cluster-proxy-proxy-agent-59ddcb46-ftws6\" (UID: \"7f7da847-dbe3-4cde-a1b8-d87706abbbff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59ddcb46-ftws6" Sep 11 18:49:53.195863 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:53.195670 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f7da847-dbe3-4cde-a1b8-d87706abbbff-additional-service-ca\") pod \"cluster-proxy-proxy-agent-59ddcb46-ftws6\" (UID: \"7f7da847-dbe3-4cde-a1b8-d87706abbbff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59ddcb46-ftws6" Sep 11 18:49:53.195863 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:53.195794 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7f7da847-dbe3-4cde-a1b8-d87706abbbff-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-59ddcb46-ftws6\" (UID: \"7f7da847-dbe3-4cde-a1b8-d87706abbbff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59ddcb46-ftws6" Sep 11 18:49:53.195863 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:53.195835 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7f7da847-dbe3-4cde-a1b8-d87706abbbff-hub\") pod \"cluster-proxy-proxy-agent-59ddcb46-ftws6\" (UID: \"7f7da847-dbe3-4cde-a1b8-d87706abbbff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59ddcb46-ftws6" Sep 11 18:49:53.196024 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:53.195903 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/26a66f34-c7ab-46fa-9311-eccbefb30770-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-p55rt\" (UID: \"26a66f34-c7ab-46fa-9311-eccbefb30770\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-p55rt" Sep 11 18:49:53.196024 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:53.195935 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5f6p\" (UniqueName: \"kubernetes.io/projected/7f7da847-dbe3-4cde-a1b8-d87706abbbff-kube-api-access-z5f6p\") pod \"cluster-proxy-proxy-agent-59ddcb46-ftws6\" (UID: \"7f7da847-dbe3-4cde-a1b8-d87706abbbff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59ddcb46-ftws6" Sep 11 18:49:53.196281 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:53.196257 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/26a66f34-c7ab-46fa-9311-eccbefb30770-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-p55rt\" (UID: \"26a66f34-c7ab-46fa-9311-eccbefb30770\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-p55rt" Sep 11 18:49:53.196397 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:53.196366 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f7da847-dbe3-4cde-a1b8-d87706abbbff-additional-service-ca\") pod \"cluster-proxy-proxy-agent-59ddcb46-ftws6\" (UID: \"7f7da847-dbe3-4cde-a1b8-d87706abbbff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59ddcb46-ftws6" Sep 11 18:49:53.198131 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:53.198108 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7f7da847-dbe3-4cde-a1b8-d87706abbbff-ca\") pod \"cluster-proxy-proxy-agent-59ddcb46-ftws6\" (UID: \"7f7da847-dbe3-4cde-a1b8-d87706abbbff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59ddcb46-ftws6" Sep 11 18:49:53.198249 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:53.198226 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/26a66f34-c7ab-46fa-9311-eccbefb30770-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-p55rt\" (UID: \"26a66f34-c7ab-46fa-9311-eccbefb30770\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-p55rt" Sep 11 18:49:53.198473 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:53.198455 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7f7da847-dbe3-4cde-a1b8-d87706abbbff-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-59ddcb46-ftws6\" (UID: \"7f7da847-dbe3-4cde-a1b8-d87706abbbff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59ddcb46-ftws6" Sep 11 18:49:53.198532 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:53.198455 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7f7da847-dbe3-4cde-a1b8-d87706abbbff-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-59ddcb46-ftws6\" (UID: \"7f7da847-dbe3-4cde-a1b8-d87706abbbff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59ddcb46-ftws6" Sep 11 18:49:53.198532 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:53.198503 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7f7da847-dbe3-4cde-a1b8-d87706abbbff-hub\") pod \"cluster-proxy-proxy-agent-59ddcb46-ftws6\" (UID: \"7f7da847-dbe3-4cde-a1b8-d87706abbbff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59ddcb46-ftws6" Sep 11 18:49:53.215807 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:53.215777 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5f6p\" (UniqueName: \"kubernetes.io/projected/7f7da847-dbe3-4cde-a1b8-d87706abbbff-kube-api-access-z5f6p\") pod \"cluster-proxy-proxy-agent-59ddcb46-ftws6\" (UID: \"7f7da847-dbe3-4cde-a1b8-d87706abbbff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59ddcb46-ftws6" Sep 11 18:49:53.234731 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:53.234692 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-p55rt" Sep 11 18:49:53.257916 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:53.257888 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59ddcb46-ftws6" Sep 11 18:49:53.541202 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:53.541178 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-p55rt"] Sep 11 18:49:53.542773 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:49:53.542746 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26a66f34_c7ab_46fa_9311_eccbefb30770.slice/crio-75eeab8c759c2671e05094709537f85c00ffed3e2b2686c44e9d7a49d97f6fa9 WatchSource:0}: Error finding container 75eeab8c759c2671e05094709537f85c00ffed3e2b2686c44e9d7a49d97f6fa9: Status 404 returned error can't find the container with id 75eeab8c759c2671e05094709537f85c00ffed3e2b2686c44e9d7a49d97f6fa9 Sep 11 18:49:53.566767 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:53.566740 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59ddcb46-ftws6"] Sep 11 18:49:53.570507 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:49:53.570486 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f7da847_dbe3_4cde_a1b8_d87706abbbff.slice/crio-67b73f6a29782554805392cb2459d125b56060d48e9d6aeedf6094e92fcd56c4 WatchSource:0}: Error finding container 67b73f6a29782554805392cb2459d125b56060d48e9d6aeedf6094e92fcd56c4: Status 404 returned error can't find the container with id 67b73f6a29782554805392cb2459d125b56060d48e9d6aeedf6094e92fcd56c4 Sep 11 18:49:53.708722 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:53.708687 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59ddcb46-ftws6" event={"ID":"7f7da847-dbe3-4cde-a1b8-d87706abbbff","Type":"ContainerStarted","Data":"67b73f6a29782554805392cb2459d125b56060d48e9d6aeedf6094e92fcd56c4"} Sep 11 18:49:53.709802 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:53.709775 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-p55rt" event={"ID":"26a66f34-c7ab-46fa-9311-eccbefb30770","Type":"ContainerStarted","Data":"75eeab8c759c2671e05094709537f85c00ffed3e2b2686c44e9d7a49d97f6fa9"} Sep 11 18:49:54.103943 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:54.103903 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fafb9edb-7b18-4285-bfbc-e44847347967-metrics-tls\") pod \"dns-default-5mls5\" (UID: \"fafb9edb-7b18-4285-bfbc-e44847347967\") " pod="openshift-dns/dns-default-5mls5" Sep 11 18:49:54.104399 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:54.103958 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-tls\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:49:54.106371 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:54.106349 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fafb9edb-7b18-4285-bfbc-e44847347967-metrics-tls\") pod \"dns-default-5mls5\" (UID: \"fafb9edb-7b18-4285-bfbc-e44847347967\") " pod="openshift-dns/dns-default-5mls5" Sep 11 18:49:54.106476 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:54.106458 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-tls\") pod \"image-registry-94bfd4bf6-fcrbl\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:49:54.376813 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:54.376731 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6x27g\"" Sep 11 18:49:54.384262 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:54.384233 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:49:54.394312 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:54.394290 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r5955\"" Sep 11 18:49:54.402138 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:54.401947 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5mls5" Sep 11 18:49:54.693617 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:54.693525 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-94bfd4bf6-fcrbl"] Sep 11 18:49:54.712373 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:54.712348 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5mls5"] Sep 11 18:49:54.890149 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:49:54.890107 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefce9264_857f_4ebe_9412_3ef1b95ec9f7.slice/crio-2e32f51d0410733095fc5a8702416d0555ec9bf137e16487360051f4986d5c1c WatchSource:0}: Error finding container 2e32f51d0410733095fc5a8702416d0555ec9bf137e16487360051f4986d5c1c: Status 404 returned error can't find the container with id 2e32f51d0410733095fc5a8702416d0555ec9bf137e16487360051f4986d5c1c Sep 11 18:49:54.890901 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:49:54.890872 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfafb9edb_7b18_4285_bfbc_e44847347967.slice/crio-2d0ffb584c6f0a9443ca20c15ea893005efb84e2c0c4246ef7fc7fe5941fb3a1 WatchSource:0}: Error finding container 2d0ffb584c6f0a9443ca20c15ea893005efb84e2c0c4246ef7fc7fe5941fb3a1: Status 404 returned error can't find the container with id 2d0ffb584c6f0a9443ca20c15ea893005efb84e2c0c4246ef7fc7fe5941fb3a1 Sep 11 18:49:55.720164 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:55.720129 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5mls5" event={"ID":"fafb9edb-7b18-4285-bfbc-e44847347967","Type":"ContainerStarted","Data":"2d0ffb584c6f0a9443ca20c15ea893005efb84e2c0c4246ef7fc7fe5941fb3a1"} Sep 11 18:49:55.722065 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:55.722023 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-p55rt" event={"ID":"26a66f34-c7ab-46fa-9311-eccbefb30770","Type":"ContainerStarted","Data":"0be24a9ef9f8450ef6a339354c0b5a9cf4e2acfd45c30180dc2a251ca63eb82e"} Sep 11 18:49:55.723800 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:55.723766 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" event={"ID":"efce9264-857f-4ebe-9412-3ef1b95ec9f7","Type":"ContainerStarted","Data":"516b6c93441e895030a43dedaf703a43903fcea7969d05a8a3443024f24394b3"} Sep 11 18:49:55.723924 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:55.723820 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" event={"ID":"efce9264-857f-4ebe-9412-3ef1b95ec9f7","Type":"ContainerStarted","Data":"2e32f51d0410733095fc5a8702416d0555ec9bf137e16487360051f4986d5c1c"} Sep 11 18:49:55.723924 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:55.723909 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:49:55.759727 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:55.759664 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-p55rt" podStartSLOduration=2.365725721 podStartE2EDuration="3.759646256s" totalImagesPullingTime="1.393920535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:49:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:49:55.759294351 +0000 UTC m=+99.939227096" watchObservedRunningTime="2026-09-11 18:49:55.759646256 +0000 UTC m=+99.939578964" Sep 11 18:49:55.808328 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:55.808269 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" podStartSLOduration=99.808246007 podStartE2EDuration="1m39.808246007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:48:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:49:55.807945949 +0000 UTC m=+99.987878661" watchObservedRunningTime="2026-09-11 18:49:55.808246007 +0000 UTC m=+99.988178714" Sep 11 18:49:58.642170 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:58.642139 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ndw4m" Sep 11 18:49:58.736093 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:58.736059 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5mls5" event={"ID":"fafb9edb-7b18-4285-bfbc-e44847347967","Type":"ContainerStarted","Data":"b363a7d2bf81215dd3bf794f1f716c212f9fcc536e67bda11701c09e52542cbd"} Sep 11 18:49:58.738359 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:58.738334 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59ddcb46-ftws6" event={"ID":"7f7da847-dbe3-4cde-a1b8-d87706abbbff","Type":"ContainerStarted","Data":"221e4e161686593e3ce6c7c0761952d79cb71ddfe77ed31626b45e78af053ab1"} Sep 11 18:49:58.738452 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:58.738375 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59ddcb46-ftws6" event={"ID":"7f7da847-dbe3-4cde-a1b8-d87706abbbff","Type":"ContainerStarted","Data":"43f8f4d25d0789d0a1f25e5bd6a519628a76d2d6dbc54addf06995bee1ee400c"} Sep 11 18:49:58.738452 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:58.738392 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59ddcb46-ftws6" event={"ID":"7f7da847-dbe3-4cde-a1b8-d87706abbbff","Type":"ContainerStarted","Data":"273b5bbabd8ea371a72c0be0c6366bb9ddecc5c40640b67c931bb6a729419826"} Sep 11 18:49:59.744182 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:59.744147 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5mls5" event={"ID":"fafb9edb-7b18-4285-bfbc-e44847347967","Type":"ContainerStarted","Data":"c278bad39c7e77dbc4b7662e33ebdb5fe72b58b610066c515353471e49e4d3fc"} Sep 11 18:49:59.744700 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:59.744300 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5mls5" Sep 11 18:49:59.764700 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:59.764653 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5mls5" podStartSLOduration=66.139247047 podStartE2EDuration="1m9.764636346s" totalImagesPullingTime="3.625389299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:48:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:49:59.763441078 +0000 UTC m=+103.943373785" watchObservedRunningTime="2026-09-11 18:49:59.764636346 +0000 UTC m=+103.944569054" Sep 11 18:49:59.782727 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:49:59.782680 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59ddcb46-ftws6" podStartSLOduration=3.045225759 podStartE2EDuration="7.782664622s" totalImagesPullingTime="4.737438863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:49:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:49:59.782421166 +0000 UTC m=+103.962353875" watchObservedRunningTime="2026-09-11 18:49:59.782664622 +0000 UTC m=+103.962597329" Sep 11 18:50:09.013845 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:09.013788 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a3662ef-c0c0-4673-a66c-173e38736517-metrics-certs\") pod \"router-default-597d5b6488-czf89\" (UID: \"1a3662ef-c0c0-4673-a66c-173e38736517\") " pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:50:09.014334 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:09.013864 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a3662ef-c0c0-4673-a66c-173e38736517-service-ca-bundle\") pod \"router-default-597d5b6488-czf89\" (UID: \"1a3662ef-c0c0-4673-a66c-173e38736517\") " pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:50:09.014659 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:09.014638 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a3662ef-c0c0-4673-a66c-173e38736517-service-ca-bundle\") pod \"router-default-597d5b6488-czf89\" (UID: \"1a3662ef-c0c0-4673-a66c-173e38736517\") " pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:50:09.016094 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:09.016074 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a3662ef-c0c0-4673-a66c-173e38736517-metrics-certs\") pod \"router-default-597d5b6488-czf89\" (UID: \"1a3662ef-c0c0-4673-a66c-173e38736517\") " pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:50:09.019182 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:09.019160 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-2jzhd\"" Sep 11 18:50:09.026664 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:09.026640 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:50:09.299272 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:09.299197 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-597d5b6488-czf89"] Sep 11 18:50:09.301984 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:50:09.301955 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a3662ef_c0c0_4673_a66c_173e38736517.slice/crio-b43b8be70ae9213b7ffcda9a77fbb44f68f0046a49e96390686405734adccb88 WatchSource:0}: Error finding container b43b8be70ae9213b7ffcda9a77fbb44f68f0046a49e96390686405734adccb88: Status 404 returned error can't find the container with id b43b8be70ae9213b7ffcda9a77fbb44f68f0046a49e96390686405734adccb88 Sep 11 18:50:09.749232 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:09.749143 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5mls5" Sep 11 18:50:09.775182 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:09.775142 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-597d5b6488-czf89" event={"ID":"1a3662ef-c0c0-4673-a66c-173e38736517","Type":"ContainerStarted","Data":"45483ba9904e819038f4bfd3fe8b1d66c0950dd5ce365c56b5a2de39c7ddfb34"} Sep 11 18:50:09.775343 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:09.775205 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-597d5b6488-czf89" event={"ID":"1a3662ef-c0c0-4673-a66c-173e38736517","Type":"ContainerStarted","Data":"b43b8be70ae9213b7ffcda9a77fbb44f68f0046a49e96390686405734adccb88"} Sep 11 18:50:09.805888 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:09.805836 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-597d5b6488-czf89" podStartSLOduration=64.805817707 podStartE2EDuration="1m4.805817707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:49:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:50:09.80417621 +0000 UTC m=+113.984108922" watchObservedRunningTime="2026-09-11 18:50:09.805817707 +0000 UTC m=+113.985750415" Sep 11 18:50:10.027771 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:10.027739 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:50:10.030394 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:10.030369 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:50:10.778506 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:10.778471 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:50:10.779695 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:10.779678 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-597d5b6488-czf89" Sep 11 18:50:15.494912 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:15.494876 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-94bfd4bf6-fcrbl"] Sep 11 18:50:15.498999 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:15.498974 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:50:20.902868 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:20.902829 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5nfpr"] Sep 11 18:50:20.908566 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:20.908546 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5nfpr" Sep 11 18:50:20.913327 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:20.913305 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ztk2x\"" Sep 11 18:50:20.913791 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:20.913772 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 11 18:50:20.913896 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:20.913772 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 11 18:50:20.914671 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:20.914626 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 11 18:50:20.914764 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:20.914679 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 11 18:50:20.914764 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:20.914691 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 11 18:50:20.914764 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:20.914721 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 11 18:50:21.003845 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:21.003814 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpswl\" (UniqueName: \"kubernetes.io/projected/e504976a-d7d4-4091-9348-f779b3bcb69c-kube-api-access-wpswl\") pod \"node-exporter-5nfpr\" (UID: \"e504976a-d7d4-4091-9348-f779b3bcb69c\") " pod="openshift-monitoring/node-exporter-5nfpr" Sep 11 18:50:21.003845 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:21.003847 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e504976a-d7d4-4091-9348-f779b3bcb69c-metrics-client-ca\") pod \"node-exporter-5nfpr\" (UID: \"e504976a-d7d4-4091-9348-f779b3bcb69c\") " pod="openshift-monitoring/node-exporter-5nfpr" Sep 11 18:50:21.004057 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:21.003890 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e504976a-d7d4-4091-9348-f779b3bcb69c-node-exporter-tls\") pod \"node-exporter-5nfpr\" (UID: \"e504976a-d7d4-4091-9348-f779b3bcb69c\") " pod="openshift-monitoring/node-exporter-5nfpr" Sep 11 18:50:21.004057 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:21.003917 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e504976a-d7d4-4091-9348-f779b3bcb69c-node-exporter-wtmp\") pod \"node-exporter-5nfpr\" (UID: \"e504976a-d7d4-4091-9348-f779b3bcb69c\") " pod="openshift-monitoring/node-exporter-5nfpr" Sep 11 18:50:21.004057 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:21.003939 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e504976a-d7d4-4091-9348-f779b3bcb69c-node-exporter-accelerators-collector-config\") pod \"node-exporter-5nfpr\" (UID: \"e504976a-d7d4-4091-9348-f779b3bcb69c\") " pod="openshift-monitoring/node-exporter-5nfpr" Sep 11 18:50:21.004057 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:21.003957 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e504976a-d7d4-4091-9348-f779b3bcb69c-root\") pod \"node-exporter-5nfpr\" (UID: \"e504976a-d7d4-4091-9348-f779b3bcb69c\") " pod="openshift-monitoring/node-exporter-5nfpr" Sep 11 18:50:21.004057 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:21.003979 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e504976a-d7d4-4091-9348-f779b3bcb69c-sys\") pod \"node-exporter-5nfpr\" (UID: \"e504976a-d7d4-4091-9348-f779b3bcb69c\") " pod="openshift-monitoring/node-exporter-5nfpr" Sep 11 18:50:21.004223 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:21.004053 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e504976a-d7d4-4091-9348-f779b3bcb69c-node-exporter-textfile\") pod \"node-exporter-5nfpr\" (UID: \"e504976a-d7d4-4091-9348-f779b3bcb69c\") " pod="openshift-monitoring/node-exporter-5nfpr" Sep 11 18:50:21.004223 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:21.004079 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e504976a-d7d4-4091-9348-f779b3bcb69c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5nfpr\" (UID: \"e504976a-d7d4-4091-9348-f779b3bcb69c\") " pod="openshift-monitoring/node-exporter-5nfpr" Sep 11 18:50:21.105084 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:21.105045 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e504976a-d7d4-4091-9348-f779b3bcb69c-root\") pod \"node-exporter-5nfpr\" (UID: \"e504976a-d7d4-4091-9348-f779b3bcb69c\") " pod="openshift-monitoring/node-exporter-5nfpr" Sep 11 18:50:21.105084 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:21.105085 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e504976a-d7d4-4091-9348-f779b3bcb69c-sys\") pod \"node-exporter-5nfpr\" (UID: \"e504976a-d7d4-4091-9348-f779b3bcb69c\") " pod="openshift-monitoring/node-exporter-5nfpr" Sep 11 18:50:21.105329 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:21.105105 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e504976a-d7d4-4091-9348-f779b3bcb69c-node-exporter-textfile\") pod \"node-exporter-5nfpr\" (UID: \"e504976a-d7d4-4091-9348-f779b3bcb69c\") " pod="openshift-monitoring/node-exporter-5nfpr" Sep 11 18:50:21.105329 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:21.105126 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e504976a-d7d4-4091-9348-f779b3bcb69c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5nfpr\" (UID: \"e504976a-d7d4-4091-9348-f779b3bcb69c\") " pod="openshift-monitoring/node-exporter-5nfpr" Sep 11 18:50:21.105329 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:21.105172 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpswl\" (UniqueName: \"kubernetes.io/projected/e504976a-d7d4-4091-9348-f779b3bcb69c-kube-api-access-wpswl\") pod \"node-exporter-5nfpr\" (UID: \"e504976a-d7d4-4091-9348-f779b3bcb69c\") " pod="openshift-monitoring/node-exporter-5nfpr" Sep 11 18:50:21.105329 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:21.105171 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e504976a-d7d4-4091-9348-f779b3bcb69c-root\") pod \"node-exporter-5nfpr\" (UID: \"e504976a-d7d4-4091-9348-f779b3bcb69c\") " pod="openshift-monitoring/node-exporter-5nfpr" Sep 11 18:50:21.105329 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:21.105188 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e504976a-d7d4-4091-9348-f779b3bcb69c-sys\") pod \"node-exporter-5nfpr\" (UID: \"e504976a-d7d4-4091-9348-f779b3bcb69c\") " pod="openshift-monitoring/node-exporter-5nfpr" Sep 11 18:50:21.105329 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:21.105215 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e504976a-d7d4-4091-9348-f779b3bcb69c-metrics-client-ca\") pod \"node-exporter-5nfpr\" (UID: \"e504976a-d7d4-4091-9348-f779b3bcb69c\") " pod="openshift-monitoring/node-exporter-5nfpr" Sep 11 18:50:21.105329 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:21.105261 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e504976a-d7d4-4091-9348-f779b3bcb69c-node-exporter-tls\") pod \"node-exporter-5nfpr\" (UID: \"e504976a-d7d4-4091-9348-f779b3bcb69c\") " pod="openshift-monitoring/node-exporter-5nfpr" Sep 11 18:50:21.105329 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:21.105286 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e504976a-d7d4-4091-9348-f779b3bcb69c-node-exporter-wtmp\") pod \"node-exporter-5nfpr\" (UID: \"e504976a-d7d4-4091-9348-f779b3bcb69c\") " pod="openshift-monitoring/node-exporter-5nfpr" Sep 11 18:50:21.105329 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:21.105315 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e504976a-d7d4-4091-9348-f779b3bcb69c-node-exporter-accelerators-collector-config\") pod \"node-exporter-5nfpr\" (UID: \"e504976a-d7d4-4091-9348-f779b3bcb69c\") " pod="openshift-monitoring/node-exporter-5nfpr" Sep 11 18:50:21.105758 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:50:21.105409 2583 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 11 18:50:21.105758 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:21.105498 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e504976a-d7d4-4091-9348-f779b3bcb69c-node-exporter-textfile\") pod \"node-exporter-5nfpr\" (UID: \"e504976a-d7d4-4091-9348-f779b3bcb69c\") " pod="openshift-monitoring/node-exporter-5nfpr" Sep 11 18:50:21.105758 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:50:21.105531 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e504976a-d7d4-4091-9348-f779b3bcb69c-node-exporter-tls podName:e504976a-d7d4-4091-9348-f779b3bcb69c nodeName:}" failed. No retries permitted until 2026-09-11 18:50:21.605506731 +0000 UTC m=+125.785439423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e504976a-d7d4-4091-9348-f779b3bcb69c-node-exporter-tls") pod "node-exporter-5nfpr" (UID: "e504976a-d7d4-4091-9348-f779b3bcb69c") : secret "node-exporter-tls" not found Sep 11 18:50:21.105758 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:21.105634 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e504976a-d7d4-4091-9348-f779b3bcb69c-node-exporter-wtmp\") pod \"node-exporter-5nfpr\" (UID: \"e504976a-d7d4-4091-9348-f779b3bcb69c\") " pod="openshift-monitoring/node-exporter-5nfpr" Sep 11 18:50:21.105938 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:21.105903 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e504976a-d7d4-4091-9348-f779b3bcb69c-node-exporter-accelerators-collector-config\") pod \"node-exporter-5nfpr\" (UID: \"e504976a-d7d4-4091-9348-f779b3bcb69c\") " pod="openshift-monitoring/node-exporter-5nfpr" Sep 11 18:50:21.105938 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:21.105907 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e504976a-d7d4-4091-9348-f779b3bcb69c-metrics-client-ca\") pod \"node-exporter-5nfpr\" (UID: \"e504976a-d7d4-4091-9348-f779b3bcb69c\") " pod="openshift-monitoring/node-exporter-5nfpr" Sep 11 18:50:21.107700 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:21.107683 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e504976a-d7d4-4091-9348-f779b3bcb69c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5nfpr\" (UID: \"e504976a-d7d4-4091-9348-f779b3bcb69c\") " pod="openshift-monitoring/node-exporter-5nfpr" Sep 11 18:50:21.114645 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:21.114624 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpswl\" (UniqueName: \"kubernetes.io/projected/e504976a-d7d4-4091-9348-f779b3bcb69c-kube-api-access-wpswl\") pod \"node-exporter-5nfpr\" (UID: \"e504976a-d7d4-4091-9348-f779b3bcb69c\") " pod="openshift-monitoring/node-exporter-5nfpr" Sep 11 18:50:21.608155 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:21.608114 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e504976a-d7d4-4091-9348-f779b3bcb69c-node-exporter-tls\") pod \"node-exporter-5nfpr\" (UID: \"e504976a-d7d4-4091-9348-f779b3bcb69c\") " pod="openshift-monitoring/node-exporter-5nfpr" Sep 11 18:50:21.610484 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:21.610464 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e504976a-d7d4-4091-9348-f779b3bcb69c-node-exporter-tls\") pod \"node-exporter-5nfpr\" (UID: \"e504976a-d7d4-4091-9348-f779b3bcb69c\") " pod="openshift-monitoring/node-exporter-5nfpr" Sep 11 18:50:21.817146 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:21.817114 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5nfpr" Sep 11 18:50:21.829532 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:50:21.829500 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode504976a_d7d4_4091_9348_f779b3bcb69c.slice/crio-f447cda426ee49a72896cc4cd4b13cd2333f2a28ecf2029de4c662954f135f81 WatchSource:0}: Error finding container f447cda426ee49a72896cc4cd4b13cd2333f2a28ecf2029de4c662954f135f81: Status 404 returned error can't find the container with id f447cda426ee49a72896cc4cd4b13cd2333f2a28ecf2029de4c662954f135f81 Sep 11 18:50:22.817252 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:22.817219 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5nfpr" event={"ID":"e504976a-d7d4-4091-9348-f779b3bcb69c","Type":"ContainerStarted","Data":"f447cda426ee49a72896cc4cd4b13cd2333f2a28ecf2029de4c662954f135f81"} Sep 11 18:50:23.823560 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:23.823524 2583 generic.go:356] "Generic (PLEG): container finished" podID="e504976a-d7d4-4091-9348-f779b3bcb69c" containerID="24f1c4206e6875654729fbfe382e525dc916f3690776ef5c7449d45a0a2942d1" exitCode=0 Sep 11 18:50:23.823985 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:23.823602 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5nfpr" event={"ID":"e504976a-d7d4-4091-9348-f779b3bcb69c","Type":"ContainerDied","Data":"24f1c4206e6875654729fbfe382e525dc916f3690776ef5c7449d45a0a2942d1"} Sep 11 18:50:24.828716 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:24.828678 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5nfpr" event={"ID":"e504976a-d7d4-4091-9348-f779b3bcb69c","Type":"ContainerStarted","Data":"7168cbc527d27c8cea715821f463cd9f4480dea4305b6cf648d8193a2fc8635d"} Sep 11 18:50:24.829147 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:24.828732 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5nfpr" event={"ID":"e504976a-d7d4-4091-9348-f779b3bcb69c","Type":"ContainerStarted","Data":"7824a83b7aae9c775e11ae1e7bcef77333c5ba28eb98f00ad9c1802d5ca09803"} Sep 11 18:50:24.857521 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:24.857476 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5nfpr" podStartSLOduration=3.658746833 podStartE2EDuration="4.857460155s" totalImagesPullingTime="1.137942607s" totalInitContainerRuntime="60.770715ms" isStatefulPod=true podCreationTimestamp="2026-09-11 18:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:50:24.855659145 +0000 UTC m=+129.035591852" watchObservedRunningTime="2026-09-11 18:50:24.857460155 +0000 UTC m=+129.037392939" Sep 11 18:50:26.246289 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:26.246252 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb6e0205-703f-4dec-af35-283ccc740b37-metrics-certs\") pod \"network-metrics-daemon-gl55g\" (UID: \"bb6e0205-703f-4dec-af35-283ccc740b37\") " pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:50:26.248426 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:26.248409 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb6e0205-703f-4dec-af35-283ccc740b37-metrics-certs\") pod \"network-metrics-daemon-gl55g\" (UID: \"bb6e0205-703f-4dec-af35-283ccc740b37\") " pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:50:26.475006 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:26.474971 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nqpv8\"" Sep 11 18:50:26.481515 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:26.481493 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl55g" Sep 11 18:50:26.762918 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:26.762881 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gl55g"] Sep 11 18:50:26.765992 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:50:26.765956 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb6e0205_703f_4dec_af35_283ccc740b37.slice/crio-89a4d54ed51f3e4421c5a2a989cd0279372828e4d23db5bf315538977cf3f523 WatchSource:0}: Error finding container 89a4d54ed51f3e4421c5a2a989cd0279372828e4d23db5bf315538977cf3f523: Status 404 returned error can't find the container with id 89a4d54ed51f3e4421c5a2a989cd0279372828e4d23db5bf315538977cf3f523 Sep 11 18:50:26.836229 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:26.836195 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gl55g" event={"ID":"bb6e0205-703f-4dec-af35-283ccc740b37","Type":"ContainerStarted","Data":"89a4d54ed51f3e4421c5a2a989cd0279372828e4d23db5bf315538977cf3f523"} Sep 11 18:50:27.181488 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.181406 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 18:50:27.185077 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.185049 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.190314 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.190281 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tw6qh\"" Sep 11 18:50:27.190448 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.190281 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 11 18:50:27.190448 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.190400 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 11 18:50:27.190448 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.190407 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 11 18:50:27.190648 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.190595 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 11 18:50:27.190913 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.190793 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 11 18:50:27.190913 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.190808 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 11 18:50:27.190913 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.190859 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 11 18:50:27.191128 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.190915 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 11 18:50:27.191128 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.190915 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 11 18:50:27.191675 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.191459 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 11 18:50:27.191675 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.191512 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 11 18:50:27.191675 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.191520 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-q8olo6r6ee44\"" Sep 11 18:50:27.191675 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.191459 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 11 18:50:27.191913 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.191738 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 11 18:50:27.191913 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.191800 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 11 18:50:27.193735 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.193548 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 11 18:50:27.213917 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.213891 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 18:50:27.254191 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.254151 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-web-config\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.254653 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.254204 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.254653 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.254232 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b4ddeba8-2ad4-4be6-b414-97a8607de19a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.254653 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.254268 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.254653 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.254299 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.254653 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.254321 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.254653 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.254397 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b4ddeba8-2ad4-4be6-b414-97a8607de19a-config-out\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.254653 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.254430 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qswj\" (UniqueName: \"kubernetes.io/projected/b4ddeba8-2ad4-4be6-b414-97a8607de19a-kube-api-access-2qswj\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.254653 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.254456 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.254653 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.254480 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-config\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.254653 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.254521 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.254653 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.254566 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.254653 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.254609 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b4ddeba8-2ad4-4be6-b414-97a8607de19a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.254653 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.254634 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.255373 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.254666 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.255373 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.254693 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.255373 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.254751 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.255373 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.254771 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.255373 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.254800 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.255373 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.254827 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.355975 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.355933 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.355975 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.355974 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.356210 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.355994 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.356210 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.356145 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.356210 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.356198 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-web-config\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.356362 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.356235 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.356362 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.356259 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b4ddeba8-2ad4-4be6-b414-97a8607de19a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.356362 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.356293 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.356362 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.356325 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.356362 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.356351 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.356659 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.356390 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b4ddeba8-2ad4-4be6-b414-97a8607de19a-config-out\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.356659 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.356414 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qswj\" (UniqueName: \"kubernetes.io/projected/b4ddeba8-2ad4-4be6-b414-97a8607de19a-kube-api-access-2qswj\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.356659 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.356438 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.356659 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.356512 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-config\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.356659 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.356543 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.356659 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.356597 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.356659 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.356647 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b4ddeba8-2ad4-4be6-b414-97a8607de19a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.357003 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.356683 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.357003 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.356707 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.357003 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.356735 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.357003 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.356794 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.357610 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.357290 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.358056 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.357737 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.359530 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.359505 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-web-config\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.359893 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.359866 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.360099 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.360070 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.360099 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.360089 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b4ddeba8-2ad4-4be6-b414-97a8607de19a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.360428 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.360406 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.360565 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.360540 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b4ddeba8-2ad4-4be6-b414-97a8607de19a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.360731 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.360701 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.361345 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.361314 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.361487 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.361459 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.361626 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.361531 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.362165 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.362130 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.362165 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.362153 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.362685 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.362660 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.363049 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.363024 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b4ddeba8-2ad4-4be6-b414-97a8607de19a-config-out\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.363211 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.363195 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.363681 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.363654 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-config\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.372429 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.372391 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qswj\" (UniqueName: \"kubernetes.io/projected/b4ddeba8-2ad4-4be6-b414-97a8607de19a-kube-api-access-2qswj\") pod \"prometheus-k8s-0\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.497620 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.497532 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:27.844447 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.844413 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gl55g" event={"ID":"bb6e0205-703f-4dec-af35-283ccc740b37","Type":"ContainerStarted","Data":"a9f2333b9b765fcd3c2e4c268f14ac1a4e82fb46432943d5ca2488f7d8e5c536"} Sep 11 18:50:27.844653 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.844466 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gl55g" event={"ID":"bb6e0205-703f-4dec-af35-283ccc740b37","Type":"ContainerStarted","Data":"68663df5a74747de52d9691e003ccfaf25f86e5c7014dbb3db55aecfb9da1662"} Sep 11 18:50:27.853315 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.853284 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 18:50:27.853463 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:50:27.853444 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4ddeba8_2ad4_4be6_b414_97a8607de19a.slice/crio-b30e88cc0ecd276e4ac5b13dfcef9e814e13b7b2fa0e20075a205e1b9f561831 WatchSource:0}: Error finding container b30e88cc0ecd276e4ac5b13dfcef9e814e13b7b2fa0e20075a205e1b9f561831: Status 404 returned error can't find the container with id b30e88cc0ecd276e4ac5b13dfcef9e814e13b7b2fa0e20075a205e1b9f561831 Sep 11 18:50:27.871885 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:27.871844 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gl55g" podStartSLOduration=131.028827552 podStartE2EDuration="2m11.871828568s" totalImagesPullingTime="843.001016ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:48:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:50:27.871193759 +0000 UTC m=+132.051126468" watchObservedRunningTime="2026-09-11 18:50:27.871828568 +0000 UTC m=+132.051761275" Sep 11 18:50:28.849602 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:28.849550 2583 generic.go:356] "Generic (PLEG): container finished" podID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerID="67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae" exitCode=0 Sep 11 18:50:28.849962 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:28.849621 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4ddeba8-2ad4-4be6-b414-97a8607de19a","Type":"ContainerDied","Data":"67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae"} Sep 11 18:50:28.849962 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:28.849700 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4ddeba8-2ad4-4be6-b414-97a8607de19a","Type":"ContainerStarted","Data":"b30e88cc0ecd276e4ac5b13dfcef9e814e13b7b2fa0e20075a205e1b9f561831"} Sep 11 18:50:32.868714 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:32.868672 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4ddeba8-2ad4-4be6-b414-97a8607de19a","Type":"ContainerStarted","Data":"9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c"} Sep 11 18:50:32.869097 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:32.868770 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4ddeba8-2ad4-4be6-b414-97a8607de19a","Type":"ContainerStarted","Data":"843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50"} Sep 11 18:50:34.878941 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:34.878901 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4ddeba8-2ad4-4be6-b414-97a8607de19a","Type":"ContainerStarted","Data":"363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e"} Sep 11 18:50:34.879319 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:34.878968 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4ddeba8-2ad4-4be6-b414-97a8607de19a","Type":"ContainerStarted","Data":"3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73"} Sep 11 18:50:34.879319 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:34.878997 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4ddeba8-2ad4-4be6-b414-97a8607de19a","Type":"ContainerStarted","Data":"713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687"} Sep 11 18:50:34.879319 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:34.879021 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4ddeba8-2ad4-4be6-b414-97a8607de19a","Type":"ContainerStarted","Data":"5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037"} Sep 11 18:50:34.916338 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:34.916285 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.096179249 podStartE2EDuration="7.916267127s" totalImagesPullingTime="5.799465218s" totalInitContainerRuntime="20.62266ms" isStatefulPod=false podCreationTimestamp="2026-09-11 18:50:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:50:34.913538737 +0000 UTC m=+139.093471482" watchObservedRunningTime="2026-09-11 18:50:34.916267127 +0000 UTC m=+139.096199875" Sep 11 18:50:37.498715 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:37.498677 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:50:40.513488 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.513423 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" podUID="efce9264-857f-4ebe-9412-3ef1b95ec9f7" containerName="registry" containerID="cri-o://516b6c93441e895030a43dedaf703a43903fcea7969d05a8a3443024f24394b3" gracePeriod=30 Sep 11 18:50:40.760171 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.760148 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:50:40.812047 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.811969 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-597d5b6488-czf89_1a3662ef-c0c0-4673-a66c-173e38736517/router/0.log" Sep 11 18:50:40.825689 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.825662 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kjvqf_dc3f63b6-c621-4d27-9e27-4a9709ef75f6/serve-healthcheck-canary/0.log" Sep 11 18:50:40.874870 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.874835 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbt6s\" (UniqueName: \"kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-kube-api-access-sbt6s\") pod \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " Sep 11 18:50:40.875014 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.874878 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/efce9264-857f-4ebe-9412-3ef1b95ec9f7-image-registry-private-configuration\") pod \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " Sep 11 18:50:40.875014 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.874918 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/efce9264-857f-4ebe-9412-3ef1b95ec9f7-installation-pull-secrets\") pod \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " Sep 11 18:50:40.875090 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.875036 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/efce9264-857f-4ebe-9412-3ef1b95ec9f7-ca-trust-extracted\") pod \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " Sep 11 18:50:40.875090 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.875082 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/efce9264-857f-4ebe-9412-3ef1b95ec9f7-trusted-ca\") pod \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " Sep 11 18:50:40.875164 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.875107 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-tls\") pod \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " Sep 11 18:50:40.875164 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.875158 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-certificates\") pod \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " Sep 11 18:50:40.875256 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.875185 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-bound-sa-token\") pod \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\" (UID: \"efce9264-857f-4ebe-9412-3ef1b95ec9f7\") " Sep 11 18:50:40.875695 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.875615 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efce9264-857f-4ebe-9412-3ef1b95ec9f7-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "efce9264-857f-4ebe-9412-3ef1b95ec9f7" (UID: "efce9264-857f-4ebe-9412-3ef1b95ec9f7"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 18:50:40.875855 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.875827 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "efce9264-857f-4ebe-9412-3ef1b95ec9f7" (UID: "efce9264-857f-4ebe-9412-3ef1b95ec9f7"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 18:50:40.877880 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.877849 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efce9264-857f-4ebe-9412-3ef1b95ec9f7-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "efce9264-857f-4ebe-9412-3ef1b95ec9f7" (UID: "efce9264-857f-4ebe-9412-3ef1b95ec9f7"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 18:50:40.877987 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.877913 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efce9264-857f-4ebe-9412-3ef1b95ec9f7-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "efce9264-857f-4ebe-9412-3ef1b95ec9f7" (UID: "efce9264-857f-4ebe-9412-3ef1b95ec9f7"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 18:50:40.877987 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.877930 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-kube-api-access-sbt6s" (OuterVolumeSpecName: "kube-api-access-sbt6s") pod "efce9264-857f-4ebe-9412-3ef1b95ec9f7" (UID: "efce9264-857f-4ebe-9412-3ef1b95ec9f7"). InnerVolumeSpecName "kube-api-access-sbt6s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 18:50:40.877987 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.877970 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "efce9264-857f-4ebe-9412-3ef1b95ec9f7" (UID: "efce9264-857f-4ebe-9412-3ef1b95ec9f7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 18:50:40.878105 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.878091 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "efce9264-857f-4ebe-9412-3ef1b95ec9f7" (UID: "efce9264-857f-4ebe-9412-3ef1b95ec9f7"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 18:50:40.883783 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.883759 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efce9264-857f-4ebe-9412-3ef1b95ec9f7-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "efce9264-857f-4ebe-9412-3ef1b95ec9f7" (UID: "efce9264-857f-4ebe-9412-3ef1b95ec9f7"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 18:50:40.899235 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.899209 2583 generic.go:356] "Generic (PLEG): container finished" podID="efce9264-857f-4ebe-9412-3ef1b95ec9f7" containerID="516b6c93441e895030a43dedaf703a43903fcea7969d05a8a3443024f24394b3" exitCode=0 Sep 11 18:50:40.899320 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.899246 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" Sep 11 18:50:40.899320 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.899275 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" event={"ID":"efce9264-857f-4ebe-9412-3ef1b95ec9f7","Type":"ContainerDied","Data":"516b6c93441e895030a43dedaf703a43903fcea7969d05a8a3443024f24394b3"} Sep 11 18:50:40.899320 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.899314 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-94bfd4bf6-fcrbl" event={"ID":"efce9264-857f-4ebe-9412-3ef1b95ec9f7","Type":"ContainerDied","Data":"2e32f51d0410733095fc5a8702416d0555ec9bf137e16487360051f4986d5c1c"} Sep 11 18:50:40.899418 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.899333 2583 scope.go:117] "RemoveContainer" containerID="516b6c93441e895030a43dedaf703a43903fcea7969d05a8a3443024f24394b3" Sep 11 18:50:40.907172 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.907156 2583 scope.go:117] "RemoveContainer" containerID="516b6c93441e895030a43dedaf703a43903fcea7969d05a8a3443024f24394b3" Sep 11 18:50:40.907455 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:50:40.907427 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"516b6c93441e895030a43dedaf703a43903fcea7969d05a8a3443024f24394b3\": container with ID starting with 516b6c93441e895030a43dedaf703a43903fcea7969d05a8a3443024f24394b3 not found: ID does not exist" containerID="516b6c93441e895030a43dedaf703a43903fcea7969d05a8a3443024f24394b3" Sep 11 18:50:40.907537 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.907461 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"516b6c93441e895030a43dedaf703a43903fcea7969d05a8a3443024f24394b3"} err="failed to get container status \"516b6c93441e895030a43dedaf703a43903fcea7969d05a8a3443024f24394b3\": rpc error: code = NotFound desc = could not find container \"516b6c93441e895030a43dedaf703a43903fcea7969d05a8a3443024f24394b3\": container with ID starting with 516b6c93441e895030a43dedaf703a43903fcea7969d05a8a3443024f24394b3 not found: ID does not exist" Sep 11 18:50:40.923464 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.923436 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-94bfd4bf6-fcrbl"] Sep 11 18:50:40.926975 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.926954 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-94bfd4bf6-fcrbl"] Sep 11 18:50:40.976454 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.976421 2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-bound-sa-token\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:50:40.976454 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.976450 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbt6s\" (UniqueName: \"kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-kube-api-access-sbt6s\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:50:40.976681 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.976463 2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/efce9264-857f-4ebe-9412-3ef1b95ec9f7-image-registry-private-configuration\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:50:40.976681 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.976474 2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/efce9264-857f-4ebe-9412-3ef1b95ec9f7-installation-pull-secrets\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:50:40.976681 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.976483 2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/efce9264-857f-4ebe-9412-3ef1b95ec9f7-ca-trust-extracted\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:50:40.976681 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.976496 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/efce9264-857f-4ebe-9412-3ef1b95ec9f7-trusted-ca\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:50:40.976681 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.976508 2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-tls\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:50:40.976681 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:40.976516 2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/efce9264-857f-4ebe-9412-3ef1b95ec9f7-registry-certificates\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:50:42.356991 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:50:42.356958 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efce9264-857f-4ebe-9412-3ef1b95ec9f7" path="/var/lib/kubelet/pods/efce9264-857f-4ebe-9412-3ef1b95ec9f7/volumes" Sep 11 18:51:27.497904 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:27.497859 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:27.513029 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:27.513004 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:28.077931 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:28.077900 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:45.650024 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.649993 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 18:51:45.650410 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.650291 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerName="kube-rbac-proxy" containerID="cri-o://3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73" gracePeriod=600 Sep 11 18:51:45.650410 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.650287 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerName="thanos-sidecar" containerID="cri-o://5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037" gracePeriod=600 Sep 11 18:51:45.650410 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.650326 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerName="kube-rbac-proxy-web" containerID="cri-o://713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687" gracePeriod=600 Sep 11 18:51:45.650410 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.650356 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerName="config-reloader" containerID="cri-o://9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c" gracePeriod=600 Sep 11 18:51:45.650410 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.650277 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerName="prometheus" containerID="cri-o://843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50" gracePeriod=600 Sep 11 18:51:45.650651 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.650376 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e" gracePeriod=600 Sep 11 18:51:45.726206 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:51:45.726176 2583 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4ddeba8_2ad4_4be6_b414_97a8607de19a.slice/crio-conmon-363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e.scope\": RecentStats: unable to find data in memory cache]" Sep 11 18:51:45.884014 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.883987 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:45.946744 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.946656 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-web-config\") pod \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " Sep 11 18:51:45.946744 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.946707 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-configmap-metrics-client-ca\") pod \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " Sep 11 18:51:45.946744 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.946743 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b4ddeba8-2ad4-4be6-b414-97a8607de19a-config-out\") pod \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " Sep 11 18:51:45.947003 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.946868 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-prometheus-k8s-tls\") pod \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " Sep 11 18:51:45.947003 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.946925 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-configmap-serving-certs-ca-bundle\") pod \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " Sep 11 18:51:45.947003 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.946956 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-grpc-tls\") pod \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " Sep 11 18:51:45.947003 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.946986 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-prometheus-k8s-rulefiles-0\") pod \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " Sep 11 18:51:45.947207 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.947011 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " Sep 11 18:51:45.947207 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.947040 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-prometheus-trusted-ca-bundle\") pod \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " Sep 11 18:51:45.947207 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.947067 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-configmap-kubelet-serving-ca-bundle\") pod \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " Sep 11 18:51:45.947207 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.947076 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "b4ddeba8-2ad4-4be6-b414-97a8607de19a" (UID: "b4ddeba8-2ad4-4be6-b414-97a8607de19a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 18:51:45.947207 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.947095 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-metrics-client-certs\") pod \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " Sep 11 18:51:45.947207 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.947127 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " Sep 11 18:51:45.947207 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.947159 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-prometheus-k8s-rulefiles-1\") pod \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " Sep 11 18:51:45.947207 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.947188 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-thanos-prometheus-http-client-file\") pod \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " Sep 11 18:51:45.947626 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.947220 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-prometheus-k8s-rulefiles-2\") pod \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " Sep 11 18:51:45.947626 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.947244 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b4ddeba8-2ad4-4be6-b414-97a8607de19a-tls-assets\") pod \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " Sep 11 18:51:45.947626 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.947274 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b4ddeba8-2ad4-4be6-b414-97a8607de19a-prometheus-k8s-db\") pod \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " Sep 11 18:51:45.947626 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.947329 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qswj\" (UniqueName: \"kubernetes.io/projected/b4ddeba8-2ad4-4be6-b414-97a8607de19a-kube-api-access-2qswj\") pod \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " Sep 11 18:51:45.947626 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.947355 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-config\") pod \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " Sep 11 18:51:45.947626 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.947389 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-kube-rbac-proxy\") pod \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\" (UID: \"b4ddeba8-2ad4-4be6-b414-97a8607de19a\") " Sep 11 18:51:45.947626 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.947440 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "b4ddeba8-2ad4-4be6-b414-97a8607de19a" (UID: "b4ddeba8-2ad4-4be6-b414-97a8607de19a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 18:51:45.947966 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.947722 2583 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-configmap-metrics-client-ca\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:51:45.947966 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.947746 2583 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:51:45.948980 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.948948 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "b4ddeba8-2ad4-4be6-b414-97a8607de19a" (UID: "b4ddeba8-2ad4-4be6-b414-97a8607de19a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 18:51:45.949642 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.949443 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "b4ddeba8-2ad4-4be6-b414-97a8607de19a" (UID: "b4ddeba8-2ad4-4be6-b414-97a8607de19a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 18:51:45.949961 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.949517 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4ddeba8-2ad4-4be6-b414-97a8607de19a-config-out" (OuterVolumeSpecName: "config-out") pod "b4ddeba8-2ad4-4be6-b414-97a8607de19a" (UID: "b4ddeba8-2ad4-4be6-b414-97a8607de19a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 18:51:45.950413 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.950177 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "b4ddeba8-2ad4-4be6-b414-97a8607de19a" (UID: "b4ddeba8-2ad4-4be6-b414-97a8607de19a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 18:51:45.950595 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.950553 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4ddeba8-2ad4-4be6-b414-97a8607de19a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "b4ddeba8-2ad4-4be6-b414-97a8607de19a" (UID: "b4ddeba8-2ad4-4be6-b414-97a8607de19a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 18:51:45.950969 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.950938 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "b4ddeba8-2ad4-4be6-b414-97a8607de19a" (UID: "b4ddeba8-2ad4-4be6-b414-97a8607de19a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 18:51:45.951061 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.951000 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "b4ddeba8-2ad4-4be6-b414-97a8607de19a" (UID: "b4ddeba8-2ad4-4be6-b414-97a8607de19a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 18:51:45.951425 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.951396 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "b4ddeba8-2ad4-4be6-b414-97a8607de19a" (UID: "b4ddeba8-2ad4-4be6-b414-97a8607de19a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 18:51:45.951798 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.951766 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "b4ddeba8-2ad4-4be6-b414-97a8607de19a" (UID: "b4ddeba8-2ad4-4be6-b414-97a8607de19a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 18:51:45.951898 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.951821 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "b4ddeba8-2ad4-4be6-b414-97a8607de19a" (UID: "b4ddeba8-2ad4-4be6-b414-97a8607de19a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 18:51:45.952276 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.952232 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "b4ddeba8-2ad4-4be6-b414-97a8607de19a" (UID: "b4ddeba8-2ad4-4be6-b414-97a8607de19a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 18:51:45.952276 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.952256 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "b4ddeba8-2ad4-4be6-b414-97a8607de19a" (UID: "b4ddeba8-2ad4-4be6-b414-97a8607de19a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 18:51:45.952519 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.952491 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "b4ddeba8-2ad4-4be6-b414-97a8607de19a" (UID: "b4ddeba8-2ad4-4be6-b414-97a8607de19a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 18:51:45.952663 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.952516 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-config" (OuterVolumeSpecName: "config") pod "b4ddeba8-2ad4-4be6-b414-97a8607de19a" (UID: "b4ddeba8-2ad4-4be6-b414-97a8607de19a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 18:51:45.952852 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.952826 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4ddeba8-2ad4-4be6-b414-97a8607de19a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b4ddeba8-2ad4-4be6-b414-97a8607de19a" (UID: "b4ddeba8-2ad4-4be6-b414-97a8607de19a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 18:51:45.952982 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.952953 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "b4ddeba8-2ad4-4be6-b414-97a8607de19a" (UID: "b4ddeba8-2ad4-4be6-b414-97a8607de19a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 18:51:45.953615 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.953593 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4ddeba8-2ad4-4be6-b414-97a8607de19a-kube-api-access-2qswj" (OuterVolumeSpecName: "kube-api-access-2qswj") pod "b4ddeba8-2ad4-4be6-b414-97a8607de19a" (UID: "b4ddeba8-2ad4-4be6-b414-97a8607de19a"). InnerVolumeSpecName "kube-api-access-2qswj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 18:51:45.960178 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:45.960152 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-web-config" (OuterVolumeSpecName: "web-config") pod "b4ddeba8-2ad4-4be6-b414-97a8607de19a" (UID: "b4ddeba8-2ad4-4be6-b414-97a8607de19a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 18:51:46.048352 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.048312 2583 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b4ddeba8-2ad4-4be6-b414-97a8607de19a-config-out\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:51:46.048352 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.048346 2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:51:46.048352 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.048358 2583 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-grpc-tls\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:51:46.048576 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.048366 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:51:46.048576 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.048376 2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:51:46.048576 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.048385 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:51:46.048576 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.048395 2583 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:51:46.048576 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.048403 2583 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-metrics-client-certs\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:51:46.048576 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.048411 2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:51:46.048576 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.048419 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:51:46.048576 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.048428 2583 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:51:46.048576 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.048435 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b4ddeba8-2ad4-4be6-b414-97a8607de19a-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:51:46.048576 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.048443 2583 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b4ddeba8-2ad4-4be6-b414-97a8607de19a-tls-assets\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:51:46.048576 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.048451 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b4ddeba8-2ad4-4be6-b414-97a8607de19a-prometheus-k8s-db\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:51:46.048576 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.048459 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qswj\" (UniqueName: \"kubernetes.io/projected/b4ddeba8-2ad4-4be6-b414-97a8607de19a-kube-api-access-2qswj\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:51:46.048576 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.048467 2583 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-config\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:51:46.048576 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.048475 2583 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-secret-kube-rbac-proxy\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:51:46.048576 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.048485 2583 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b4ddeba8-2ad4-4be6-b414-97a8607de19a-web-config\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:51:46.125141 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.125112 2583 generic.go:356] "Generic (PLEG): container finished" podID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerID="363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e" exitCode=0 Sep 11 18:51:46.125141 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.125135 2583 generic.go:356] "Generic (PLEG): container finished" podID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerID="3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73" exitCode=0 Sep 11 18:51:46.125141 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.125141 2583 generic.go:356] "Generic (PLEG): container finished" podID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerID="713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687" exitCode=0 Sep 11 18:51:46.125141 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.125146 2583 generic.go:356] "Generic (PLEG): container finished" podID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerID="5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037" exitCode=0 Sep 11 18:51:46.125373 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.125151 2583 generic.go:356] "Generic (PLEG): container finished" podID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerID="9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c" exitCode=0 Sep 11 18:51:46.125373 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.125156 2583 generic.go:356] "Generic (PLEG): container finished" podID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerID="843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50" exitCode=0 Sep 11 18:51:46.125373 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.125194 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.125373 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.125204 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4ddeba8-2ad4-4be6-b414-97a8607de19a","Type":"ContainerDied","Data":"363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e"} Sep 11 18:51:46.125373 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.125299 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4ddeba8-2ad4-4be6-b414-97a8607de19a","Type":"ContainerDied","Data":"3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73"} Sep 11 18:51:46.125373 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.125328 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4ddeba8-2ad4-4be6-b414-97a8607de19a","Type":"ContainerDied","Data":"713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687"} Sep 11 18:51:46.125373 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.125353 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4ddeba8-2ad4-4be6-b414-97a8607de19a","Type":"ContainerDied","Data":"5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037"} Sep 11 18:51:46.125373 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.125365 2583 scope.go:117] "RemoveContainer" containerID="363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e" Sep 11 18:51:46.125648 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.125377 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4ddeba8-2ad4-4be6-b414-97a8607de19a","Type":"ContainerDied","Data":"9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c"} Sep 11 18:51:46.125648 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.125402 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4ddeba8-2ad4-4be6-b414-97a8607de19a","Type":"ContainerDied","Data":"843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50"} Sep 11 18:51:46.125648 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.125425 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b4ddeba8-2ad4-4be6-b414-97a8607de19a","Type":"ContainerDied","Data":"b30e88cc0ecd276e4ac5b13dfcef9e814e13b7b2fa0e20075a205e1b9f561831"} Sep 11 18:51:46.133402 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.133381 2583 scope.go:117] "RemoveContainer" containerID="3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73" Sep 11 18:51:46.140114 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.140096 2583 scope.go:117] "RemoveContainer" containerID="713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687" Sep 11 18:51:46.146117 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.146101 2583 scope.go:117] "RemoveContainer" containerID="5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037" Sep 11 18:51:46.151050 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.151031 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 18:51:46.152413 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.152399 2583 scope.go:117] "RemoveContainer" containerID="9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c" Sep 11 18:51:46.157153 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.157133 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 18:51:46.159351 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.159338 2583 scope.go:117] "RemoveContainer" containerID="843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50" Sep 11 18:51:46.165873 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.165856 2583 scope.go:117] "RemoveContainer" containerID="67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae" Sep 11 18:51:46.171733 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.171718 2583 scope.go:117] "RemoveContainer" containerID="363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e" Sep 11 18:51:46.171998 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:51:46.171975 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e\": container with ID starting with 363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e not found: ID does not exist" containerID="363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e" Sep 11 18:51:46.172083 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.172006 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e"} err="failed to get container status \"363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e\": rpc error: code = NotFound desc = could not find container \"363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e\": container with ID starting with 363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e not found: ID does not exist" Sep 11 18:51:46.172083 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.172024 2583 scope.go:117] "RemoveContainer" containerID="3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73" Sep 11 18:51:46.172271 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:51:46.172253 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73\": container with ID starting with 3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73 not found: ID does not exist" containerID="3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73" Sep 11 18:51:46.172319 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.172276 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73"} err="failed to get container status \"3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73\": rpc error: code = NotFound desc = could not find container \"3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73\": container with ID starting with 3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73 not found: ID does not exist" Sep 11 18:51:46.172319 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.172291 2583 scope.go:117] "RemoveContainer" containerID="713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687" Sep 11 18:51:46.172506 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:51:46.172490 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687\": container with ID starting with 713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687 not found: ID does not exist" containerID="713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687" Sep 11 18:51:46.172567 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.172512 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687"} err="failed to get container status \"713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687\": rpc error: code = NotFound desc = could not find container \"713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687\": container with ID starting with 713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687 not found: ID does not exist" Sep 11 18:51:46.172567 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.172535 2583 scope.go:117] "RemoveContainer" containerID="5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037" Sep 11 18:51:46.172801 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:51:46.172783 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037\": container with ID starting with 5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037 not found: ID does not exist" containerID="5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037" Sep 11 18:51:46.172853 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.172805 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037"} err="failed to get container status \"5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037\": rpc error: code = NotFound desc = could not find container \"5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037\": container with ID starting with 5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037 not found: ID does not exist" Sep 11 18:51:46.172853 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.172819 2583 scope.go:117] "RemoveContainer" containerID="9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c" Sep 11 18:51:46.173027 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:51:46.173013 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c\": container with ID starting with 9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c not found: ID does not exist" containerID="9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c" Sep 11 18:51:46.173059 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.173031 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c"} err="failed to get container status \"9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c\": rpc error: code = NotFound desc = could not find container \"9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c\": container with ID starting with 9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c not found: ID does not exist" Sep 11 18:51:46.173059 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.173042 2583 scope.go:117] "RemoveContainer" containerID="843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50" Sep 11 18:51:46.173241 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:51:46.173225 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50\": container with ID starting with 843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50 not found: ID does not exist" containerID="843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50" Sep 11 18:51:46.173285 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.173245 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50"} err="failed to get container status \"843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50\": rpc error: code = NotFound desc = could not find container \"843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50\": container with ID starting with 843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50 not found: ID does not exist" Sep 11 18:51:46.173285 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.173258 2583 scope.go:117] "RemoveContainer" containerID="67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae" Sep 11 18:51:46.173468 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:51:46.173453 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae\": container with ID starting with 67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae not found: ID does not exist" containerID="67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae" Sep 11 18:51:46.173510 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.173470 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae"} err="failed to get container status \"67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae\": rpc error: code = NotFound desc = could not find container \"67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae\": container with ID starting with 67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae not found: ID does not exist" Sep 11 18:51:46.173510 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.173481 2583 scope.go:117] "RemoveContainer" containerID="363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e" Sep 11 18:51:46.173725 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.173709 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e"} err="failed to get container status \"363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e\": rpc error: code = NotFound desc = could not find container \"363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e\": container with ID starting with 363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e not found: ID does not exist" Sep 11 18:51:46.173775 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.173725 2583 scope.go:117] "RemoveContainer" containerID="3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73" Sep 11 18:51:46.173931 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.173906 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73"} err="failed to get container status \"3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73\": rpc error: code = NotFound desc = could not find container \"3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73\": container with ID starting with 3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73 not found: ID does not exist" Sep 11 18:51:46.173983 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.173930 2583 scope.go:117] "RemoveContainer" containerID="713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687" Sep 11 18:51:46.174134 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.174115 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687"} err="failed to get container status \"713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687\": rpc error: code = NotFound desc = could not find container \"713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687\": container with ID starting with 713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687 not found: ID does not exist" Sep 11 18:51:46.174182 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.174136 2583 scope.go:117] "RemoveContainer" containerID="5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037" Sep 11 18:51:46.174386 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.174367 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037"} err="failed to get container status \"5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037\": rpc error: code = NotFound desc = could not find container \"5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037\": container with ID starting with 5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037 not found: ID does not exist" Sep 11 18:51:46.174454 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.174388 2583 scope.go:117] "RemoveContainer" containerID="9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c" Sep 11 18:51:46.174652 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.174625 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c"} err="failed to get container status \"9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c\": rpc error: code = NotFound desc = could not find container \"9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c\": container with ID starting with 9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c not found: ID does not exist" Sep 11 18:51:46.174710 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.174652 2583 scope.go:117] "RemoveContainer" containerID="843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50" Sep 11 18:51:46.174891 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.174872 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50"} err="failed to get container status \"843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50\": rpc error: code = NotFound desc = could not find container \"843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50\": container with ID starting with 843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50 not found: ID does not exist" Sep 11 18:51:46.174970 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.174899 2583 scope.go:117] "RemoveContainer" containerID="67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae" Sep 11 18:51:46.175171 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.175154 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae"} err="failed to get container status \"67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae\": rpc error: code = NotFound desc = could not find container \"67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae\": container with ID starting with 67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae not found: ID does not exist" Sep 11 18:51:46.175240 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.175172 2583 scope.go:117] "RemoveContainer" containerID="363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e" Sep 11 18:51:46.175405 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.175385 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e"} err="failed to get container status \"363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e\": rpc error: code = NotFound desc = could not find container \"363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e\": container with ID starting with 363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e not found: ID does not exist" Sep 11 18:51:46.175458 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.175406 2583 scope.go:117] "RemoveContainer" containerID="3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73" Sep 11 18:51:46.175664 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.175636 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73"} err="failed to get container status \"3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73\": rpc error: code = NotFound desc = could not find container \"3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73\": container with ID starting with 3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73 not found: ID does not exist" Sep 11 18:51:46.175664 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.175665 2583 scope.go:117] "RemoveContainer" containerID="713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687" Sep 11 18:51:46.175900 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.175882 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687"} err="failed to get container status \"713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687\": rpc error: code = NotFound desc = could not find container \"713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687\": container with ID starting with 713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687 not found: ID does not exist" Sep 11 18:51:46.175948 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.175901 2583 scope.go:117] "RemoveContainer" containerID="5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037" Sep 11 18:51:46.176104 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.176087 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037"} err="failed to get container status \"5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037\": rpc error: code = NotFound desc = could not find container \"5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037\": container with ID starting with 5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037 not found: ID does not exist" Sep 11 18:51:46.176164 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.176105 2583 scope.go:117] "RemoveContainer" containerID="9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c" Sep 11 18:51:46.176340 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.176323 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c"} err="failed to get container status \"9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c\": rpc error: code = NotFound desc = could not find container \"9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c\": container with ID starting with 9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c not found: ID does not exist" Sep 11 18:51:46.176387 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.176341 2583 scope.go:117] "RemoveContainer" containerID="843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50" Sep 11 18:51:46.176538 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.176522 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50"} err="failed to get container status \"843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50\": rpc error: code = NotFound desc = could not find container \"843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50\": container with ID starting with 843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50 not found: ID does not exist" Sep 11 18:51:46.176621 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.176539 2583 scope.go:117] "RemoveContainer" containerID="67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae" Sep 11 18:51:46.176772 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.176756 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae"} err="failed to get container status \"67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae\": rpc error: code = NotFound desc = could not find container \"67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae\": container with ID starting with 67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae not found: ID does not exist" Sep 11 18:51:46.176811 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.176773 2583 scope.go:117] "RemoveContainer" containerID="363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e" Sep 11 18:51:46.176989 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.176973 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e"} err="failed to get container status \"363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e\": rpc error: code = NotFound desc = could not find container \"363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e\": container with ID starting with 363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e not found: ID does not exist" Sep 11 18:51:46.177026 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.176991 2583 scope.go:117] "RemoveContainer" containerID="3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73" Sep 11 18:51:46.177208 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.177191 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73"} err="failed to get container status \"3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73\": rpc error: code = NotFound desc = could not find container \"3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73\": container with ID starting with 3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73 not found: ID does not exist" Sep 11 18:51:46.177254 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.177209 2583 scope.go:117] "RemoveContainer" containerID="713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687" Sep 11 18:51:46.177420 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.177402 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687"} err="failed to get container status \"713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687\": rpc error: code = NotFound desc = could not find container \"713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687\": container with ID starting with 713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687 not found: ID does not exist" Sep 11 18:51:46.177486 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.177421 2583 scope.go:117] "RemoveContainer" containerID="5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037" Sep 11 18:51:46.177705 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.177683 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037"} err="failed to get container status \"5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037\": rpc error: code = NotFound desc = could not find container \"5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037\": container with ID starting with 5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037 not found: ID does not exist" Sep 11 18:51:46.177761 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.177708 2583 scope.go:117] "RemoveContainer" containerID="9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c" Sep 11 18:51:46.177957 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.177938 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c"} err="failed to get container status \"9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c\": rpc error: code = NotFound desc = could not find container \"9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c\": container with ID starting with 9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c not found: ID does not exist" Sep 11 18:51:46.178031 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.177959 2583 scope.go:117] "RemoveContainer" containerID="843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50" Sep 11 18:51:46.178186 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.178167 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50"} err="failed to get container status \"843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50\": rpc error: code = NotFound desc = could not find container \"843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50\": container with ID starting with 843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50 not found: ID does not exist" Sep 11 18:51:46.178233 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.178187 2583 scope.go:117] "RemoveContainer" containerID="67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae" Sep 11 18:51:46.178407 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.178389 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae"} err="failed to get container status \"67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae\": rpc error: code = NotFound desc = could not find container \"67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae\": container with ID starting with 67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae not found: ID does not exist" Sep 11 18:51:46.178473 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.178408 2583 scope.go:117] "RemoveContainer" containerID="363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e" Sep 11 18:51:46.178639 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.178625 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e"} err="failed to get container status \"363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e\": rpc error: code = NotFound desc = could not find container \"363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e\": container with ID starting with 363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e not found: ID does not exist" Sep 11 18:51:46.178691 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.178639 2583 scope.go:117] "RemoveContainer" containerID="3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73" Sep 11 18:51:46.178838 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.178821 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73"} err="failed to get container status \"3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73\": rpc error: code = NotFound desc = could not find container \"3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73\": container with ID starting with 3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73 not found: ID does not exist" Sep 11 18:51:46.178896 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.178839 2583 scope.go:117] "RemoveContainer" containerID="713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687" Sep 11 18:51:46.179067 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.179048 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687"} err="failed to get container status \"713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687\": rpc error: code = NotFound desc = could not find container \"713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687\": container with ID starting with 713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687 not found: ID does not exist" Sep 11 18:51:46.179140 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.179069 2583 scope.go:117] "RemoveContainer" containerID="5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037" Sep 11 18:51:46.179270 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.179255 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037"} err="failed to get container status \"5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037\": rpc error: code = NotFound desc = could not find container \"5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037\": container with ID starting with 5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037 not found: ID does not exist" Sep 11 18:51:46.179315 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.179270 2583 scope.go:117] "RemoveContainer" containerID="9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c" Sep 11 18:51:46.179455 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.179438 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c"} err="failed to get container status \"9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c\": rpc error: code = NotFound desc = could not find container \"9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c\": container with ID starting with 9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c not found: ID does not exist" Sep 11 18:51:46.179520 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.179456 2583 scope.go:117] "RemoveContainer" containerID="843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50" Sep 11 18:51:46.179663 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.179649 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50"} err="failed to get container status \"843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50\": rpc error: code = NotFound desc = could not find container \"843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50\": container with ID starting with 843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50 not found: ID does not exist" Sep 11 18:51:46.179713 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.179664 2583 scope.go:117] "RemoveContainer" containerID="67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae" Sep 11 18:51:46.179867 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.179851 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae"} err="failed to get container status \"67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae\": rpc error: code = NotFound desc = could not find container \"67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae\": container with ID starting with 67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae not found: ID does not exist" Sep 11 18:51:46.179932 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.179868 2583 scope.go:117] "RemoveContainer" containerID="363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e" Sep 11 18:51:46.180065 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.180048 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e"} err="failed to get container status \"363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e\": rpc error: code = NotFound desc = could not find container \"363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e\": container with ID starting with 363529bc5ce631c22c588507c582e277bbe09ee69471495b8403538dde91d67e not found: ID does not exist" Sep 11 18:51:46.180110 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.180065 2583 scope.go:117] "RemoveContainer" containerID="3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73" Sep 11 18:51:46.182206 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.182186 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73"} err="failed to get container status \"3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73\": rpc error: code = NotFound desc = could not find container \"3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73\": container with ID starting with 3544122e081915d90622d4ddca2d37ed129b4834daad1b6222868e32665e2d73 not found: ID does not exist" Sep 11 18:51:46.182206 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.182206 2583 scope.go:117] "RemoveContainer" containerID="713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687" Sep 11 18:51:46.182674 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.182655 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687"} err="failed to get container status \"713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687\": rpc error: code = NotFound desc = could not find container \"713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687\": container with ID starting with 713af86d69639e42014ed90e37869f06b8ac896892327246776ee1101a0cf687 not found: ID does not exist" Sep 11 18:51:46.182674 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.182674 2583 scope.go:117] "RemoveContainer" containerID="5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037" Sep 11 18:51:46.182911 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.182894 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037"} err="failed to get container status \"5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037\": rpc error: code = NotFound desc = could not find container \"5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037\": container with ID starting with 5b8dfd37df56cd01333ea6e2d5f8783ef53a279836f7e85f840893202b584037 not found: ID does not exist" Sep 11 18:51:46.182972 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.182911 2583 scope.go:117] "RemoveContainer" containerID="9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c" Sep 11 18:51:46.183108 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.183094 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c"} err="failed to get container status \"9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c\": rpc error: code = NotFound desc = could not find container \"9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c\": container with ID starting with 9b1dd7775927ac428edf215e67e90908e1bcb0cb7df56ee6abb1d9560982694c not found: ID does not exist" Sep 11 18:51:46.183165 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.183108 2583 scope.go:117] "RemoveContainer" containerID="843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50" Sep 11 18:51:46.183293 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.183278 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50"} err="failed to get container status \"843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50\": rpc error: code = NotFound desc = could not find container \"843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50\": container with ID starting with 843d7400510858101652f2138f5f5b363be5b9739cc32abbcba6df7969275e50 not found: ID does not exist" Sep 11 18:51:46.183345 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.183293 2583 scope.go:117] "RemoveContainer" containerID="67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae" Sep 11 18:51:46.183488 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.183472 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae"} err="failed to get container status \"67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae\": rpc error: code = NotFound desc = could not find container \"67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae\": container with ID starting with 67a380b73809cfbc9e54c04f519612cdc5c2fe32cb563e22ad6cc817c71bd1ae not found: ID does not exist" Sep 11 18:51:46.187234 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.187215 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 18:51:46.187426 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.187416 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efce9264-857f-4ebe-9412-3ef1b95ec9f7" containerName="registry" Sep 11 18:51:46.187474 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.187428 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="efce9264-857f-4ebe-9412-3ef1b95ec9f7" containerName="registry" Sep 11 18:51:46.187474 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.187437 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerName="init-config-reloader" Sep 11 18:51:46.187474 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.187442 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerName="init-config-reloader" Sep 11 18:51:46.187474 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.187448 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerName="prometheus" Sep 11 18:51:46.187474 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.187453 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerName="prometheus" Sep 11 18:51:46.187474 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.187464 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerName="kube-rbac-proxy-thanos" Sep 11 18:51:46.187474 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.187470 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerName="kube-rbac-proxy-thanos" Sep 11 18:51:46.187688 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.187476 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerName="thanos-sidecar" Sep 11 18:51:46.187688 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.187482 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerName="thanos-sidecar" Sep 11 18:51:46.187688 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.187487 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerName="kube-rbac-proxy-web" Sep 11 18:51:46.187688 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.187492 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerName="kube-rbac-proxy-web" Sep 11 18:51:46.187688 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.187499 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerName="kube-rbac-proxy" Sep 11 18:51:46.187688 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.187503 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerName="kube-rbac-proxy" Sep 11 18:51:46.187688 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.187513 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerName="config-reloader" Sep 11 18:51:46.187688 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.187520 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerName="config-reloader" Sep 11 18:51:46.187688 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.187554 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="efce9264-857f-4ebe-9412-3ef1b95ec9f7" containerName="registry" Sep 11 18:51:46.187688 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.187561 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerName="thanos-sidecar" Sep 11 18:51:46.187688 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.187568 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerName="prometheus" Sep 11 18:51:46.187688 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.187572 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerName="kube-rbac-proxy-web" Sep 11 18:51:46.187688 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.187592 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerName="config-reloader" Sep 11 18:51:46.187688 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.187598 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerName="kube-rbac-proxy" Sep 11 18:51:46.187688 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.187602 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" containerName="kube-rbac-proxy-thanos" Sep 11 18:51:46.192360 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.192344 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.196869 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.196821 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-q8olo6r6ee44\"" Sep 11 18:51:46.197734 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.197714 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 11 18:51:46.197734 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.197717 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 11 18:51:46.197901 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.197716 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 11 18:51:46.197901 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.197721 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 11 18:51:46.197901 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.197851 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 11 18:51:46.197901 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.197880 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 11 18:51:46.198102 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.197922 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 11 18:51:46.198102 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.197937 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 11 18:51:46.198102 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.197992 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 11 18:51:46.198102 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.197944 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 11 18:51:46.198102 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.198013 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 11 18:51:46.198102 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.198053 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 11 18:51:46.198102 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.198054 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tw6qh\"" Sep 11 18:51:46.198440 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.198173 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 11 18:51:46.201016 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.200998 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 11 18:51:46.203781 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.203763 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 11 18:51:46.210392 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.210373 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 18:51:46.249771 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.249743 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fc07c570-3b25-4940-8088-9e6ec803c463-config\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.249771 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.249772 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fc07c570-3b25-4940-8088-9e6ec803c463-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.249946 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.249792 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc07c570-3b25-4940-8088-9e6ec803c463-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.249946 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.249823 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fc07c570-3b25-4940-8088-9e6ec803c463-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.249946 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.249861 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fc07c570-3b25-4940-8088-9e6ec803c463-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.249946 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.249880 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc07c570-3b25-4940-8088-9e6ec803c463-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.249946 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.249901 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc07c570-3b25-4940-8088-9e6ec803c463-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.249946 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.249923 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fc07c570-3b25-4940-8088-9e6ec803c463-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.249946 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.249945 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc07c570-3b25-4940-8088-9e6ec803c463-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.250182 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.250023 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fc07c570-3b25-4940-8088-9e6ec803c463-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.250182 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.250051 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fc07c570-3b25-4940-8088-9e6ec803c463-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.250182 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.250076 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc07c570-3b25-4940-8088-9e6ec803c463-web-config\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.250182 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.250102 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc07c570-3b25-4940-8088-9e6ec803c463-config-out\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.250182 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.250117 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc07c570-3b25-4940-8088-9e6ec803c463-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.250182 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.250132 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6m8h\" (UniqueName: \"kubernetes.io/projected/fc07c570-3b25-4940-8088-9e6ec803c463-kube-api-access-j6m8h\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.250182 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.250166 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fc07c570-3b25-4940-8088-9e6ec803c463-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.250375 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.250186 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc07c570-3b25-4940-8088-9e6ec803c463-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.250375 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.250202 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fc07c570-3b25-4940-8088-9e6ec803c463-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.250375 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.250229 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc07c570-3b25-4940-8088-9e6ec803c463-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.250375 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.250249 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc07c570-3b25-4940-8088-9e6ec803c463-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.350980 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.350951 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc07c570-3b25-4940-8088-9e6ec803c463-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.351141 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.350993 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fc07c570-3b25-4940-8088-9e6ec803c463-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.351141 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.351008 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fc07c570-3b25-4940-8088-9e6ec803c463-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.351141 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.351029 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc07c570-3b25-4940-8088-9e6ec803c463-web-config\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.351141 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.351059 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc07c570-3b25-4940-8088-9e6ec803c463-config-out\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.351141 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.351082 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc07c570-3b25-4940-8088-9e6ec803c463-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.351141 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.351105 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6m8h\" (UniqueName: \"kubernetes.io/projected/fc07c570-3b25-4940-8088-9e6ec803c463-kube-api-access-j6m8h\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.351141 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.351128 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fc07c570-3b25-4940-8088-9e6ec803c463-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.351473 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.351149 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc07c570-3b25-4940-8088-9e6ec803c463-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.351473 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.351202 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fc07c570-3b25-4940-8088-9e6ec803c463-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.351473 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.351230 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc07c570-3b25-4940-8088-9e6ec803c463-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.351473 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.351289 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc07c570-3b25-4940-8088-9e6ec803c463-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.351473 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.351331 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fc07c570-3b25-4940-8088-9e6ec803c463-config\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.351473 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.351355 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fc07c570-3b25-4940-8088-9e6ec803c463-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.351473 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.351386 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc07c570-3b25-4940-8088-9e6ec803c463-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.351473 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.351417 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fc07c570-3b25-4940-8088-9e6ec803c463-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.351473 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.351445 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fc07c570-3b25-4940-8088-9e6ec803c463-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.351473 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.351470 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc07c570-3b25-4940-8088-9e6ec803c463-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.351985 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.351495 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc07c570-3b25-4940-8088-9e6ec803c463-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.351985 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.351520 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fc07c570-3b25-4940-8088-9e6ec803c463-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.351985 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.351806 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc07c570-3b25-4940-8088-9e6ec803c463-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.351985 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.351934 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fc07c570-3b25-4940-8088-9e6ec803c463-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.353929 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.352537 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc07c570-3b25-4940-8088-9e6ec803c463-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.353929 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.353138 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc07c570-3b25-4940-8088-9e6ec803c463-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.353929 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.353666 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fc07c570-3b25-4940-8088-9e6ec803c463-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.354175 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.353992 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc07c570-3b25-4940-8088-9e6ec803c463-config-out\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.355661 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.354636 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fc07c570-3b25-4940-8088-9e6ec803c463-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.355661 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.354658 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc07c570-3b25-4940-8088-9e6ec803c463-web-config\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.355661 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.354802 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fc07c570-3b25-4940-8088-9e6ec803c463-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.355661 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.354833 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc07c570-3b25-4940-8088-9e6ec803c463-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.355661 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.354953 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc07c570-3b25-4940-8088-9e6ec803c463-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.355661 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.355307 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fc07c570-3b25-4940-8088-9e6ec803c463-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.355661 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.355607 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fc07c570-3b25-4940-8088-9e6ec803c463-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.356430 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.356405 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc07c570-3b25-4940-8088-9e6ec803c463-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.356982 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.356956 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc07c570-3b25-4940-8088-9e6ec803c463-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.357117 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.357096 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fc07c570-3b25-4940-8088-9e6ec803c463-config\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.357482 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.357464 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fc07c570-3b25-4940-8088-9e6ec803c463-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.357991 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.357975 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc07c570-3b25-4940-8088-9e6ec803c463-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.358191 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.358173 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fc07c570-3b25-4940-8088-9e6ec803c463-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.358312 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.358290 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4ddeba8-2ad4-4be6-b414-97a8607de19a" path="/var/lib/kubelet/pods/b4ddeba8-2ad4-4be6-b414-97a8607de19a/volumes" Sep 11 18:51:46.360703 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.360685 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6m8h\" (UniqueName: \"kubernetes.io/projected/fc07c570-3b25-4940-8088-9e6ec803c463-kube-api-access-j6m8h\") pod \"prometheus-k8s-0\" (UID: \"fc07c570-3b25-4940-8088-9e6ec803c463\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.501841 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.501778 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:51:46.792958 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:46.789562 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 18:51:47.130387 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:47.130305 2583 generic.go:356] "Generic (PLEG): container finished" podID="fc07c570-3b25-4940-8088-9e6ec803c463" containerID="eb3cc4cea692a1d6cf13c15bba1653cbf4f224d994ae0db542c52c4a3b9f0be0" exitCode=0 Sep 11 18:51:47.130387 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:47.130344 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc07c570-3b25-4940-8088-9e6ec803c463","Type":"ContainerDied","Data":"eb3cc4cea692a1d6cf13c15bba1653cbf4f224d994ae0db542c52c4a3b9f0be0"} Sep 11 18:51:47.130562 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:47.130392 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc07c570-3b25-4940-8088-9e6ec803c463","Type":"ContainerStarted","Data":"2db3b2af62a7fe8d14c9277389d610c96b760b45efd23b21f507f417f8ce40cf"} Sep 11 18:51:48.137208 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:48.137174 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc07c570-3b25-4940-8088-9e6ec803c463","Type":"ContainerStarted","Data":"e7b1a9e26f9fdabf24450d9a139d823be51d564f64806f19b6185ffcd8fa3d7e"} Sep 11 18:51:48.137626 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:48.137235 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc07c570-3b25-4940-8088-9e6ec803c463","Type":"ContainerStarted","Data":"be9eac7a49e77ecef3d6d0ceef47c68a465159c918612f51708b22812083bb85"} Sep 11 18:51:48.137626 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:48.137261 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc07c570-3b25-4940-8088-9e6ec803c463","Type":"ContainerStarted","Data":"d55c52cd58cf8e9687edd146e17936b5b2199224b8dec49c385d5a3c4c24ddc3"} Sep 11 18:51:48.137626 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:48.137287 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc07c570-3b25-4940-8088-9e6ec803c463","Type":"ContainerStarted","Data":"9469ff26a0b3ddb275ea4157da7ee5b6890e645b322b195e287677273693b5bc"} Sep 11 18:51:48.137626 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:48.137317 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc07c570-3b25-4940-8088-9e6ec803c463","Type":"ContainerStarted","Data":"b5683900248499a67557bf42131e35c53f275f8039ecbd561cc66f24a3becc39"} Sep 11 18:51:48.137626 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:48.137341 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc07c570-3b25-4940-8088-9e6ec803c463","Type":"ContainerStarted","Data":"a1145ed0a541909fa76415928da3944dc78f2a59ad398be17fc082f81eacddfb"} Sep 11 18:51:48.175569 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:48.175507 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.156162195 podStartE2EDuration="2.175490833s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.328638ms" isStatefulPod=false podCreationTimestamp="2026-09-11 18:51:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:51:48.173401433 +0000 UTC m=+212.353334141" watchObservedRunningTime="2026-09-11 18:51:48.175490833 +0000 UTC m=+212.355423537" Sep 11 18:51:51.502356 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:51:51.502320 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:52:46.502183 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:52:46.502096 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:52:46.517233 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:52:46.517209 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:52:47.350659 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:52:47.350629 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 18:53:16.239495 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:16.239466 2583 kubelet.go:1648] "Image garbage collection succeeded" Sep 11 18:53:44.318248 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:44.318213 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8f9f87498-647gp"] Sep 11 18:53:44.321600 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:44.321568 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8f9f87498-647gp" Sep 11 18:53:44.325215 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:44.325195 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 11 18:53:44.325619 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:44.325599 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 11 18:53:44.325718 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:44.325640 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 11 18:53:44.325718 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:44.325648 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7hdlb\"" Sep 11 18:53:44.325802 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:44.325768 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 11 18:53:44.392719 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:44.392687 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8f9f87498-647gp"] Sep 11 18:53:44.417191 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:44.417157 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbtdg\" (UniqueName: \"kubernetes.io/projected/ec5c8401-aef8-4447-812d-2cfbe4c50698-kube-api-access-hbtdg\") pod \"opendatahub-operator-controller-manager-8f9f87498-647gp\" (UID: \"ec5c8401-aef8-4447-812d-2cfbe4c50698\") " pod="opendatahub/opendatahub-operator-controller-manager-8f9f87498-647gp" Sep 11 18:53:44.417347 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:44.417197 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec5c8401-aef8-4447-812d-2cfbe4c50698-tmp\") pod \"opendatahub-operator-controller-manager-8f9f87498-647gp\" (UID: \"ec5c8401-aef8-4447-812d-2cfbe4c50698\") " pod="opendatahub/opendatahub-operator-controller-manager-8f9f87498-647gp" Sep 11 18:53:44.417347 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:44.417253 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec5c8401-aef8-4447-812d-2cfbe4c50698-webhook-cert\") pod \"opendatahub-operator-controller-manager-8f9f87498-647gp\" (UID: \"ec5c8401-aef8-4447-812d-2cfbe4c50698\") " pod="opendatahub/opendatahub-operator-controller-manager-8f9f87498-647gp" Sep 11 18:53:44.417347 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:44.417287 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ec5c8401-aef8-4447-812d-2cfbe4c50698-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8f9f87498-647gp\" (UID: \"ec5c8401-aef8-4447-812d-2cfbe4c50698\") " pod="opendatahub/opendatahub-operator-controller-manager-8f9f87498-647gp" Sep 11 18:53:44.417347 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:44.417304 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ec5c8401-aef8-4447-812d-2cfbe4c50698-manifests\") pod \"opendatahub-operator-controller-manager-8f9f87498-647gp\" (UID: \"ec5c8401-aef8-4447-812d-2cfbe4c50698\") " pod="opendatahub/opendatahub-operator-controller-manager-8f9f87498-647gp" Sep 11 18:53:44.517826 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:44.517794 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ec5c8401-aef8-4447-812d-2cfbe4c50698-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8f9f87498-647gp\" (UID: \"ec5c8401-aef8-4447-812d-2cfbe4c50698\") " pod="opendatahub/opendatahub-operator-controller-manager-8f9f87498-647gp" Sep 11 18:53:44.517826 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:44.517831 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ec5c8401-aef8-4447-812d-2cfbe4c50698-manifests\") pod \"opendatahub-operator-controller-manager-8f9f87498-647gp\" (UID: \"ec5c8401-aef8-4447-812d-2cfbe4c50698\") " pod="opendatahub/opendatahub-operator-controller-manager-8f9f87498-647gp" Sep 11 18:53:44.518033 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:44.517863 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbtdg\" (UniqueName: \"kubernetes.io/projected/ec5c8401-aef8-4447-812d-2cfbe4c50698-kube-api-access-hbtdg\") pod \"opendatahub-operator-controller-manager-8f9f87498-647gp\" (UID: \"ec5c8401-aef8-4447-812d-2cfbe4c50698\") " pod="opendatahub/opendatahub-operator-controller-manager-8f9f87498-647gp" Sep 11 18:53:44.518033 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:44.517898 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec5c8401-aef8-4447-812d-2cfbe4c50698-tmp\") pod \"opendatahub-operator-controller-manager-8f9f87498-647gp\" (UID: \"ec5c8401-aef8-4447-812d-2cfbe4c50698\") " pod="opendatahub/opendatahub-operator-controller-manager-8f9f87498-647gp" Sep 11 18:53:44.518033 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:44.517951 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec5c8401-aef8-4447-812d-2cfbe4c50698-webhook-cert\") pod \"opendatahub-operator-controller-manager-8f9f87498-647gp\" (UID: \"ec5c8401-aef8-4447-812d-2cfbe4c50698\") " pod="opendatahub/opendatahub-operator-controller-manager-8f9f87498-647gp" Sep 11 18:53:44.518239 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:44.518221 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ec5c8401-aef8-4447-812d-2cfbe4c50698-manifests\") pod \"opendatahub-operator-controller-manager-8f9f87498-647gp\" (UID: \"ec5c8401-aef8-4447-812d-2cfbe4c50698\") " pod="opendatahub/opendatahub-operator-controller-manager-8f9f87498-647gp" Sep 11 18:53:44.519957 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:44.519935 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec5c8401-aef8-4447-812d-2cfbe4c50698-tmp\") pod \"opendatahub-operator-controller-manager-8f9f87498-647gp\" (UID: \"ec5c8401-aef8-4447-812d-2cfbe4c50698\") " pod="opendatahub/opendatahub-operator-controller-manager-8f9f87498-647gp" Sep 11 18:53:44.520191 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:44.520174 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec5c8401-aef8-4447-812d-2cfbe4c50698-webhook-cert\") pod \"opendatahub-operator-controller-manager-8f9f87498-647gp\" (UID: \"ec5c8401-aef8-4447-812d-2cfbe4c50698\") " pod="opendatahub/opendatahub-operator-controller-manager-8f9f87498-647gp" Sep 11 18:53:44.520252 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:44.520200 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ec5c8401-aef8-4447-812d-2cfbe4c50698-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8f9f87498-647gp\" (UID: \"ec5c8401-aef8-4447-812d-2cfbe4c50698\") " pod="opendatahub/opendatahub-operator-controller-manager-8f9f87498-647gp" Sep 11 18:53:44.536801 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:44.536777 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbtdg\" (UniqueName: \"kubernetes.io/projected/ec5c8401-aef8-4447-812d-2cfbe4c50698-kube-api-access-hbtdg\") pod \"opendatahub-operator-controller-manager-8f9f87498-647gp\" (UID: \"ec5c8401-aef8-4447-812d-2cfbe4c50698\") " pod="opendatahub/opendatahub-operator-controller-manager-8f9f87498-647gp" Sep 11 18:53:44.631010 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:44.630911 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8f9f87498-647gp" Sep 11 18:53:44.962539 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:44.962510 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8f9f87498-647gp"] Sep 11 18:53:44.964190 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:53:44.964158 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec5c8401_aef8_4447_812d_2cfbe4c50698.slice/crio-d335f84efccf69a3470e34217b0ca6996c4728909d1fdfa2667e5edd24c373e6 WatchSource:0}: Error finding container d335f84efccf69a3470e34217b0ca6996c4728909d1fdfa2667e5edd24c373e6: Status 404 returned error can't find the container with id d335f84efccf69a3470e34217b0ca6996c4728909d1fdfa2667e5edd24c373e6 Sep 11 18:53:44.965952 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:44.965938 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 11 18:53:45.533492 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:45.533457 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8f9f87498-647gp" event={"ID":"ec5c8401-aef8-4447-812d-2cfbe4c50698","Type":"ContainerStarted","Data":"d335f84efccf69a3470e34217b0ca6996c4728909d1fdfa2667e5edd24c373e6"} Sep 11 18:53:48.546145 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:48.546106 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8f9f87498-647gp" event={"ID":"ec5c8401-aef8-4447-812d-2cfbe4c50698","Type":"ContainerStarted","Data":"68447b88f03e975d06d99dda7cc7a3412cfad52744bbb5648bc533a2f1d8aa0c"} Sep 11 18:53:49.551348 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:49.551310 2583 generic.go:356] "Generic (PLEG): container finished" podID="ec5c8401-aef8-4447-812d-2cfbe4c50698" containerID="68447b88f03e975d06d99dda7cc7a3412cfad52744bbb5648bc533a2f1d8aa0c" exitCode=0 Sep 11 18:53:49.551834 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:49.551360 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8f9f87498-647gp" event={"ID":"ec5c8401-aef8-4447-812d-2cfbe4c50698","Type":"ContainerDied","Data":"68447b88f03e975d06d99dda7cc7a3412cfad52744bbb5648bc533a2f1d8aa0c"} Sep 11 18:53:50.556466 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:50.556427 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8f9f87498-647gp" event={"ID":"ec5c8401-aef8-4447-812d-2cfbe4c50698","Type":"ContainerStarted","Data":"da6376b65e1670a0c5f5e5ec48f125c12bf8e9784657ba86e0a44cbc13e041a9"} Sep 11 18:53:50.556938 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:50.556616 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8f9f87498-647gp" Sep 11 18:53:50.586789 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:53:50.586741 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8f9f87498-647gp" podStartSLOduration=2.367584645 podStartE2EDuration="6.586724507s" totalImagesPullingTime="3.153192594s" totalInitContainerRuntime="1.065947268s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:53:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:53:50.585204952 +0000 UTC m=+334.765137853" watchObservedRunningTime="2026-09-11 18:53:50.586724507 +0000 UTC m=+334.766657207" Sep 11 18:54:01.562596 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:01.562548 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8f9f87498-647gp" Sep 11 18:54:09.600260 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:09.600170 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7f8f98866c-wlcnc"] Sep 11 18:54:09.603345 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:09.603322 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f8f98866c-wlcnc" Sep 11 18:54:09.606112 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:09.606091 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 11 18:54:09.606210 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:09.606151 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 11 18:54:09.621164 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:09.621141 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f8f98866c-wlcnc"] Sep 11 18:54:09.713608 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:09.713545 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d87a6c40-2265-4075-879a-ebfd2d65dc68-tmp\") pod \"kube-auth-proxy-7f8f98866c-wlcnc\" (UID: \"d87a6c40-2265-4075-879a-ebfd2d65dc68\") " pod="openshift-ingress/kube-auth-proxy-7f8f98866c-wlcnc" Sep 11 18:54:09.713608 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:09.713611 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws5dg\" (UniqueName: \"kubernetes.io/projected/d87a6c40-2265-4075-879a-ebfd2d65dc68-kube-api-access-ws5dg\") pod \"kube-auth-proxy-7f8f98866c-wlcnc\" (UID: \"d87a6c40-2265-4075-879a-ebfd2d65dc68\") " pod="openshift-ingress/kube-auth-proxy-7f8f98866c-wlcnc" Sep 11 18:54:09.713817 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:09.713693 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d87a6c40-2265-4075-879a-ebfd2d65dc68-tls-certs\") pod \"kube-auth-proxy-7f8f98866c-wlcnc\" (UID: \"d87a6c40-2265-4075-879a-ebfd2d65dc68\") " pod="openshift-ingress/kube-auth-proxy-7f8f98866c-wlcnc" Sep 11 18:54:09.814215 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:09.814181 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d87a6c40-2265-4075-879a-ebfd2d65dc68-tls-certs\") pod \"kube-auth-proxy-7f8f98866c-wlcnc\" (UID: \"d87a6c40-2265-4075-879a-ebfd2d65dc68\") " pod="openshift-ingress/kube-auth-proxy-7f8f98866c-wlcnc" Sep 11 18:54:09.814403 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:09.814253 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d87a6c40-2265-4075-879a-ebfd2d65dc68-tmp\") pod \"kube-auth-proxy-7f8f98866c-wlcnc\" (UID: \"d87a6c40-2265-4075-879a-ebfd2d65dc68\") " pod="openshift-ingress/kube-auth-proxy-7f8f98866c-wlcnc" Sep 11 18:54:09.814403 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:09.814281 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws5dg\" (UniqueName: \"kubernetes.io/projected/d87a6c40-2265-4075-879a-ebfd2d65dc68-kube-api-access-ws5dg\") pod \"kube-auth-proxy-7f8f98866c-wlcnc\" (UID: \"d87a6c40-2265-4075-879a-ebfd2d65dc68\") " pod="openshift-ingress/kube-auth-proxy-7f8f98866c-wlcnc" Sep 11 18:54:09.816435 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:09.816407 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d87a6c40-2265-4075-879a-ebfd2d65dc68-tmp\") pod \"kube-auth-proxy-7f8f98866c-wlcnc\" (UID: \"d87a6c40-2265-4075-879a-ebfd2d65dc68\") " pod="openshift-ingress/kube-auth-proxy-7f8f98866c-wlcnc" Sep 11 18:54:09.816637 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:09.816613 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d87a6c40-2265-4075-879a-ebfd2d65dc68-tls-certs\") pod \"kube-auth-proxy-7f8f98866c-wlcnc\" (UID: \"d87a6c40-2265-4075-879a-ebfd2d65dc68\") " pod="openshift-ingress/kube-auth-proxy-7f8f98866c-wlcnc" Sep 11 18:54:09.822980 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:09.822960 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws5dg\" (UniqueName: \"kubernetes.io/projected/d87a6c40-2265-4075-879a-ebfd2d65dc68-kube-api-access-ws5dg\") pod \"kube-auth-proxy-7f8f98866c-wlcnc\" (UID: \"d87a6c40-2265-4075-879a-ebfd2d65dc68\") " pod="openshift-ingress/kube-auth-proxy-7f8f98866c-wlcnc" Sep 11 18:54:09.912469 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:09.912376 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f8f98866c-wlcnc" Sep 11 18:54:10.204227 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:10.204145 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f8f98866c-wlcnc"] Sep 11 18:54:10.208025 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:54:10.208000 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd87a6c40_2265_4075_879a_ebfd2d65dc68.slice/crio-cb722e8a0cf1a8e120cd237aa3462d15af59e09dd19f82fad545519d6dd9e4a9 WatchSource:0}: Error finding container cb722e8a0cf1a8e120cd237aa3462d15af59e09dd19f82fad545519d6dd9e4a9: Status 404 returned error can't find the container with id cb722e8a0cf1a8e120cd237aa3462d15af59e09dd19f82fad545519d6dd9e4a9 Sep 11 18:54:10.628373 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:10.628330 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f8f98866c-wlcnc" event={"ID":"d87a6c40-2265-4075-879a-ebfd2d65dc68","Type":"ContainerStarted","Data":"cb722e8a0cf1a8e120cd237aa3462d15af59e09dd19f82fad545519d6dd9e4a9"} Sep 11 18:54:11.125910 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:11.125767 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r"] Sep 11 18:54:11.128976 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:11.128940 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" Sep 11 18:54:11.132823 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:11.132632 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 11 18:54:11.133180 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:11.133159 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 11 18:54:11.133406 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:11.133322 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 11 18:54:11.133406 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:11.133373 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 11 18:54:11.133656 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:11.133637 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-4nfrj\"" Sep 11 18:54:11.151775 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:11.151752 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r"] Sep 11 18:54:11.326211 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:11.326176 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/87485aa6-8b14-45b5-be53-b375560e71d5-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-tnn2r\" (UID: \"87485aa6-8b14-45b5-be53-b375560e71d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" Sep 11 18:54:11.326385 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:11.326226 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/87485aa6-8b14-45b5-be53-b375560e71d5-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-tnn2r\" (UID: \"87485aa6-8b14-45b5-be53-b375560e71d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" Sep 11 18:54:11.326385 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:11.326262 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhgcx\" (UniqueName: \"kubernetes.io/projected/87485aa6-8b14-45b5-be53-b375560e71d5-kube-api-access-qhgcx\") pod \"istiod-openshift-gateway-7b7995d5cd-tnn2r\" (UID: \"87485aa6-8b14-45b5-be53-b375560e71d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" Sep 11 18:54:11.326385 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:11.326304 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/87485aa6-8b14-45b5-be53-b375560e71d5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-tnn2r\" (UID: \"87485aa6-8b14-45b5-be53-b375560e71d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" Sep 11 18:54:11.326385 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:11.326369 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/87485aa6-8b14-45b5-be53-b375560e71d5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-tnn2r\" (UID: \"87485aa6-8b14-45b5-be53-b375560e71d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" Sep 11 18:54:11.326611 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:11.326409 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/87485aa6-8b14-45b5-be53-b375560e71d5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-tnn2r\" (UID: \"87485aa6-8b14-45b5-be53-b375560e71d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" Sep 11 18:54:11.326611 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:11.326434 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87485aa6-8b14-45b5-be53-b375560e71d5-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-tnn2r\" (UID: \"87485aa6-8b14-45b5-be53-b375560e71d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" Sep 11 18:54:11.427725 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:11.427636 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/87485aa6-8b14-45b5-be53-b375560e71d5-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-tnn2r\" (UID: \"87485aa6-8b14-45b5-be53-b375560e71d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" Sep 11 18:54:11.427725 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:11.427692 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhgcx\" (UniqueName: \"kubernetes.io/projected/87485aa6-8b14-45b5-be53-b375560e71d5-kube-api-access-qhgcx\") pod \"istiod-openshift-gateway-7b7995d5cd-tnn2r\" (UID: \"87485aa6-8b14-45b5-be53-b375560e71d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" Sep 11 18:54:11.427942 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:11.427737 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/87485aa6-8b14-45b5-be53-b375560e71d5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-tnn2r\" (UID: \"87485aa6-8b14-45b5-be53-b375560e71d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" Sep 11 18:54:11.427942 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:11.427794 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/87485aa6-8b14-45b5-be53-b375560e71d5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-tnn2r\" (UID: \"87485aa6-8b14-45b5-be53-b375560e71d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" Sep 11 18:54:11.427942 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:11.427843 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/87485aa6-8b14-45b5-be53-b375560e71d5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-tnn2r\" (UID: \"87485aa6-8b14-45b5-be53-b375560e71d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" Sep 11 18:54:11.427942 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:11.427870 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87485aa6-8b14-45b5-be53-b375560e71d5-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-tnn2r\" (UID: \"87485aa6-8b14-45b5-be53-b375560e71d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" Sep 11 18:54:11.427942 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:11.427906 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/87485aa6-8b14-45b5-be53-b375560e71d5-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-tnn2r\" (UID: \"87485aa6-8b14-45b5-be53-b375560e71d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" Sep 11 18:54:11.428915 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:11.428881 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/87485aa6-8b14-45b5-be53-b375560e71d5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-tnn2r\" (UID: \"87485aa6-8b14-45b5-be53-b375560e71d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" Sep 11 18:54:11.431036 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:11.430938 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/87485aa6-8b14-45b5-be53-b375560e71d5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-tnn2r\" (UID: \"87485aa6-8b14-45b5-be53-b375560e71d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" Sep 11 18:54:11.431036 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:11.430991 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/87485aa6-8b14-45b5-be53-b375560e71d5-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-tnn2r\" (UID: \"87485aa6-8b14-45b5-be53-b375560e71d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" Sep 11 18:54:11.431198 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:11.431053 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/87485aa6-8b14-45b5-be53-b375560e71d5-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-tnn2r\" (UID: \"87485aa6-8b14-45b5-be53-b375560e71d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" Sep 11 18:54:11.431980 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:11.431955 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/87485aa6-8b14-45b5-be53-b375560e71d5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-tnn2r\" (UID: \"87485aa6-8b14-45b5-be53-b375560e71d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" Sep 11 18:54:11.437594 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:11.437536 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87485aa6-8b14-45b5-be53-b375560e71d5-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-tnn2r\" (UID: \"87485aa6-8b14-45b5-be53-b375560e71d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" Sep 11 18:54:11.437857 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:11.437835 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhgcx\" (UniqueName: \"kubernetes.io/projected/87485aa6-8b14-45b5-be53-b375560e71d5-kube-api-access-qhgcx\") pod \"istiod-openshift-gateway-7b7995d5cd-tnn2r\" (UID: \"87485aa6-8b14-45b5-be53-b375560e71d5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" Sep 11 18:54:11.441509 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:11.441488 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" Sep 11 18:54:12.888643 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:12.888550 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r"] Sep 11 18:54:12.891466 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:54:12.891435 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87485aa6_8b14_45b5_be53_b375560e71d5.slice/crio-d1da5efdcc46e69fef7063a28bce4e6f6d410c191021506a42be9c42809b4e75 WatchSource:0}: Error finding container d1da5efdcc46e69fef7063a28bce4e6f6d410c191021506a42be9c42809b4e75: Status 404 returned error can't find the container with id d1da5efdcc46e69fef7063a28bce4e6f6d410c191021506a42be9c42809b4e75 Sep 11 18:54:13.642851 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:13.642769 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f8f98866c-wlcnc" event={"ID":"d87a6c40-2265-4075-879a-ebfd2d65dc68","Type":"ContainerStarted","Data":"3fe5c4afdeb4c385f90d945aa9c2b2189640919f236306a264c10042a09a64da"} Sep 11 18:54:13.644240 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:13.644215 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" event={"ID":"87485aa6-8b14-45b5-be53-b375560e71d5","Type":"ContainerStarted","Data":"d1da5efdcc46e69fef7063a28bce4e6f6d410c191021506a42be9c42809b4e75"} Sep 11 18:54:13.660913 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:13.660860 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7f8f98866c-wlcnc" podStartSLOduration=2.195335051 podStartE2EDuration="4.660842338s" totalImagesPullingTime="2.465507287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:54:13.660198254 +0000 UTC m=+357.840130976" watchObservedRunningTime="2026-09-11 18:54:13.660842338 +0000 UTC m=+357.840775047" Sep 11 18:54:15.077389 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:15.077345 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 11 18:54:15.077690 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:15.077429 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 11 18:54:15.656685 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:15.656639 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" event={"ID":"87485aa6-8b14-45b5-be53-b375560e71d5","Type":"ContainerStarted","Data":"bc9cdce84c2fd4ef7ff1e70e5ec82fc04c56ae5c31357630d51a133e020d89f4"} Sep 11 18:54:15.656866 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:15.656734 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" Sep 11 18:54:15.704767 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:15.704703 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" podStartSLOduration=2.521167072 podStartE2EDuration="4.704680427s" totalImagesPullingTime="2.183513355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:54:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:54:15.701897833 +0000 UTC m=+359.881830553" watchObservedRunningTime="2026-09-11 18:54:15.704680427 +0000 UTC m=+359.884613135" Sep 11 18:54:16.662806 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:16.662776 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" Sep 11 18:54:24.973159 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:24.973122 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-fgc5x"] Sep 11 18:54:24.978386 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:24.978368 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fgc5x" Sep 11 18:54:24.981771 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:24.981740 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Sep 11 18:54:24.981880 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:24.981859 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-469ld\"" Sep 11 18:54:24.996035 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:24.996016 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jnps2"] Sep 11 18:54:24.999509 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:24.999490 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jnps2" Sep 11 18:54:25.001693 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:25.001674 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-fgc5x"] Sep 11 18:54:25.002837 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:25.002818 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Sep 11 18:54:25.002933 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:25.002819 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-68cnc\"" Sep 11 18:54:25.019370 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:25.019344 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jnps2"] Sep 11 18:54:25.029614 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:25.029567 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt6rg\" (UniqueName: \"kubernetes.io/projected/f0bbebeb-9370-45d2-9cb6-09d307fa91b3-kube-api-access-tt6rg\") pod \"kserve-controller-manager-d6f4b65b8-fgc5x\" (UID: \"f0bbebeb-9370-45d2-9cb6-09d307fa91b3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fgc5x" Sep 11 18:54:25.029720 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:25.029677 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfs8q\" (UniqueName: \"kubernetes.io/projected/557fc74c-4b00-4fc8-bb7c-62ff3d662820-kube-api-access-nfs8q\") pod \"llmisvc-controller-manager-777c6bd7d5-jnps2\" (UID: \"557fc74c-4b00-4fc8-bb7c-62ff3d662820\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jnps2" Sep 11 18:54:25.029780 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:25.029733 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0bbebeb-9370-45d2-9cb6-09d307fa91b3-cert\") pod \"kserve-controller-manager-d6f4b65b8-fgc5x\" (UID: \"f0bbebeb-9370-45d2-9cb6-09d307fa91b3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fgc5x" Sep 11 18:54:25.029827 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:25.029791 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/557fc74c-4b00-4fc8-bb7c-62ff3d662820-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jnps2\" (UID: \"557fc74c-4b00-4fc8-bb7c-62ff3d662820\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jnps2" Sep 11 18:54:25.130404 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:25.130368 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfs8q\" (UniqueName: \"kubernetes.io/projected/557fc74c-4b00-4fc8-bb7c-62ff3d662820-kube-api-access-nfs8q\") pod \"llmisvc-controller-manager-777c6bd7d5-jnps2\" (UID: \"557fc74c-4b00-4fc8-bb7c-62ff3d662820\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jnps2" Sep 11 18:54:25.130569 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:25.130420 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0bbebeb-9370-45d2-9cb6-09d307fa91b3-cert\") pod \"kserve-controller-manager-d6f4b65b8-fgc5x\" (UID: \"f0bbebeb-9370-45d2-9cb6-09d307fa91b3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fgc5x" Sep 11 18:54:25.130569 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:25.130461 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/557fc74c-4b00-4fc8-bb7c-62ff3d662820-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jnps2\" (UID: \"557fc74c-4b00-4fc8-bb7c-62ff3d662820\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jnps2" Sep 11 18:54:25.130569 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:25.130533 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt6rg\" (UniqueName: \"kubernetes.io/projected/f0bbebeb-9370-45d2-9cb6-09d307fa91b3-kube-api-access-tt6rg\") pod \"kserve-controller-manager-d6f4b65b8-fgc5x\" (UID: \"f0bbebeb-9370-45d2-9cb6-09d307fa91b3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fgc5x" Sep 11 18:54:25.130761 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:54:25.130576 2583 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Sep 11 18:54:25.130761 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:54:25.130662 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0bbebeb-9370-45d2-9cb6-09d307fa91b3-cert podName:f0bbebeb-9370-45d2-9cb6-09d307fa91b3 nodeName:}" failed. No retries permitted until 2026-09-11 18:54:25.630646485 +0000 UTC m=+369.810579171 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f0bbebeb-9370-45d2-9cb6-09d307fa91b3-cert") pod "kserve-controller-manager-d6f4b65b8-fgc5x" (UID: "f0bbebeb-9370-45d2-9cb6-09d307fa91b3") : secret "kserve-webhook-server-cert" not found Sep 11 18:54:25.130761 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:54:25.130686 2583 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Sep 11 18:54:25.130761 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:54:25.130746 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/557fc74c-4b00-4fc8-bb7c-62ff3d662820-cert podName:557fc74c-4b00-4fc8-bb7c-62ff3d662820 nodeName:}" failed. No retries permitted until 2026-09-11 18:54:25.630728689 +0000 UTC m=+369.810661378 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/557fc74c-4b00-4fc8-bb7c-62ff3d662820-cert") pod "llmisvc-controller-manager-777c6bd7d5-jnps2" (UID: "557fc74c-4b00-4fc8-bb7c-62ff3d662820") : secret "llmisvc-webhook-server-cert" not found Sep 11 18:54:25.146041 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:25.146014 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt6rg\" (UniqueName: \"kubernetes.io/projected/f0bbebeb-9370-45d2-9cb6-09d307fa91b3-kube-api-access-tt6rg\") pod \"kserve-controller-manager-d6f4b65b8-fgc5x\" (UID: \"f0bbebeb-9370-45d2-9cb6-09d307fa91b3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fgc5x" Sep 11 18:54:25.146176 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:25.146157 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfs8q\" (UniqueName: \"kubernetes.io/projected/557fc74c-4b00-4fc8-bb7c-62ff3d662820-kube-api-access-nfs8q\") pod \"llmisvc-controller-manager-777c6bd7d5-jnps2\" (UID: \"557fc74c-4b00-4fc8-bb7c-62ff3d662820\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jnps2" Sep 11 18:54:25.635828 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:25.635788 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0bbebeb-9370-45d2-9cb6-09d307fa91b3-cert\") pod \"kserve-controller-manager-d6f4b65b8-fgc5x\" (UID: \"f0bbebeb-9370-45d2-9cb6-09d307fa91b3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fgc5x" Sep 11 18:54:25.636017 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:25.635840 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/557fc74c-4b00-4fc8-bb7c-62ff3d662820-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jnps2\" (UID: \"557fc74c-4b00-4fc8-bb7c-62ff3d662820\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jnps2" Sep 11 18:54:25.638155 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:25.638128 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0bbebeb-9370-45d2-9cb6-09d307fa91b3-cert\") pod \"kserve-controller-manager-d6f4b65b8-fgc5x\" (UID: \"f0bbebeb-9370-45d2-9cb6-09d307fa91b3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fgc5x" Sep 11 18:54:25.638282 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:25.638264 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/557fc74c-4b00-4fc8-bb7c-62ff3d662820-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jnps2\" (UID: \"557fc74c-4b00-4fc8-bb7c-62ff3d662820\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jnps2" Sep 11 18:54:25.875591 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:25.875539 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r"] Sep 11 18:54:25.875788 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:25.875750 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" podUID="87485aa6-8b14-45b5-be53-b375560e71d5" containerName="discovery" containerID="cri-o://bc9cdce84c2fd4ef7ff1e70e5ec82fc04c56ae5c31357630d51a133e020d89f4" gracePeriod=30 Sep 11 18:54:25.888483 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:25.888418 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fgc5x" Sep 11 18:54:25.908452 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:25.908428 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jnps2" Sep 11 18:54:26.099080 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.099052 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" Sep 11 18:54:26.140812 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.140738 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/87485aa6-8b14-45b5-be53-b375560e71d5-istio-csr-dns-cert\") pod \"87485aa6-8b14-45b5-be53-b375560e71d5\" (UID: \"87485aa6-8b14-45b5-be53-b375560e71d5\") " Sep 11 18:54:26.140812 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.140792 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhgcx\" (UniqueName: \"kubernetes.io/projected/87485aa6-8b14-45b5-be53-b375560e71d5-kube-api-access-qhgcx\") pod \"87485aa6-8b14-45b5-be53-b375560e71d5\" (UID: \"87485aa6-8b14-45b5-be53-b375560e71d5\") " Sep 11 18:54:26.141028 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.140826 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/87485aa6-8b14-45b5-be53-b375560e71d5-istio-kubeconfig\") pod \"87485aa6-8b14-45b5-be53-b375560e71d5\" (UID: \"87485aa6-8b14-45b5-be53-b375560e71d5\") " Sep 11 18:54:26.141028 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.140868 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/87485aa6-8b14-45b5-be53-b375560e71d5-local-certs\") pod \"87485aa6-8b14-45b5-be53-b375560e71d5\" (UID: \"87485aa6-8b14-45b5-be53-b375560e71d5\") " Sep 11 18:54:26.141028 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.140916 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/87485aa6-8b14-45b5-be53-b375560e71d5-istio-csr-ca-configmap\") pod \"87485aa6-8b14-45b5-be53-b375560e71d5\" (UID: \"87485aa6-8b14-45b5-be53-b375560e71d5\") " Sep 11 18:54:26.141028 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.140990 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/87485aa6-8b14-45b5-be53-b375560e71d5-cacerts\") pod \"87485aa6-8b14-45b5-be53-b375560e71d5\" (UID: \"87485aa6-8b14-45b5-be53-b375560e71d5\") " Sep 11 18:54:26.141028 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.141016 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87485aa6-8b14-45b5-be53-b375560e71d5-istio-token\") pod \"87485aa6-8b14-45b5-be53-b375560e71d5\" (UID: \"87485aa6-8b14-45b5-be53-b375560e71d5\") " Sep 11 18:54:26.141513 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.141474 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87485aa6-8b14-45b5-be53-b375560e71d5-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "87485aa6-8b14-45b5-be53-b375560e71d5" (UID: "87485aa6-8b14-45b5-be53-b375560e71d5"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 18:54:26.143655 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.143595 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87485aa6-8b14-45b5-be53-b375560e71d5-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "87485aa6-8b14-45b5-be53-b375560e71d5" (UID: "87485aa6-8b14-45b5-be53-b375560e71d5"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 18:54:26.143764 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.143681 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87485aa6-8b14-45b5-be53-b375560e71d5-kube-api-access-qhgcx" (OuterVolumeSpecName: "kube-api-access-qhgcx") pod "87485aa6-8b14-45b5-be53-b375560e71d5" (UID: "87485aa6-8b14-45b5-be53-b375560e71d5"). InnerVolumeSpecName "kube-api-access-qhgcx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 18:54:26.143826 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.143759 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87485aa6-8b14-45b5-be53-b375560e71d5-local-certs" (OuterVolumeSpecName: "local-certs") pod "87485aa6-8b14-45b5-be53-b375560e71d5" (UID: "87485aa6-8b14-45b5-be53-b375560e71d5"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 18:54:26.143876 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.143820 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87485aa6-8b14-45b5-be53-b375560e71d5-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "87485aa6-8b14-45b5-be53-b375560e71d5" (UID: "87485aa6-8b14-45b5-be53-b375560e71d5"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 18:54:26.143929 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.143909 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87485aa6-8b14-45b5-be53-b375560e71d5-istio-token" (OuterVolumeSpecName: "istio-token") pod "87485aa6-8b14-45b5-be53-b375560e71d5" (UID: "87485aa6-8b14-45b5-be53-b375560e71d5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 18:54:26.143977 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.143956 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87485aa6-8b14-45b5-be53-b375560e71d5-cacerts" (OuterVolumeSpecName: "cacerts") pod "87485aa6-8b14-45b5-be53-b375560e71d5" (UID: "87485aa6-8b14-45b5-be53-b375560e71d5"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 18:54:26.164704 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.164674 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-fgc5x"] Sep 11 18:54:26.167607 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:54:26.167566 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0bbebeb_9370_45d2_9cb6_09d307fa91b3.slice/crio-c0865752f0710755bb9bc43ea65a39bdd4c09aaa27f932b5641adf91a701e935 WatchSource:0}: Error finding container c0865752f0710755bb9bc43ea65a39bdd4c09aaa27f932b5641adf91a701e935: Status 404 returned error can't find the container with id c0865752f0710755bb9bc43ea65a39bdd4c09aaa27f932b5641adf91a701e935 Sep 11 18:54:26.185174 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.185153 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jnps2"] Sep 11 18:54:26.187151 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:54:26.187128 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod557fc74c_4b00_4fc8_bb7c_62ff3d662820.slice/crio-8eaccfa6f76da8027cf2a7979c996a904cbfc53f2b22fd79913883b4e9b683e7 WatchSource:0}: Error finding container 8eaccfa6f76da8027cf2a7979c996a904cbfc53f2b22fd79913883b4e9b683e7: Status 404 returned error can't find the container with id 8eaccfa6f76da8027cf2a7979c996a904cbfc53f2b22fd79913883b4e9b683e7 Sep 11 18:54:26.242511 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.242480 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhgcx\" (UniqueName: \"kubernetes.io/projected/87485aa6-8b14-45b5-be53-b375560e71d5-kube-api-access-qhgcx\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:54:26.242511 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.242507 2583 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/87485aa6-8b14-45b5-be53-b375560e71d5-istio-kubeconfig\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:54:26.242511 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.242517 2583 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/87485aa6-8b14-45b5-be53-b375560e71d5-local-certs\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:54:26.242746 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.242525 2583 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/87485aa6-8b14-45b5-be53-b375560e71d5-istio-csr-ca-configmap\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:54:26.242746 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.242534 2583 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/87485aa6-8b14-45b5-be53-b375560e71d5-cacerts\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:54:26.242746 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.242541 2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87485aa6-8b14-45b5-be53-b375560e71d5-istio-token\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:54:26.242746 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.242550 2583 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/87485aa6-8b14-45b5-be53-b375560e71d5-istio-csr-dns-cert\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:54:26.699627 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.699574 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jnps2" event={"ID":"557fc74c-4b00-4fc8-bb7c-62ff3d662820","Type":"ContainerStarted","Data":"8eaccfa6f76da8027cf2a7979c996a904cbfc53f2b22fd79913883b4e9b683e7"} Sep 11 18:54:26.700776 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.700727 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fgc5x" event={"ID":"f0bbebeb-9370-45d2-9cb6-09d307fa91b3","Type":"ContainerStarted","Data":"c0865752f0710755bb9bc43ea65a39bdd4c09aaa27f932b5641adf91a701e935"} Sep 11 18:54:26.702207 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.702179 2583 generic.go:356] "Generic (PLEG): container finished" podID="87485aa6-8b14-45b5-be53-b375560e71d5" containerID="bc9cdce84c2fd4ef7ff1e70e5ec82fc04c56ae5c31357630d51a133e020d89f4" exitCode=0 Sep 11 18:54:26.702303 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.702253 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" event={"ID":"87485aa6-8b14-45b5-be53-b375560e71d5","Type":"ContainerDied","Data":"bc9cdce84c2fd4ef7ff1e70e5ec82fc04c56ae5c31357630d51a133e020d89f4"} Sep 11 18:54:26.702303 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.702290 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" event={"ID":"87485aa6-8b14-45b5-be53-b375560e71d5","Type":"ContainerDied","Data":"d1da5efdcc46e69fef7063a28bce4e6f6d410c191021506a42be9c42809b4e75"} Sep 11 18:54:26.702406 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.702314 2583 scope.go:117] "RemoveContainer" containerID="bc9cdce84c2fd4ef7ff1e70e5ec82fc04c56ae5c31357630d51a133e020d89f4" Sep 11 18:54:26.702476 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.702463 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r" Sep 11 18:54:26.726308 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.726269 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r"] Sep 11 18:54:26.728002 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.727977 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-tnn2r"] Sep 11 18:54:26.740559 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.740538 2583 scope.go:117] "RemoveContainer" containerID="bc9cdce84c2fd4ef7ff1e70e5ec82fc04c56ae5c31357630d51a133e020d89f4" Sep 11 18:54:26.740915 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:54:26.740892 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc9cdce84c2fd4ef7ff1e70e5ec82fc04c56ae5c31357630d51a133e020d89f4\": container with ID starting with bc9cdce84c2fd4ef7ff1e70e5ec82fc04c56ae5c31357630d51a133e020d89f4 not found: ID does not exist" containerID="bc9cdce84c2fd4ef7ff1e70e5ec82fc04c56ae5c31357630d51a133e020d89f4" Sep 11 18:54:26.740983 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:26.740923 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc9cdce84c2fd4ef7ff1e70e5ec82fc04c56ae5c31357630d51a133e020d89f4"} err="failed to get container status \"bc9cdce84c2fd4ef7ff1e70e5ec82fc04c56ae5c31357630d51a133e020d89f4\": rpc error: code = NotFound desc = could not find container \"bc9cdce84c2fd4ef7ff1e70e5ec82fc04c56ae5c31357630d51a133e020d89f4\": container with ID starting with bc9cdce84c2fd4ef7ff1e70e5ec82fc04c56ae5c31357630d51a133e020d89f4 not found: ID does not exist" Sep 11 18:54:28.358284 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:28.358245 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87485aa6-8b14-45b5-be53-b375560e71d5" path="/var/lib/kubelet/pods/87485aa6-8b14-45b5-be53-b375560e71d5/volumes" Sep 11 18:54:29.717256 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:29.717218 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fgc5x" event={"ID":"f0bbebeb-9370-45d2-9cb6-09d307fa91b3","Type":"ContainerStarted","Data":"aaa9c3bc1540b5384ff9e7d4f2523d62c4c9c6f2ecce967f5de29754bdfd21b9"} Sep 11 18:54:29.717766 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:29.717301 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fgc5x" Sep 11 18:54:29.718734 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:29.718711 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jnps2" event={"ID":"557fc74c-4b00-4fc8-bb7c-62ff3d662820","Type":"ContainerStarted","Data":"36cede5cccefa6dc65f2768ec63c973443a399cb0b803842b0c7928215f801e8"} Sep 11 18:54:29.718850 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:29.718840 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jnps2" Sep 11 18:54:29.751145 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:29.751098 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fgc5x" podStartSLOduration=3.062772795 podStartE2EDuration="5.751082794s" totalImagesPullingTime="2.688309999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:54:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:54:29.748855677 +0000 UTC m=+373.928788384" watchObservedRunningTime="2026-09-11 18:54:29.751082794 +0000 UTC m=+373.931015506" Sep 11 18:54:29.790125 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:54:29.790060 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jnps2" podStartSLOduration=3.117508584 podStartE2EDuration="5.790040001s" totalImagesPullingTime="2.672531417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:54:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:54:29.789774431 +0000 UTC m=+373.969707151" watchObservedRunningTime="2026-09-11 18:54:29.790040001 +0000 UTC m=+373.969972712" Sep 11 18:55:00.724690 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:00.724639 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jnps2" Sep 11 18:55:00.728083 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:00.728056 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fgc5x" Sep 11 18:55:33.807105 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:33.807069 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-pp6js"] Sep 11 18:55:33.807553 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:33.807334 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87485aa6-8b14-45b5-be53-b375560e71d5" containerName="discovery" Sep 11 18:55:33.807553 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:33.807344 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="87485aa6-8b14-45b5-be53-b375560e71d5" containerName="discovery" Sep 11 18:55:33.807553 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:33.807396 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="87485aa6-8b14-45b5-be53-b375560e71d5" containerName="discovery" Sep 11 18:55:33.811430 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:33.811411 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pp6js" Sep 11 18:55:33.814298 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:33.814273 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-wvlf9\"" Sep 11 18:55:33.814401 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:33.814379 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 11 18:55:33.815505 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:33.815490 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 11 18:55:33.822904 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:33.822884 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-pp6js"] Sep 11 18:55:33.878113 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:33.878077 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfsm8\" (UniqueName: \"kubernetes.io/projected/a36529a1-8b54-4ecd-b8fd-a5ca17021159-kube-api-access-nfsm8\") pod \"limitador-operator-controller-manager-74495c69f8-pp6js\" (UID: \"a36529a1-8b54-4ecd-b8fd-a5ca17021159\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pp6js" Sep 11 18:55:33.979029 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:33.978996 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfsm8\" (UniqueName: \"kubernetes.io/projected/a36529a1-8b54-4ecd-b8fd-a5ca17021159-kube-api-access-nfsm8\") pod \"limitador-operator-controller-manager-74495c69f8-pp6js\" (UID: \"a36529a1-8b54-4ecd-b8fd-a5ca17021159\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pp6js" Sep 11 18:55:34.010267 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:34.010228 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfsm8\" (UniqueName: \"kubernetes.io/projected/a36529a1-8b54-4ecd-b8fd-a5ca17021159-kube-api-access-nfsm8\") pod \"limitador-operator-controller-manager-74495c69f8-pp6js\" (UID: \"a36529a1-8b54-4ecd-b8fd-a5ca17021159\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pp6js" Sep 11 18:55:34.121351 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:34.121263 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pp6js" Sep 11 18:55:34.405270 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:34.405084 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-pp6js"] Sep 11 18:55:34.407862 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:55:34.407828 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda36529a1_8b54_4ecd_b8fd_a5ca17021159.slice/crio-6e706ff5b278ac70e3121e9766e9803577899de46be589d9752a44689ac4cc06 WatchSource:0}: Error finding container 6e706ff5b278ac70e3121e9766e9803577899de46be589d9752a44689ac4cc06: Status 404 returned error can't find the container with id 6e706ff5b278ac70e3121e9766e9803577899de46be589d9752a44689ac4cc06 Sep 11 18:55:34.954082 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:34.954046 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pp6js" event={"ID":"a36529a1-8b54-4ecd-b8fd-a5ca17021159","Type":"ContainerStarted","Data":"6e706ff5b278ac70e3121e9766e9803577899de46be589d9752a44689ac4cc06"} Sep 11 18:55:37.968345 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:37.968304 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pp6js" event={"ID":"a36529a1-8b54-4ecd-b8fd-a5ca17021159","Type":"ContainerStarted","Data":"4268c58dacd182e817c30e7b63857d56a7063640db8754386ea0780bd8a52532"} Sep 11 18:55:37.968845 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:37.968393 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pp6js" Sep 11 18:55:38.021210 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:38.021152 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pp6js" podStartSLOduration=2.300056371 podStartE2EDuration="5.021136611s" totalImagesPullingTime="2.72108024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:55:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:55:38.020123361 +0000 UTC m=+442.200056069" watchObservedRunningTime="2026-09-11 18:55:38.021136611 +0000 UTC m=+442.201069318" Sep 11 18:55:38.300344 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:38.300312 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg6cj"] Sep 11 18:55:38.303734 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:38.303705 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg6cj" Sep 11 18:55:38.307281 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:38.307259 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-m9mdd\"" Sep 11 18:55:38.321312 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:38.321288 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg6cj"] Sep 11 18:55:38.417513 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:38.417434 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xlcz\" (UniqueName: \"kubernetes.io/projected/64785317-3c61-44d1-b8a6-e150fb4e0b60-kube-api-access-2xlcz\") pod \"kuadrant-operator-controller-manager-76f8f686bf-cg6cj\" (UID: \"64785317-3c61-44d1-b8a6-e150fb4e0b60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg6cj" Sep 11 18:55:38.417513 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:38.417503 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64785317-3c61-44d1-b8a6-e150fb4e0b60-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-cg6cj\" (UID: \"64785317-3c61-44d1-b8a6-e150fb4e0b60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg6cj" Sep 11 18:55:38.517897 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:38.517863 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64785317-3c61-44d1-b8a6-e150fb4e0b60-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-cg6cj\" (UID: \"64785317-3c61-44d1-b8a6-e150fb4e0b60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg6cj" Sep 11 18:55:38.518038 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:38.517912 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xlcz\" (UniqueName: \"kubernetes.io/projected/64785317-3c61-44d1-b8a6-e150fb4e0b60-kube-api-access-2xlcz\") pod \"kuadrant-operator-controller-manager-76f8f686bf-cg6cj\" (UID: \"64785317-3c61-44d1-b8a6-e150fb4e0b60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg6cj" Sep 11 18:55:38.518269 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:38.518248 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64785317-3c61-44d1-b8a6-e150fb4e0b60-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-cg6cj\" (UID: \"64785317-3c61-44d1-b8a6-e150fb4e0b60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg6cj" Sep 11 18:55:38.533597 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:38.533559 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xlcz\" (UniqueName: \"kubernetes.io/projected/64785317-3c61-44d1-b8a6-e150fb4e0b60-kube-api-access-2xlcz\") pod \"kuadrant-operator-controller-manager-76f8f686bf-cg6cj\" (UID: \"64785317-3c61-44d1-b8a6-e150fb4e0b60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg6cj" Sep 11 18:55:38.613391 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:38.613310 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg6cj" Sep 11 18:55:38.914054 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:38.914030 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg6cj"] Sep 11 18:55:38.916308 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:55:38.916278 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64785317_3c61_44d1_b8a6_e150fb4e0b60.slice/crio-f2be38c0f84ab5bd2b49401228c9deaebfa54127b175caad1c23445cae92b13b WatchSource:0}: Error finding container f2be38c0f84ab5bd2b49401228c9deaebfa54127b175caad1c23445cae92b13b: Status 404 returned error can't find the container with id f2be38c0f84ab5bd2b49401228c9deaebfa54127b175caad1c23445cae92b13b Sep 11 18:55:38.974097 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:38.974063 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg6cj" event={"ID":"64785317-3c61-44d1-b8a6-e150fb4e0b60","Type":"ContainerStarted","Data":"f2be38c0f84ab5bd2b49401228c9deaebfa54127b175caad1c23445cae92b13b"} Sep 11 18:55:40.990487 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:40.990454 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-rwdwj"] Sep 11 18:55:40.993672 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:40.993653 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-rwdwj" Sep 11 18:55:41.001632 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:40.998923 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-njxlp\"" Sep 11 18:55:41.017865 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:41.017842 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-rwdwj"] Sep 11 18:55:41.039788 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:41.039758 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv4jm\" (UniqueName: \"kubernetes.io/projected/76c5200b-b818-4b96-bf72-93ab410e4bc9-kube-api-access-cv4jm\") pod \"authorino-operator-76b478bd78-rwdwj\" (UID: \"76c5200b-b818-4b96-bf72-93ab410e4bc9\") " pod="kuadrant-system/authorino-operator-76b478bd78-rwdwj" Sep 11 18:55:41.140791 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:41.140745 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv4jm\" (UniqueName: \"kubernetes.io/projected/76c5200b-b818-4b96-bf72-93ab410e4bc9-kube-api-access-cv4jm\") pod \"authorino-operator-76b478bd78-rwdwj\" (UID: \"76c5200b-b818-4b96-bf72-93ab410e4bc9\") " pod="kuadrant-system/authorino-operator-76b478bd78-rwdwj" Sep 11 18:55:41.171499 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:41.171459 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv4jm\" (UniqueName: \"kubernetes.io/projected/76c5200b-b818-4b96-bf72-93ab410e4bc9-kube-api-access-cv4jm\") pod \"authorino-operator-76b478bd78-rwdwj\" (UID: \"76c5200b-b818-4b96-bf72-93ab410e4bc9\") " pod="kuadrant-system/authorino-operator-76b478bd78-rwdwj" Sep 11 18:55:41.307275 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:41.307235 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-rwdwj" Sep 11 18:55:41.620728 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:41.620696 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-rwdwj"] Sep 11 18:55:41.624018 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:55:41.623984 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76c5200b_b818_4b96_bf72_93ab410e4bc9.slice/crio-08b988884454693d77668bbdb8069ae7e5f5b9c6c34f2c1a56b3ad538659a1c5 WatchSource:0}: Error finding container 08b988884454693d77668bbdb8069ae7e5f5b9c6c34f2c1a56b3ad538659a1c5: Status 404 returned error can't find the container with id 08b988884454693d77668bbdb8069ae7e5f5b9c6c34f2c1a56b3ad538659a1c5 Sep 11 18:55:41.989511 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:41.989425 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-rwdwj" event={"ID":"76c5200b-b818-4b96-bf72-93ab410e4bc9","Type":"ContainerStarted","Data":"08b988884454693d77668bbdb8069ae7e5f5b9c6c34f2c1a56b3ad538659a1c5"} Sep 11 18:55:43.503950 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:43.503916 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-phjfx"] Sep 11 18:55:43.507466 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:43.507439 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-phjfx" Sep 11 18:55:43.512276 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:43.512250 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-kdtwr\"" Sep 11 18:55:43.512422 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:43.512277 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Sep 11 18:55:43.525171 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:43.525142 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-phjfx"] Sep 11 18:55:43.561490 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:43.561453 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvrgl\" (UniqueName: \"kubernetes.io/projected/5c881077-7314-42d5-b21f-3ff31c460d10-kube-api-access-mvrgl\") pod \"dns-operator-controller-manager-7b84cd7c9c-phjfx\" (UID: \"5c881077-7314-42d5-b21f-3ff31c460d10\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-phjfx" Sep 11 18:55:43.662465 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:43.662438 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvrgl\" (UniqueName: \"kubernetes.io/projected/5c881077-7314-42d5-b21f-3ff31c460d10-kube-api-access-mvrgl\") pod \"dns-operator-controller-manager-7b84cd7c9c-phjfx\" (UID: \"5c881077-7314-42d5-b21f-3ff31c460d10\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-phjfx" Sep 11 18:55:43.683335 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:43.683313 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvrgl\" (UniqueName: \"kubernetes.io/projected/5c881077-7314-42d5-b21f-3ff31c460d10-kube-api-access-mvrgl\") pod \"dns-operator-controller-manager-7b84cd7c9c-phjfx\" (UID: \"5c881077-7314-42d5-b21f-3ff31c460d10\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-phjfx" Sep 11 18:55:43.818532 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:43.818499 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-phjfx" Sep 11 18:55:43.999881 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:43.999840 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg6cj" event={"ID":"64785317-3c61-44d1-b8a6-e150fb4e0b60","Type":"ContainerStarted","Data":"3258c1a6591869f6ef495664ea7aa860c9b20ad7c49298ba7b5844decc0a2e2c"} Sep 11 18:55:44.000043 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:43.999933 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg6cj" Sep 11 18:55:44.001439 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:44.001413 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-rwdwj" event={"ID":"76c5200b-b818-4b96-bf72-93ab410e4bc9","Type":"ContainerStarted","Data":"0090d71c3e5c89f2546d2a30bbfeb59636d5ebac178f4afb9a389c08bd817b9c"} Sep 11 18:55:44.001562 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:44.001528 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-rwdwj" Sep 11 18:55:44.039551 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:44.039489 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg6cj" podStartSLOduration=1.9618948330000001 podStartE2EDuration="6.039474686s" totalImagesPullingTime="4.077579853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:55:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:55:44.033926979 +0000 UTC m=+448.213859687" watchObservedRunningTime="2026-09-11 18:55:44.039474686 +0000 UTC m=+448.219407385" Sep 11 18:55:44.062720 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:44.062670 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-rwdwj" podStartSLOduration=2.051969939 podStartE2EDuration="4.062655705s" totalImagesPullingTime="2.010685766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:55:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:55:44.060513015 +0000 UTC m=+448.240445722" watchObservedRunningTime="2026-09-11 18:55:44.062655705 +0000 UTC m=+448.242588412" Sep 11 18:55:44.106155 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:44.105997 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-phjfx"] Sep 11 18:55:44.108555 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:55:44.108531 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c881077_7314_42d5_b21f_3ff31c460d10.slice/crio-b91306e515ebd13797f452b2bdc09daba621b97fbeaa0a5ad1825715cedb2e3e WatchSource:0}: Error finding container b91306e515ebd13797f452b2bdc09daba621b97fbeaa0a5ad1825715cedb2e3e: Status 404 returned error can't find the container with id b91306e515ebd13797f452b2bdc09daba621b97fbeaa0a5ad1825715cedb2e3e Sep 11 18:55:45.007508 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:45.007474 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-phjfx" event={"ID":"5c881077-7314-42d5-b21f-3ff31c460d10","Type":"ContainerStarted","Data":"b91306e515ebd13797f452b2bdc09daba621b97fbeaa0a5ad1825715cedb2e3e"} Sep 11 18:55:46.013644 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:46.013611 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-phjfx" event={"ID":"5c881077-7314-42d5-b21f-3ff31c460d10","Type":"ContainerStarted","Data":"7b46ce7cce238dd60f62914af8b7290ec491d903b8df46f551c74971ed408994"} Sep 11 18:55:46.014020 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:46.013693 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-phjfx" Sep 11 18:55:46.036377 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:46.036326 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-phjfx" podStartSLOduration=1.5785606909999998 podStartE2EDuration="3.036310531s" totalImagesPullingTime="1.45774984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:55:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:55:46.034659206 +0000 UTC m=+450.214591909" watchObservedRunningTime="2026-09-11 18:55:46.036310531 +0000 UTC m=+450.216243239" Sep 11 18:55:48.976871 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:48.976837 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pp6js" Sep 11 18:55:55.009599 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:55.009545 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-rwdwj" Sep 11 18:55:55.009963 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:55.009726 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg6cj" Sep 11 18:55:57.019605 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.019556 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-phjfx" Sep 11 18:55:57.430564 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.430476 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg6cj"] Sep 11 18:55:57.430753 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.430661 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg6cj" podUID="64785317-3c61-44d1-b8a6-e150fb4e0b60" containerName="manager" containerID="cri-o://3258c1a6591869f6ef495664ea7aa860c9b20ad7c49298ba7b5844decc0a2e2c" gracePeriod=2 Sep 11 18:55:57.435650 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.435624 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg6cj"] Sep 11 18:55:57.461026 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.461002 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-pp6js"] Sep 11 18:55:57.461213 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.461191 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pp6js" podUID="a36529a1-8b54-4ecd-b8fd-a5ca17021159" containerName="manager" containerID="cri-o://4268c58dacd182e817c30e7b63857d56a7063640db8754386ea0780bd8a52532" gracePeriod=2 Sep 11 18:55:57.463809 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:55:57.463779 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-cg6cj\" is forbidden: User \"system:node:ip-10-0-133-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-25.ec2.internal' and this object" podUID="64785317-3c61-44d1-b8a6-e150fb4e0b60" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg6cj" Sep 11 18:55:57.479614 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.478618 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-pp6js"] Sep 11 18:55:57.480652 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.480623 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmznt"] Sep 11 18:55:57.481077 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.481057 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a36529a1-8b54-4ecd-b8fd-a5ca17021159" containerName="manager" Sep 11 18:55:57.481163 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.481081 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a36529a1-8b54-4ecd-b8fd-a5ca17021159" containerName="manager" Sep 11 18:55:57.481163 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.481103 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64785317-3c61-44d1-b8a6-e150fb4e0b60" containerName="manager" Sep 11 18:55:57.481163 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.481114 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="64785317-3c61-44d1-b8a6-e150fb4e0b60" containerName="manager" Sep 11 18:55:57.481308 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.481178 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a36529a1-8b54-4ecd-b8fd-a5ca17021159" containerName="manager" Sep 11 18:55:57.481308 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.481189 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="64785317-3c61-44d1-b8a6-e150fb4e0b60" containerName="manager" Sep 11 18:55:57.485097 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.485071 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmznt" Sep 11 18:55:57.503496 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.503466 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-hsctw"] Sep 11 18:55:57.509988 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.509956 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hsctw" Sep 11 18:55:57.512572 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.512541 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmznt"] Sep 11 18:55:57.535960 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:55:57.535916 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-pp6js\" is forbidden: User \"system:node:ip-10-0-133-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-25.ec2.internal' and this object" podUID="a36529a1-8b54-4ecd-b8fd-a5ca17021159" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pp6js" Sep 11 18:55:57.538372 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:55:57.538340 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-cg6cj\" is forbidden: User \"system:node:ip-10-0-133-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-25.ec2.internal' and this object" podUID="64785317-3c61-44d1-b8a6-e150fb4e0b60" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg6cj" Sep 11 18:55:57.539240 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.539214 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-hsctw"] Sep 11 18:55:57.570800 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:55:57.570764 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-pp6js\" is forbidden: User \"system:node:ip-10-0-133-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-25.ec2.internal' and this object" podUID="a36529a1-8b54-4ecd-b8fd-a5ca17021159" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pp6js" Sep 11 18:55:57.574186 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:55:57.574146 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-cg6cj\" is forbidden: User \"system:node:ip-10-0-133-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-25.ec2.internal' and this object" podUID="64785317-3c61-44d1-b8a6-e150fb4e0b60" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg6cj" Sep 11 18:55:57.580152 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.580120 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxdm8\" (UniqueName: \"kubernetes.io/projected/d7928ce8-4684-4725-bb37-f4fa6e67a5aa-kube-api-access-kxdm8\") pod \"limitador-operator-controller-manager-74495c69f8-hsctw\" (UID: \"d7928ce8-4684-4725-bb37-f4fa6e67a5aa\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hsctw" Sep 11 18:55:57.580272 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.580251 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3bd1373-2985-4a05-8e8f-e2a4f7a44c95-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gmznt\" (UID: \"f3bd1373-2985-4a05-8e8f-e2a4f7a44c95\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmznt" Sep 11 18:55:57.580342 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.580330 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sknjb\" (UniqueName: \"kubernetes.io/projected/f3bd1373-2985-4a05-8e8f-e2a4f7a44c95-kube-api-access-sknjb\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gmznt\" (UID: \"f3bd1373-2985-4a05-8e8f-e2a4f7a44c95\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmznt" Sep 11 18:55:57.680824 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.680758 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3bd1373-2985-4a05-8e8f-e2a4f7a44c95-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gmznt\" (UID: \"f3bd1373-2985-4a05-8e8f-e2a4f7a44c95\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmznt" Sep 11 18:55:57.680952 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.680826 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sknjb\" (UniqueName: \"kubernetes.io/projected/f3bd1373-2985-4a05-8e8f-e2a4f7a44c95-kube-api-access-sknjb\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gmznt\" (UID: \"f3bd1373-2985-4a05-8e8f-e2a4f7a44c95\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmznt" Sep 11 18:55:57.680952 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.680868 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxdm8\" (UniqueName: \"kubernetes.io/projected/d7928ce8-4684-4725-bb37-f4fa6e67a5aa-kube-api-access-kxdm8\") pod \"limitador-operator-controller-manager-74495c69f8-hsctw\" (UID: \"d7928ce8-4684-4725-bb37-f4fa6e67a5aa\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hsctw" Sep 11 18:55:57.681204 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.681173 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3bd1373-2985-4a05-8e8f-e2a4f7a44c95-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gmznt\" (UID: \"f3bd1373-2985-4a05-8e8f-e2a4f7a44c95\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmznt" Sep 11 18:55:57.695034 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.695012 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sknjb\" (UniqueName: \"kubernetes.io/projected/f3bd1373-2985-4a05-8e8f-e2a4f7a44c95-kube-api-access-sknjb\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gmznt\" (UID: \"f3bd1373-2985-4a05-8e8f-e2a4f7a44c95\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmznt" Sep 11 18:55:57.696177 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.696158 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg6cj" Sep 11 18:55:57.698591 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.698564 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pp6js" Sep 11 18:55:57.699286 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:55:57.699260 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-pp6js\" is forbidden: User \"system:node:ip-10-0-133-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-25.ec2.internal' and this object" podUID="a36529a1-8b54-4ecd-b8fd-a5ca17021159" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pp6js" Sep 11 18:55:57.701077 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.701061 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxdm8\" (UniqueName: \"kubernetes.io/projected/d7928ce8-4684-4725-bb37-f4fa6e67a5aa-kube-api-access-kxdm8\") pod \"limitador-operator-controller-manager-74495c69f8-hsctw\" (UID: \"d7928ce8-4684-4725-bb37-f4fa6e67a5aa\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hsctw" Sep 11 18:55:57.701599 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:55:57.701562 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-cg6cj\" is forbidden: User \"system:node:ip-10-0-133-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-25.ec2.internal' and this object" podUID="64785317-3c61-44d1-b8a6-e150fb4e0b60" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg6cj" Sep 11 18:55:57.703889 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:55:57.703868 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-pp6js\" is forbidden: User \"system:node:ip-10-0-133-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-25.ec2.internal' and this object" podUID="a36529a1-8b54-4ecd-b8fd-a5ca17021159" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pp6js" Sep 11 18:55:57.706176 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:55:57.706151 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-cg6cj\" is forbidden: User \"system:node:ip-10-0-133-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-25.ec2.internal' and this object" podUID="64785317-3c61-44d1-b8a6-e150fb4e0b60" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg6cj" Sep 11 18:55:57.781339 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.781302 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfsm8\" (UniqueName: \"kubernetes.io/projected/a36529a1-8b54-4ecd-b8fd-a5ca17021159-kube-api-access-nfsm8\") pod \"a36529a1-8b54-4ecd-b8fd-a5ca17021159\" (UID: \"a36529a1-8b54-4ecd-b8fd-a5ca17021159\") " Sep 11 18:55:57.781498 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.781363 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xlcz\" (UniqueName: \"kubernetes.io/projected/64785317-3c61-44d1-b8a6-e150fb4e0b60-kube-api-access-2xlcz\") pod \"64785317-3c61-44d1-b8a6-e150fb4e0b60\" (UID: \"64785317-3c61-44d1-b8a6-e150fb4e0b60\") " Sep 11 18:55:57.781498 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.781399 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64785317-3c61-44d1-b8a6-e150fb4e0b60-extensions-socket-volume\") pod \"64785317-3c61-44d1-b8a6-e150fb4e0b60\" (UID: \"64785317-3c61-44d1-b8a6-e150fb4e0b60\") " Sep 11 18:55:57.782031 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.782003 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64785317-3c61-44d1-b8a6-e150fb4e0b60-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "64785317-3c61-44d1-b8a6-e150fb4e0b60" (UID: "64785317-3c61-44d1-b8a6-e150fb4e0b60"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 18:55:57.783482 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.783456 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a36529a1-8b54-4ecd-b8fd-a5ca17021159-kube-api-access-nfsm8" (OuterVolumeSpecName: "kube-api-access-nfsm8") pod "a36529a1-8b54-4ecd-b8fd-a5ca17021159" (UID: "a36529a1-8b54-4ecd-b8fd-a5ca17021159"). InnerVolumeSpecName "kube-api-access-nfsm8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 18:55:57.783567 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.783461 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64785317-3c61-44d1-b8a6-e150fb4e0b60-kube-api-access-2xlcz" (OuterVolumeSpecName: "kube-api-access-2xlcz") pod "64785317-3c61-44d1-b8a6-e150fb4e0b60" (UID: "64785317-3c61-44d1-b8a6-e150fb4e0b60"). InnerVolumeSpecName "kube-api-access-2xlcz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 18:55:57.855427 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.855391 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmznt" Sep 11 18:55:57.860897 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.860871 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hsctw" Sep 11 18:55:57.882492 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.882459 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfsm8\" (UniqueName: \"kubernetes.io/projected/a36529a1-8b54-4ecd-b8fd-a5ca17021159-kube-api-access-nfsm8\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:55:57.882623 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.882498 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xlcz\" (UniqueName: \"kubernetes.io/projected/64785317-3c61-44d1-b8a6-e150fb4e0b60-kube-api-access-2xlcz\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:55:57.882623 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:57.882517 2583 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64785317-3c61-44d1-b8a6-e150fb4e0b60-extensions-socket-volume\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:55:58.064990 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:58.064961 2583 generic.go:356] "Generic (PLEG): container finished" podID="a36529a1-8b54-4ecd-b8fd-a5ca17021159" containerID="4268c58dacd182e817c30e7b63857d56a7063640db8754386ea0780bd8a52532" exitCode=0 Sep 11 18:55:58.065396 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:58.065010 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pp6js" Sep 11 18:55:58.065396 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:58.065070 2583 scope.go:117] "RemoveContainer" containerID="4268c58dacd182e817c30e7b63857d56a7063640db8754386ea0780bd8a52532" Sep 11 18:55:58.066590 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:58.066556 2583 generic.go:356] "Generic (PLEG): container finished" podID="64785317-3c61-44d1-b8a6-e150fb4e0b60" containerID="3258c1a6591869f6ef495664ea7aa860c9b20ad7c49298ba7b5844decc0a2e2c" exitCode=0 Sep 11 18:55:58.066718 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:58.066700 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg6cj" Sep 11 18:55:58.067858 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:55:58.067828 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-pp6js\" is forbidden: User \"system:node:ip-10-0-133-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-25.ec2.internal' and this object" podUID="a36529a1-8b54-4ecd-b8fd-a5ca17021159" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pp6js" Sep 11 18:55:58.070226 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:55:58.070202 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-cg6cj\" is forbidden: User \"system:node:ip-10-0-133-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-25.ec2.internal' and this object" podUID="64785317-3c61-44d1-b8a6-e150fb4e0b60" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg6cj" Sep 11 18:55:58.072630 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:55:58.072572 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-pp6js\" is forbidden: User \"system:node:ip-10-0-133-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-25.ec2.internal' and this object" podUID="a36529a1-8b54-4ecd-b8fd-a5ca17021159" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pp6js" Sep 11 18:55:58.073124 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:58.073110 2583 scope.go:117] "RemoveContainer" containerID="4268c58dacd182e817c30e7b63857d56a7063640db8754386ea0780bd8a52532" Sep 11 18:55:58.073407 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:55:58.073390 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4268c58dacd182e817c30e7b63857d56a7063640db8754386ea0780bd8a52532\": container with ID starting with 4268c58dacd182e817c30e7b63857d56a7063640db8754386ea0780bd8a52532 not found: ID does not exist" containerID="4268c58dacd182e817c30e7b63857d56a7063640db8754386ea0780bd8a52532" Sep 11 18:55:58.073453 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:58.073418 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4268c58dacd182e817c30e7b63857d56a7063640db8754386ea0780bd8a52532"} err="failed to get container status \"4268c58dacd182e817c30e7b63857d56a7063640db8754386ea0780bd8a52532\": rpc error: code = NotFound desc = could not find container \"4268c58dacd182e817c30e7b63857d56a7063640db8754386ea0780bd8a52532\": container with ID starting with 4268c58dacd182e817c30e7b63857d56a7063640db8754386ea0780bd8a52532 not found: ID does not exist" Sep 11 18:55:58.073453 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:58.073434 2583 scope.go:117] "RemoveContainer" containerID="3258c1a6591869f6ef495664ea7aa860c9b20ad7c49298ba7b5844decc0a2e2c" Sep 11 18:55:58.074819 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:55:58.074798 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-cg6cj\" is forbidden: User \"system:node:ip-10-0-133-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-25.ec2.internal' and this object" podUID="64785317-3c61-44d1-b8a6-e150fb4e0b60" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg6cj" Sep 11 18:55:58.080922 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:58.080903 2583 scope.go:117] "RemoveContainer" containerID="3258c1a6591869f6ef495664ea7aa860c9b20ad7c49298ba7b5844decc0a2e2c" Sep 11 18:55:58.081162 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:55:58.081141 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-pp6js\" is forbidden: User \"system:node:ip-10-0-133-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-25.ec2.internal' and this object" podUID="a36529a1-8b54-4ecd-b8fd-a5ca17021159" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pp6js" Sep 11 18:55:58.081252 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:55:58.081196 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3258c1a6591869f6ef495664ea7aa860c9b20ad7c49298ba7b5844decc0a2e2c\": container with ID starting with 3258c1a6591869f6ef495664ea7aa860c9b20ad7c49298ba7b5844decc0a2e2c not found: ID does not exist" containerID="3258c1a6591869f6ef495664ea7aa860c9b20ad7c49298ba7b5844decc0a2e2c" Sep 11 18:55:58.081252 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:58.081216 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3258c1a6591869f6ef495664ea7aa860c9b20ad7c49298ba7b5844decc0a2e2c"} err="failed to get container status \"3258c1a6591869f6ef495664ea7aa860c9b20ad7c49298ba7b5844decc0a2e2c\": rpc error: code = NotFound desc = could not find container \"3258c1a6591869f6ef495664ea7aa860c9b20ad7c49298ba7b5844decc0a2e2c\": container with ID starting with 3258c1a6591869f6ef495664ea7aa860c9b20ad7c49298ba7b5844decc0a2e2c not found: ID does not exist" Sep 11 18:55:58.083815 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:55:58.083791 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-cg6cj\" is forbidden: User \"system:node:ip-10-0-133-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-25.ec2.internal' and this object" podUID="64785317-3c61-44d1-b8a6-e150fb4e0b60" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg6cj" Sep 11 18:55:58.086561 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:55:58.086538 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-pp6js\" is forbidden: User \"system:node:ip-10-0-133-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-25.ec2.internal' and this object" podUID="a36529a1-8b54-4ecd-b8fd-a5ca17021159" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-pp6js" Sep 11 18:55:58.089124 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:55:58.089103 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-cg6cj\" is forbidden: User \"system:node:ip-10-0-133-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-25.ec2.internal' and this object" podUID="64785317-3c61-44d1-b8a6-e150fb4e0b60" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg6cj" Sep 11 18:55:58.136971 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:58.136948 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmznt"] Sep 11 18:55:58.139178 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:55:58.139155 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3bd1373_2985_4a05_8e8f_e2a4f7a44c95.slice/crio-1a251ffe4bbb4191843593b176146f661381be9455aa2f7aba700176d875a861 WatchSource:0}: Error finding container 1a251ffe4bbb4191843593b176146f661381be9455aa2f7aba700176d875a861: Status 404 returned error can't find the container with id 1a251ffe4bbb4191843593b176146f661381be9455aa2f7aba700176d875a861 Sep 11 18:55:58.142920 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:58.142895 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-hsctw"] Sep 11 18:55:58.145407 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:55:58.145385 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7928ce8_4684_4725_bb37_f4fa6e67a5aa.slice/crio-628f68e7c10007134ad2c42039b8abb24d665dba78e418763ea01d317e09bdf1 WatchSource:0}: Error finding container 628f68e7c10007134ad2c42039b8abb24d665dba78e418763ea01d317e09bdf1: Status 404 returned error can't find the container with id 628f68e7c10007134ad2c42039b8abb24d665dba78e418763ea01d317e09bdf1 Sep 11 18:55:58.358008 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:58.357924 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64785317-3c61-44d1-b8a6-e150fb4e0b60" path="/var/lib/kubelet/pods/64785317-3c61-44d1-b8a6-e150fb4e0b60/volumes" Sep 11 18:55:58.358296 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:58.358282 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a36529a1-8b54-4ecd-b8fd-a5ca17021159" path="/var/lib/kubelet/pods/a36529a1-8b54-4ecd-b8fd-a5ca17021159/volumes" Sep 11 18:55:58.588698 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:58.588664 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fzwvj"] Sep 11 18:55:58.592258 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:58.592235 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fzwvj" Sep 11 18:55:58.612188 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:58.612133 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fzwvj"] Sep 11 18:55:58.687993 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:58.687946 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw7cx\" (UniqueName: \"kubernetes.io/projected/36fa9f7e-5a8d-4fc9-9200-b52f3b868ed2-kube-api-access-zw7cx\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fzwvj\" (UID: \"36fa9f7e-5a8d-4fc9-9200-b52f3b868ed2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fzwvj" Sep 11 18:55:58.688163 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:58.688008 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/36fa9f7e-5a8d-4fc9-9200-b52f3b868ed2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fzwvj\" (UID: \"36fa9f7e-5a8d-4fc9-9200-b52f3b868ed2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fzwvj" Sep 11 18:55:58.788604 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:58.788550 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw7cx\" (UniqueName: \"kubernetes.io/projected/36fa9f7e-5a8d-4fc9-9200-b52f3b868ed2-kube-api-access-zw7cx\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fzwvj\" (UID: \"36fa9f7e-5a8d-4fc9-9200-b52f3b868ed2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fzwvj" Sep 11 18:55:58.788750 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:58.788625 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/36fa9f7e-5a8d-4fc9-9200-b52f3b868ed2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fzwvj\" (UID: \"36fa9f7e-5a8d-4fc9-9200-b52f3b868ed2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fzwvj" Sep 11 18:55:58.789023 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:58.789001 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/36fa9f7e-5a8d-4fc9-9200-b52f3b868ed2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fzwvj\" (UID: \"36fa9f7e-5a8d-4fc9-9200-b52f3b868ed2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fzwvj" Sep 11 18:55:58.799443 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:58.799409 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw7cx\" (UniqueName: \"kubernetes.io/projected/36fa9f7e-5a8d-4fc9-9200-b52f3b868ed2-kube-api-access-zw7cx\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fzwvj\" (UID: \"36fa9f7e-5a8d-4fc9-9200-b52f3b868ed2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fzwvj" Sep 11 18:55:58.901519 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:58.901426 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fzwvj" Sep 11 18:55:59.074028 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:59.073994 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hsctw" event={"ID":"d7928ce8-4684-4725-bb37-f4fa6e67a5aa","Type":"ContainerStarted","Data":"c6252cd664eaa4596b0a35365d8fc3a500845b42ad911b21feec645d9c5ea340"} Sep 11 18:55:59.074470 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:59.074083 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hsctw" event={"ID":"d7928ce8-4684-4725-bb37-f4fa6e67a5aa","Type":"ContainerStarted","Data":"628f68e7c10007134ad2c42039b8abb24d665dba78e418763ea01d317e09bdf1"} Sep 11 18:55:59.074470 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:59.074214 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hsctw" Sep 11 18:55:59.076220 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:59.076192 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmznt" event={"ID":"f3bd1373-2985-4a05-8e8f-e2a4f7a44c95","Type":"ContainerStarted","Data":"ff6a3e927f0f8a5464b13e7368003fcb300606eadb5f73297f67916cf797a6f3"} Sep 11 18:55:59.076352 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:59.076235 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmznt" Sep 11 18:55:59.076352 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:59.076258 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmznt" event={"ID":"f3bd1373-2985-4a05-8e8f-e2a4f7a44c95","Type":"ContainerStarted","Data":"1a251ffe4bbb4191843593b176146f661381be9455aa2f7aba700176d875a861"} Sep 11 18:55:59.093660 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:59.093610 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hsctw" podStartSLOduration=2.093570806 podStartE2EDuration="2.093570806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:55:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:55:59.091903537 +0000 UTC m=+463.271836245" watchObservedRunningTime="2026-09-11 18:55:59.093570806 +0000 UTC m=+463.273503511" Sep 11 18:55:59.116817 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:59.116769 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmznt" podStartSLOduration=2.11675346 podStartE2EDuration="2.11675346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:55:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:55:59.115990466 +0000 UTC m=+463.295923198" watchObservedRunningTime="2026-09-11 18:55:59.11675346 +0000 UTC m=+463.296686167" Sep 11 18:55:59.193852 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:55:59.193824 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fzwvj"] Sep 11 18:55:59.196102 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:55:59.196073 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36fa9f7e_5a8d_4fc9_9200_b52f3b868ed2.slice/crio-ccc2907f40ed4d4321ee2ea7191ac459e652ac0b193d5eef0c0beb7612f806c6 WatchSource:0}: Error finding container ccc2907f40ed4d4321ee2ea7191ac459e652ac0b193d5eef0c0beb7612f806c6: Status 404 returned error can't find the container with id ccc2907f40ed4d4321ee2ea7191ac459e652ac0b193d5eef0c0beb7612f806c6 Sep 11 18:56:00.084342 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:00.084306 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fzwvj" event={"ID":"36fa9f7e-5a8d-4fc9-9200-b52f3b868ed2","Type":"ContainerStarted","Data":"e5db2d86e1225d1bf90bfaddbfe05c64efdb6e9756fa0199888e37900e084a8f"} Sep 11 18:56:00.084854 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:00.084367 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fzwvj" event={"ID":"36fa9f7e-5a8d-4fc9-9200-b52f3b868ed2","Type":"ContainerStarted","Data":"ccc2907f40ed4d4321ee2ea7191ac459e652ac0b193d5eef0c0beb7612f806c6"} Sep 11 18:56:00.084854 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:00.084395 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fzwvj" Sep 11 18:56:00.110152 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:00.110102 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fzwvj" podStartSLOduration=2.110085669 podStartE2EDuration="2.110085669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:55:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:56:00.107906117 +0000 UTC m=+464.287838825" watchObservedRunningTime="2026-09-11 18:56:00.110085669 +0000 UTC m=+464.290018377" Sep 11 18:56:10.087113 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:10.087082 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hsctw" Sep 11 18:56:10.087624 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:10.087157 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmznt" Sep 11 18:56:11.091148 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:11.091114 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fzwvj" Sep 11 18:56:11.157430 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:11.157396 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmznt"] Sep 11 18:56:11.157670 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:11.157628 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmznt" podUID="f3bd1373-2985-4a05-8e8f-e2a4f7a44c95" containerName="manager" containerID="cri-o://ff6a3e927f0f8a5464b13e7368003fcb300606eadb5f73297f67916cf797a6f3" gracePeriod=10 Sep 11 18:56:11.395764 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:11.395742 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmznt" Sep 11 18:56:11.496858 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:11.496826 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sknjb\" (UniqueName: \"kubernetes.io/projected/f3bd1373-2985-4a05-8e8f-e2a4f7a44c95-kube-api-access-sknjb\") pod \"f3bd1373-2985-4a05-8e8f-e2a4f7a44c95\" (UID: \"f3bd1373-2985-4a05-8e8f-e2a4f7a44c95\") " Sep 11 18:56:11.497051 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:11.496882 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3bd1373-2985-4a05-8e8f-e2a4f7a44c95-extensions-socket-volume\") pod \"f3bd1373-2985-4a05-8e8f-e2a4f7a44c95\" (UID: \"f3bd1373-2985-4a05-8e8f-e2a4f7a44c95\") " Sep 11 18:56:11.497298 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:11.497267 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3bd1373-2985-4a05-8e8f-e2a4f7a44c95-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f3bd1373-2985-4a05-8e8f-e2a4f7a44c95" (UID: "f3bd1373-2985-4a05-8e8f-e2a4f7a44c95"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 18:56:11.498901 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:11.498883 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3bd1373-2985-4a05-8e8f-e2a4f7a44c95-kube-api-access-sknjb" (OuterVolumeSpecName: "kube-api-access-sknjb") pod "f3bd1373-2985-4a05-8e8f-e2a4f7a44c95" (UID: "f3bd1373-2985-4a05-8e8f-e2a4f7a44c95"). InnerVolumeSpecName "kube-api-access-sknjb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 18:56:11.597888 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:11.597850 2583 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3bd1373-2985-4a05-8e8f-e2a4f7a44c95-extensions-socket-volume\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:56:11.597888 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:11.597880 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sknjb\" (UniqueName: \"kubernetes.io/projected/f3bd1373-2985-4a05-8e8f-e2a4f7a44c95-kube-api-access-sknjb\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:56:12.141006 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:12.140966 2583 generic.go:356] "Generic (PLEG): container finished" podID="f3bd1373-2985-4a05-8e8f-e2a4f7a44c95" containerID="ff6a3e927f0f8a5464b13e7368003fcb300606eadb5f73297f67916cf797a6f3" exitCode=0 Sep 11 18:56:12.141396 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:12.141025 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmznt" event={"ID":"f3bd1373-2985-4a05-8e8f-e2a4f7a44c95","Type":"ContainerDied","Data":"ff6a3e927f0f8a5464b13e7368003fcb300606eadb5f73297f67916cf797a6f3"} Sep 11 18:56:12.141396 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:12.141092 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmznt" event={"ID":"f3bd1373-2985-4a05-8e8f-e2a4f7a44c95","Type":"ContainerDied","Data":"1a251ffe4bbb4191843593b176146f661381be9455aa2f7aba700176d875a861"} Sep 11 18:56:12.141396 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:12.141030 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmznt" Sep 11 18:56:12.141396 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:12.141122 2583 scope.go:117] "RemoveContainer" containerID="ff6a3e927f0f8a5464b13e7368003fcb300606eadb5f73297f67916cf797a6f3" Sep 11 18:56:12.149003 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:12.148980 2583 scope.go:117] "RemoveContainer" containerID="ff6a3e927f0f8a5464b13e7368003fcb300606eadb5f73297f67916cf797a6f3" Sep 11 18:56:12.149406 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:56:12.149385 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff6a3e927f0f8a5464b13e7368003fcb300606eadb5f73297f67916cf797a6f3\": container with ID starting with ff6a3e927f0f8a5464b13e7368003fcb300606eadb5f73297f67916cf797a6f3 not found: ID does not exist" containerID="ff6a3e927f0f8a5464b13e7368003fcb300606eadb5f73297f67916cf797a6f3" Sep 11 18:56:12.149490 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:12.149418 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff6a3e927f0f8a5464b13e7368003fcb300606eadb5f73297f67916cf797a6f3"} err="failed to get container status \"ff6a3e927f0f8a5464b13e7368003fcb300606eadb5f73297f67916cf797a6f3\": rpc error: code = NotFound desc = could not find container \"ff6a3e927f0f8a5464b13e7368003fcb300606eadb5f73297f67916cf797a6f3\": container with ID starting with ff6a3e927f0f8a5464b13e7368003fcb300606eadb5f73297f67916cf797a6f3 not found: ID does not exist" Sep 11 18:56:12.170747 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:12.170710 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmznt"] Sep 11 18:56:12.181596 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:12.181559 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmznt"] Sep 11 18:56:12.357207 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:12.357176 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3bd1373-2985-4a05-8e8f-e2a4f7a44c95" path="/var/lib/kubelet/pods/f3bd1373-2985-4a05-8e8f-e2a4f7a44c95/volumes" Sep 11 18:56:27.478259 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.478228 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp"] Sep 11 18:56:27.478838 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.478691 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3bd1373-2985-4a05-8e8f-e2a4f7a44c95" containerName="manager" Sep 11 18:56:27.478838 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.478709 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3bd1373-2985-4a05-8e8f-e2a4f7a44c95" containerName="manager" Sep 11 18:56:27.478838 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.478806 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3bd1373-2985-4a05-8e8f-e2a4f7a44c95" containerName="manager" Sep 11 18:56:27.483166 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.483142 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:27.486133 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.486091 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 11 18:56:27.486509 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.486486 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-vm4q8\"" Sep 11 18:56:27.493622 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.493599 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp"] Sep 11 18:56:27.515572 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.515539 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e568a493-a68a-4541-a69b-b92f303cba6e-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-q4gvp\" (UID: \"e568a493-a68a-4541-a69b-b92f303cba6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:27.515736 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.515577 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e568a493-a68a-4541-a69b-b92f303cba6e-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-q4gvp\" (UID: \"e568a493-a68a-4541-a69b-b92f303cba6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:27.515736 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.515618 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e568a493-a68a-4541-a69b-b92f303cba6e-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-q4gvp\" (UID: \"e568a493-a68a-4541-a69b-b92f303cba6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:27.515736 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.515635 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e568a493-a68a-4541-a69b-b92f303cba6e-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-q4gvp\" (UID: \"e568a493-a68a-4541-a69b-b92f303cba6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:27.515736 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.515651 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cg6n\" (UniqueName: \"kubernetes.io/projected/e568a493-a68a-4541-a69b-b92f303cba6e-kube-api-access-5cg6n\") pod \"maas-default-gateway-openshift-default-5ccb968c66-q4gvp\" (UID: \"e568a493-a68a-4541-a69b-b92f303cba6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:27.515736 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.515674 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e568a493-a68a-4541-a69b-b92f303cba6e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-q4gvp\" (UID: \"e568a493-a68a-4541-a69b-b92f303cba6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:27.515736 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.515734 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e568a493-a68a-4541-a69b-b92f303cba6e-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-q4gvp\" (UID: \"e568a493-a68a-4541-a69b-b92f303cba6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:27.515980 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.515769 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e568a493-a68a-4541-a69b-b92f303cba6e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-q4gvp\" (UID: \"e568a493-a68a-4541-a69b-b92f303cba6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:27.515980 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.515797 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e568a493-a68a-4541-a69b-b92f303cba6e-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-q4gvp\" (UID: \"e568a493-a68a-4541-a69b-b92f303cba6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:27.616865 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.616825 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e568a493-a68a-4541-a69b-b92f303cba6e-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-q4gvp\" (UID: \"e568a493-a68a-4541-a69b-b92f303cba6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:27.617059 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.616884 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e568a493-a68a-4541-a69b-b92f303cba6e-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-q4gvp\" (UID: \"e568a493-a68a-4541-a69b-b92f303cba6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:27.617059 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.616903 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e568a493-a68a-4541-a69b-b92f303cba6e-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-q4gvp\" (UID: \"e568a493-a68a-4541-a69b-b92f303cba6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:27.617059 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.616921 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e568a493-a68a-4541-a69b-b92f303cba6e-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-q4gvp\" (UID: \"e568a493-a68a-4541-a69b-b92f303cba6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:27.617059 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.616936 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e568a493-a68a-4541-a69b-b92f303cba6e-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-q4gvp\" (UID: \"e568a493-a68a-4541-a69b-b92f303cba6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:27.617059 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.616955 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cg6n\" (UniqueName: \"kubernetes.io/projected/e568a493-a68a-4541-a69b-b92f303cba6e-kube-api-access-5cg6n\") pod \"maas-default-gateway-openshift-default-5ccb968c66-q4gvp\" (UID: \"e568a493-a68a-4541-a69b-b92f303cba6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:27.617059 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.616979 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e568a493-a68a-4541-a69b-b92f303cba6e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-q4gvp\" (UID: \"e568a493-a68a-4541-a69b-b92f303cba6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:27.617059 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.617008 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e568a493-a68a-4541-a69b-b92f303cba6e-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-q4gvp\" (UID: \"e568a493-a68a-4541-a69b-b92f303cba6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:27.617059 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.617058 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e568a493-a68a-4541-a69b-b92f303cba6e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-q4gvp\" (UID: \"e568a493-a68a-4541-a69b-b92f303cba6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:27.617455 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.617308 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e568a493-a68a-4541-a69b-b92f303cba6e-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-q4gvp\" (UID: \"e568a493-a68a-4541-a69b-b92f303cba6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:27.617455 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.617373 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e568a493-a68a-4541-a69b-b92f303cba6e-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-q4gvp\" (UID: \"e568a493-a68a-4541-a69b-b92f303cba6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:27.617558 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.617508 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e568a493-a68a-4541-a69b-b92f303cba6e-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-q4gvp\" (UID: \"e568a493-a68a-4541-a69b-b92f303cba6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:27.617671 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.617651 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e568a493-a68a-4541-a69b-b92f303cba6e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-q4gvp\" (UID: \"e568a493-a68a-4541-a69b-b92f303cba6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:27.617736 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.617704 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e568a493-a68a-4541-a69b-b92f303cba6e-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-q4gvp\" (UID: \"e568a493-a68a-4541-a69b-b92f303cba6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:27.619364 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.619339 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e568a493-a68a-4541-a69b-b92f303cba6e-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-q4gvp\" (UID: \"e568a493-a68a-4541-a69b-b92f303cba6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:27.619622 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.619597 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e568a493-a68a-4541-a69b-b92f303cba6e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-q4gvp\" (UID: \"e568a493-a68a-4541-a69b-b92f303cba6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:27.624806 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.624784 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e568a493-a68a-4541-a69b-b92f303cba6e-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-q4gvp\" (UID: \"e568a493-a68a-4541-a69b-b92f303cba6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:27.624922 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.624906 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cg6n\" (UniqueName: \"kubernetes.io/projected/e568a493-a68a-4541-a69b-b92f303cba6e-kube-api-access-5cg6n\") pod \"maas-default-gateway-openshift-default-5ccb968c66-q4gvp\" (UID: \"e568a493-a68a-4541-a69b-b92f303cba6e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:27.794890 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:27.794852 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:28.067714 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:28.067652 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp"] Sep 11 18:56:28.069856 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:56:28.069829 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode568a493_a68a_4541_a69b_b92f303cba6e.slice/crio-6dc4ed59a6d30efe6dc9e964cff674e04b614d56cddda5f129b12f4a57a6949a WatchSource:0}: Error finding container 6dc4ed59a6d30efe6dc9e964cff674e04b614d56cddda5f129b12f4a57a6949a: Status 404 returned error can't find the container with id 6dc4ed59a6d30efe6dc9e964cff674e04b614d56cddda5f129b12f4a57a6949a Sep 11 18:56:28.212425 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:28.212387 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" event={"ID":"e568a493-a68a-4541-a69b-b92f303cba6e","Type":"ContainerStarted","Data":"6dc4ed59a6d30efe6dc9e964cff674e04b614d56cddda5f129b12f4a57a6949a"} Sep 11 18:56:30.892285 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:30.892244 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 11 18:56:30.892540 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:30.892340 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 11 18:56:30.892540 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:30.892375 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 11 18:56:31.227608 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:31.227505 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" event={"ID":"e568a493-a68a-4541-a69b-b92f303cba6e","Type":"ContainerStarted","Data":"c6d6391179ff7ef924436ef85cd2fe6317430aeb946f54c9ea7d7e1d84ec4e73"} Sep 11 18:56:31.248558 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:31.248498 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" podStartSLOduration=1.42847113 podStartE2EDuration="4.248481765s" totalImagesPullingTime="2.820010635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:56:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:56:31.247060096 +0000 UTC m=+495.426992806" watchObservedRunningTime="2026-09-11 18:56:31.248481765 +0000 UTC m=+495.428414472" Sep 11 18:56:31.795762 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:31.795718 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:31.801079 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:31.801053 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:32.231266 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:32.231193 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-gsm5s"] Sep 11 18:56:32.234639 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:32.234618 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:32.234773 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:32.234672 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-q4gvp" Sep 11 18:56:32.234773 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:32.234728 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-gsm5s" Sep 11 18:56:32.237296 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:32.237275 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 11 18:56:32.237420 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:32.237284 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-t789c\"" Sep 11 18:56:32.242331 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:32.242125 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-gsm5s"] Sep 11 18:56:32.256216 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:32.256184 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9e5c5345-38b8-4a44-ac64-26cc33498f22-config-file\") pod \"limitador-limitador-8588749977-gsm5s\" (UID: \"9e5c5345-38b8-4a44-ac64-26cc33498f22\") " pod="kuadrant-system/limitador-limitador-8588749977-gsm5s" Sep 11 18:56:32.256350 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:32.256309 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9dql\" (UniqueName: \"kubernetes.io/projected/9e5c5345-38b8-4a44-ac64-26cc33498f22-kube-api-access-z9dql\") pod \"limitador-limitador-8588749977-gsm5s\" (UID: \"9e5c5345-38b8-4a44-ac64-26cc33498f22\") " pod="kuadrant-system/limitador-limitador-8588749977-gsm5s" Sep 11 18:56:32.321448 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:32.321409 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-gsm5s"] Sep 11 18:56:32.357455 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:32.357424 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9dql\" (UniqueName: \"kubernetes.io/projected/9e5c5345-38b8-4a44-ac64-26cc33498f22-kube-api-access-z9dql\") pod \"limitador-limitador-8588749977-gsm5s\" (UID: \"9e5c5345-38b8-4a44-ac64-26cc33498f22\") " pod="kuadrant-system/limitador-limitador-8588749977-gsm5s" Sep 11 18:56:32.357642 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:32.357504 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9e5c5345-38b8-4a44-ac64-26cc33498f22-config-file\") pod \"limitador-limitador-8588749977-gsm5s\" (UID: \"9e5c5345-38b8-4a44-ac64-26cc33498f22\") " pod="kuadrant-system/limitador-limitador-8588749977-gsm5s" Sep 11 18:56:32.358281 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:32.358259 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9e5c5345-38b8-4a44-ac64-26cc33498f22-config-file\") pod \"limitador-limitador-8588749977-gsm5s\" (UID: \"9e5c5345-38b8-4a44-ac64-26cc33498f22\") " pod="kuadrant-system/limitador-limitador-8588749977-gsm5s" Sep 11 18:56:32.365974 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:32.365950 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9dql\" (UniqueName: \"kubernetes.io/projected/9e5c5345-38b8-4a44-ac64-26cc33498f22-kube-api-access-z9dql\") pod \"limitador-limitador-8588749977-gsm5s\" (UID: \"9e5c5345-38b8-4a44-ac64-26cc33498f22\") " pod="kuadrant-system/limitador-limitador-8588749977-gsm5s" Sep 11 18:56:32.546221 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:32.546178 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-gsm5s" Sep 11 18:56:32.816298 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:32.816195 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-gsm5s"] Sep 11 18:56:32.819952 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:56:32.819924 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e5c5345_38b8_4a44_ac64_26cc33498f22.slice/crio-1c5ac15dcfd67f34de65bc52e86f400af7b4c95a6d20280eb66ad351722b8135 WatchSource:0}: Error finding container 1c5ac15dcfd67f34de65bc52e86f400af7b4c95a6d20280eb66ad351722b8135: Status 404 returned error can't find the container with id 1c5ac15dcfd67f34de65bc52e86f400af7b4c95a6d20280eb66ad351722b8135 Sep 11 18:56:33.016252 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:33.016218 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-kn74m"] Sep 11 18:56:33.021259 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:33.021234 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-kn74m" Sep 11 18:56:33.024366 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:33.024318 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qg5db\"" Sep 11 18:56:33.025981 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:33.025960 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-kn74m"] Sep 11 18:56:33.063395 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:33.063367 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wpdz\" (UniqueName: \"kubernetes.io/projected/a565af61-6ca7-410b-9121-0c40d999c005-kube-api-access-5wpdz\") pod \"authorino-7bcfd8f9cd-kn74m\" (UID: \"a565af61-6ca7-410b-9121-0c40d999c005\") " pod="kuadrant-system/authorino-7bcfd8f9cd-kn74m" Sep 11 18:56:33.164505 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:33.164425 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wpdz\" (UniqueName: \"kubernetes.io/projected/a565af61-6ca7-410b-9121-0c40d999c005-kube-api-access-5wpdz\") pod \"authorino-7bcfd8f9cd-kn74m\" (UID: \"a565af61-6ca7-410b-9121-0c40d999c005\") " pod="kuadrant-system/authorino-7bcfd8f9cd-kn74m" Sep 11 18:56:33.173268 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:33.173235 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wpdz\" (UniqueName: \"kubernetes.io/projected/a565af61-6ca7-410b-9121-0c40d999c005-kube-api-access-5wpdz\") pod \"authorino-7bcfd8f9cd-kn74m\" (UID: \"a565af61-6ca7-410b-9121-0c40d999c005\") " pod="kuadrant-system/authorino-7bcfd8f9cd-kn74m" Sep 11 18:56:33.244342 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:33.244308 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-gsm5s" event={"ID":"9e5c5345-38b8-4a44-ac64-26cc33498f22","Type":"ContainerStarted","Data":"1c5ac15dcfd67f34de65bc52e86f400af7b4c95a6d20280eb66ad351722b8135"} Sep 11 18:56:33.332039 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:33.332008 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-kn74m" Sep 11 18:56:33.411727 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:33.411699 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-v6qlr"] Sep 11 18:56:33.416159 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:33.416098 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-v6qlr" Sep 11 18:56:33.419821 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:33.419793 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-v6qlr"] Sep 11 18:56:33.467010 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:33.466969 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjv2z\" (UniqueName: \"kubernetes.io/projected/c1feda9b-eed3-41a6-9934-f860730e7ec4-kube-api-access-jjv2z\") pod \"authorino-59c974bd48-v6qlr\" (UID: \"c1feda9b-eed3-41a6-9934-f860730e7ec4\") " pod="kuadrant-system/authorino-59c974bd48-v6qlr" Sep 11 18:56:33.567958 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:33.567922 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjv2z\" (UniqueName: \"kubernetes.io/projected/c1feda9b-eed3-41a6-9934-f860730e7ec4-kube-api-access-jjv2z\") pod \"authorino-59c974bd48-v6qlr\" (UID: \"c1feda9b-eed3-41a6-9934-f860730e7ec4\") " pod="kuadrant-system/authorino-59c974bd48-v6qlr" Sep 11 18:56:33.583771 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:33.583729 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjv2z\" (UniqueName: \"kubernetes.io/projected/c1feda9b-eed3-41a6-9934-f860730e7ec4-kube-api-access-jjv2z\") pod \"authorino-59c974bd48-v6qlr\" (UID: \"c1feda9b-eed3-41a6-9934-f860730e7ec4\") " pod="kuadrant-system/authorino-59c974bd48-v6qlr" Sep 11 18:56:33.603487 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:33.603458 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-kn74m"] Sep 11 18:56:33.605995 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:56:33.605966 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda565af61_6ca7_410b_9121_0c40d999c005.slice/crio-aa5635a9f35ecd3aea22843c903349ec284fa6cb7920081502873853ed55c222 WatchSource:0}: Error finding container aa5635a9f35ecd3aea22843c903349ec284fa6cb7920081502873853ed55c222: Status 404 returned error can't find the container with id aa5635a9f35ecd3aea22843c903349ec284fa6cb7920081502873853ed55c222 Sep 11 18:56:33.728137 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:33.728057 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-v6qlr" Sep 11 18:56:34.150761 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:34.150734 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-v6qlr"] Sep 11 18:56:34.153024 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:56:34.153000 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1feda9b_eed3_41a6_9934_f860730e7ec4.slice/crio-a32a63d4f7869cad2055a0c19622e2bc17bfa42f4dc236c24a466605196a9814 WatchSource:0}: Error finding container a32a63d4f7869cad2055a0c19622e2bc17bfa42f4dc236c24a466605196a9814: Status 404 returned error can't find the container with id a32a63d4f7869cad2055a0c19622e2bc17bfa42f4dc236c24a466605196a9814 Sep 11 18:56:34.250306 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:34.250226 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-gsm5s" event={"ID":"9e5c5345-38b8-4a44-ac64-26cc33498f22","Type":"ContainerStarted","Data":"58a8a13294d5a3be6d28cc65f2351dfd1c5e8123d9781ff13f683bb1adb97401"} Sep 11 18:56:34.250698 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:34.250346 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-gsm5s" Sep 11 18:56:34.251383 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:34.251359 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-kn74m" event={"ID":"a565af61-6ca7-410b-9121-0c40d999c005","Type":"ContainerStarted","Data":"aa5635a9f35ecd3aea22843c903349ec284fa6cb7920081502873853ed55c222"} Sep 11 18:56:34.252446 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:34.252413 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-v6qlr" event={"ID":"c1feda9b-eed3-41a6-9934-f860730e7ec4","Type":"ContainerStarted","Data":"a32a63d4f7869cad2055a0c19622e2bc17bfa42f4dc236c24a466605196a9814"} Sep 11 18:56:34.268544 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:34.268500 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-gsm5s" podStartSLOduration=1.150311397 podStartE2EDuration="2.268486506s" totalImagesPullingTime="1.118175109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:56:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:56:34.26627267 +0000 UTC m=+498.446205380" watchObservedRunningTime="2026-09-11 18:56:34.268486506 +0000 UTC m=+498.448419239" Sep 11 18:56:36.264974 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:36.264934 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-kn74m" event={"ID":"a565af61-6ca7-410b-9121-0c40d999c005","Type":"ContainerStarted","Data":"64416e25960c9498f4d780acd8a9a49c5ffc0be3f01e5d50b370f514c7766358"} Sep 11 18:56:36.266399 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:36.266376 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-v6qlr" event={"ID":"c1feda9b-eed3-41a6-9934-f860730e7ec4","Type":"ContainerStarted","Data":"4518e529fa27610f301fe60386aa5e71cb6235b2eb27f57da4648792b6847632"} Sep 11 18:56:36.280644 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:36.280574 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-kn74m" podStartSLOduration=2.347975345 podStartE2EDuration="4.280560527s" totalImagesPullingTime="1.932585182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:56:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:56:36.279653934 +0000 UTC m=+500.459586645" watchObservedRunningTime="2026-09-11 18:56:36.280560527 +0000 UTC m=+500.460493234" Sep 11 18:56:36.295829 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:36.295780 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-v6qlr" podStartSLOduration=1.905709378 podStartE2EDuration="3.295759786s" totalImagesPullingTime="1.390050408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:56:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:56:36.294825617 +0000 UTC m=+500.474758322" watchObservedRunningTime="2026-09-11 18:56:36.295759786 +0000 UTC m=+500.475692495" Sep 11 18:56:36.319115 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:36.319081 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-kn74m"] Sep 11 18:56:38.275176 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:38.275129 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-kn74m" podUID="a565af61-6ca7-410b-9121-0c40d999c005" containerName="authorino" containerID="cri-o://64416e25960c9498f4d780acd8a9a49c5ffc0be3f01e5d50b370f514c7766358" gracePeriod=30 Sep 11 18:56:38.515847 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:38.515815 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-kn74m" Sep 11 18:56:38.612549 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:38.612463 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wpdz\" (UniqueName: \"kubernetes.io/projected/a565af61-6ca7-410b-9121-0c40d999c005-kube-api-access-5wpdz\") pod \"a565af61-6ca7-410b-9121-0c40d999c005\" (UID: \"a565af61-6ca7-410b-9121-0c40d999c005\") " Sep 11 18:56:38.614531 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:38.614495 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a565af61-6ca7-410b-9121-0c40d999c005-kube-api-access-5wpdz" (OuterVolumeSpecName: "kube-api-access-5wpdz") pod "a565af61-6ca7-410b-9121-0c40d999c005" (UID: "a565af61-6ca7-410b-9121-0c40d999c005"). InnerVolumeSpecName "kube-api-access-5wpdz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 18:56:38.714003 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:38.713959 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wpdz\" (UniqueName: \"kubernetes.io/projected/a565af61-6ca7-410b-9121-0c40d999c005-kube-api-access-5wpdz\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:56:39.280900 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:39.280866 2583 generic.go:356] "Generic (PLEG): container finished" podID="a565af61-6ca7-410b-9121-0c40d999c005" containerID="64416e25960c9498f4d780acd8a9a49c5ffc0be3f01e5d50b370f514c7766358" exitCode=0 Sep 11 18:56:39.281314 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:39.280909 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-kn74m" Sep 11 18:56:39.281314 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:39.280916 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-kn74m" event={"ID":"a565af61-6ca7-410b-9121-0c40d999c005","Type":"ContainerDied","Data":"64416e25960c9498f4d780acd8a9a49c5ffc0be3f01e5d50b370f514c7766358"} Sep 11 18:56:39.281314 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:39.280957 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-kn74m" event={"ID":"a565af61-6ca7-410b-9121-0c40d999c005","Type":"ContainerDied","Data":"aa5635a9f35ecd3aea22843c903349ec284fa6cb7920081502873853ed55c222"} Sep 11 18:56:39.281314 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:39.280980 2583 scope.go:117] "RemoveContainer" containerID="64416e25960c9498f4d780acd8a9a49c5ffc0be3f01e5d50b370f514c7766358" Sep 11 18:56:39.289219 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:39.289204 2583 scope.go:117] "RemoveContainer" containerID="64416e25960c9498f4d780acd8a9a49c5ffc0be3f01e5d50b370f514c7766358" Sep 11 18:56:39.289494 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:56:39.289474 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64416e25960c9498f4d780acd8a9a49c5ffc0be3f01e5d50b370f514c7766358\": container with ID starting with 64416e25960c9498f4d780acd8a9a49c5ffc0be3f01e5d50b370f514c7766358 not found: ID does not exist" containerID="64416e25960c9498f4d780acd8a9a49c5ffc0be3f01e5d50b370f514c7766358" Sep 11 18:56:39.289533 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:39.289503 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64416e25960c9498f4d780acd8a9a49c5ffc0be3f01e5d50b370f514c7766358"} err="failed to get container status \"64416e25960c9498f4d780acd8a9a49c5ffc0be3f01e5d50b370f514c7766358\": rpc error: code = NotFound desc = could not find container \"64416e25960c9498f4d780acd8a9a49c5ffc0be3f01e5d50b370f514c7766358\": container with ID starting with 64416e25960c9498f4d780acd8a9a49c5ffc0be3f01e5d50b370f514c7766358 not found: ID does not exist" Sep 11 18:56:39.302416 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:39.302395 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-kn74m"] Sep 11 18:56:39.310987 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:39.310961 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-kn74m"] Sep 11 18:56:40.357876 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:40.357845 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a565af61-6ca7-410b-9121-0c40d999c005" path="/var/lib/kubelet/pods/a565af61-6ca7-410b-9121-0c40d999c005/volumes" Sep 11 18:56:45.258288 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:45.258251 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-gsm5s" Sep 11 18:56:47.087507 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:47.087469 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-gsm5s"] Sep 11 18:56:47.087969 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:47.087659 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-gsm5s" podUID="9e5c5345-38b8-4a44-ac64-26cc33498f22" containerName="limitador" containerID="cri-o://58a8a13294d5a3be6d28cc65f2351dfd1c5e8123d9781ff13f683bb1adb97401" gracePeriod=30 Sep 11 18:56:47.635646 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:47.635619 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-gsm5s" Sep 11 18:56:47.688152 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:47.688065 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9dql\" (UniqueName: \"kubernetes.io/projected/9e5c5345-38b8-4a44-ac64-26cc33498f22-kube-api-access-z9dql\") pod \"9e5c5345-38b8-4a44-ac64-26cc33498f22\" (UID: \"9e5c5345-38b8-4a44-ac64-26cc33498f22\") " Sep 11 18:56:47.688152 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:47.688123 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9e5c5345-38b8-4a44-ac64-26cc33498f22-config-file\") pod \"9e5c5345-38b8-4a44-ac64-26cc33498f22\" (UID: \"9e5c5345-38b8-4a44-ac64-26cc33498f22\") " Sep 11 18:56:47.688507 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:47.688484 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e5c5345-38b8-4a44-ac64-26cc33498f22-config-file" (OuterVolumeSpecName: "config-file") pod "9e5c5345-38b8-4a44-ac64-26cc33498f22" (UID: "9e5c5345-38b8-4a44-ac64-26cc33498f22"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 18:56:47.690099 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:47.690081 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e5c5345-38b8-4a44-ac64-26cc33498f22-kube-api-access-z9dql" (OuterVolumeSpecName: "kube-api-access-z9dql") pod "9e5c5345-38b8-4a44-ac64-26cc33498f22" (UID: "9e5c5345-38b8-4a44-ac64-26cc33498f22"). InnerVolumeSpecName "kube-api-access-z9dql". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 18:56:47.789212 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:47.789174 2583 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9e5c5345-38b8-4a44-ac64-26cc33498f22-config-file\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:56:47.789212 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:47.789205 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9dql\" (UniqueName: \"kubernetes.io/projected/9e5c5345-38b8-4a44-ac64-26cc33498f22-kube-api-access-z9dql\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:56:48.326590 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:48.326549 2583 generic.go:356] "Generic (PLEG): container finished" podID="9e5c5345-38b8-4a44-ac64-26cc33498f22" containerID="58a8a13294d5a3be6d28cc65f2351dfd1c5e8123d9781ff13f683bb1adb97401" exitCode=0 Sep 11 18:56:48.327158 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:48.326641 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-gsm5s" Sep 11 18:56:48.327158 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:48.326694 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-gsm5s" event={"ID":"9e5c5345-38b8-4a44-ac64-26cc33498f22","Type":"ContainerDied","Data":"58a8a13294d5a3be6d28cc65f2351dfd1c5e8123d9781ff13f683bb1adb97401"} Sep 11 18:56:48.327158 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:48.326775 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-gsm5s" event={"ID":"9e5c5345-38b8-4a44-ac64-26cc33498f22","Type":"ContainerDied","Data":"1c5ac15dcfd67f34de65bc52e86f400af7b4c95a6d20280eb66ad351722b8135"} Sep 11 18:56:48.327158 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:48.326806 2583 scope.go:117] "RemoveContainer" containerID="58a8a13294d5a3be6d28cc65f2351dfd1c5e8123d9781ff13f683bb1adb97401" Sep 11 18:56:48.335519 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:48.335501 2583 scope.go:117] "RemoveContainer" containerID="58a8a13294d5a3be6d28cc65f2351dfd1c5e8123d9781ff13f683bb1adb97401" Sep 11 18:56:48.335802 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:56:48.335783 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58a8a13294d5a3be6d28cc65f2351dfd1c5e8123d9781ff13f683bb1adb97401\": container with ID starting with 58a8a13294d5a3be6d28cc65f2351dfd1c5e8123d9781ff13f683bb1adb97401 not found: ID does not exist" containerID="58a8a13294d5a3be6d28cc65f2351dfd1c5e8123d9781ff13f683bb1adb97401" Sep 11 18:56:48.335868 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:48.335809 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58a8a13294d5a3be6d28cc65f2351dfd1c5e8123d9781ff13f683bb1adb97401"} err="failed to get container status \"58a8a13294d5a3be6d28cc65f2351dfd1c5e8123d9781ff13f683bb1adb97401\": rpc error: code = NotFound desc = could not find container \"58a8a13294d5a3be6d28cc65f2351dfd1c5e8123d9781ff13f683bb1adb97401\": container with ID starting with 58a8a13294d5a3be6d28cc65f2351dfd1c5e8123d9781ff13f683bb1adb97401 not found: ID does not exist" Sep 11 18:56:48.357486 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:48.357451 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-gsm5s"] Sep 11 18:56:48.363901 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:48.363877 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-gsm5s"] Sep 11 18:56:48.805565 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:48.805536 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9n857"] Sep 11 18:56:48.805864 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:48.805851 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e5c5345-38b8-4a44-ac64-26cc33498f22" containerName="limitador" Sep 11 18:56:48.805914 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:48.805865 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e5c5345-38b8-4a44-ac64-26cc33498f22" containerName="limitador" Sep 11 18:56:48.805914 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:48.805876 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a565af61-6ca7-410b-9121-0c40d999c005" containerName="authorino" Sep 11 18:56:48.805914 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:48.805881 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a565af61-6ca7-410b-9121-0c40d999c005" containerName="authorino" Sep 11 18:56:48.806012 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:48.805943 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a565af61-6ca7-410b-9121-0c40d999c005" containerName="authorino" Sep 11 18:56:48.806012 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:48.805951 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e5c5345-38b8-4a44-ac64-26cc33498f22" containerName="limitador" Sep 11 18:56:48.810045 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:48.810028 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9n857" Sep 11 18:56:48.812847 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:48.812824 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 11 18:56:48.814052 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:48.814036 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-q5x74\"" Sep 11 18:56:48.814163 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:48.814068 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Sep 11 18:56:48.814163 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:48.814068 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 11 18:56:48.820533 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:48.820512 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9n857"] Sep 11 18:56:48.899864 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:48.899835 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4fc0214c-fef3-4efb-acb1-dcb92e011884-data\") pod \"postgres-69fb4594cf-9n857\" (UID: \"4fc0214c-fef3-4efb-acb1-dcb92e011884\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9n857" Sep 11 18:56:48.900016 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:48.899900 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqshq\" (UniqueName: \"kubernetes.io/projected/4fc0214c-fef3-4efb-acb1-dcb92e011884-kube-api-access-vqshq\") pod \"postgres-69fb4594cf-9n857\" (UID: \"4fc0214c-fef3-4efb-acb1-dcb92e011884\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9n857" Sep 11 18:56:49.001150 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:49.001105 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4fc0214c-fef3-4efb-acb1-dcb92e011884-data\") pod \"postgres-69fb4594cf-9n857\" (UID: \"4fc0214c-fef3-4efb-acb1-dcb92e011884\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9n857" Sep 11 18:56:49.001318 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:49.001187 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqshq\" (UniqueName: \"kubernetes.io/projected/4fc0214c-fef3-4efb-acb1-dcb92e011884-kube-api-access-vqshq\") pod \"postgres-69fb4594cf-9n857\" (UID: \"4fc0214c-fef3-4efb-acb1-dcb92e011884\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9n857" Sep 11 18:56:49.001508 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:49.001487 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4fc0214c-fef3-4efb-acb1-dcb92e011884-data\") pod \"postgres-69fb4594cf-9n857\" (UID: \"4fc0214c-fef3-4efb-acb1-dcb92e011884\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9n857" Sep 11 18:56:49.009818 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:49.009794 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqshq\" (UniqueName: \"kubernetes.io/projected/4fc0214c-fef3-4efb-acb1-dcb92e011884-kube-api-access-vqshq\") pod \"postgres-69fb4594cf-9n857\" (UID: \"4fc0214c-fef3-4efb-acb1-dcb92e011884\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9n857" Sep 11 18:56:49.119817 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:49.119733 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9n857" Sep 11 18:56:49.389769 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:49.389747 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9n857"] Sep 11 18:56:49.391917 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:56:49.391877 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fc0214c_fef3_4efb_acb1_dcb92e011884.slice/crio-913bdeb5395d4b3ce1ab44c3d30e0ab04f6bbf65a31e73cce92941a21e0ce6e5 WatchSource:0}: Error finding container 913bdeb5395d4b3ce1ab44c3d30e0ab04f6bbf65a31e73cce92941a21e0ce6e5: Status 404 returned error can't find the container with id 913bdeb5395d4b3ce1ab44c3d30e0ab04f6bbf65a31e73cce92941a21e0ce6e5 Sep 11 18:56:50.339506 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:50.339435 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9n857" event={"ID":"4fc0214c-fef3-4efb-acb1-dcb92e011884","Type":"ContainerStarted","Data":"913bdeb5395d4b3ce1ab44c3d30e0ab04f6bbf65a31e73cce92941a21e0ce6e5"} Sep 11 18:56:50.359755 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:50.359704 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e5c5345-38b8-4a44-ac64-26cc33498f22" path="/var/lib/kubelet/pods/9e5c5345-38b8-4a44-ac64-26cc33498f22/volumes" Sep 11 18:56:54.360216 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:54.360183 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9n857" event={"ID":"4fc0214c-fef3-4efb-acb1-dcb92e011884","Type":"ContainerStarted","Data":"3957f95acb2192e1edbc0f5a68c9decf28f5c4ad7f670811ff9acd0e12997fac"} Sep 11 18:56:54.360636 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:54.360247 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9n857" Sep 11 18:56:54.379383 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:56:54.379332 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9n857" podStartSLOduration=1.826737544 podStartE2EDuration="6.379315331s" totalImagesPullingTime="4.552577787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:56:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:56:54.376913969 +0000 UTC m=+518.556846678" watchObservedRunningTime="2026-09-11 18:56:54.379315331 +0000 UTC m=+518.559248033" Sep 11 18:57:00.396017 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:00.395978 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9n857" Sep 11 18:57:00.945015 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:00.944979 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-kl95m"] Sep 11 18:57:00.949958 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:00.949934 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-kl95m" Sep 11 18:57:00.954866 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:00.954843 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-kl95m"] Sep 11 18:57:01.027136 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.027098 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-kl95m"] Sep 11 18:57:01.027371 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:57:01.027349 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-vjchp], unattached volumes=[], failed to process volumes=[kube-api-access-vjchp]: context canceled" pod="kuadrant-system/authorino-557f876f69-kl95m" podUID="b33bc0a1-414a-4e26-92b6-a5301514611c" Sep 11 18:57:01.055085 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.055050 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-mxgcg"] Sep 11 18:57:01.058548 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.058525 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-mxgcg" Sep 11 18:57:01.061488 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.061464 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 11 18:57:01.066270 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.066250 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-mxgcg"] Sep 11 18:57:01.109336 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.109300 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjchp\" (UniqueName: \"kubernetes.io/projected/b33bc0a1-414a-4e26-92b6-a5301514611c-kube-api-access-vjchp\") pod \"authorino-557f876f69-kl95m\" (UID: \"b33bc0a1-414a-4e26-92b6-a5301514611c\") " pod="kuadrant-system/authorino-557f876f69-kl95m" Sep 11 18:57:01.191908 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.191862 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-mxgcg"] Sep 11 18:57:01.192189 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:57:01.192164 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-c886z tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-mxgcg" podUID="e2fbde42-e001-46e2-bdc8-0092977d8096" Sep 11 18:57:01.209868 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.209789 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjchp\" (UniqueName: \"kubernetes.io/projected/b33bc0a1-414a-4e26-92b6-a5301514611c-kube-api-access-vjchp\") pod \"authorino-557f876f69-kl95m\" (UID: \"b33bc0a1-414a-4e26-92b6-a5301514611c\") " pod="kuadrant-system/authorino-557f876f69-kl95m" Sep 11 18:57:01.210036 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.209888 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e2fbde42-e001-46e2-bdc8-0092977d8096-tls-cert\") pod \"authorino-6d4dfc649f-mxgcg\" (UID: \"e2fbde42-e001-46e2-bdc8-0092977d8096\") " pod="kuadrant-system/authorino-6d4dfc649f-mxgcg" Sep 11 18:57:01.210036 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.209931 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c886z\" (UniqueName: \"kubernetes.io/projected/e2fbde42-e001-46e2-bdc8-0092977d8096-kube-api-access-c886z\") pod \"authorino-6d4dfc649f-mxgcg\" (UID: \"e2fbde42-e001-46e2-bdc8-0092977d8096\") " pod="kuadrant-system/authorino-6d4dfc649f-mxgcg" Sep 11 18:57:01.224560 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.224531 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjchp\" (UniqueName: \"kubernetes.io/projected/b33bc0a1-414a-4e26-92b6-a5301514611c-kube-api-access-vjchp\") pod \"authorino-557f876f69-kl95m\" (UID: \"b33bc0a1-414a-4e26-92b6-a5301514611c\") " pod="kuadrant-system/authorino-557f876f69-kl95m" Sep 11 18:57:01.227846 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.227818 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7fc4bf9bc-kvxw7"] Sep 11 18:57:01.231397 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.231371 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fc4bf9bc-kvxw7" Sep 11 18:57:01.240432 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.240408 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7fc4bf9bc-kvxw7"] Sep 11 18:57:01.310651 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.310614 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e2fbde42-e001-46e2-bdc8-0092977d8096-tls-cert\") pod \"authorino-6d4dfc649f-mxgcg\" (UID: \"e2fbde42-e001-46e2-bdc8-0092977d8096\") " pod="kuadrant-system/authorino-6d4dfc649f-mxgcg" Sep 11 18:57:01.310879 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.310669 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snwvx\" (UniqueName: \"kubernetes.io/projected/3b77e47e-49a2-4e1d-8851-a9077a7cb62f-kube-api-access-snwvx\") pod \"authorino-7fc4bf9bc-kvxw7\" (UID: \"3b77e47e-49a2-4e1d-8851-a9077a7cb62f\") " pod="kuadrant-system/authorino-7fc4bf9bc-kvxw7" Sep 11 18:57:01.310879 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.310702 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c886z\" (UniqueName: \"kubernetes.io/projected/e2fbde42-e001-46e2-bdc8-0092977d8096-kube-api-access-c886z\") pod \"authorino-6d4dfc649f-mxgcg\" (UID: \"e2fbde42-e001-46e2-bdc8-0092977d8096\") " pod="kuadrant-system/authorino-6d4dfc649f-mxgcg" Sep 11 18:57:01.310879 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.310726 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3b77e47e-49a2-4e1d-8851-a9077a7cb62f-tls-cert\") pod \"authorino-7fc4bf9bc-kvxw7\" (UID: \"3b77e47e-49a2-4e1d-8851-a9077a7cb62f\") " pod="kuadrant-system/authorino-7fc4bf9bc-kvxw7" Sep 11 18:57:01.313188 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.313155 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e2fbde42-e001-46e2-bdc8-0092977d8096-tls-cert\") pod \"authorino-6d4dfc649f-mxgcg\" (UID: \"e2fbde42-e001-46e2-bdc8-0092977d8096\") " pod="kuadrant-system/authorino-6d4dfc649f-mxgcg" Sep 11 18:57:01.324279 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.324259 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c886z\" (UniqueName: \"kubernetes.io/projected/e2fbde42-e001-46e2-bdc8-0092977d8096-kube-api-access-c886z\") pod \"authorino-6d4dfc649f-mxgcg\" (UID: \"e2fbde42-e001-46e2-bdc8-0092977d8096\") " pod="kuadrant-system/authorino-6d4dfc649f-mxgcg" Sep 11 18:57:01.392516 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.392492 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-kl95m" Sep 11 18:57:01.392707 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.392492 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-mxgcg" Sep 11 18:57:01.399416 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.399397 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-kl95m" Sep 11 18:57:01.402632 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.402573 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-mxgcg" Sep 11 18:57:01.411987 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.411968 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snwvx\" (UniqueName: \"kubernetes.io/projected/3b77e47e-49a2-4e1d-8851-a9077a7cb62f-kube-api-access-snwvx\") pod \"authorino-7fc4bf9bc-kvxw7\" (UID: \"3b77e47e-49a2-4e1d-8851-a9077a7cb62f\") " pod="kuadrant-system/authorino-7fc4bf9bc-kvxw7" Sep 11 18:57:01.412058 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.411997 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3b77e47e-49a2-4e1d-8851-a9077a7cb62f-tls-cert\") pod \"authorino-7fc4bf9bc-kvxw7\" (UID: \"3b77e47e-49a2-4e1d-8851-a9077a7cb62f\") " pod="kuadrant-system/authorino-7fc4bf9bc-kvxw7" Sep 11 18:57:01.414393 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.414364 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3b77e47e-49a2-4e1d-8851-a9077a7cb62f-tls-cert\") pod \"authorino-7fc4bf9bc-kvxw7\" (UID: \"3b77e47e-49a2-4e1d-8851-a9077a7cb62f\") " pod="kuadrant-system/authorino-7fc4bf9bc-kvxw7" Sep 11 18:57:01.423330 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.423310 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snwvx\" (UniqueName: \"kubernetes.io/projected/3b77e47e-49a2-4e1d-8851-a9077a7cb62f-kube-api-access-snwvx\") pod \"authorino-7fc4bf9bc-kvxw7\" (UID: \"3b77e47e-49a2-4e1d-8851-a9077a7cb62f\") " pod="kuadrant-system/authorino-7fc4bf9bc-kvxw7" Sep 11 18:57:01.512388 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.512361 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjchp\" (UniqueName: \"kubernetes.io/projected/b33bc0a1-414a-4e26-92b6-a5301514611c-kube-api-access-vjchp\") pod \"b33bc0a1-414a-4e26-92b6-a5301514611c\" (UID: \"b33bc0a1-414a-4e26-92b6-a5301514611c\") " Sep 11 18:57:01.512552 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.512429 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c886z\" (UniqueName: \"kubernetes.io/projected/e2fbde42-e001-46e2-bdc8-0092977d8096-kube-api-access-c886z\") pod \"e2fbde42-e001-46e2-bdc8-0092977d8096\" (UID: \"e2fbde42-e001-46e2-bdc8-0092977d8096\") " Sep 11 18:57:01.512552 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.512478 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e2fbde42-e001-46e2-bdc8-0092977d8096-tls-cert\") pod \"e2fbde42-e001-46e2-bdc8-0092977d8096\" (UID: \"e2fbde42-e001-46e2-bdc8-0092977d8096\") " Sep 11 18:57:01.514298 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.514266 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2fbde42-e001-46e2-bdc8-0092977d8096-kube-api-access-c886z" (OuterVolumeSpecName: "kube-api-access-c886z") pod "e2fbde42-e001-46e2-bdc8-0092977d8096" (UID: "e2fbde42-e001-46e2-bdc8-0092977d8096"). InnerVolumeSpecName "kube-api-access-c886z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 18:57:01.514401 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.514327 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b33bc0a1-414a-4e26-92b6-a5301514611c-kube-api-access-vjchp" (OuterVolumeSpecName: "kube-api-access-vjchp") pod "b33bc0a1-414a-4e26-92b6-a5301514611c" (UID: "b33bc0a1-414a-4e26-92b6-a5301514611c"). InnerVolumeSpecName "kube-api-access-vjchp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 18:57:01.514401 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.514352 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2fbde42-e001-46e2-bdc8-0092977d8096-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e2fbde42-e001-46e2-bdc8-0092977d8096" (UID: "e2fbde42-e001-46e2-bdc8-0092977d8096"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 18:57:01.541314 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.541284 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fc4bf9bc-kvxw7" Sep 11 18:57:01.614157 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.614125 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjchp\" (UniqueName: \"kubernetes.io/projected/b33bc0a1-414a-4e26-92b6-a5301514611c-kube-api-access-vjchp\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:57:01.614157 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.614155 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c886z\" (UniqueName: \"kubernetes.io/projected/e2fbde42-e001-46e2-bdc8-0092977d8096-kube-api-access-c886z\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:57:01.614354 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.614166 2583 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e2fbde42-e001-46e2-bdc8-0092977d8096-tls-cert\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:57:01.810127 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:01.810102 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7fc4bf9bc-kvxw7"] Sep 11 18:57:01.812356 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:57:01.812330 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b77e47e_49a2_4e1d_8851_a9077a7cb62f.slice/crio-78f26f210b4f2211d59a33d1ff195b79c70efc07417ed9eb9913d07642908b31 WatchSource:0}: Error finding container 78f26f210b4f2211d59a33d1ff195b79c70efc07417ed9eb9913d07642908b31: Status 404 returned error can't find the container with id 78f26f210b4f2211d59a33d1ff195b79c70efc07417ed9eb9913d07642908b31 Sep 11 18:57:02.398237 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:02.398201 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7fc4bf9bc-kvxw7" event={"ID":"3b77e47e-49a2-4e1d-8851-a9077a7cb62f","Type":"ContainerStarted","Data":"78f26f210b4f2211d59a33d1ff195b79c70efc07417ed9eb9913d07642908b31"} Sep 11 18:57:02.398419 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:02.398240 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-kl95m" Sep 11 18:57:02.398419 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:02.398212 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-mxgcg" Sep 11 18:57:02.434277 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:02.434250 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-mxgcg"] Sep 11 18:57:02.436382 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:02.436360 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-mxgcg"] Sep 11 18:57:02.467451 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:02.467428 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-kl95m"] Sep 11 18:57:02.471848 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:02.471812 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-kl95m"] Sep 11 18:57:03.405505 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:03.405466 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7fc4bf9bc-kvxw7" event={"ID":"3b77e47e-49a2-4e1d-8851-a9077a7cb62f","Type":"ContainerStarted","Data":"5414e9d3d4a0e345e647f05c0e2215052ac3bd5e8bc53668118e0528f80a5669"} Sep 11 18:57:03.422241 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:03.422188 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7fc4bf9bc-kvxw7" podStartSLOduration=1.835672632 podStartE2EDuration="2.42217011s" totalImagesPullingTime="586.497478ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:57:03.421465656 +0000 UTC m=+527.601398376" watchObservedRunningTime="2026-09-11 18:57:03.42217011 +0000 UTC m=+527.602102819" Sep 11 18:57:03.451076 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:03.451032 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-v6qlr"] Sep 11 18:57:03.451520 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:03.451266 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-v6qlr" podUID="c1feda9b-eed3-41a6-9934-f860730e7ec4" containerName="authorino" containerID="cri-o://4518e529fa27610f301fe60386aa5e71cb6235b2eb27f57da4648792b6847632" gracePeriod=30 Sep 11 18:57:03.754365 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:03.754336 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-v6qlr" Sep 11 18:57:03.936348 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:03.936315 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjv2z\" (UniqueName: \"kubernetes.io/projected/c1feda9b-eed3-41a6-9934-f860730e7ec4-kube-api-access-jjv2z\") pod \"c1feda9b-eed3-41a6-9934-f860730e7ec4\" (UID: \"c1feda9b-eed3-41a6-9934-f860730e7ec4\") " Sep 11 18:57:03.938406 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:03.938384 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1feda9b-eed3-41a6-9934-f860730e7ec4-kube-api-access-jjv2z" (OuterVolumeSpecName: "kube-api-access-jjv2z") pod "c1feda9b-eed3-41a6-9934-f860730e7ec4" (UID: "c1feda9b-eed3-41a6-9934-f860730e7ec4"). InnerVolumeSpecName "kube-api-access-jjv2z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 18:57:04.037149 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:04.037116 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjv2z\" (UniqueName: \"kubernetes.io/projected/c1feda9b-eed3-41a6-9934-f860730e7ec4-kube-api-access-jjv2z\") on node \"ip-10-0-133-25.ec2.internal\" DevicePath \"\"" Sep 11 18:57:04.358416 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:04.358341 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b33bc0a1-414a-4e26-92b6-a5301514611c" path="/var/lib/kubelet/pods/b33bc0a1-414a-4e26-92b6-a5301514611c/volumes" Sep 11 18:57:04.358623 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:04.358610 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2fbde42-e001-46e2-bdc8-0092977d8096" path="/var/lib/kubelet/pods/e2fbde42-e001-46e2-bdc8-0092977d8096/volumes" Sep 11 18:57:04.411700 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:04.411669 2583 generic.go:356] "Generic (PLEG): container finished" podID="c1feda9b-eed3-41a6-9934-f860730e7ec4" containerID="4518e529fa27610f301fe60386aa5e71cb6235b2eb27f57da4648792b6847632" exitCode=0 Sep 11 18:57:04.411866 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:04.411709 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-v6qlr" Sep 11 18:57:04.411866 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:04.411751 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-v6qlr" event={"ID":"c1feda9b-eed3-41a6-9934-f860730e7ec4","Type":"ContainerDied","Data":"4518e529fa27610f301fe60386aa5e71cb6235b2eb27f57da4648792b6847632"} Sep 11 18:57:04.411866 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:04.411789 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-v6qlr" event={"ID":"c1feda9b-eed3-41a6-9934-f860730e7ec4","Type":"ContainerDied","Data":"a32a63d4f7869cad2055a0c19622e2bc17bfa42f4dc236c24a466605196a9814"} Sep 11 18:57:04.411866 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:04.411811 2583 scope.go:117] "RemoveContainer" containerID="4518e529fa27610f301fe60386aa5e71cb6235b2eb27f57da4648792b6847632" Sep 11 18:57:04.421749 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:04.421714 2583 scope.go:117] "RemoveContainer" containerID="4518e529fa27610f301fe60386aa5e71cb6235b2eb27f57da4648792b6847632" Sep 11 18:57:04.422228 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:57:04.422209 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4518e529fa27610f301fe60386aa5e71cb6235b2eb27f57da4648792b6847632\": container with ID starting with 4518e529fa27610f301fe60386aa5e71cb6235b2eb27f57da4648792b6847632 not found: ID does not exist" containerID="4518e529fa27610f301fe60386aa5e71cb6235b2eb27f57da4648792b6847632" Sep 11 18:57:04.422291 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:04.422242 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4518e529fa27610f301fe60386aa5e71cb6235b2eb27f57da4648792b6847632"} err="failed to get container status \"4518e529fa27610f301fe60386aa5e71cb6235b2eb27f57da4648792b6847632\": rpc error: code = NotFound desc = could not find container \"4518e529fa27610f301fe60386aa5e71cb6235b2eb27f57da4648792b6847632\": container with ID starting with 4518e529fa27610f301fe60386aa5e71cb6235b2eb27f57da4648792b6847632 not found: ID does not exist" Sep 11 18:57:04.427785 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:04.427761 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-v6qlr"] Sep 11 18:57:04.431473 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:04.431445 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-v6qlr"] Sep 11 18:57:06.357650 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:06.357612 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1feda9b-eed3-41a6-9934-f860730e7ec4" path="/var/lib/kubelet/pods/c1feda9b-eed3-41a6-9934-f860730e7ec4/volumes" Sep 11 18:57:08.115371 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.115336 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-94fd9d49d-t75cr"] Sep 11 18:57:08.115727 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.115692 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1feda9b-eed3-41a6-9934-f860730e7ec4" containerName="authorino" Sep 11 18:57:08.115727 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.115704 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1feda9b-eed3-41a6-9934-f860730e7ec4" containerName="authorino" Sep 11 18:57:08.115806 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.115758 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1feda9b-eed3-41a6-9934-f860730e7ec4" containerName="authorino" Sep 11 18:57:08.122859 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.122838 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-94fd9d49d-t75cr" Sep 11 18:57:08.126340 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.126318 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 11 18:57:08.126340 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.126330 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-b457m\"" Sep 11 18:57:08.126516 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.126433 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 11 18:57:08.126516 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.126449 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 11 18:57:08.130644 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.130620 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-94fd9d49d-t75cr"] Sep 11 18:57:08.276484 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.276444 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a769d90b-b2e1-43d5-b0b1-576b4df37319-webhook-cert\") pod \"maas-controller-94fd9d49d-t75cr\" (UID: \"a769d90b-b2e1-43d5-b0b1-576b4df37319\") " pod="opendatahub/maas-controller-94fd9d49d-t75cr" Sep 11 18:57:08.276683 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.276552 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a769d90b-b2e1-43d5-b0b1-576b4df37319-metrics-certs\") pod \"maas-controller-94fd9d49d-t75cr\" (UID: \"a769d90b-b2e1-43d5-b0b1-576b4df37319\") " pod="opendatahub/maas-controller-94fd9d49d-t75cr" Sep 11 18:57:08.276683 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.276577 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjbf7\" (UniqueName: \"kubernetes.io/projected/a769d90b-b2e1-43d5-b0b1-576b4df37319-kube-api-access-mjbf7\") pod \"maas-controller-94fd9d49d-t75cr\" (UID: \"a769d90b-b2e1-43d5-b0b1-576b4df37319\") " pod="opendatahub/maas-controller-94fd9d49d-t75cr" Sep 11 18:57:08.299248 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.299213 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68b494756f-xrlrw"] Sep 11 18:57:08.302748 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.302723 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68b494756f-xrlrw" Sep 11 18:57:08.313056 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.313036 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68b494756f-xrlrw"] Sep 11 18:57:08.377033 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.376959 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a769d90b-b2e1-43d5-b0b1-576b4df37319-webhook-cert\") pod \"maas-controller-94fd9d49d-t75cr\" (UID: \"a769d90b-b2e1-43d5-b0b1-576b4df37319\") " pod="opendatahub/maas-controller-94fd9d49d-t75cr" Sep 11 18:57:08.377179 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.377043 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a769d90b-b2e1-43d5-b0b1-576b4df37319-metrics-certs\") pod \"maas-controller-94fd9d49d-t75cr\" (UID: \"a769d90b-b2e1-43d5-b0b1-576b4df37319\") " pod="opendatahub/maas-controller-94fd9d49d-t75cr" Sep 11 18:57:08.377179 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.377070 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjbf7\" (UniqueName: \"kubernetes.io/projected/a769d90b-b2e1-43d5-b0b1-576b4df37319-kube-api-access-mjbf7\") pod \"maas-controller-94fd9d49d-t75cr\" (UID: \"a769d90b-b2e1-43d5-b0b1-576b4df37319\") " pod="opendatahub/maas-controller-94fd9d49d-t75cr" Sep 11 18:57:08.377179 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:57:08.377110 2583 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Sep 11 18:57:08.377179 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:57:08.377171 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a769d90b-b2e1-43d5-b0b1-576b4df37319-webhook-cert podName:a769d90b-b2e1-43d5-b0b1-576b4df37319 nodeName:}" failed. No retries permitted until 2026-09-11 18:57:08.877150712 +0000 UTC m=+533.057083404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/a769d90b-b2e1-43d5-b0b1-576b4df37319-webhook-cert") pod "maas-controller-94fd9d49d-t75cr" (UID: "a769d90b-b2e1-43d5-b0b1-576b4df37319") : secret "maas-controller-webhook-cert" not found Sep 11 18:57:08.379436 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.379414 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a769d90b-b2e1-43d5-b0b1-576b4df37319-metrics-certs\") pod \"maas-controller-94fd9d49d-t75cr\" (UID: \"a769d90b-b2e1-43d5-b0b1-576b4df37319\") " pod="opendatahub/maas-controller-94fd9d49d-t75cr" Sep 11 18:57:08.387363 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.387337 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjbf7\" (UniqueName: \"kubernetes.io/projected/a769d90b-b2e1-43d5-b0b1-576b4df37319-kube-api-access-mjbf7\") pod \"maas-controller-94fd9d49d-t75cr\" (UID: \"a769d90b-b2e1-43d5-b0b1-576b4df37319\") " pod="opendatahub/maas-controller-94fd9d49d-t75cr" Sep 11 18:57:08.477694 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.477611 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr6mq\" (UniqueName: \"kubernetes.io/projected/41c8c3d6-82ec-4d0e-bd9f-94f2a271f994-kube-api-access-dr6mq\") pod \"maas-controller-68b494756f-xrlrw\" (UID: \"41c8c3d6-82ec-4d0e-bd9f-94f2a271f994\") " pod="opendatahub/maas-controller-68b494756f-xrlrw" Sep 11 18:57:08.477845 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.477725 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41c8c3d6-82ec-4d0e-bd9f-94f2a271f994-webhook-cert\") pod \"maas-controller-68b494756f-xrlrw\" (UID: \"41c8c3d6-82ec-4d0e-bd9f-94f2a271f994\") " pod="opendatahub/maas-controller-68b494756f-xrlrw" Sep 11 18:57:08.477845 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.477761 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41c8c3d6-82ec-4d0e-bd9f-94f2a271f994-metrics-certs\") pod \"maas-controller-68b494756f-xrlrw\" (UID: \"41c8c3d6-82ec-4d0e-bd9f-94f2a271f994\") " pod="opendatahub/maas-controller-68b494756f-xrlrw" Sep 11 18:57:08.579069 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.579035 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr6mq\" (UniqueName: \"kubernetes.io/projected/41c8c3d6-82ec-4d0e-bd9f-94f2a271f994-kube-api-access-dr6mq\") pod \"maas-controller-68b494756f-xrlrw\" (UID: \"41c8c3d6-82ec-4d0e-bd9f-94f2a271f994\") " pod="opendatahub/maas-controller-68b494756f-xrlrw" Sep 11 18:57:08.579243 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.579105 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41c8c3d6-82ec-4d0e-bd9f-94f2a271f994-webhook-cert\") pod \"maas-controller-68b494756f-xrlrw\" (UID: \"41c8c3d6-82ec-4d0e-bd9f-94f2a271f994\") " pod="opendatahub/maas-controller-68b494756f-xrlrw" Sep 11 18:57:08.579243 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.579124 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41c8c3d6-82ec-4d0e-bd9f-94f2a271f994-metrics-certs\") pod \"maas-controller-68b494756f-xrlrw\" (UID: \"41c8c3d6-82ec-4d0e-bd9f-94f2a271f994\") " pod="opendatahub/maas-controller-68b494756f-xrlrw" Sep 11 18:57:08.579243 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:57:08.579221 2583 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Sep 11 18:57:08.579409 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:57:08.579290 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41c8c3d6-82ec-4d0e-bd9f-94f2a271f994-webhook-cert podName:41c8c3d6-82ec-4d0e-bd9f-94f2a271f994 nodeName:}" failed. No retries permitted until 2026-09-11 18:57:09.079268671 +0000 UTC m=+533.259201371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/41c8c3d6-82ec-4d0e-bd9f-94f2a271f994-webhook-cert") pod "maas-controller-68b494756f-xrlrw" (UID: "41c8c3d6-82ec-4d0e-bd9f-94f2a271f994") : secret "maas-controller-webhook-cert" not found Sep 11 18:57:08.581523 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.581499 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41c8c3d6-82ec-4d0e-bd9f-94f2a271f994-metrics-certs\") pod \"maas-controller-68b494756f-xrlrw\" (UID: \"41c8c3d6-82ec-4d0e-bd9f-94f2a271f994\") " pod="opendatahub/maas-controller-68b494756f-xrlrw" Sep 11 18:57:08.587881 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.587856 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr6mq\" (UniqueName: \"kubernetes.io/projected/41c8c3d6-82ec-4d0e-bd9f-94f2a271f994-kube-api-access-dr6mq\") pod \"maas-controller-68b494756f-xrlrw\" (UID: \"41c8c3d6-82ec-4d0e-bd9f-94f2a271f994\") " pod="opendatahub/maas-controller-68b494756f-xrlrw" Sep 11 18:57:08.882649 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.882615 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a769d90b-b2e1-43d5-b0b1-576b4df37319-webhook-cert\") pod \"maas-controller-94fd9d49d-t75cr\" (UID: \"a769d90b-b2e1-43d5-b0b1-576b4df37319\") " pod="opendatahub/maas-controller-94fd9d49d-t75cr" Sep 11 18:57:08.885013 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:08.884987 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a769d90b-b2e1-43d5-b0b1-576b4df37319-webhook-cert\") pod \"maas-controller-94fd9d49d-t75cr\" (UID: \"a769d90b-b2e1-43d5-b0b1-576b4df37319\") " pod="opendatahub/maas-controller-94fd9d49d-t75cr" Sep 11 18:57:09.033981 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:09.033949 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-94fd9d49d-t75cr" Sep 11 18:57:09.085216 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:09.085180 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41c8c3d6-82ec-4d0e-bd9f-94f2a271f994-webhook-cert\") pod \"maas-controller-68b494756f-xrlrw\" (UID: \"41c8c3d6-82ec-4d0e-bd9f-94f2a271f994\") " pod="opendatahub/maas-controller-68b494756f-xrlrw" Sep 11 18:57:09.087945 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:09.087918 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41c8c3d6-82ec-4d0e-bd9f-94f2a271f994-webhook-cert\") pod \"maas-controller-68b494756f-xrlrw\" (UID: \"41c8c3d6-82ec-4d0e-bd9f-94f2a271f994\") " pod="opendatahub/maas-controller-68b494756f-xrlrw" Sep 11 18:57:09.212714 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:09.212603 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68b494756f-xrlrw" Sep 11 18:57:09.308536 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:09.308487 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-94fd9d49d-t75cr"] Sep 11 18:57:09.310911 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:57:09.310887 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda769d90b_b2e1_43d5_b0b1_576b4df37319.slice/crio-e093e09a6d689ff550338955e9c28e2191ce98ee3c5b4aab6c362ea26db3c2c7 WatchSource:0}: Error finding container e093e09a6d689ff550338955e9c28e2191ce98ee3c5b4aab6c362ea26db3c2c7: Status 404 returned error can't find the container with id e093e09a6d689ff550338955e9c28e2191ce98ee3c5b4aab6c362ea26db3c2c7 Sep 11 18:57:09.434101 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:09.434065 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-94fd9d49d-t75cr" event={"ID":"a769d90b-b2e1-43d5-b0b1-576b4df37319","Type":"ContainerStarted","Data":"e093e09a6d689ff550338955e9c28e2191ce98ee3c5b4aab6c362ea26db3c2c7"} Sep 11 18:57:09.485496 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:09.485471 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68b494756f-xrlrw"] Sep 11 18:57:09.487751 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:57:09.487725 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41c8c3d6_82ec_4d0e_bd9f_94f2a271f994.slice/crio-98e98c3efd8509c76267cd0c044e7194cb2317a8544aca97d864257ccf8fc655 WatchSource:0}: Error finding container 98e98c3efd8509c76267cd0c044e7194cb2317a8544aca97d864257ccf8fc655: Status 404 returned error can't find the container with id 98e98c3efd8509c76267cd0c044e7194cb2317a8544aca97d864257ccf8fc655 Sep 11 18:57:10.440231 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:10.440192 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68b494756f-xrlrw" event={"ID":"41c8c3d6-82ec-4d0e-bd9f-94f2a271f994","Type":"ContainerStarted","Data":"98e98c3efd8509c76267cd0c044e7194cb2317a8544aca97d864257ccf8fc655"} Sep 11 18:57:11.446417 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:11.446380 2583 generic.go:356] "Generic (PLEG): container finished" podID="a769d90b-b2e1-43d5-b0b1-576b4df37319" containerID="2b6efc2d476a7b57f72cf8903d7d97769f9e7ee498f419036492af177ee31035" exitCode=2 Sep 11 18:57:11.446886 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:11.446462 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-94fd9d49d-t75cr" event={"ID":"a769d90b-b2e1-43d5-b0b1-576b4df37319","Type":"ContainerDied","Data":"2b6efc2d476a7b57f72cf8903d7d97769f9e7ee498f419036492af177ee31035"} Sep 11 18:57:11.446886 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:11.446721 2583 scope.go:117] "RemoveContainer" containerID="2b6efc2d476a7b57f72cf8903d7d97769f9e7ee498f419036492af177ee31035" Sep 11 18:57:11.447977 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:11.447954 2583 generic.go:356] "Generic (PLEG): container finished" podID="41c8c3d6-82ec-4d0e-bd9f-94f2a271f994" containerID="fc799578e6fa8d33d8d84b6f37aad09d45c92f76459eebf50a6cbb0876bf7de8" exitCode=2 Sep 11 18:57:11.448073 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:11.448000 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68b494756f-xrlrw" event={"ID":"41c8c3d6-82ec-4d0e-bd9f-94f2a271f994","Type":"ContainerDied","Data":"fc799578e6fa8d33d8d84b6f37aad09d45c92f76459eebf50a6cbb0876bf7de8"} Sep 11 18:57:11.448204 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:11.448193 2583 scope.go:117] "RemoveContainer" containerID="fc799578e6fa8d33d8d84b6f37aad09d45c92f76459eebf50a6cbb0876bf7de8" Sep 11 18:57:12.454978 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:12.454943 2583 generic.go:356] "Generic (PLEG): container finished" podID="a769d90b-b2e1-43d5-b0b1-576b4df37319" containerID="01eb4e2d3089f08bdb59b8d864fdd7a40ae5ed889c08f895eefa832d7bded21b" exitCode=2 Sep 11 18:57:12.455399 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:12.455032 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-94fd9d49d-t75cr" event={"ID":"a769d90b-b2e1-43d5-b0b1-576b4df37319","Type":"ContainerDied","Data":"01eb4e2d3089f08bdb59b8d864fdd7a40ae5ed889c08f895eefa832d7bded21b"} Sep 11 18:57:12.455399 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:12.455096 2583 scope.go:117] "RemoveContainer" containerID="2b6efc2d476a7b57f72cf8903d7d97769f9e7ee498f419036492af177ee31035" Sep 11 18:57:12.455399 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:12.455354 2583 scope.go:117] "RemoveContainer" containerID="01eb4e2d3089f08bdb59b8d864fdd7a40ae5ed889c08f895eefa832d7bded21b" Sep 11 18:57:12.455570 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:57:12.455548 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-94fd9d49d-t75cr_opendatahub(a769d90b-b2e1-43d5-b0b1-576b4df37319)\"" pod="opendatahub/maas-controller-94fd9d49d-t75cr" podUID="a769d90b-b2e1-43d5-b0b1-576b4df37319" Sep 11 18:57:12.456833 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:12.456808 2583 generic.go:356] "Generic (PLEG): container finished" podID="41c8c3d6-82ec-4d0e-bd9f-94f2a271f994" containerID="28398286c2f9b89c47880697afa53b03a87dea31745368e144be8d3838a3a66c" exitCode=2 Sep 11 18:57:12.456936 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:12.456849 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68b494756f-xrlrw" event={"ID":"41c8c3d6-82ec-4d0e-bd9f-94f2a271f994","Type":"ContainerDied","Data":"28398286c2f9b89c47880697afa53b03a87dea31745368e144be8d3838a3a66c"} Sep 11 18:57:12.457104 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:12.457089 2583 scope.go:117] "RemoveContainer" containerID="28398286c2f9b89c47880697afa53b03a87dea31745368e144be8d3838a3a66c" Sep 11 18:57:12.457271 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:57:12.457252 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-68b494756f-xrlrw_opendatahub(41c8c3d6-82ec-4d0e-bd9f-94f2a271f994)\"" pod="opendatahub/maas-controller-68b494756f-xrlrw" podUID="41c8c3d6-82ec-4d0e-bd9f-94f2a271f994" Sep 11 18:57:12.465618 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:12.465602 2583 scope.go:117] "RemoveContainer" containerID="fc799578e6fa8d33d8d84b6f37aad09d45c92f76459eebf50a6cbb0876bf7de8" Sep 11 18:57:13.462673 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:13.462641 2583 scope.go:117] "RemoveContainer" containerID="01eb4e2d3089f08bdb59b8d864fdd7a40ae5ed889c08f895eefa832d7bded21b" Sep 11 18:57:13.463087 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:57:13.462818 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-94fd9d49d-t75cr_opendatahub(a769d90b-b2e1-43d5-b0b1-576b4df37319)\"" pod="opendatahub/maas-controller-94fd9d49d-t75cr" podUID="a769d90b-b2e1-43d5-b0b1-576b4df37319" Sep 11 18:57:13.464183 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:13.464162 2583 scope.go:117] "RemoveContainer" containerID="28398286c2f9b89c47880697afa53b03a87dea31745368e144be8d3838a3a66c" Sep 11 18:57:13.464321 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:57:13.464300 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-68b494756f-xrlrw_opendatahub(41c8c3d6-82ec-4d0e-bd9f-94f2a271f994)\"" pod="opendatahub/maas-controller-68b494756f-xrlrw" podUID="41c8c3d6-82ec-4d0e-bd9f-94f2a271f994" Sep 11 18:57:19.034244 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:19.034209 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-94fd9d49d-t75cr" Sep 11 18:57:19.034629 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:19.034603 2583 scope.go:117] "RemoveContainer" containerID="01eb4e2d3089f08bdb59b8d864fdd7a40ae5ed889c08f895eefa832d7bded21b" Sep 11 18:57:19.034803 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:57:19.034784 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-94fd9d49d-t75cr_opendatahub(a769d90b-b2e1-43d5-b0b1-576b4df37319)\"" pod="opendatahub/maas-controller-94fd9d49d-t75cr" podUID="a769d90b-b2e1-43d5-b0b1-576b4df37319" Sep 11 18:57:19.213460 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:19.213426 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68b494756f-xrlrw" Sep 11 18:57:19.213848 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:19.213831 2583 scope.go:117] "RemoveContainer" containerID="28398286c2f9b89c47880697afa53b03a87dea31745368e144be8d3838a3a66c" Sep 11 18:57:19.214044 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:57:19.214022 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-68b494756f-xrlrw_opendatahub(41c8c3d6-82ec-4d0e-bd9f-94f2a271f994)\"" pod="opendatahub/maas-controller-68b494756f-xrlrw" podUID="41c8c3d6-82ec-4d0e-bd9f-94f2a271f994" Sep 11 18:57:29.034508 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:29.034461 2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-94fd9d49d-t75cr" Sep 11 18:57:29.035016 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:29.034997 2583 scope.go:117] "RemoveContainer" containerID="01eb4e2d3089f08bdb59b8d864fdd7a40ae5ed889c08f895eefa832d7bded21b" Sep 11 18:57:29.213028 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:29.212985 2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-68b494756f-xrlrw" Sep 11 18:57:29.213399 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:29.213385 2583 scope.go:117] "RemoveContainer" containerID="28398286c2f9b89c47880697afa53b03a87dea31745368e144be8d3838a3a66c" Sep 11 18:57:29.536154 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:29.536130 2583 generic.go:356] "Generic (PLEG): container finished" podID="a769d90b-b2e1-43d5-b0b1-576b4df37319" containerID="d7aa27509e32ff050d6667beaaddf4949cb52d42e6cbe006c79f7a96b6d4965d" exitCode=2 Sep 11 18:57:29.536270 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:29.536203 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-94fd9d49d-t75cr" event={"ID":"a769d90b-b2e1-43d5-b0b1-576b4df37319","Type":"ContainerDied","Data":"d7aa27509e32ff050d6667beaaddf4949cb52d42e6cbe006c79f7a96b6d4965d"} Sep 11 18:57:29.536329 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:29.536276 2583 scope.go:117] "RemoveContainer" containerID="01eb4e2d3089f08bdb59b8d864fdd7a40ae5ed889c08f895eefa832d7bded21b" Sep 11 18:57:29.536669 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:29.536645 2583 scope.go:117] "RemoveContainer" containerID="d7aa27509e32ff050d6667beaaddf4949cb52d42e6cbe006c79f7a96b6d4965d" Sep 11 18:57:29.536888 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:57:29.536869 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-94fd9d49d-t75cr_opendatahub(a769d90b-b2e1-43d5-b0b1-576b4df37319)\"" pod="opendatahub/maas-controller-94fd9d49d-t75cr" podUID="a769d90b-b2e1-43d5-b0b1-576b4df37319" Sep 11 18:57:30.544504 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:30.544470 2583 generic.go:356] "Generic (PLEG): container finished" podID="41c8c3d6-82ec-4d0e-bd9f-94f2a271f994" containerID="465e997e441a6b8879b7d369ee6ef22a0fa40e78eedfe8e10cd2b5bf67a1f8ba" exitCode=2 Sep 11 18:57:30.544942 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:30.544540 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68b494756f-xrlrw" event={"ID":"41c8c3d6-82ec-4d0e-bd9f-94f2a271f994","Type":"ContainerDied","Data":"465e997e441a6b8879b7d369ee6ef22a0fa40e78eedfe8e10cd2b5bf67a1f8ba"} Sep 11 18:57:30.544942 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:30.544609 2583 scope.go:117] "RemoveContainer" containerID="28398286c2f9b89c47880697afa53b03a87dea31745368e144be8d3838a3a66c" Sep 11 18:57:30.545048 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:30.544954 2583 scope.go:117] "RemoveContainer" containerID="465e997e441a6b8879b7d369ee6ef22a0fa40e78eedfe8e10cd2b5bf67a1f8ba" Sep 11 18:57:30.545154 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:57:30.545135 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-68b494756f-xrlrw_opendatahub(41c8c3d6-82ec-4d0e-bd9f-94f2a271f994)\"" pod="opendatahub/maas-controller-68b494756f-xrlrw" podUID="41c8c3d6-82ec-4d0e-bd9f-94f2a271f994" Sep 11 18:57:39.034173 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:39.034139 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-94fd9d49d-t75cr" Sep 11 18:57:39.034837 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:39.034516 2583 scope.go:117] "RemoveContainer" containerID="d7aa27509e32ff050d6667beaaddf4949cb52d42e6cbe006c79f7a96b6d4965d" Sep 11 18:57:39.034837 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:57:39.034702 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-94fd9d49d-t75cr_opendatahub(a769d90b-b2e1-43d5-b0b1-576b4df37319)\"" pod="opendatahub/maas-controller-94fd9d49d-t75cr" podUID="a769d90b-b2e1-43d5-b0b1-576b4df37319" Sep 11 18:57:39.213376 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:39.213338 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68b494756f-xrlrw" Sep 11 18:57:39.213729 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:39.213716 2583 scope.go:117] "RemoveContainer" containerID="465e997e441a6b8879b7d369ee6ef22a0fa40e78eedfe8e10cd2b5bf67a1f8ba" Sep 11 18:57:39.213890 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:57:39.213873 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-68b494756f-xrlrw_opendatahub(41c8c3d6-82ec-4d0e-bd9f-94f2a271f994)\"" pod="opendatahub/maas-controller-68b494756f-xrlrw" podUID="41c8c3d6-82ec-4d0e-bd9f-94f2a271f994" Sep 11 18:57:49.034624 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:49.034563 2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-94fd9d49d-t75cr" Sep 11 18:57:49.035024 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:49.034951 2583 scope.go:117] "RemoveContainer" containerID="d7aa27509e32ff050d6667beaaddf4949cb52d42e6cbe006c79f7a96b6d4965d" Sep 11 18:57:49.035129 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:57:49.035108 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-94fd9d49d-t75cr_opendatahub(a769d90b-b2e1-43d5-b0b1-576b4df37319)\"" pod="opendatahub/maas-controller-94fd9d49d-t75cr" podUID="a769d90b-b2e1-43d5-b0b1-576b4df37319" Sep 11 18:57:49.213745 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:49.213712 2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-68b494756f-xrlrw" Sep 11 18:57:49.214102 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:57:49.214089 2583 scope.go:117] "RemoveContainer" containerID="465e997e441a6b8879b7d369ee6ef22a0fa40e78eedfe8e10cd2b5bf67a1f8ba" Sep 11 18:57:49.214275 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:57:49.214255 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-68b494756f-xrlrw_opendatahub(41c8c3d6-82ec-4d0e-bd9f-94f2a271f994)\"" pod="opendatahub/maas-controller-68b494756f-xrlrw" podUID="41c8c3d6-82ec-4d0e-bd9f-94f2a271f994" Sep 11 18:58:00.352184 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:00.352152 2583 scope.go:117] "RemoveContainer" containerID="465e997e441a6b8879b7d369ee6ef22a0fa40e78eedfe8e10cd2b5bf67a1f8ba" Sep 11 18:58:01.683779 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:01.683743 2583 generic.go:356] "Generic (PLEG): container finished" podID="41c8c3d6-82ec-4d0e-bd9f-94f2a271f994" containerID="f8775d5485dbd19b541fa3607102cbb1c9d3243b6fe83d90b9474d8b2f099b0e" exitCode=2 Sep 11 18:58:01.684229 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:01.683795 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68b494756f-xrlrw" event={"ID":"41c8c3d6-82ec-4d0e-bd9f-94f2a271f994","Type":"ContainerDied","Data":"f8775d5485dbd19b541fa3607102cbb1c9d3243b6fe83d90b9474d8b2f099b0e"} Sep 11 18:58:01.684229 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:01.683864 2583 scope.go:117] "RemoveContainer" containerID="465e997e441a6b8879b7d369ee6ef22a0fa40e78eedfe8e10cd2b5bf67a1f8ba" Sep 11 18:58:01.684343 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:01.684246 2583 scope.go:117] "RemoveContainer" containerID="f8775d5485dbd19b541fa3607102cbb1c9d3243b6fe83d90b9474d8b2f099b0e" Sep 11 18:58:01.684517 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:58:01.684492 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-68b494756f-xrlrw_opendatahub(41c8c3d6-82ec-4d0e-bd9f-94f2a271f994)\"" pod="opendatahub/maas-controller-68b494756f-xrlrw" podUID="41c8c3d6-82ec-4d0e-bd9f-94f2a271f994" Sep 11 18:58:04.351920 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:04.351885 2583 scope.go:117] "RemoveContainer" containerID="d7aa27509e32ff050d6667beaaddf4949cb52d42e6cbe006c79f7a96b6d4965d" Sep 11 18:58:05.704138 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:05.704102 2583 generic.go:356] "Generic (PLEG): container finished" podID="a769d90b-b2e1-43d5-b0b1-576b4df37319" containerID="5dca5122c6f0d3c5c17f8fc188c2e566d2054f44f3467bc80c99bb5dac7d58b4" exitCode=2 Sep 11 18:58:05.704653 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:05.704173 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-94fd9d49d-t75cr" event={"ID":"a769d90b-b2e1-43d5-b0b1-576b4df37319","Type":"ContainerDied","Data":"5dca5122c6f0d3c5c17f8fc188c2e566d2054f44f3467bc80c99bb5dac7d58b4"} Sep 11 18:58:05.704653 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:05.704233 2583 scope.go:117] "RemoveContainer" containerID="d7aa27509e32ff050d6667beaaddf4949cb52d42e6cbe006c79f7a96b6d4965d" Sep 11 18:58:05.704653 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:05.704548 2583 scope.go:117] "RemoveContainer" containerID="5dca5122c6f0d3c5c17f8fc188c2e566d2054f44f3467bc80c99bb5dac7d58b4" Sep 11 18:58:05.704798 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:58:05.704778 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-94fd9d49d-t75cr_opendatahub(a769d90b-b2e1-43d5-b0b1-576b4df37319)\"" pod="opendatahub/maas-controller-94fd9d49d-t75cr" podUID="a769d90b-b2e1-43d5-b0b1-576b4df37319" Sep 11 18:58:09.034491 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:09.034461 2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-94fd9d49d-t75cr" Sep 11 18:58:09.034988 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:09.034524 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-94fd9d49d-t75cr" Sep 11 18:58:09.034988 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:09.034969 2583 scope.go:117] "RemoveContainer" containerID="5dca5122c6f0d3c5c17f8fc188c2e566d2054f44f3467bc80c99bb5dac7d58b4" Sep 11 18:58:09.035193 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:58:09.035168 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-94fd9d49d-t75cr_opendatahub(a769d90b-b2e1-43d5-b0b1-576b4df37319)\"" pod="opendatahub/maas-controller-94fd9d49d-t75cr" podUID="a769d90b-b2e1-43d5-b0b1-576b4df37319" Sep 11 18:58:09.213142 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:09.213095 2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-68b494756f-xrlrw" Sep 11 18:58:09.213314 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:09.213163 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68b494756f-xrlrw" Sep 11 18:58:09.213492 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:09.213480 2583 scope.go:117] "RemoveContainer" containerID="f8775d5485dbd19b541fa3607102cbb1c9d3243b6fe83d90b9474d8b2f099b0e" Sep 11 18:58:09.213701 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:58:09.213670 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-68b494756f-xrlrw_opendatahub(41c8c3d6-82ec-4d0e-bd9f-94f2a271f994)\"" pod="opendatahub/maas-controller-68b494756f-xrlrw" podUID="41c8c3d6-82ec-4d0e-bd9f-94f2a271f994" Sep 11 18:58:20.352987 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:20.352956 2583 scope.go:117] "RemoveContainer" containerID="f8775d5485dbd19b541fa3607102cbb1c9d3243b6fe83d90b9474d8b2f099b0e" Sep 11 18:58:20.353445 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:58:20.353155 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-68b494756f-xrlrw_opendatahub(41c8c3d6-82ec-4d0e-bd9f-94f2a271f994)\"" pod="opendatahub/maas-controller-68b494756f-xrlrw" podUID="41c8c3d6-82ec-4d0e-bd9f-94f2a271f994" Sep 11 18:58:23.352306 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:23.352272 2583 scope.go:117] "RemoveContainer" containerID="5dca5122c6f0d3c5c17f8fc188c2e566d2054f44f3467bc80c99bb5dac7d58b4" Sep 11 18:58:23.352712 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:58:23.352435 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-94fd9d49d-t75cr_opendatahub(a769d90b-b2e1-43d5-b0b1-576b4df37319)\"" pod="opendatahub/maas-controller-94fd9d49d-t75cr" podUID="a769d90b-b2e1-43d5-b0b1-576b4df37319" Sep 11 18:58:34.352678 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:34.352645 2583 scope.go:117] "RemoveContainer" containerID="f8775d5485dbd19b541fa3607102cbb1c9d3243b6fe83d90b9474d8b2f099b0e" Sep 11 18:58:34.353131 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:58:34.352830 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-68b494756f-xrlrw_opendatahub(41c8c3d6-82ec-4d0e-bd9f-94f2a271f994)\"" pod="opendatahub/maas-controller-68b494756f-xrlrw" podUID="41c8c3d6-82ec-4d0e-bd9f-94f2a271f994" Sep 11 18:58:36.354132 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:36.354100 2583 scope.go:117] "RemoveContainer" containerID="5dca5122c6f0d3c5c17f8fc188c2e566d2054f44f3467bc80c99bb5dac7d58b4" Sep 11 18:58:36.354528 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:58:36.354311 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-94fd9d49d-t75cr_opendatahub(a769d90b-b2e1-43d5-b0b1-576b4df37319)\"" pod="opendatahub/maas-controller-94fd9d49d-t75cr" podUID="a769d90b-b2e1-43d5-b0b1-576b4df37319" Sep 11 18:58:48.352966 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:48.352933 2583 scope.go:117] "RemoveContainer" containerID="f8775d5485dbd19b541fa3607102cbb1c9d3243b6fe83d90b9474d8b2f099b0e" Sep 11 18:58:48.355082 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:48.353284 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 11 18:58:48.901371 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:48.901337 2583 generic.go:356] "Generic (PLEG): container finished" podID="41c8c3d6-82ec-4d0e-bd9f-94f2a271f994" containerID="6eabd86bf538fa83817ca646dd2934cd2d1f408e17adab68cfcfb32c6fef01bf" exitCode=2 Sep 11 18:58:48.901570 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:48.901377 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68b494756f-xrlrw" event={"ID":"41c8c3d6-82ec-4d0e-bd9f-94f2a271f994","Type":"ContainerDied","Data":"6eabd86bf538fa83817ca646dd2934cd2d1f408e17adab68cfcfb32c6fef01bf"} Sep 11 18:58:48.901570 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:48.901434 2583 scope.go:117] "RemoveContainer" containerID="f8775d5485dbd19b541fa3607102cbb1c9d3243b6fe83d90b9474d8b2f099b0e" Sep 11 18:58:48.901846 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:48.901824 2583 scope.go:117] "RemoveContainer" containerID="6eabd86bf538fa83817ca646dd2934cd2d1f408e17adab68cfcfb32c6fef01bf" Sep 11 18:58:48.902061 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:58:48.902036 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-68b494756f-xrlrw_opendatahub(41c8c3d6-82ec-4d0e-bd9f-94f2a271f994)\"" pod="opendatahub/maas-controller-68b494756f-xrlrw" podUID="41c8c3d6-82ec-4d0e-bd9f-94f2a271f994" Sep 11 18:58:49.213059 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:49.212970 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68b494756f-xrlrw" Sep 11 18:58:49.213059 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:49.213032 2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-68b494756f-xrlrw" Sep 11 18:58:49.908276 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:49.908247 2583 scope.go:117] "RemoveContainer" containerID="6eabd86bf538fa83817ca646dd2934cd2d1f408e17adab68cfcfb32c6fef01bf" Sep 11 18:58:49.908677 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:58:49.908407 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-68b494756f-xrlrw_opendatahub(41c8c3d6-82ec-4d0e-bd9f-94f2a271f994)\"" pod="opendatahub/maas-controller-68b494756f-xrlrw" podUID="41c8c3d6-82ec-4d0e-bd9f-94f2a271f994" Sep 11 18:58:50.352293 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:50.352259 2583 scope.go:117] "RemoveContainer" containerID="5dca5122c6f0d3c5c17f8fc188c2e566d2054f44f3467bc80c99bb5dac7d58b4" Sep 11 18:58:50.914455 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:50.914425 2583 generic.go:356] "Generic (PLEG): container finished" podID="a769d90b-b2e1-43d5-b0b1-576b4df37319" containerID="1251d1d87d62e36a6103de6d53f74b12c33ab55cf9f97b132a577168e6d7bc77" exitCode=2 Sep 11 18:58:50.914841 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:50.914499 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-94fd9d49d-t75cr" event={"ID":"a769d90b-b2e1-43d5-b0b1-576b4df37319","Type":"ContainerDied","Data":"1251d1d87d62e36a6103de6d53f74b12c33ab55cf9f97b132a577168e6d7bc77"} Sep 11 18:58:50.914841 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:50.914560 2583 scope.go:117] "RemoveContainer" containerID="5dca5122c6f0d3c5c17f8fc188c2e566d2054f44f3467bc80c99bb5dac7d58b4" Sep 11 18:58:50.914943 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:50.914902 2583 scope.go:117] "RemoveContainer" containerID="1251d1d87d62e36a6103de6d53f74b12c33ab55cf9f97b132a577168e6d7bc77" Sep 11 18:58:50.915115 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:58:50.915093 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-94fd9d49d-t75cr_opendatahub(a769d90b-b2e1-43d5-b0b1-576b4df37319)\"" pod="opendatahub/maas-controller-94fd9d49d-t75cr" podUID="a769d90b-b2e1-43d5-b0b1-576b4df37319" Sep 11 18:58:59.035000 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:59.034957 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-94fd9d49d-t75cr" Sep 11 18:58:59.035447 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:58:59.035348 2583 scope.go:117] "RemoveContainer" containerID="1251d1d87d62e36a6103de6d53f74b12c33ab55cf9f97b132a577168e6d7bc77" Sep 11 18:58:59.035545 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:58:59.035524 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-94fd9d49d-t75cr_opendatahub(a769d90b-b2e1-43d5-b0b1-576b4df37319)\"" pod="opendatahub/maas-controller-94fd9d49d-t75cr" podUID="a769d90b-b2e1-43d5-b0b1-576b4df37319" Sep 11 18:59:04.352385 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:04.352345 2583 scope.go:117] "RemoveContainer" containerID="6eabd86bf538fa83817ca646dd2934cd2d1f408e17adab68cfcfb32c6fef01bf" Sep 11 18:59:04.352912 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:59:04.352511 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-68b494756f-xrlrw_opendatahub(41c8c3d6-82ec-4d0e-bd9f-94f2a271f994)\"" pod="opendatahub/maas-controller-68b494756f-xrlrw" podUID="41c8c3d6-82ec-4d0e-bd9f-94f2a271f994" Sep 11 18:59:08.752889 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:08.752860 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7fc4bf9bc-kvxw7_3b77e47e-49a2-4e1d-8851-a9077a7cb62f/authorino/0.log" Sep 11 18:59:09.034554 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:09.034520 2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-94fd9d49d-t75cr" Sep 11 18:59:09.034932 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:09.034918 2583 scope.go:117] "RemoveContainer" containerID="1251d1d87d62e36a6103de6d53f74b12c33ab55cf9f97b132a577168e6d7bc77" Sep 11 18:59:09.035121 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:59:09.035099 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-94fd9d49d-t75cr_opendatahub(a769d90b-b2e1-43d5-b0b1-576b4df37319)\"" pod="opendatahub/maas-controller-94fd9d49d-t75cr" podUID="a769d90b-b2e1-43d5-b0b1-576b4df37319" Sep 11 18:59:13.997752 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:13.997699 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-fgc5x_f0bbebeb-9370-45d2-9cb6-09d307fa91b3/manager/0.log" Sep 11 18:59:14.111445 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:14.111413 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jnps2_557fc74c-4b00-4fc8-bb7c-62ff3d662820/manager/0.log" Sep 11 18:59:14.228877 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:14.228844 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-68b494756f-xrlrw_41c8c3d6-82ec-4d0e-bd9f-94f2a271f994/manager/4.log" Sep 11 18:59:14.343911 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:14.343875 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-94fd9d49d-t75cr_a769d90b-b2e1-43d5-b0b1-576b4df37319/manager/4.log" Sep 11 18:59:14.684011 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:14.683929 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8f9f87498-647gp_ec5c8401-aef8-4447-812d-2cfbe4c50698/copy-manifests/0.log" Sep 11 18:59:14.690196 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:14.690171 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8f9f87498-647gp_ec5c8401-aef8-4447-812d-2cfbe4c50698/manager/0.log" Sep 11 18:59:15.285772 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:15.285744 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-9n857_4fc0214c-fef3-4efb-acb1-dcb92e011884/postgres/0.log" Sep 11 18:59:15.962903 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:15.962876 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7fc4bf9bc-kvxw7_3b77e47e-49a2-4e1d-8851-a9077a7cb62f/authorino/0.log" Sep 11 18:59:16.072551 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:16.072514 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-rwdwj_76c5200b-b818-4b96-bf72-93ab410e4bc9/manager/0.log" Sep 11 18:59:16.193410 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:16.193380 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-phjfx_5c881077-7314-42d5-b21f-3ff31c460d10/manager/0.log" Sep 11 18:59:16.423873 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:16.423842 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-fzwvj_36fa9f7e-5a8d-4fc9-9200-b52f3b868ed2/manager/0.log" Sep 11 18:59:16.647372 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:16.647332 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-hsctw_d7928ce8-4684-4725-bb37-f4fa6e67a5aa/manager/0.log" Sep 11 18:59:17.326948 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:17.326918 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f8f98866c-wlcnc_d87a6c40-2265-4075-879a-ebfd2d65dc68/kube-auth-proxy/0.log" Sep 11 18:59:17.437404 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:17.437374 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-q4gvp_e568a493-a68a-4541-a69b-b92f303cba6e/istio-proxy/0.log" Sep 11 18:59:17.545539 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:17.545499 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-597d5b6488-czf89_1a3662ef-c0c0-4673-a66c-173e38736517/router/0.log" Sep 11 18:59:19.352495 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:19.352460 2583 scope.go:117] "RemoveContainer" containerID="6eabd86bf538fa83817ca646dd2934cd2d1f408e17adab68cfcfb32c6fef01bf" Sep 11 18:59:19.352904 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:59:19.352675 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-68b494756f-xrlrw_opendatahub(41c8c3d6-82ec-4d0e-bd9f-94f2a271f994)\"" pod="opendatahub/maas-controller-68b494756f-xrlrw" podUID="41c8c3d6-82ec-4d0e-bd9f-94f2a271f994" Sep 11 18:59:20.352849 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:20.352820 2583 scope.go:117] "RemoveContainer" containerID="1251d1d87d62e36a6103de6d53f74b12c33ab55cf9f97b132a577168e6d7bc77" Sep 11 18:59:20.353209 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:59:20.352970 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-94fd9d49d-t75cr_opendatahub(a769d90b-b2e1-43d5-b0b1-576b4df37319)\"" pod="opendatahub/maas-controller-94fd9d49d-t75cr" podUID="a769d90b-b2e1-43d5-b0b1-576b4df37319" Sep 11 18:59:26.479307 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:26.479277 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kltxq_06964030-e916-4d42-a39f-96727c8c77a1/global-pull-secret-syncer/0.log" Sep 11 18:59:26.583635 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:26.583597 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zsn78_d2d05796-e12c-4be6-a44b-f221b91594e3/konnectivity-agent/0.log" Sep 11 18:59:26.627796 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:26.627771 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-25.ec2.internal_0c8d5dd7e1a7979f39ff552b2657e9d3/haproxy/0.log" Sep 11 18:59:31.297940 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:31.297907 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7fc4bf9bc-kvxw7_3b77e47e-49a2-4e1d-8851-a9077a7cb62f/authorino/0.log" Sep 11 18:59:31.349351 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:31.349315 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-rwdwj_76c5200b-b818-4b96-bf72-93ab410e4bc9/manager/0.log" Sep 11 18:59:31.396341 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:31.396318 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-phjfx_5c881077-7314-42d5-b21f-3ff31c460d10/manager/0.log" Sep 11 18:59:31.479777 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:31.479748 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-fzwvj_36fa9f7e-5a8d-4fc9-9200-b52f3b868ed2/manager/0.log" Sep 11 18:59:31.532015 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:31.531989 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-hsctw_d7928ce8-4684-4725-bb37-f4fa6e67a5aa/manager/0.log" Sep 11 18:59:33.408656 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:33.408611 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5nfpr_e504976a-d7d4-4091-9348-f779b3bcb69c/node-exporter/0.log" Sep 11 18:59:33.430868 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:33.430849 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5nfpr_e504976a-d7d4-4091-9348-f779b3bcb69c/kube-rbac-proxy/0.log" Sep 11 18:59:33.448795 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:33.448776 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5nfpr_e504976a-d7d4-4091-9348-f779b3bcb69c/init-textfile/0.log" Sep 11 18:59:33.682054 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:33.682005 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fc07c570-3b25-4940-8088-9e6ec803c463/prometheus/0.log" Sep 11 18:59:33.701305 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:33.701273 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fc07c570-3b25-4940-8088-9e6ec803c463/config-reloader/0.log" Sep 11 18:59:33.721497 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:33.721471 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fc07c570-3b25-4940-8088-9e6ec803c463/thanos-sidecar/0.log" Sep 11 18:59:33.744677 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:33.744652 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fc07c570-3b25-4940-8088-9e6ec803c463/kube-rbac-proxy-web/0.log" Sep 11 18:59:33.764139 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:33.764117 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fc07c570-3b25-4940-8088-9e6ec803c463/kube-rbac-proxy/0.log" Sep 11 18:59:33.784008 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:33.783985 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fc07c570-3b25-4940-8088-9e6ec803c463/kube-rbac-proxy-thanos/0.log" Sep 11 18:59:33.803707 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:33.803688 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fc07c570-3b25-4940-8088-9e6ec803c463/init-config-reloader/0.log" Sep 11 18:59:34.352972 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:34.352933 2583 scope.go:117] "RemoveContainer" containerID="6eabd86bf538fa83817ca646dd2934cd2d1f408e17adab68cfcfb32c6fef01bf" Sep 11 18:59:34.353168 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:59:34.353137 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-68b494756f-xrlrw_opendatahub(41c8c3d6-82ec-4d0e-bd9f-94f2a271f994)\"" pod="opendatahub/maas-controller-68b494756f-xrlrw" podUID="41c8c3d6-82ec-4d0e-bd9f-94f2a271f994" Sep 11 18:59:35.352925 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:35.352893 2583 scope.go:117] "RemoveContainer" containerID="1251d1d87d62e36a6103de6d53f74b12c33ab55cf9f97b132a577168e6d7bc77" Sep 11 18:59:35.353295 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:59:35.353063 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-94fd9d49d-t75cr_opendatahub(a769d90b-b2e1-43d5-b0b1-576b4df37319)\"" pod="opendatahub/maas-controller-94fd9d49d-t75cr" podUID="a769d90b-b2e1-43d5-b0b1-576b4df37319" Sep 11 18:59:35.584062 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:35.584031 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-p55rt_26a66f34-c7ab-46fa-9311-eccbefb30770/networking-console-plugin/0.log" Sep 11 18:59:36.196189 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:36.196156 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nmffl/perf-node-gather-daemonset-vqt25"] Sep 11 18:59:36.199792 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:36.199771 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nmffl/perf-node-gather-daemonset-vqt25" Sep 11 18:59:36.202876 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:36.202856 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nmffl\"/\"default-dockercfg-r57tf\"" Sep 11 18:59:36.202876 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:36.202871 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nmffl\"/\"kube-root-ca.crt\"" Sep 11 18:59:36.204179 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:36.204164 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nmffl\"/\"openshift-service-ca.crt\"" Sep 11 18:59:36.210279 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:36.210258 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nmffl/perf-node-gather-daemonset-vqt25"] Sep 11 18:59:36.362742 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:36.362702 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz2mm\" (UniqueName: \"kubernetes.io/projected/a2bf589d-6c35-4a5b-ac84-32c5f4777ab9-kube-api-access-mz2mm\") pod \"perf-node-gather-daemonset-vqt25\" (UID: \"a2bf589d-6c35-4a5b-ac84-32c5f4777ab9\") " pod="openshift-must-gather-nmffl/perf-node-gather-daemonset-vqt25" Sep 11 18:59:36.362742 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:36.362750 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2bf589d-6c35-4a5b-ac84-32c5f4777ab9-proc\") pod \"perf-node-gather-daemonset-vqt25\" (UID: \"a2bf589d-6c35-4a5b-ac84-32c5f4777ab9\") " pod="openshift-must-gather-nmffl/perf-node-gather-daemonset-vqt25" Sep 11 18:59:36.363150 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:36.362837 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2bf589d-6c35-4a5b-ac84-32c5f4777ab9-sys\") pod \"perf-node-gather-daemonset-vqt25\" (UID: \"a2bf589d-6c35-4a5b-ac84-32c5f4777ab9\") " pod="openshift-must-gather-nmffl/perf-node-gather-daemonset-vqt25" Sep 11 18:59:36.363150 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:36.362867 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a2bf589d-6c35-4a5b-ac84-32c5f4777ab9-podres\") pod \"perf-node-gather-daemonset-vqt25\" (UID: \"a2bf589d-6c35-4a5b-ac84-32c5f4777ab9\") " pod="openshift-must-gather-nmffl/perf-node-gather-daemonset-vqt25" Sep 11 18:59:36.363150 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:36.362892 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2bf589d-6c35-4a5b-ac84-32c5f4777ab9-lib-modules\") pod \"perf-node-gather-daemonset-vqt25\" (UID: \"a2bf589d-6c35-4a5b-ac84-32c5f4777ab9\") " pod="openshift-must-gather-nmffl/perf-node-gather-daemonset-vqt25" Sep 11 18:59:36.463316 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:36.463231 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2bf589d-6c35-4a5b-ac84-32c5f4777ab9-sys\") pod \"perf-node-gather-daemonset-vqt25\" (UID: \"a2bf589d-6c35-4a5b-ac84-32c5f4777ab9\") " pod="openshift-must-gather-nmffl/perf-node-gather-daemonset-vqt25" Sep 11 18:59:36.463316 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:36.463267 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a2bf589d-6c35-4a5b-ac84-32c5f4777ab9-podres\") pod \"perf-node-gather-daemonset-vqt25\" (UID: \"a2bf589d-6c35-4a5b-ac84-32c5f4777ab9\") " pod="openshift-must-gather-nmffl/perf-node-gather-daemonset-vqt25" Sep 11 18:59:36.463316 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:36.463288 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2bf589d-6c35-4a5b-ac84-32c5f4777ab9-lib-modules\") pod \"perf-node-gather-daemonset-vqt25\" (UID: \"a2bf589d-6c35-4a5b-ac84-32c5f4777ab9\") " pod="openshift-must-gather-nmffl/perf-node-gather-daemonset-vqt25" Sep 11 18:59:36.463577 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:36.463326 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz2mm\" (UniqueName: \"kubernetes.io/projected/a2bf589d-6c35-4a5b-ac84-32c5f4777ab9-kube-api-access-mz2mm\") pod \"perf-node-gather-daemonset-vqt25\" (UID: \"a2bf589d-6c35-4a5b-ac84-32c5f4777ab9\") " pod="openshift-must-gather-nmffl/perf-node-gather-daemonset-vqt25" Sep 11 18:59:36.463577 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:36.463343 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2bf589d-6c35-4a5b-ac84-32c5f4777ab9-proc\") pod \"perf-node-gather-daemonset-vqt25\" (UID: \"a2bf589d-6c35-4a5b-ac84-32c5f4777ab9\") " pod="openshift-must-gather-nmffl/perf-node-gather-daemonset-vqt25" Sep 11 18:59:36.463577 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:36.463344 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2bf589d-6c35-4a5b-ac84-32c5f4777ab9-sys\") pod \"perf-node-gather-daemonset-vqt25\" (UID: \"a2bf589d-6c35-4a5b-ac84-32c5f4777ab9\") " pod="openshift-must-gather-nmffl/perf-node-gather-daemonset-vqt25" Sep 11 18:59:36.463577 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:36.463412 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2bf589d-6c35-4a5b-ac84-32c5f4777ab9-proc\") pod \"perf-node-gather-daemonset-vqt25\" (UID: \"a2bf589d-6c35-4a5b-ac84-32c5f4777ab9\") " pod="openshift-must-gather-nmffl/perf-node-gather-daemonset-vqt25" Sep 11 18:59:36.463577 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:36.463419 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a2bf589d-6c35-4a5b-ac84-32c5f4777ab9-podres\") pod \"perf-node-gather-daemonset-vqt25\" (UID: \"a2bf589d-6c35-4a5b-ac84-32c5f4777ab9\") " pod="openshift-must-gather-nmffl/perf-node-gather-daemonset-vqt25" Sep 11 18:59:36.463577 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:36.463468 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2bf589d-6c35-4a5b-ac84-32c5f4777ab9-lib-modules\") pod \"perf-node-gather-daemonset-vqt25\" (UID: \"a2bf589d-6c35-4a5b-ac84-32c5f4777ab9\") " pod="openshift-must-gather-nmffl/perf-node-gather-daemonset-vqt25" Sep 11 18:59:36.472263 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:36.472240 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz2mm\" (UniqueName: \"kubernetes.io/projected/a2bf589d-6c35-4a5b-ac84-32c5f4777ab9-kube-api-access-mz2mm\") pod \"perf-node-gather-daemonset-vqt25\" (UID: \"a2bf589d-6c35-4a5b-ac84-32c5f4777ab9\") " pod="openshift-must-gather-nmffl/perf-node-gather-daemonset-vqt25" Sep 11 18:59:36.509982 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:36.509951 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nmffl/perf-node-gather-daemonset-vqt25" Sep 11 18:59:36.781561 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:36.781519 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nmffl/perf-node-gather-daemonset-vqt25"] Sep 11 18:59:36.784079 ip-10-0-133-25 kubenswrapper[2583]: W0911 18:59:36.784053 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda2bf589d_6c35_4a5b_ac84_32c5f4777ab9.slice/crio-bc0b55153abec036e6a23781f9c1dab7ace950d358118c94e8f7caf9e3159cbf WatchSource:0}: Error finding container bc0b55153abec036e6a23781f9c1dab7ace950d358118c94e8f7caf9e3159cbf: Status 404 returned error can't find the container with id bc0b55153abec036e6a23781f9c1dab7ace950d358118c94e8f7caf9e3159cbf Sep 11 18:59:37.115221 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:37.115124 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nmffl/perf-node-gather-daemonset-vqt25" event={"ID":"a2bf589d-6c35-4a5b-ac84-32c5f4777ab9","Type":"ContainerStarted","Data":"e30b651d3e803a160f1487e7f21150a15f3d270a591c2f531f6f94469a9a8176"} Sep 11 18:59:37.115221 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:37.115183 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nmffl/perf-node-gather-daemonset-vqt25" event={"ID":"a2bf589d-6c35-4a5b-ac84-32c5f4777ab9","Type":"ContainerStarted","Data":"bc0b55153abec036e6a23781f9c1dab7ace950d358118c94e8f7caf9e3159cbf"} Sep 11 18:59:37.115458 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:37.115256 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nmffl/perf-node-gather-daemonset-vqt25" Sep 11 18:59:37.133409 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:37.133359 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nmffl/perf-node-gather-daemonset-vqt25" podStartSLOduration=1.133344516 podStartE2EDuration="1.133344516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:59:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:59:37.131082356 +0000 UTC m=+681.311015064" watchObservedRunningTime="2026-09-11 18:59:37.133344516 +0000 UTC m=+681.313277225" Sep 11 18:59:38.425154 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:38.425124 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5mls5_fafb9edb-7b18-4285-bfbc-e44847347967/dns/0.log" Sep 11 18:59:38.444311 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:38.444284 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5mls5_fafb9edb-7b18-4285-bfbc-e44847347967/kube-rbac-proxy/0.log" Sep 11 18:59:38.583495 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:38.583465 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c7t7x_df77fbc6-2613-4a23-b1da-c0dd94f680eb/dns-node-resolver/0.log" Sep 11 18:59:39.135338 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:39.135313 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8w6hj_074bae97-de81-4f57-ba67-4790e60c0f2a/node-ca/0.log" Sep 11 18:59:40.228968 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:40.228937 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f8f98866c-wlcnc_d87a6c40-2265-4075-879a-ebfd2d65dc68/kube-auth-proxy/0.log" Sep 11 18:59:40.258479 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:40.258447 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-q4gvp_e568a493-a68a-4541-a69b-b92f303cba6e/istio-proxy/0.log" Sep 11 18:59:40.283634 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:40.283606 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-597d5b6488-czf89_1a3662ef-c0c0-4673-a66c-173e38736517/router/0.log" Sep 11 18:59:40.881790 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:40.881760 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kjvqf_dc3f63b6-c621-4d27-9e27-4a9709ef75f6/serve-healthcheck-canary/0.log" Sep 11 18:59:41.393534 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:41.393504 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d7msf_4d126684-1402-472d-b32f-44bfdbc5eb82/kube-rbac-proxy/0.log" Sep 11 18:59:41.413180 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:41.413152 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d7msf_4d126684-1402-472d-b32f-44bfdbc5eb82/exporter/0.log" Sep 11 18:59:41.431910 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:41.431887 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d7msf_4d126684-1402-472d-b32f-44bfdbc5eb82/extractor/0.log" Sep 11 18:59:43.129421 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:43.129391 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nmffl/perf-node-gather-daemonset-vqt25" Sep 11 18:59:43.792720 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:43.792685 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-fgc5x_f0bbebeb-9370-45d2-9cb6-09d307fa91b3/manager/0.log" Sep 11 18:59:43.816817 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:43.816788 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jnps2_557fc74c-4b00-4fc8-bb7c-62ff3d662820/manager/0.log" Sep 11 18:59:43.841190 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:43.841155 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-68b494756f-xrlrw_41c8c3d6-82ec-4d0e-bd9f-94f2a271f994/manager/4.log" Sep 11 18:59:43.841328 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:43.841163 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-68b494756f-xrlrw_41c8c3d6-82ec-4d0e-bd9f-94f2a271f994/manager/4.log" Sep 11 18:59:43.861226 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:43.861202 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-94fd9d49d-t75cr_a769d90b-b2e1-43d5-b0b1-576b4df37319/manager/4.log" Sep 11 18:59:43.861366 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:43.861260 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-94fd9d49d-t75cr_a769d90b-b2e1-43d5-b0b1-576b4df37319/manager/4.log" Sep 11 18:59:43.967982 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:43.967954 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8f9f87498-647gp_ec5c8401-aef8-4447-812d-2cfbe4c50698/manager/0.log" Sep 11 18:59:43.985183 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:43.985161 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8f9f87498-647gp_ec5c8401-aef8-4447-812d-2cfbe4c50698/copy-manifests/0.log" Sep 11 18:59:47.000936 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:47.000897 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f8f98866c-wlcnc_d87a6c40-2265-4075-879a-ebfd2d65dc68/kube-auth-proxy/0.log" Sep 11 18:59:47.022086 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:47.022052 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-q4gvp_e568a493-a68a-4541-a69b-b92f303cba6e/istio-proxy/0.log" Sep 11 18:59:47.040856 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:47.040833 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-597d5b6488-czf89_1a3662ef-c0c0-4673-a66c-173e38736517/router/0.log" Sep 11 18:59:48.103636 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:48.103605 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f8f98866c-wlcnc_d87a6c40-2265-4075-879a-ebfd2d65dc68/kube-auth-proxy/0.log" Sep 11 18:59:48.120737 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:48.120711 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-q4gvp_e568a493-a68a-4541-a69b-b92f303cba6e/istio-proxy/0.log" Sep 11 18:59:48.145713 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:48.145687 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-597d5b6488-czf89_1a3662ef-c0c0-4673-a66c-173e38736517/router/0.log" Sep 11 18:59:49.352351 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:49.352318 2583 scope.go:117] "RemoveContainer" containerID="1251d1d87d62e36a6103de6d53f74b12c33ab55cf9f97b132a577168e6d7bc77" Sep 11 18:59:49.352850 ip-10-0-133-25 kubenswrapper[2583]: I0911 18:59:49.352476 2583 scope.go:117] "RemoveContainer" containerID="6eabd86bf538fa83817ca646dd2934cd2d1f408e17adab68cfcfb32c6fef01bf" Sep 11 18:59:49.352850 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:59:49.352508 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-94fd9d49d-t75cr_opendatahub(a769d90b-b2e1-43d5-b0b1-576b4df37319)\"" pod="opendatahub/maas-controller-94fd9d49d-t75cr" podUID="a769d90b-b2e1-43d5-b0b1-576b4df37319" Sep 11 18:59:49.352850 ip-10-0-133-25 kubenswrapper[2583]: E0911 18:59:49.352736 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-68b494756f-xrlrw_opendatahub(41c8c3d6-82ec-4d0e-bd9f-94f2a271f994)\"" pod="opendatahub/maas-controller-68b494756f-xrlrw" podUID="41c8c3d6-82ec-4d0e-bd9f-94f2a271f994"