Jul 17 17:39:05.714745 ip-10-0-133-127 systemd[1]: Starting Kubernetes Kubelet... Jul 17 17:39:06.048759 ip-10-0-133-127 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 17:39:06.048759 ip-10-0-133-127 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 17 17:39:06.048759 ip-10-0-133-127 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 17:39:06.048759 ip-10-0-133-127 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 17 17:39:06.048759 ip-10-0-133-127 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 17:39:06.050210 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.050123 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 17 17:39:06.055292 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055270 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 17:39:06.055292 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055291 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 17:39:06.055365 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055296 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 17:39:06.055365 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055299 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 17:39:06.055365 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055302 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 17:39:06.055365 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055305 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 17:39:06.055365 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055309 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 17:39:06.055365 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055312 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 17:39:06.055365 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055315 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 17:39:06.055365 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055317 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 17:39:06.055365 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055320 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 17:39:06.055365 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055322 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 17:39:06.055365 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055325 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 17:39:06.055365 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055328 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 17:39:06.055365 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055331 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 17:39:06.055365 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055333 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 17:39:06.055365 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055336 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 17:39:06.055365 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055338 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 17:39:06.055365 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055342 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 17:39:06.055365 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055347 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 17:39:06.055365 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055352 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 17:39:06.055839 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055356 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 17:39:06.055839 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055359 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 17:39:06.055839 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055362 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 17 17:39:06.055839 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055365 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 17:39:06.055839 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055368 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 17:39:06.055839 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055371 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 17:39:06.055839 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055374 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 17:39:06.055839 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055377 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 17:39:06.055839 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055380 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 17:39:06.055839 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055382 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 17:39:06.055839 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055385 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 17:39:06.055839 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055388 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 17:39:06.055839 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055390 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 17:39:06.055839 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055393 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 17:39:06.055839 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055395 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 17:39:06.055839 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055399 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 17:39:06.055839 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055401 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 17:39:06.055839 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055404 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 17:39:06.055839 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055406 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 17:39:06.055839 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055409 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 17:39:06.056356 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055411 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 17:39:06.056356 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055414 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 17:39:06.056356 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055416 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 17:39:06.056356 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055419 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 17:39:06.056356 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055421 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 17:39:06.056356 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055423 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 17:39:06.056356 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055426 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 17:39:06.056356 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055429 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 17:39:06.056356 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055431 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 17:39:06.056356 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055433 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 17:39:06.056356 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055436 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 17:39:06.056356 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055438 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 17:39:06.056356 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055452 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 17:39:06.056356 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055457 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 17:39:06.056356 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055459 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 17:39:06.056356 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055462 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 17:39:06.056356 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055465 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 17:39:06.056356 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055468 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 17:39:06.056356 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055471 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 17:39:06.056356 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055473 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 17:39:06.056849 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055476 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 17:39:06.056849 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055479 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 17:39:06.056849 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055481 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 17:39:06.056849 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055483 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 17:39:06.056849 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055486 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 17:39:06.056849 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055488 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 17:39:06.056849 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055491 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 17:39:06.056849 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055493 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 17:39:06.056849 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055495 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 17:39:06.056849 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055498 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 17:39:06.056849 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055501 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 17:39:06.056849 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055504 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 17:39:06.056849 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055506 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 17:39:06.056849 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055509 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 17:39:06.056849 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055511 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 17:39:06.056849 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055514 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 17:39:06.056849 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055516 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 17:39:06.056849 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055518 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 17:39:06.056849 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055521 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 17:39:06.057309 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055523 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 17:39:06.057309 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055526 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 17:39:06.057309 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055529 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 17:39:06.057309 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055531 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 17:39:06.057309 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055535 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 17:39:06.057309 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055539 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 17:39:06.057309 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055543 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 17:39:06.057309 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055547 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 17:39:06.057309 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055550 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 17:39:06.057309 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055553 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 17:39:06.057309 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055556 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 17:39:06.057309 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055559 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 17:39:06.057309 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055561 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 17:39:06.057309 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055564 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 17:39:06.057309 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055567 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 17:39:06.057309 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055569 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 17:39:06.057309 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055572 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 17:39:06.057309 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055574 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 17:39:06.057309 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.055577 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 17:39:06.057309 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056310 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 17:39:06.057787 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056316 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 17:39:06.057787 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056319 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 17:39:06.057787 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056322 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 17:39:06.057787 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056325 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 17:39:06.057787 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056328 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 17:39:06.057787 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056331 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 17:39:06.057787 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056334 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 17:39:06.057787 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056337 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 17:39:06.057787 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056339 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 17:39:06.057787 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056342 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 17:39:06.057787 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056344 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 17:39:06.057787 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056347 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 17:39:06.057787 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056350 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 17:39:06.057787 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056352 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 17:39:06.057787 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056354 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 17:39:06.057787 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056357 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 17:39:06.057787 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056360 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 17:39:06.057787 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056363 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 17:39:06.057787 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056365 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 17:39:06.058246 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056368 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 17:39:06.058246 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056371 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 17:39:06.058246 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056374 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 17:39:06.058246 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056376 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 17:39:06.058246 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056379 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 17:39:06.058246 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056381 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 17:39:06.058246 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056384 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 17:39:06.058246 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056387 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 17:39:06.058246 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056389 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 17:39:06.058246 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056392 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 17:39:06.058246 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056394 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 17:39:06.058246 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056397 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 17:39:06.058246 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056399 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 17:39:06.058246 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056402 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 17:39:06.058246 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056404 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 17:39:06.058246 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056406 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 17:39:06.058246 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056409 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 17:39:06.058246 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056411 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 17:39:06.058246 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056414 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 17:39:06.058246 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056417 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 17:39:06.058741 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056422 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 17:39:06.058741 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056425 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 17:39:06.058741 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056427 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 17:39:06.058741 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056430 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 17:39:06.058741 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056432 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 17:39:06.058741 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056435 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 17:39:06.058741 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056437 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 17:39:06.058741 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056456 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 17:39:06.058741 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056459 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 17:39:06.058741 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056462 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 17:39:06.058741 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056464 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 17:39:06.058741 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056471 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 17:39:06.058741 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056474 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 17:39:06.058741 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056476 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 17:39:06.058741 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056479 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 17:39:06.058741 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056481 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 17:39:06.058741 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056484 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 17:39:06.058741 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056486 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 17:39:06.058741 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056489 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 17:39:06.058741 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056491 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 17:39:06.059221 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056494 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 17:39:06.059221 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056497 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 17:39:06.059221 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056500 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 17:39:06.059221 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056502 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 17:39:06.059221 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056504 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 17:39:06.059221 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056507 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 17:39:06.059221 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056509 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 17:39:06.059221 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056512 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 17:39:06.059221 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056514 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 17:39:06.059221 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056516 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 17:39:06.059221 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056519 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 17:39:06.059221 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056522 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 17:39:06.059221 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056524 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 17:39:06.059221 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056527 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 17:39:06.059221 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056530 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 17:39:06.059221 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056533 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 17:39:06.059221 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056535 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 17:39:06.059221 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056538 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 17 17:39:06.059221 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056540 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 17:39:06.059717 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056544 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 17:39:06.059717 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056548 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 17:39:06.059717 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056552 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 17:39:06.059717 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056554 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 17:39:06.059717 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056558 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 17:39:06.059717 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056561 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 17:39:06.059717 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056564 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 17:39:06.059717 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056566 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 17:39:06.059717 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056569 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 17:39:06.059717 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056571 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 17:39:06.059717 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056573 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 17:39:06.059717 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056578 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 17:39:06.059717 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056581 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 17:39:06.059717 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056584 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 17:39:06.059717 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056587 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 17:39:06.059717 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056589 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 17:39:06.059717 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056592 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 17:39:06.059717 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056595 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 17:39:06.059717 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056597 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 17:39:06.060204 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.056600 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 17:39:06.060204 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057004 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 17:39:06.060204 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057010 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 17:39:06.060204 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057013 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 17:39:06.060204 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057017 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 17:39:06.060204 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057021 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 17:39:06.060204 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057024 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 17:39:06.060204 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057027 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 17:39:06.060204 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057030 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 17:39:06.060204 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057033 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 17:39:06.060204 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057035 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 17:39:06.060204 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057038 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 17:39:06.060204 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057040 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 17:39:06.060204 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057043 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 17:39:06.060204 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057045 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 17:39:06.060204 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057048 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 17:39:06.060204 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057052 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 17:39:06.060204 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057057 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 17:39:06.060204 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057060 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 17:39:06.060684 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057062 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 17:39:06.060684 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057065 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 17:39:06.060684 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057067 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 17:39:06.060684 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057070 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 17:39:06.060684 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057073 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 17:39:06.060684 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057076 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 17:39:06.060684 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057078 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 17:39:06.060684 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057081 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 17:39:06.060684 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057084 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 17:39:06.060684 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057086 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 17:39:06.060684 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057088 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 17:39:06.060684 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057091 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 17:39:06.060684 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057093 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 17:39:06.060684 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057096 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 17:39:06.060684 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057098 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 17:39:06.060684 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057101 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 17:39:06.060684 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057104 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 17:39:06.060684 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057106 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 17:39:06.060684 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057109 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 17 17:39:06.061143 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057116 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 17:39:06.061143 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057119 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 17:39:06.061143 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057121 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 17:39:06.061143 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057124 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 17:39:06.061143 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057126 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 17:39:06.061143 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057129 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 17:39:06.061143 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057131 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 17:39:06.061143 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057134 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 17:39:06.061143 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057136 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 17:39:06.061143 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057139 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 17:39:06.061143 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057142 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 17:39:06.061143 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057146 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 17:39:06.061143 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057149 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 17:39:06.061143 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057152 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 17:39:06.061143 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057155 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 17:39:06.061143 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057157 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 17:39:06.061143 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057159 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 17:39:06.061143 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057162 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 17:39:06.061143 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057164 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 17:39:06.061143 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057167 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 17:39:06.061658 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057169 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 17:39:06.061658 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057172 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 17:39:06.061658 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057174 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 17:39:06.061658 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057177 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 17:39:06.061658 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057180 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 17:39:06.061658 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057183 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 17:39:06.061658 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057186 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 17:39:06.061658 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057189 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 17:39:06.061658 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057191 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 17:39:06.061658 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057194 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 17:39:06.061658 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057196 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 17:39:06.061658 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057199 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 17:39:06.061658 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057201 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 17:39:06.061658 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057204 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 17:39:06.061658 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057207 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 17:39:06.061658 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057209 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 17:39:06.061658 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057211 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 17:39:06.061658 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057214 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 17:39:06.061658 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057216 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 17:39:06.062109 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057218 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 17:39:06.062109 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057221 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 17:39:06.062109 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057224 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 17:39:06.062109 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057226 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 17:39:06.062109 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057230 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 17:39:06.062109 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057232 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 17:39:06.062109 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057235 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 17:39:06.062109 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057237 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 17:39:06.062109 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057240 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 17:39:06.062109 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057243 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 17:39:06.062109 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057246 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 17:39:06.062109 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057248 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 17:39:06.062109 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057251 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 17:39:06.062109 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057253 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 17:39:06.062109 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057256 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 17:39:06.062109 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057258 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 17:39:06.062109 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057261 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 17:39:06.062109 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057264 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 17:39:06.062109 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057266 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 17:39:06.062601 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057268 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 17:39:06.062601 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057271 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 17:39:06.062601 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057273 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 17:39:06.062601 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.057276 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 17:39:06.062601 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057354 2563 flags.go:64] FLAG: --address="0.0.0.0" Jul 17 17:39:06.062601 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057362 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 17 17:39:06.062601 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057368 2563 flags.go:64] FLAG: --anonymous-auth="true" Jul 17 17:39:06.062601 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057372 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 17 17:39:06.062601 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057377 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 17 17:39:06.062601 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057380 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 17 17:39:06.062601 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057385 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 17 17:39:06.062601 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057389 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 17 17:39:06.062601 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057392 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 17 17:39:06.062601 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057395 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 17 17:39:06.062601 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057401 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 17 17:39:06.062601 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057404 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 17 17:39:06.062601 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057407 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 17 17:39:06.062601 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057411 2563 flags.go:64] FLAG: --cgroup-root="" Jul 17 17:39:06.062601 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057414 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 17 17:39:06.062601 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057417 2563 flags.go:64] FLAG: --client-ca-file="" Jul 17 17:39:06.062601 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057420 2563 flags.go:64] FLAG: --cloud-provider="external" Jul 17 17:39:06.062601 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057422 2563 flags.go:64] FLAG: --cluster-dns="[]" Jul 17 17:39:06.062601 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057430 2563 flags.go:64] FLAG: --cluster-domain="" Jul 17 17:39:06.062601 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057433 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 17 17:39:06.063170 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057436 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 17 17:39:06.063170 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057439 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 17 17:39:06.063170 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057462 2563 flags.go:64] FLAG: --container-log-max-files="5" Jul 17 17:39:06.063170 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057466 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 17 17:39:06.063170 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057470 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 17 17:39:06.063170 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057473 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 17 17:39:06.063170 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057476 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 17 17:39:06.063170 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057479 2563 flags.go:64] FLAG: --contention-profiling="false" Jul 17 17:39:06.063170 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057482 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 17 17:39:06.063170 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057485 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 17 17:39:06.063170 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057488 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 17 17:39:06.063170 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057491 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 17 17:39:06.063170 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057499 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 17 17:39:06.063170 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057502 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 17 17:39:06.063170 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057505 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 17 17:39:06.063170 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057508 2563 flags.go:64] FLAG: --enable-load-reader="false" Jul 17 17:39:06.063170 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057511 2563 flags.go:64] FLAG: --enable-server="true" Jul 17 17:39:06.063170 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057515 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 17 17:39:06.063170 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057522 2563 flags.go:64] FLAG: --event-burst="100" Jul 17 17:39:06.063170 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057525 2563 flags.go:64] FLAG: --event-qps="50" Jul 17 17:39:06.063170 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057527 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 17 17:39:06.063170 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057530 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 17 17:39:06.063170 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057535 2563 flags.go:64] FLAG: --eviction-hard="" Jul 17 17:39:06.063170 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057539 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 17 17:39:06.063750 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057542 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 17 17:39:06.063750 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057546 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 17 17:39:06.063750 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057549 2563 flags.go:64] FLAG: --eviction-soft="" Jul 17 17:39:06.063750 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057552 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 17 17:39:06.063750 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057555 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 17 17:39:06.063750 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057558 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 17 17:39:06.063750 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057561 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jul 17 17:39:06.063750 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057563 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 17 17:39:06.063750 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057566 2563 flags.go:64] FLAG: --fail-swap-on="true" Jul 17 17:39:06.063750 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057569 2563 flags.go:64] FLAG: --feature-gates="" Jul 17 17:39:06.063750 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057573 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jul 17 17:39:06.063750 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057576 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 17 17:39:06.063750 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057579 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 17 17:39:06.063750 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057582 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 17 17:39:06.063750 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057585 2563 flags.go:64] FLAG: --healthz-port="10248" Jul 17 17:39:06.063750 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057588 2563 flags.go:64] FLAG: --help="false" Jul 17 17:39:06.063750 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057591 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-133-127.ec2.internal" Jul 17 17:39:06.063750 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057594 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 17 17:39:06.063750 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057597 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jul 17 17:39:06.063750 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057600 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 17 17:39:06.063750 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057604 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 17 17:39:06.063750 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057607 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 17 17:39:06.063750 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057610 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 17 17:39:06.063750 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057613 2563 flags.go:64] FLAG: --image-service-endpoint="" Jul 17 17:39:06.064477 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057615 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 17 17:39:06.064477 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057618 2563 flags.go:64] FLAG: --kube-api-burst="100" Jul 17 17:39:06.064477 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057621 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 17 17:39:06.064477 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057625 2563 flags.go:64] FLAG: --kube-api-qps="50" Jul 17 17:39:06.064477 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057627 2563 flags.go:64] FLAG: --kube-reserved="" Jul 17 17:39:06.064477 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057630 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 17 17:39:06.064477 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057634 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 17 17:39:06.064477 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057637 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jul 17 17:39:06.064477 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057640 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 17 17:39:06.064477 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057644 2563 flags.go:64] FLAG: --lock-file="" Jul 17 17:39:06.064477 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057647 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 17 17:39:06.064477 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057650 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 17 17:39:06.064477 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057653 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 17 17:39:06.064477 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057658 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jul 17 17:39:06.064477 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057661 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 17 17:39:06.064477 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057663 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jul 17 17:39:06.064477 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057666 2563 flags.go:64] FLAG: --logging-format="text" Jul 17 17:39:06.064477 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057669 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 17 17:39:06.064477 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057673 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 17 17:39:06.064477 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057675 2563 flags.go:64] FLAG: --manifest-url="" Jul 17 17:39:06.064477 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057678 2563 flags.go:64] FLAG: --manifest-url-header="" Jul 17 17:39:06.064477 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057683 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 17 17:39:06.064477 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057685 2563 flags.go:64] FLAG: --max-open-files="1000000" Jul 17 17:39:06.064477 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057690 2563 flags.go:64] FLAG: --max-pods="110" Jul 17 17:39:06.064477 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057692 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 17 17:39:06.065083 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057695 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 17 17:39:06.065083 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057698 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jul 17 17:39:06.065083 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057701 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 17 17:39:06.065083 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057704 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 17 17:39:06.065083 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057707 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 17 17:39:06.065083 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057710 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 17 17:39:06.065083 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057717 2563 flags.go:64] FLAG: --node-status-max-images="50" Jul 17 17:39:06.065083 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057720 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 17 17:39:06.065083 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057723 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jul 17 17:39:06.065083 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057726 2563 flags.go:64] FLAG: --pod-cidr="" Jul 17 17:39:06.065083 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057729 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 17 17:39:06.065083 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057734 2563 flags.go:64] FLAG: --pod-manifest-path="" Jul 17 17:39:06.065083 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057737 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jul 17 17:39:06.065083 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057740 2563 flags.go:64] FLAG: --pods-per-core="0" Jul 17 17:39:06.065083 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057746 2563 flags.go:64] FLAG: --port="10250" Jul 17 17:39:06.065083 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057749 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 17 17:39:06.065083 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057753 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-013785caa7410de91" Jul 17 17:39:06.065083 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057756 2563 flags.go:64] FLAG: --qos-reserved="" Jul 17 17:39:06.065083 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057759 2563 flags.go:64] FLAG: --read-only-port="10255" Jul 17 17:39:06.065083 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057762 2563 flags.go:64] FLAG: --register-node="true" Jul 17 17:39:06.065083 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057765 2563 flags.go:64] FLAG: --register-with-taints="" Jul 17 17:39:06.065083 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057768 2563 flags.go:64] FLAG: --registry-burst="10" Jul 17 17:39:06.065083 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057771 2563 flags.go:64] FLAG: --registry-qps="5" Jul 17 17:39:06.065083 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057774 2563 flags.go:64] FLAG: --reserved-cpus="" Jul 17 17:39:06.065702 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057776 2563 flags.go:64] FLAG: --reserved-memory="" Jul 17 17:39:06.065702 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057780 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 17 17:39:06.065702 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057783 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 17 17:39:06.065702 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057786 2563 flags.go:64] FLAG: --rotate-certificates="false" Jul 17 17:39:06.065702 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057789 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 17 17:39:06.065702 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057792 2563 flags.go:64] FLAG: --runonce="false" Jul 17 17:39:06.065702 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057795 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 17 17:39:06.065702 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057799 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 17 17:39:06.065702 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057802 2563 flags.go:64] FLAG: --seccomp-default="false" Jul 17 17:39:06.065702 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057804 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 17 17:39:06.065702 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057807 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 17 17:39:06.065702 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057810 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 17 17:39:06.065702 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057813 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 17 17:39:06.065702 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057816 2563 flags.go:64] FLAG: --storage-driver-password="root" Jul 17 17:39:06.065702 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057819 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jul 17 17:39:06.065702 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057822 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jul 17 17:39:06.065702 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057824 2563 flags.go:64] FLAG: --storage-driver-user="root" Jul 17 17:39:06.065702 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057827 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 17 17:39:06.065702 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057830 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 17 17:39:06.065702 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057833 2563 flags.go:64] FLAG: --system-cgroups="" Jul 17 17:39:06.065702 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057836 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 17 17:39:06.065702 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057841 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 17 17:39:06.065702 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057845 2563 flags.go:64] FLAG: --tls-cert-file="" Jul 17 17:39:06.065702 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057847 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 17 17:39:06.065702 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057853 2563 flags.go:64] FLAG: --tls-min-version="" Jul 17 17:39:06.066345 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057855 2563 flags.go:64] FLAG: --tls-private-key-file="" Jul 17 17:39:06.066345 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057858 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jul 17 17:39:06.066345 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057861 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 17 17:39:06.066345 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057864 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jul 17 17:39:06.066345 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057867 2563 flags.go:64] FLAG: --v="2" Jul 17 17:39:06.066345 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057871 2563 flags.go:64] FLAG: --version="false" Jul 17 17:39:06.066345 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057875 2563 flags.go:64] FLAG: --vmodule="" Jul 17 17:39:06.066345 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057879 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 17 17:39:06.066345 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.057882 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 17 17:39:06.066345 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058001 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 17:39:06.066345 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058005 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 17:39:06.066345 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058007 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 17:39:06.066345 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058010 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 17 17:39:06.066345 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058012 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 17:39:06.066345 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058015 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 17:39:06.066345 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058017 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 17:39:06.066345 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058020 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 17:39:06.066345 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058024 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 17:39:06.066345 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058028 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 17:39:06.066345 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058031 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 17:39:06.066345 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058033 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 17:39:06.066345 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058036 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 17:39:06.066900 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058038 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 17:39:06.066900 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058041 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 17:39:06.066900 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058043 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 17:39:06.066900 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058046 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 17:39:06.066900 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058048 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 17:39:06.066900 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058051 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 17:39:06.066900 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058054 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 17:39:06.066900 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058058 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 17:39:06.066900 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058060 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 17:39:06.066900 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058063 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 17:39:06.066900 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058066 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 17:39:06.066900 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058069 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 17:39:06.066900 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058071 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 17:39:06.066900 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058075 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 17:39:06.066900 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058078 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 17:39:06.066900 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058081 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 17:39:06.066900 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058084 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 17:39:06.066900 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058087 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 17:39:06.066900 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058090 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 17:39:06.066900 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058093 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 17:39:06.067381 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058095 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 17:39:06.067381 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058098 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 17:39:06.067381 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058101 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 17:39:06.067381 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058103 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 17:39:06.067381 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058106 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 17:39:06.067381 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058109 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 17:39:06.067381 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058111 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 17:39:06.067381 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058114 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 17:39:06.067381 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058116 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 17:39:06.067381 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058119 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 17:39:06.067381 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058121 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 17:39:06.067381 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058123 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 17:39:06.067381 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058126 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 17:39:06.067381 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058128 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 17:39:06.067381 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058131 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 17:39:06.067381 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058133 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 17:39:06.067381 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058136 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 17:39:06.067381 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058138 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 17:39:06.067381 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058141 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 17:39:06.067871 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058145 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 17:39:06.067871 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058148 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 17:39:06.067871 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058150 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 17:39:06.067871 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058152 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 17:39:06.067871 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058155 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 17:39:06.067871 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058158 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 17:39:06.067871 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058160 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 17:39:06.067871 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058162 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 17:39:06.067871 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058165 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 17:39:06.067871 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058167 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 17:39:06.067871 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058170 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 17:39:06.067871 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058172 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 17:39:06.067871 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058174 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 17:39:06.067871 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058177 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 17:39:06.067871 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058180 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 17:39:06.067871 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058182 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 17:39:06.067871 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058185 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 17:39:06.067871 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058187 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 17:39:06.067871 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058190 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 17:39:06.067871 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058192 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 17:39:06.068352 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058194 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 17:39:06.068352 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058197 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 17:39:06.068352 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058199 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 17:39:06.068352 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058202 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 17:39:06.068352 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058205 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 17:39:06.068352 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058207 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 17:39:06.068352 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058209 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 17:39:06.068352 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058212 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 17:39:06.068352 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058215 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 17:39:06.068352 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058217 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 17:39:06.068352 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058221 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 17:39:06.068352 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058224 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 17:39:06.068352 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058228 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 17:39:06.068352 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058232 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 17:39:06.068352 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058234 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 17:39:06.068352 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058237 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 17:39:06.068352 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058240 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 17:39:06.068352 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058242 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 17:39:06.068352 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058245 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 17:39:06.068837 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058248 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 17:39:06.068837 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058251 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 17:39:06.068837 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058254 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 17:39:06.068837 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058257 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 17:39:06.068837 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058260 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 17:39:06.068837 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058263 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 17:39:06.068837 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058265 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 17:39:06.068837 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.058268 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 17:39:06.068837 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.058773 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 17:39:06.068837 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.065514 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 17 17:39:06.068837 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.065530 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 17 17:39:06.068837 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.066332 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 17 17:39:06.068837 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.066340 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 17 17:39:06.068837 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066408 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 17:39:06.068837 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066414 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 17:39:06.069220 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066417 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 17:39:06.069220 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066420 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 17:39:06.069220 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066423 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 17:39:06.069220 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066425 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 17:39:06.069220 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066428 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 17:39:06.069220 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066432 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 17:39:06.069220 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066434 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 17:39:06.069220 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066437 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 17:39:06.069220 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066454 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 17:39:06.069220 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066457 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 17:39:06.069220 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066466 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 17:39:06.069220 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066469 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 17:39:06.069220 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066472 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 17:39:06.069220 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066475 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 17:39:06.069220 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066481 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 17:39:06.069220 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066483 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 17:39:06.069220 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066486 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 17:39:06.069220 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066488 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 17:39:06.069220 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066491 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 17:39:06.069732 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066495 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 17:39:06.069732 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066499 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 17:39:06.069732 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066503 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 17:39:06.069732 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066507 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 17:39:06.069732 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066511 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 17:39:06.069732 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066514 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 17:39:06.069732 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066516 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 17:39:06.069732 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066519 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 17:39:06.069732 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066522 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 17:39:06.069732 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066525 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 17:39:06.069732 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066527 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 17:39:06.069732 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066530 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 17:39:06.069732 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066533 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 17:39:06.069732 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066535 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 17:39:06.069732 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066538 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 17:39:06.069732 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066540 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 17:39:06.069732 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066543 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 17:39:06.069732 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066546 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 17:39:06.069732 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066548 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 17:39:06.070187 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066550 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 17:39:06.070187 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066553 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 17:39:06.070187 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066556 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 17:39:06.070187 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066558 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 17:39:06.070187 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066561 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 17:39:06.070187 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066569 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 17:39:06.070187 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066572 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 17:39:06.070187 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066574 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 17:39:06.070187 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066577 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 17:39:06.070187 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066579 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 17:39:06.070187 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066581 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 17:39:06.070187 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066584 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 17:39:06.070187 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066586 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 17:39:06.070187 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066588 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 17:39:06.070187 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066591 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 17:39:06.070187 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066593 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 17:39:06.070187 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066596 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 17:39:06.070187 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066598 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 17:39:06.070187 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066600 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 17:39:06.070797 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066604 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 17:39:06.070797 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066608 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 17:39:06.070797 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066611 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 17:39:06.070797 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066614 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 17:39:06.070797 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066617 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 17:39:06.070797 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066620 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 17:39:06.070797 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066623 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 17:39:06.070797 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066625 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 17:39:06.070797 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066628 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 17:39:06.070797 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066631 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 17:39:06.070797 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066633 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 17:39:06.070797 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066635 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 17:39:06.070797 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066638 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 17:39:06.070797 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066640 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 17:39:06.070797 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066642 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 17:39:06.070797 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066645 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 17:39:06.070797 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066648 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 17:39:06.070797 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066650 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 17:39:06.070797 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066653 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 17:39:06.070797 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066661 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 17:39:06.071281 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066663 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 17:39:06.071281 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066666 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 17:39:06.071281 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066668 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 17 17:39:06.071281 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066671 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 17:39:06.071281 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066673 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 17:39:06.071281 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066675 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 17:39:06.071281 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066678 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 17:39:06.071281 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066680 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 17:39:06.071281 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066683 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 17:39:06.071281 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066685 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 17:39:06.071281 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066687 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 17:39:06.071281 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066690 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 17:39:06.071281 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066692 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 17:39:06.071281 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066695 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 17:39:06.071281 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066698 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 17:39:06.071281 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066700 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 17:39:06.071281 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066703 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 17:39:06.071281 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066706 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 17:39:06.071281 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066708 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 17:39:06.071281 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066710 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 17:39:06.071781 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.066716 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 17:39:06.071781 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066873 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 17:39:06.071781 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066878 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 17:39:06.071781 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066881 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 17:39:06.071781 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066883 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 17:39:06.071781 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066886 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 17:39:06.071781 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066889 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 17:39:06.071781 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066891 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 17:39:06.071781 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066894 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 17:39:06.071781 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066896 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 17:39:06.071781 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066899 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 17:39:06.071781 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066901 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 17:39:06.071781 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066910 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 17:39:06.071781 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066912 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 17:39:06.071781 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066915 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 17:39:06.072157 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066917 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 17:39:06.072157 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066919 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 17:39:06.072157 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066922 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 17:39:06.072157 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066925 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 17:39:06.072157 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066927 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 17:39:06.072157 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066929 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 17:39:06.072157 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066932 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 17:39:06.072157 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066934 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 17:39:06.072157 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066936 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 17:39:06.072157 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066939 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 17:39:06.072157 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066941 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 17:39:06.072157 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066944 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 17:39:06.072157 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066948 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 17:39:06.072157 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066952 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 17:39:06.072157 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066954 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 17:39:06.072157 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066957 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 17:39:06.072157 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066959 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 17:39:06.072157 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066962 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 17:39:06.072157 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066964 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 17:39:06.072636 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066967 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 17:39:06.072636 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066969 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 17:39:06.072636 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066971 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 17:39:06.072636 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066974 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 17:39:06.072636 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066977 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 17:39:06.072636 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066979 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 17:39:06.072636 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066981 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 17:39:06.072636 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066984 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 17:39:06.072636 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066986 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 17:39:06.072636 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066989 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 17:39:06.072636 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.066992 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 17:39:06.072636 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067001 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 17:39:06.072636 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067004 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 17:39:06.072636 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067006 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 17:39:06.072636 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067009 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 17:39:06.072636 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067011 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 17:39:06.072636 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067015 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 17:39:06.072636 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067018 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 17:39:06.072636 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067021 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 17:39:06.073084 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067024 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 17 17:39:06.073084 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067026 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 17:39:06.073084 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067029 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 17:39:06.073084 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067031 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 17:39:06.073084 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067034 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 17:39:06.073084 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067037 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 17:39:06.073084 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067039 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 17:39:06.073084 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067042 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 17:39:06.073084 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067044 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 17:39:06.073084 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067046 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 17:39:06.073084 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067049 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 17:39:06.073084 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067051 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 17:39:06.073084 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067054 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 17:39:06.073084 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067056 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 17:39:06.073084 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067058 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 17:39:06.073084 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067061 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 17:39:06.073084 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067063 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 17:39:06.073084 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067066 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 17:39:06.073084 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067068 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 17:39:06.073084 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067070 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 17:39:06.073560 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067073 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 17:39:06.073560 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067075 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 17:39:06.073560 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067077 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 17:39:06.073560 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067080 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 17:39:06.073560 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067082 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 17:39:06.073560 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067090 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 17:39:06.073560 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067093 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 17:39:06.073560 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067095 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 17:39:06.073560 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067097 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 17:39:06.073560 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067100 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 17:39:06.073560 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067103 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 17:39:06.073560 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067105 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 17:39:06.073560 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067107 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 17:39:06.073560 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067110 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 17:39:06.073560 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067113 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 17:39:06.073560 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067117 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 17:39:06.073560 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067119 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 17:39:06.073560 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067122 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 17:39:06.073560 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067124 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 17:39:06.073560 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067127 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 17:39:06.074040 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067130 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 17:39:06.074040 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067132 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 17:39:06.074040 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067135 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 17:39:06.074040 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067137 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 17:39:06.074040 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067139 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 17:39:06.074040 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067142 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 17:39:06.074040 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:06.067144 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 17:39:06.074040 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.067149 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 17:39:06.074040 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.067290 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jul 17 17:39:06.074040 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.070987 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 17 17:39:06.074040 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.072272 2563 server.go:1019] "Starting client certificate rotation" Jul 17 17:39:06.074040 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.072390 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 17:39:06.074040 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.072433 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 17:39:06.074847 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.074829 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 17:39:06.082402 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.082377 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 17:39:06.090737 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.090715 2563 log.go:25] "Validated CRI v1 runtime API" Jul 17 17:39:06.092685 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.092671 2563 log.go:25] "Validated CRI v1 image API" Jul 17 17:39:06.094192 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.094175 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 17 17:39:06.096354 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.096334 2563 fs.go:135] Filesystem UUIDs: map[1ae24718-caf9-4c42-9419-998e4fd9109e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c1844809-483b-4fab-b0e7-c85f9de1c18f:/dev/nvme0n1p4] Jul 17 17:39:06.096408 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.096354 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 17 17:39:06.101286 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.101165 2563 manager.go:216] Machine: {Timestamp:2026-07-17 17:39:06.100036395 +0000 UTC m=+0.284094162 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099942 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28a5d51eae37c4c3c6ec9905cab478 SystemUUID:ec28a5d5-1eae-37c4-c3c6-ec9905cab478 BootID:de1e2a31-79e5-43b0-bf51-27de222e4b5a Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ed:7c:8e:87:b1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ed:7c:8e:87:b1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:58:55:70:72:ba Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 17 17:39:06.101286 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.101273 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 17 17:39:06.101436 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.101358 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 17 17:39:06.103097 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.103079 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 17:39:06.104165 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.104136 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 17 17:39:06.104317 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.104171 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-127.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 17 17:39:06.104872 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.104861 2563 topology_manager.go:138] "Creating topology manager with none policy" Jul 17 17:39:06.104903 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.104874 2563 container_manager_linux.go:309] "Creating device plugin manager" Jul 17 17:39:06.104903 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.104882 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 17:39:06.105522 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.105511 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 17:39:06.106589 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.106579 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 17 17:39:06.109038 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.109026 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 17 17:39:06.109155 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.109145 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 17 17:39:06.109196 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.109188 2563 kubelet.go:486] "Attempting to sync node with API server" Jul 17 17:39:06.109224 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.109207 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 17 17:39:06.109224 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.109217 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 17 17:39:06.109287 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.109227 2563 kubelet.go:398] "Adding apiserver pod source" Jul 17 17:39:06.109287 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.109237 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 17 17:39:06.109698 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.109684 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 17:39:06.109807 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.109706 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 17:39:06.111818 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.111800 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 17 17:39:06.113318 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.113303 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 17 17:39:06.113380 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.113334 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 17 17:39:06.114734 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.114722 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 17 17:39:06.114771 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.114738 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 17 17:39:06.114771 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.114744 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 17 17:39:06.114771 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.114752 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 17 17:39:06.114771 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.114765 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 17 17:39:06.114883 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.114774 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 17 17:39:06.114883 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.114787 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 17 17:39:06.114883 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.114795 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 17 17:39:06.114883 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.114800 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 17 17:39:06.114883 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.114815 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 17 17:39:06.114883 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.114828 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 17 17:39:06.114883 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.114834 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 17 17:39:06.115383 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.115372 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 17 17:39:06.115416 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.115383 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 17 17:39:06.118974 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.118946 2563 server.go:1268] "Started kubelet" Jul 17 17:39:06.119070 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.119021 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 17 17:39:06.119195 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.119152 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-127.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 17 17:39:06.119195 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:06.119155 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-127.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 17 17:39:06.119355 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.119191 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 17 17:39:06.119355 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:06.119228 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 17 17:39:06.119355 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.119257 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 17 17:39:06.119976 ip-10-0-133-127 systemd[1]: Started Kubernetes Kubelet. Jul 17 17:39:06.122111 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.122087 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 17 17:39:06.123947 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.123918 2563 server.go:310] "Adding debug handlers to kubelet server" Jul 17 17:39:06.126114 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:06.125321 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-127.ec2.internal.18c324713b9c12fc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-127.ec2.internal,UID:ip-10-0-133-127.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-127.ec2.internal,},FirstTimestamp:2026-07-17 17:39:06.118836988 +0000 UTC m=+0.302894756,LastTimestamp:2026-07-17 17:39:06.118836988 +0000 UTC m=+0.302894756,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-127.ec2.internal,}" Jul 17 17:39:06.126307 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:06.126291 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 17 17:39:06.129222 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.129204 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 17 17:39:06.129299 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.129224 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 17 17:39:06.129299 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:06.129280 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-127.ec2.internal\" not found" Jul 17 17:39:06.129686 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.129662 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-24br4" Jul 17 17:39:06.129887 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.129779 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 17 17:39:06.129887 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.129799 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 17 17:39:06.129887 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.129795 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 17 17:39:06.130045 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.129926 2563 reconstruct.go:97] "Volume reconstruction finished" Jul 17 17:39:06.130045 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.129937 2563 reconciler.go:29] "Reconciler: start to sync state" Jul 17 17:39:06.130137 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.130072 2563 factory.go:55] Registering systemd factory Jul 17 17:39:06.130137 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.130089 2563 factory.go:223] Registration of the systemd container factory successfully Jul 17 17:39:06.130328 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.130315 2563 factory.go:153] Registering CRI-O factory Jul 17 17:39:06.130328 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.130331 2563 factory.go:223] Registration of the crio container factory successfully Jul 17 17:39:06.130437 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.130385 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 17 17:39:06.130437 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.130412 2563 factory.go:103] Registering Raw factory Jul 17 17:39:06.130437 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.130427 2563 manager.go:1196] Started watching for new ooms in manager Jul 17 17:39:06.131077 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.131054 2563 manager.go:349] Starting recovery of all containers Jul 17 17:39:06.131349 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:06.131328 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 17 17:39:06.138111 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.137934 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-24br4" Jul 17 17:39:06.142464 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.142424 2563 manager.go:354] Recovery completed Jul 17 17:39:06.142761 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:06.142737 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-127.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 17 17:39:06.146970 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.146951 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 17:39:06.149457 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.149425 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-127.ec2.internal" event="NodeHasSufficientMemory" Jul 17 17:39:06.149537 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.149473 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 17:39:06.149537 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.149491 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-127.ec2.internal" event="NodeHasSufficientPID" Jul 17 17:39:06.150020 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.150007 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 17 17:39:06.150020 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.150021 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 17 17:39:06.150115 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.150026 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 17:39:06.150115 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.150039 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 17 17:39:06.150822 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.150808 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-127.ec2.internal" event="NodeHasSufficientMemory" Jul 17 17:39:06.150895 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.150838 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 17:39:06.150895 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.150858 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-127.ec2.internal" event="NodeHasSufficientPID" Jul 17 17:39:06.150984 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.150971 2563 policy_none.go:49] "None policy: Start" Jul 17 17:39:06.150984 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.150983 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 17 17:39:06.151072 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.150995 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 17 17:39:06.151822 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.151810 2563 policy_none.go:47] "Start" Jul 17 17:39:06.190082 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.190060 2563 manager.go:337] "Starting Device Plugin manager" Jul 17 17:39:06.190174 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:06.190106 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 17 17:39:06.190174 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.190119 2563 server.go:87] "Starting device plugin registration server" Jul 17 17:39:06.190434 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.190414 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 17 17:39:06.190568 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.190432 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 17 17:39:06.190568 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.190555 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 17 17:39:06.190667 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.190648 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 17 17:39:06.190667 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.190661 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 17 17:39:06.191169 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:06.191152 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 17 17:39:06.191247 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:06.191204 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-127.ec2.internal\" not found" Jul 17 17:39:06.290972 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.290925 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 17:39:06.292153 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.291964 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-127.ec2.internal" event="NodeHasSufficientMemory" Jul 17 17:39:06.292153 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.291992 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 17:39:06.292153 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.292003 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-127.ec2.internal" event="NodeHasSufficientPID" Jul 17 17:39:06.292153 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.292034 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-127.ec2.internal" Jul 17 17:39:06.301057 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.300995 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-127.ec2.internal" Jul 17 17:39:06.301057 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:06.301023 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-127.ec2.internal\": node \"ip-10-0-133-127.ec2.internal\" not found" Jul 17 17:39:06.303921 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.303888 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 17 17:39:06.305318 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.305300 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 17 17:39:06.305396 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.305334 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 17 17:39:06.305396 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.305352 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jul 17 17:39:06.305396 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:06.305383 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 17 17:39:06.309092 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.309070 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 17:39:06.319244 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:06.319224 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-127.ec2.internal\" not found" Jul 17 17:39:06.405814 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.405769 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-127.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-127.ec2.internal"] Jul 17 17:39:06.405946 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.405875 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 17:39:06.407431 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.407412 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-127.ec2.internal" event="NodeHasSufficientMemory" Jul 17 17:39:06.407539 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.407470 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 17:39:06.407539 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.407486 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-127.ec2.internal" event="NodeHasSufficientPID" Jul 17 17:39:06.408774 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.408760 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 17:39:06.408904 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.408889 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-127.ec2.internal" Jul 17 17:39:06.408963 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.408928 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 17:39:06.409556 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.409537 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-127.ec2.internal" event="NodeHasSufficientMemory" Jul 17 17:39:06.409556 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.409537 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-127.ec2.internal" event="NodeHasSufficientMemory" Jul 17 17:39:06.409654 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.409579 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 17:39:06.409654 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.409594 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-127.ec2.internal" event="NodeHasSufficientPID" Jul 17 17:39:06.409728 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.409580 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 17:39:06.409774 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.409755 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-127.ec2.internal" event="NodeHasSufficientPID" Jul 17 17:39:06.410753 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.410738 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-127.ec2.internal" Jul 17 17:39:06.410808 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.410765 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 17:39:06.411456 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.411425 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-127.ec2.internal" event="NodeHasSufficientMemory" Jul 17 17:39:06.411514 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.411484 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 17:39:06.411514 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.411496 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-127.ec2.internal" event="NodeHasSufficientPID" Jul 17 17:39:06.419510 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:06.419492 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-127.ec2.internal\" not found" Jul 17 17:39:06.432319 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.432294 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5268946509bf7913d6cec963b2c9ff24-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-127.ec2.internal\" (UID: \"5268946509bf7913d6cec963b2c9ff24\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-127.ec2.internal" Jul 17 17:39:06.432411 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.432323 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5268946509bf7913d6cec963b2c9ff24-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-127.ec2.internal\" (UID: \"5268946509bf7913d6cec963b2c9ff24\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-127.ec2.internal" Jul 17 17:39:06.432411 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.432341 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7276ebbf3e3a8cdc488397a5fe19d27c-config\") pod \"kube-apiserver-proxy-ip-10-0-133-127.ec2.internal\" (UID: \"7276ebbf3e3a8cdc488397a5fe19d27c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-127.ec2.internal" Jul 17 17:39:06.440236 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:06.440218 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-127.ec2.internal\" not found" node="ip-10-0-133-127.ec2.internal" Jul 17 17:39:06.444854 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:06.444831 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-127.ec2.internal\" not found" node="ip-10-0-133-127.ec2.internal" Jul 17 17:39:06.520160 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:06.520117 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-127.ec2.internal\" not found" Jul 17 17:39:06.533495 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.533464 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5268946509bf7913d6cec963b2c9ff24-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-127.ec2.internal\" (UID: \"5268946509bf7913d6cec963b2c9ff24\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-127.ec2.internal" Jul 17 17:39:06.533612 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.533504 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5268946509bf7913d6cec963b2c9ff24-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-127.ec2.internal\" (UID: \"5268946509bf7913d6cec963b2c9ff24\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-127.ec2.internal" Jul 17 17:39:06.533612 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.533529 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7276ebbf3e3a8cdc488397a5fe19d27c-config\") pod \"kube-apiserver-proxy-ip-10-0-133-127.ec2.internal\" (UID: \"7276ebbf3e3a8cdc488397a5fe19d27c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-127.ec2.internal" Jul 17 17:39:06.533612 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.533579 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7276ebbf3e3a8cdc488397a5fe19d27c-config\") pod \"kube-apiserver-proxy-ip-10-0-133-127.ec2.internal\" (UID: \"7276ebbf3e3a8cdc488397a5fe19d27c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-127.ec2.internal" Jul 17 17:39:06.533612 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.533588 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5268946509bf7913d6cec963b2c9ff24-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-127.ec2.internal\" (UID: \"5268946509bf7913d6cec963b2c9ff24\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-127.ec2.internal" Jul 17 17:39:06.533762 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.533578 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5268946509bf7913d6cec963b2c9ff24-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-127.ec2.internal\" (UID: \"5268946509bf7913d6cec963b2c9ff24\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-127.ec2.internal" Jul 17 17:39:06.621016 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:06.620937 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-127.ec2.internal\" not found" Jul 17 17:39:06.721506 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:06.721466 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-127.ec2.internal\" not found" Jul 17 17:39:06.743023 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.742995 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-127.ec2.internal" Jul 17 17:39:06.747062 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:06.746927 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-127.ec2.internal" Jul 17 17:39:06.822216 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:06.822164 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-127.ec2.internal\" not found" Jul 17 17:39:06.922743 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:06.922662 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-127.ec2.internal\" not found" Jul 17 17:39:07.023249 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:07.023219 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-127.ec2.internal\" not found" Jul 17 17:39:07.053565 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:07.053539 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 17:39:07.072265 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:07.072241 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 17 17:39:07.072393 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:07.072376 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 17 17:39:07.072452 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:07.072391 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 17 17:39:07.123469 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:07.123422 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-127.ec2.internal\" not found" Jul 17 17:39:07.143294 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:07.143260 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 17:34:06 +0000 UTC" deadline="2028-05-01 10:50:22.70925847 +0000 UTC" Jul 17 17:39:07.143294 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:07.143287 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15689h11m15.56597428s" Jul 17 17:39:07.223595 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:07.223506 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-127.ec2.internal\" not found" Jul 17 17:39:07.237800 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:07.237765 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5268946509bf7913d6cec963b2c9ff24.slice/crio-cd7f258f43dca8e2b96364a9674dc9f44bf4cb21a9271966537bfb0e2e2ec22e WatchSource:0}: Error finding container cd7f258f43dca8e2b96364a9674dc9f44bf4cb21a9271966537bfb0e2e2ec22e: Status 404 returned error can't find the container with id cd7f258f43dca8e2b96364a9674dc9f44bf4cb21a9271966537bfb0e2e2ec22e Jul 17 17:39:07.241666 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:07.241648 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 17:39:07.308482 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:07.308415 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-127.ec2.internal" event={"ID":"5268946509bf7913d6cec963b2c9ff24","Type":"ContainerStarted","Data":"cd7f258f43dca8e2b96364a9674dc9f44bf4cb21a9271966537bfb0e2e2ec22e"} Jul 17 17:39:07.323619 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:07.323587 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-127.ec2.internal\" not found" Jul 17 17:39:07.342928 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:07.342899 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7276ebbf3e3a8cdc488397a5fe19d27c.slice/crio-dae7d61725ddb5be55132b3f835c4a71152f06a5ac819eb642ccf2e29e881037 WatchSource:0}: Error finding container dae7d61725ddb5be55132b3f835c4a71152f06a5ac819eb642ccf2e29e881037: Status 404 returned error can't find the container with id dae7d61725ddb5be55132b3f835c4a71152f06a5ac819eb642ccf2e29e881037 Jul 17 17:39:07.427777 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:07.427736 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-127.ec2.internal\" not found" Jul 17 17:39:07.449206 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:07.449188 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 17:39:07.532354 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:07.532307 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-127.ec2.internal" Jul 17 17:39:07.540916 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:07.540895 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 17:39:07.547232 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:07.547209 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 17:39:07.547997 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:07.547984 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-127.ec2.internal" Jul 17 17:39:07.554860 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:07.554834 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 17:39:08.080620 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.080570 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 17:39:08.110335 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.110302 2563 apiserver.go:52] "Watching apiserver" Jul 17 17:39:08.124040 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.124005 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 17 17:39:08.124552 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.124507 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-6dqlm","openshift-ovn-kubernetes/ovnkube-node-lkfst","kube-system/global-pull-secret-syncer-xxhkm","kube-system/konnectivity-agent-vw726","kube-system/kube-apiserver-proxy-ip-10-0-133-127.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72vj","openshift-cluster-node-tuning-operator/tuned-fxzks","openshift-multus/multus-additional-cni-plugins-zfjf6","openshift-multus/network-metrics-daemon-82zfd","openshift-network-diagnostics/network-check-target-cpx5f","openshift-dns/node-resolver-f97wh","openshift-image-registry/node-ca-b2qql","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-127.ec2.internal","openshift-multus/multus-mhw56"] Jul 17 17:39:08.127305 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.127275 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.130645 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.130077 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f97wh" Jul 17 17:39:08.130645 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.130247 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 17 17:39:08.130645 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.130463 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 17 17:39:08.130645 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.130513 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 17 17:39:08.130645 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.130495 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rwz5f\"" Jul 17 17:39:08.132943 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.132920 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 17 17:39:08.133047 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.132959 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 17 17:39:08.133191 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.133171 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lnsdg\"" Jul 17 17:39:08.139022 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.138996 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.140804 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.140780 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 17:39:08.141374 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.141348 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vw726" Jul 17 17:39:08.141797 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.141761 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-os-release\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.141903 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.141799 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/29d7b457-69a2-47e0-9da5-4b88178bea9d-cni-binary-copy\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.141903 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.141828 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-etc-kubernetes\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.141903 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.141853 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m26pb\" (UniqueName: \"kubernetes.io/projected/d4dcc94c-110b-4b31-8a6c-dfbae393c058-kube-api-access-m26pb\") pod \"node-resolver-f97wh\" (UID: \"d4dcc94c-110b-4b31-8a6c-dfbae393c058\") " pod="openshift-dns/node-resolver-f97wh" Jul 17 17:39:08.141903 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.141882 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-system-cni-dir\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.142141 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.141908 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-multus-cni-dir\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.142141 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.141932 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-etc-systemd\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.142141 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.141954 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-var-lib-kubelet\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.142141 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.141974 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-n7qq5\"" Jul 17 17:39:08.142141 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.142071 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 17 17:39:08.142391 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.142165 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 17 17:39:08.142391 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.142249 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 17 17:39:08.142391 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.141979 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d4dcc94c-110b-4b31-8a6c-dfbae393c058-hosts-file\") pod \"node-resolver-f97wh\" (UID: \"d4dcc94c-110b-4b31-8a6c-dfbae393c058\") " pod="openshift-dns/node-resolver-f97wh" Jul 17 17:39:08.142604 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.142422 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-etc-sysctl-conf\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.142604 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.142452 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-lib-modules\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.142604 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.142478 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-etc-tuned\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.142604 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.142502 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4dcc94c-110b-4b31-8a6c-dfbae393c058-tmp-dir\") pod \"node-resolver-f97wh\" (UID: \"d4dcc94c-110b-4b31-8a6c-dfbae393c058\") " pod="openshift-dns/node-resolver-f97wh" Jul 17 17:39:08.142604 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.142547 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/29d7b457-69a2-47e0-9da5-4b88178bea9d-multus-daemon-config\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.142604 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.142571 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-etc-sysctl-d\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.142604 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.142591 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-run\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.143007 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.142632 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-host-var-lib-cni-bin\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.143007 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.142676 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 17 17:39:08.143007 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.142685 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-host-var-lib-cni-multus\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.143007 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.142715 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-multus-conf-dir\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.143007 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.142772 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-etc-modprobe-d\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.143007 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.142797 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-sys\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.143007 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.142822 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-host\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.143007 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.142859 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbvkr\" (UniqueName: \"kubernetes.io/projected/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-kube-api-access-pbvkr\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.143007 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.142894 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-multus-socket-dir-parent\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.143007 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.142927 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-hostroot\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.143007 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.142951 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-host-run-multus-certs\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.143007 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.142980 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-host-run-k8s-cni-cncf-io\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.143656 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.143018 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-etc-kubernetes\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.143656 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.143060 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-host-run-netns\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.143656 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.143090 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-host-var-lib-kubelet\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.143656 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.143121 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj6zn\" (UniqueName: \"kubernetes.io/projected/29d7b457-69a2-47e0-9da5-4b88178bea9d-kube-api-access-gj6zn\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.143656 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.143170 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-etc-sysconfig\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.143656 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.143192 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-tmp\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.143656 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.143215 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-cnibin\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.144655 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.144633 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 17 17:39:08.145015 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.144998 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 17 17:39:08.145164 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.145003 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wwzjk\"" Jul 17 17:39:08.145570 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.145545 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6dqlm" Jul 17 17:39:08.148095 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.148072 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h85zb\"" Jul 17 17:39:08.148281 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.148265 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 17 17:39:08.148478 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.148459 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72vj" Jul 17 17:39:08.148478 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.148474 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 17 17:39:08.148655 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.148474 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 17 17:39:08.150831 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.150616 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:39:08.150831 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.150665 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 17 17:39:08.150831 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:08.150699 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82zfd" podUID="05410b3d-9fba-454e-be26-568dbfce20f4" Jul 17 17:39:08.151049 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.151032 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 17 17:39:08.151107 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.151071 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-whxkf\"" Jul 17 17:39:08.151246 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.151228 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 17 17:39:08.153377 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.153142 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zfjf6" Jul 17 17:39:08.156853 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.156659 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 17 17:39:08.156853 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.156667 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 17 17:39:08.156853 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.156719 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xcmrz\"" Jul 17 17:39:08.157251 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.157227 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.159977 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.159701 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:39:08.159977 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:08.159766 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpx5f" podUID="c5789fef-e8da-4204-b2af-3468ba9fac6d" Jul 17 17:39:08.160247 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.160230 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 17 17:39:08.160409 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.160394 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 17 17:39:08.160603 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.160584 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hhwz6\"" Jul 17 17:39:08.160864 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.160850 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 17 17:39:08.161000 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.160967 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 17 17:39:08.161182 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.161169 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 17 17:39:08.161340 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.161326 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 17 17:39:08.163922 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.163901 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b2qql" Jul 17 17:39:08.165475 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.165449 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:08.165630 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:08.165600 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxhkm" podUID="6d3cc0e8-3539-4637-b778-a4cd8663d4f2" Jul 17 17:39:08.166749 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.166727 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 17 17:39:08.168023 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.168001 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 17 17:39:08.168119 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.168026 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zqx28\"" Jul 17 17:39:08.168119 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.168112 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 17 17:39:08.170323 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.170299 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-84m8w" Jul 17 17:39:08.178898 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.178875 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-84m8w" Jul 17 17:39:08.231389 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.231363 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 17 17:39:08.244438 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.244411 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-var-lib-kubelet\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.244438 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.244443 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d4dcc94c-110b-4b31-8a6c-dfbae393c058-hosts-file\") pod \"node-resolver-f97wh\" (UID: \"d4dcc94c-110b-4b31-8a6c-dfbae393c058\") " pod="openshift-dns/node-resolver-f97wh" Jul 17 17:39:08.244701 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.244487 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-host-kubelet\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.244701 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.244513 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-systemd-units\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.244701 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.244536 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-run-ovn\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.244701 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.244560 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/85eee69e-719a-48b1-95fb-e2012eb6e31f-host\") pod \"node-ca-b2qql\" (UID: \"85eee69e-719a-48b1-95fb-e2012eb6e31f\") " pod="openshift-image-registry/node-ca-b2qql" Jul 17 17:39:08.244701 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.244584 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-etc-tuned\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.244701 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.244608 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-host-slash\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.244701 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.244618 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d4dcc94c-110b-4b31-8a6c-dfbae393c058-hosts-file\") pod \"node-resolver-f97wh\" (UID: \"d4dcc94c-110b-4b31-8a6c-dfbae393c058\") " pod="openshift-dns/node-resolver-f97wh" Jul 17 17:39:08.244701 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.244632 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6d3cc0e8-3539-4637-b778-a4cd8663d4f2-dbus\") pod \"global-pull-secret-syncer-xxhkm\" (UID: \"6d3cc0e8-3539-4637-b778-a4cd8663d4f2\") " pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:08.244701 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.244656 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f65fe5ae-90c2-4f29-8510-f6a0edca8c54-device-dir\") pod \"aws-ebs-csi-driver-node-b72vj\" (UID: \"f65fe5ae-90c2-4f29-8510-f6a0edca8c54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72vj" Jul 17 17:39:08.244701 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.244682 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-var-lib-kubelet\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.244701 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.244684 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76zqs\" (UniqueName: \"kubernetes.io/projected/05410b3d-9fba-454e-be26-568dbfce20f4-kube-api-access-76zqs\") pod \"network-metrics-daemon-82zfd\" (UID: \"05410b3d-9fba-454e-be26-568dbfce20f4\") " pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:39:08.245117 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.244712 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c3987132-0222-45e9-8c90-7a3ad682329e-cnibin\") pod \"multus-additional-cni-plugins-zfjf6\" (UID: \"c3987132-0222-45e9-8c90-7a3ad682329e\") " pod="openshift-multus/multus-additional-cni-plugins-zfjf6" Jul 17 17:39:08.245117 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.244759 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c3987132-0222-45e9-8c90-7a3ad682329e-cni-binary-copy\") pod \"multus-additional-cni-plugins-zfjf6\" (UID: \"c3987132-0222-45e9-8c90-7a3ad682329e\") " pod="openshift-multus/multus-additional-cni-plugins-zfjf6" Jul 17 17:39:08.245117 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.244784 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt665\" (UniqueName: \"kubernetes.io/projected/c3987132-0222-45e9-8c90-7a3ad682329e-kube-api-access-xt665\") pod \"multus-additional-cni-plugins-zfjf6\" (UID: \"c3987132-0222-45e9-8c90-7a3ad682329e\") " pod="openshift-multus/multus-additional-cni-plugins-zfjf6" Jul 17 17:39:08.245117 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.244817 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-host-var-lib-cni-multus\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.245117 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.244855 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-multus-conf-dir\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.245117 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.244878 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7004a1df-981b-4eb2-bb70-742617ac70e4-agent-certs\") pod \"konnectivity-agent-vw726\" (UID: \"7004a1df-981b-4eb2-bb70-742617ac70e4\") " pod="kube-system/konnectivity-agent-vw726" Jul 17 17:39:08.245117 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.244918 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-host-var-lib-cni-multus\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.245117 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.244943 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-etc-modprobe-d\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.245117 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.244973 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 17 17:39:08.245117 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.244981 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-host\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.245117 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245041 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-multus-socket-dir-parent\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.245117 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245067 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-hostroot\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.245117 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245076 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-etc-modprobe-d\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.245117 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245101 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-host-run-multus-certs\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.245117 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245116 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-multus-socket-dir-parent\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.245117 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245124 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/85eee69e-719a-48b1-95fb-e2012eb6e31f-serviceca\") pod \"node-ca-b2qql\" (UID: \"85eee69e-719a-48b1-95fb-e2012eb6e31f\") " pod="openshift-image-registry/node-ca-b2qql" Jul 17 17:39:08.245728 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245111 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-host\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.245728 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245149 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-hostroot\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.245728 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245152 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-host-run-k8s-cni-cncf-io\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.245728 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245197 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-etc-kubernetes\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.245728 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245194 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-host-run-multus-certs\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.245728 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245224 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-var-lib-openvswitch\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.245728 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245250 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-ovnkube-script-lib\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.245728 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245270 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-host-run-k8s-cni-cncf-io\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.245728 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245276 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-etc-kubernetes\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.245728 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245276 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6d3cc0e8-3539-4637-b778-a4cd8663d4f2-kubelet-config\") pod \"global-pull-secret-syncer-xxhkm\" (UID: \"6d3cc0e8-3539-4637-b778-a4cd8663d4f2\") " pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:08.245728 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245310 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f65fe5ae-90c2-4f29-8510-f6a0edca8c54-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b72vj\" (UID: \"f65fe5ae-90c2-4f29-8510-f6a0edca8c54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72vj" Jul 17 17:39:08.245728 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245338 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c3987132-0222-45e9-8c90-7a3ad682329e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zfjf6\" (UID: \"c3987132-0222-45e9-8c90-7a3ad682329e\") " pod="openshift-multus/multus-additional-cni-plugins-zfjf6" Jul 17 17:39:08.245728 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245364 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-host-run-netns\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.245728 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.244978 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-multus-conf-dir\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.245728 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245389 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj6zn\" (UniqueName: \"kubernetes.io/projected/29d7b457-69a2-47e0-9da5-4b88178bea9d-kube-api-access-gj6zn\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.245728 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245414 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-etc-sysconfig\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.245728 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245421 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-host-run-netns\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.245728 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245437 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-os-release\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.246371 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245496 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-etc-sysconfig\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.246371 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245503 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhrrt\" (UniqueName: \"kubernetes.io/projected/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-kube-api-access-bhrrt\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.246371 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245531 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-os-release\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.246371 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245552 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f88ed1a5-3fe2-4745-8ceb-ad864fd4f686-iptables-alerter-script\") pod \"iptables-alerter-6dqlm\" (UID: \"f88ed1a5-3fe2-4745-8ceb-ad864fd4f686\") " pod="openshift-network-operator/iptables-alerter-6dqlm" Jul 17 17:39:08.246371 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245579 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f88ed1a5-3fe2-4745-8ceb-ad864fd4f686-host-slash\") pod \"iptables-alerter-6dqlm\" (UID: \"f88ed1a5-3fe2-4745-8ceb-ad864fd4f686\") " pod="openshift-network-operator/iptables-alerter-6dqlm" Jul 17 17:39:08.246371 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245603 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f65fe5ae-90c2-4f29-8510-f6a0edca8c54-sys-fs\") pod \"aws-ebs-csi-driver-node-b72vj\" (UID: \"f65fe5ae-90c2-4f29-8510-f6a0edca8c54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72vj" Jul 17 17:39:08.246371 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245654 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3987132-0222-45e9-8c90-7a3ad682329e-system-cni-dir\") pod \"multus-additional-cni-plugins-zfjf6\" (UID: \"c3987132-0222-45e9-8c90-7a3ad682329e\") " pod="openshift-multus/multus-additional-cni-plugins-zfjf6" Jul 17 17:39:08.246371 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245676 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c3987132-0222-45e9-8c90-7a3ad682329e-os-release\") pod \"multus-additional-cni-plugins-zfjf6\" (UID: \"c3987132-0222-45e9-8c90-7a3ad682329e\") " pod="openshift-multus/multus-additional-cni-plugins-zfjf6" Jul 17 17:39:08.246371 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245697 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m26pb\" (UniqueName: \"kubernetes.io/projected/d4dcc94c-110b-4b31-8a6c-dfbae393c058-kube-api-access-m26pb\") pod \"node-resolver-f97wh\" (UID: \"d4dcc94c-110b-4b31-8a6c-dfbae393c058\") " pod="openshift-dns/node-resolver-f97wh" Jul 17 17:39:08.246371 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245714 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-system-cni-dir\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.246371 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245733 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c3987132-0222-45e9-8c90-7a3ad682329e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zfjf6\" (UID: \"c3987132-0222-45e9-8c90-7a3ad682329e\") " pod="openshift-multus/multus-additional-cni-plugins-zfjf6" Jul 17 17:39:08.246371 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245750 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-host-cni-bin\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.246371 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245766 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-host-cni-netd\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.246371 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245781 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-run-systemd\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.246371 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245783 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-system-cni-dir\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.246371 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245795 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-run-openvswitch\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.246972 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245841 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swqvs\" (UniqueName: \"kubernetes.io/projected/f88ed1a5-3fe2-4745-8ceb-ad864fd4f686-kube-api-access-swqvs\") pod \"iptables-alerter-6dqlm\" (UID: \"f88ed1a5-3fe2-4745-8ceb-ad864fd4f686\") " pod="openshift-network-operator/iptables-alerter-6dqlm" Jul 17 17:39:08.246972 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245876 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f65fe5ae-90c2-4f29-8510-f6a0edca8c54-socket-dir\") pod \"aws-ebs-csi-driver-node-b72vj\" (UID: \"f65fe5ae-90c2-4f29-8510-f6a0edca8c54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72vj" Jul 17 17:39:08.246972 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245909 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f65fe5ae-90c2-4f29-8510-f6a0edca8c54-etc-selinux\") pod \"aws-ebs-csi-driver-node-b72vj\" (UID: \"f65fe5ae-90c2-4f29-8510-f6a0edca8c54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72vj" Jul 17 17:39:08.246972 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245942 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c3987132-0222-45e9-8c90-7a3ad682329e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zfjf6\" (UID: \"c3987132-0222-45e9-8c90-7a3ad682329e\") " pod="openshift-multus/multus-additional-cni-plugins-zfjf6" Jul 17 17:39:08.246972 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.245986 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-etc-sysctl-conf\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.246972 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246019 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-lib-modules\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.246972 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246044 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4dcc94c-110b-4b31-8a6c-dfbae393c058-tmp-dir\") pod \"node-resolver-f97wh\" (UID: \"d4dcc94c-110b-4b31-8a6c-dfbae393c058\") " pod="openshift-dns/node-resolver-f97wh" Jul 17 17:39:08.246972 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246069 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/29d7b457-69a2-47e0-9da5-4b88178bea9d-multus-daemon-config\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.246972 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246097 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxcz9\" (UniqueName: \"kubernetes.io/projected/c5789fef-e8da-4204-b2af-3468ba9fac6d-kube-api-access-wxcz9\") pod \"network-check-target-cpx5f\" (UID: \"c5789fef-e8da-4204-b2af-3468ba9fac6d\") " pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:39:08.246972 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246145 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-etc-sysctl-d\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.246972 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246169 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-run\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.246972 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246194 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-host-var-lib-cni-bin\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.246972 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246221 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-host-run-netns\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.246972 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246248 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-ovnkube-config\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.246972 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246342 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-ovn-node-metrics-cert\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.246972 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246368 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05410b3d-9fba-454e-be26-568dbfce20f4-metrics-certs\") pod \"network-metrics-daemon-82zfd\" (UID: \"05410b3d-9fba-454e-be26-568dbfce20f4\") " pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:39:08.246972 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246417 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4dcc94c-110b-4b31-8a6c-dfbae393c058-tmp-dir\") pod \"node-resolver-f97wh\" (UID: \"d4dcc94c-110b-4b31-8a6c-dfbae393c058\") " pod="openshift-dns/node-resolver-f97wh" Jul 17 17:39:08.247821 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246415 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-etc-sysctl-d\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.247821 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246402 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-sys\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.247821 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246505 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-sys\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.247821 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246505 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbvkr\" (UniqueName: \"kubernetes.io/projected/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-kube-api-access-pbvkr\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.247821 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246550 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.247821 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246578 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7004a1df-981b-4eb2-bb70-742617ac70e4-konnectivity-ca\") pod \"konnectivity-agent-vw726\" (UID: \"7004a1df-981b-4eb2-bb70-742617ac70e4\") " pod="kube-system/konnectivity-agent-vw726" Jul 17 17:39:08.247821 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246626 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-run\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.247821 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246659 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-etc-openvswitch\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.247821 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246691 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc77p\" (UniqueName: \"kubernetes.io/projected/85eee69e-719a-48b1-95fb-e2012eb6e31f-kube-api-access-rc77p\") pod \"node-ca-b2qql\" (UID: \"85eee69e-719a-48b1-95fb-e2012eb6e31f\") " pod="openshift-image-registry/node-ca-b2qql" Jul 17 17:39:08.247821 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246718 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d3cc0e8-3539-4637-b778-a4cd8663d4f2-original-pull-secret\") pod \"global-pull-secret-syncer-xxhkm\" (UID: \"6d3cc0e8-3539-4637-b778-a4cd8663d4f2\") " pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:08.247821 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246696 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-etc-sysctl-conf\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.247821 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246762 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f65fe5ae-90c2-4f29-8510-f6a0edca8c54-registration-dir\") pod \"aws-ebs-csi-driver-node-b72vj\" (UID: \"f65fe5ae-90c2-4f29-8510-f6a0edca8c54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72vj" Jul 17 17:39:08.247821 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246814 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-host-var-lib-cni-bin\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.247821 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246825 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-host-var-lib-kubelet\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.247821 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246855 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-env-overrides\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.247821 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246886 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-lib-modules\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.247821 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246895 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-host-var-lib-kubelet\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.248671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246911 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztwn6\" (UniqueName: \"kubernetes.io/projected/f65fe5ae-90c2-4f29-8510-f6a0edca8c54-kube-api-access-ztwn6\") pod \"aws-ebs-csi-driver-node-b72vj\" (UID: \"f65fe5ae-90c2-4f29-8510-f6a0edca8c54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72vj" Jul 17 17:39:08.248671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246950 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-tmp\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.248671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.246986 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/29d7b457-69a2-47e0-9da5-4b88178bea9d-multus-daemon-config\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.248671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.247010 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-cnibin\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.248671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.247048 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/29d7b457-69a2-47e0-9da5-4b88178bea9d-cni-binary-copy\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.248671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.247076 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-etc-kubernetes\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.248671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.247117 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-multus-cni-dir\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.248671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.247181 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-node-log\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.248671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.247223 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-host-run-ovn-kubernetes\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.248671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.247281 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-cnibin\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.248671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.247317 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-log-socket\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.248671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.247346 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-etc-kubernetes\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.248671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.247349 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-etc-systemd\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.248671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.247370 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29d7b457-69a2-47e0-9da5-4b88178bea9d-multus-cni-dir\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.248671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.247399 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-etc-systemd\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.248671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.247546 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/29d7b457-69a2-47e0-9da5-4b88178bea9d-cni-binary-copy\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.251557 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.250897 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-tmp\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.251699 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.251609 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-etc-tuned\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.259379 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.259348 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbvkr\" (UniqueName: \"kubernetes.io/projected/1c9cdba6-ccaa-48e2-a37c-c84f560968bf-kube-api-access-pbvkr\") pod \"tuned-fxzks\" (UID: \"1c9cdba6-ccaa-48e2-a37c-c84f560968bf\") " pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.259564 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.259345 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj6zn\" (UniqueName: \"kubernetes.io/projected/29d7b457-69a2-47e0-9da5-4b88178bea9d-kube-api-access-gj6zn\") pod \"multus-mhw56\" (UID: \"29d7b457-69a2-47e0-9da5-4b88178bea9d\") " pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.266738 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.266698 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m26pb\" (UniqueName: \"kubernetes.io/projected/d4dcc94c-110b-4b31-8a6c-dfbae393c058-kube-api-access-m26pb\") pod \"node-resolver-f97wh\" (UID: \"d4dcc94c-110b-4b31-8a6c-dfbae393c058\") " pod="openshift-dns/node-resolver-f97wh" Jul 17 17:39:08.313551 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.313496 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-127.ec2.internal" event={"ID":"7276ebbf3e3a8cdc488397a5fe19d27c","Type":"ContainerStarted","Data":"dae7d61725ddb5be55132b3f835c4a71152f06a5ac819eb642ccf2e29e881037"} Jul 17 17:39:08.348586 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.347824 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-host-cni-bin\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.348586 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.347863 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-host-cni-netd\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.348586 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.347891 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-run-systemd\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.348586 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.347940 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-run-openvswitch\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.348586 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.347967 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swqvs\" (UniqueName: \"kubernetes.io/projected/f88ed1a5-3fe2-4745-8ceb-ad864fd4f686-kube-api-access-swqvs\") pod \"iptables-alerter-6dqlm\" (UID: \"f88ed1a5-3fe2-4745-8ceb-ad864fd4f686\") " pod="openshift-network-operator/iptables-alerter-6dqlm" Jul 17 17:39:08.348586 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.347992 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f65fe5ae-90c2-4f29-8510-f6a0edca8c54-socket-dir\") pod \"aws-ebs-csi-driver-node-b72vj\" (UID: \"f65fe5ae-90c2-4f29-8510-f6a0edca8c54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72vj" Jul 17 17:39:08.348586 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.348016 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f65fe5ae-90c2-4f29-8510-f6a0edca8c54-etc-selinux\") pod \"aws-ebs-csi-driver-node-b72vj\" (UID: \"f65fe5ae-90c2-4f29-8510-f6a0edca8c54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72vj" Jul 17 17:39:08.348586 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.348040 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c3987132-0222-45e9-8c90-7a3ad682329e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zfjf6\" (UID: \"c3987132-0222-45e9-8c90-7a3ad682329e\") " pod="openshift-multus/multus-additional-cni-plugins-zfjf6" Jul 17 17:39:08.348586 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.348087 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxcz9\" (UniqueName: \"kubernetes.io/projected/c5789fef-e8da-4204-b2af-3468ba9fac6d-kube-api-access-wxcz9\") pod \"network-check-target-cpx5f\" (UID: \"c5789fef-e8da-4204-b2af-3468ba9fac6d\") " pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:39:08.348586 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.348105 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-host-run-netns\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.348586 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.348121 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-ovnkube-config\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.348586 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.348136 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-ovn-node-metrics-cert\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.348586 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.348152 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05410b3d-9fba-454e-be26-568dbfce20f4-metrics-certs\") pod \"network-metrics-daemon-82zfd\" (UID: \"05410b3d-9fba-454e-be26-568dbfce20f4\") " pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:39:08.348586 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.348171 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.348586 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.348209 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7004a1df-981b-4eb2-bb70-742617ac70e4-konnectivity-ca\") pod \"konnectivity-agent-vw726\" (UID: \"7004a1df-981b-4eb2-bb70-742617ac70e4\") " pod="kube-system/konnectivity-agent-vw726" Jul 17 17:39:08.348586 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.348237 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-etc-openvswitch\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.348586 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.348262 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc77p\" (UniqueName: \"kubernetes.io/projected/85eee69e-719a-48b1-95fb-e2012eb6e31f-kube-api-access-rc77p\") pod \"node-ca-b2qql\" (UID: \"85eee69e-719a-48b1-95fb-e2012eb6e31f\") " pod="openshift-image-registry/node-ca-b2qql" Jul 17 17:39:08.349650 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.348290 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d3cc0e8-3539-4637-b778-a4cd8663d4f2-original-pull-secret\") pod \"global-pull-secret-syncer-xxhkm\" (UID: \"6d3cc0e8-3539-4637-b778-a4cd8663d4f2\") " pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:08.349650 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.348315 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f65fe5ae-90c2-4f29-8510-f6a0edca8c54-registration-dir\") pod \"aws-ebs-csi-driver-node-b72vj\" (UID: \"f65fe5ae-90c2-4f29-8510-f6a0edca8c54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72vj" Jul 17 17:39:08.349650 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.348340 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-env-overrides\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.349650 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.348366 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztwn6\" (UniqueName: \"kubernetes.io/projected/f65fe5ae-90c2-4f29-8510-f6a0edca8c54-kube-api-access-ztwn6\") pod \"aws-ebs-csi-driver-node-b72vj\" (UID: \"f65fe5ae-90c2-4f29-8510-f6a0edca8c54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72vj" Jul 17 17:39:08.349650 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.348399 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-node-log\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.349650 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.348428 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-host-run-ovn-kubernetes\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.349650 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.348459 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-log-socket\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.349650 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.348491 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-host-kubelet\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.349650 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:08.348641 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 17:39:08.349650 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.348665 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f65fe5ae-90c2-4f29-8510-f6a0edca8c54-etc-selinux\") pod \"aws-ebs-csi-driver-node-b72vj\" (UID: \"f65fe5ae-90c2-4f29-8510-f6a0edca8c54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72vj" Jul 17 17:39:08.349650 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:08.348743 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d3cc0e8-3539-4637-b778-a4cd8663d4f2-original-pull-secret podName:6d3cc0e8-3539-4637-b778-a4cd8663d4f2 nodeName:}" failed. No retries permitted until 2026-07-17 17:39:08.848701746 +0000 UTC m=+3.032759518 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d3cc0e8-3539-4637-b778-a4cd8663d4f2-original-pull-secret") pod "global-pull-secret-syncer-xxhkm" (UID: "6d3cc0e8-3539-4637-b778-a4cd8663d4f2") : object "kube-system"/"original-pull-secret" not registered Jul 17 17:39:08.349650 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.348795 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f65fe5ae-90c2-4f29-8510-f6a0edca8c54-registration-dir\") pod \"aws-ebs-csi-driver-node-b72vj\" (UID: \"f65fe5ae-90c2-4f29-8510-f6a0edca8c54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72vj" Jul 17 17:39:08.349650 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.348833 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c3987132-0222-45e9-8c90-7a3ad682329e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zfjf6\" (UID: \"c3987132-0222-45e9-8c90-7a3ad682329e\") " pod="openshift-multus/multus-additional-cni-plugins-zfjf6" Jul 17 17:39:08.349650 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.348868 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-host-cni-bin\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.349650 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:08.348908 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:39:08.349650 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.348928 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-host-run-netns\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.350671 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:08.348963 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05410b3d-9fba-454e-be26-568dbfce20f4-metrics-certs podName:05410b3d-9fba-454e-be26-568dbfce20f4 nodeName:}" failed. No retries permitted until 2026-07-17 17:39:08.848939572 +0000 UTC m=+3.032997333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05410b3d-9fba-454e-be26-568dbfce20f4-metrics-certs") pod "network-metrics-daemon-82zfd" (UID: "05410b3d-9fba-454e-be26-568dbfce20f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:39:08.350671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.348966 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-host-cni-netd\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.350671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.349018 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-run-systemd\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.350671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.349060 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-etc-openvswitch\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.350671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.349828 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-env-overrides\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.350671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.349903 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-host-run-ovn-kubernetes\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.350671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.349958 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-node-log\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.350671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.350061 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f65fe5ae-90c2-4f29-8510-f6a0edca8c54-socket-dir\") pod \"aws-ebs-csi-driver-node-b72vj\" (UID: \"f65fe5ae-90c2-4f29-8510-f6a0edca8c54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72vj" Jul 17 17:39:08.350671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.350085 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-ovnkube-config\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.350671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.350174 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-log-socket\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.350671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.350235 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.350671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.350282 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-run-openvswitch\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.350671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.350420 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-host-kubelet\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.351297 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.351187 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7004a1df-981b-4eb2-bb70-742617ac70e4-konnectivity-ca\") pod \"konnectivity-agent-vw726\" (UID: \"7004a1df-981b-4eb2-bb70-742617ac70e4\") " pod="kube-system/konnectivity-agent-vw726" Jul 17 17:39:08.351504 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.351394 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-systemd-units\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.351504 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.351427 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-run-ovn\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.351504 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.351450 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/85eee69e-719a-48b1-95fb-e2012eb6e31f-host\") pod \"node-ca-b2qql\" (UID: \"85eee69e-719a-48b1-95fb-e2012eb6e31f\") " pod="openshift-image-registry/node-ca-b2qql" Jul 17 17:39:08.351765 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.351512 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-host-slash\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.351765 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.351566 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-run-ovn\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.351765 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.351590 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6d3cc0e8-3539-4637-b778-a4cd8663d4f2-dbus\") pod \"global-pull-secret-syncer-xxhkm\" (UID: \"6d3cc0e8-3539-4637-b778-a4cd8663d4f2\") " pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:08.351765 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.351621 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f65fe5ae-90c2-4f29-8510-f6a0edca8c54-device-dir\") pod \"aws-ebs-csi-driver-node-b72vj\" (UID: \"f65fe5ae-90c2-4f29-8510-f6a0edca8c54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72vj" Jul 17 17:39:08.351765 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.351644 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/85eee69e-719a-48b1-95fb-e2012eb6e31f-host\") pod \"node-ca-b2qql\" (UID: \"85eee69e-719a-48b1-95fb-e2012eb6e31f\") " pod="openshift-image-registry/node-ca-b2qql" Jul 17 17:39:08.351765 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.351645 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76zqs\" (UniqueName: \"kubernetes.io/projected/05410b3d-9fba-454e-be26-568dbfce20f4-kube-api-access-76zqs\") pod \"network-metrics-daemon-82zfd\" (UID: \"05410b3d-9fba-454e-be26-568dbfce20f4\") " pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:39:08.351765 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.351688 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c3987132-0222-45e9-8c90-7a3ad682329e-cnibin\") pod \"multus-additional-cni-plugins-zfjf6\" (UID: \"c3987132-0222-45e9-8c90-7a3ad682329e\") " pod="openshift-multus/multus-additional-cni-plugins-zfjf6" Jul 17 17:39:08.351765 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.351725 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c3987132-0222-45e9-8c90-7a3ad682329e-cni-binary-copy\") pod \"multus-additional-cni-plugins-zfjf6\" (UID: \"c3987132-0222-45e9-8c90-7a3ad682329e\") " pod="openshift-multus/multus-additional-cni-plugins-zfjf6" Jul 17 17:39:08.351765 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.351753 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt665\" (UniqueName: \"kubernetes.io/projected/c3987132-0222-45e9-8c90-7a3ad682329e-kube-api-access-xt665\") pod \"multus-additional-cni-plugins-zfjf6\" (UID: \"c3987132-0222-45e9-8c90-7a3ad682329e\") " pod="openshift-multus/multus-additional-cni-plugins-zfjf6" Jul 17 17:39:08.352219 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.351780 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7004a1df-981b-4eb2-bb70-742617ac70e4-agent-certs\") pod \"konnectivity-agent-vw726\" (UID: \"7004a1df-981b-4eb2-bb70-742617ac70e4\") " pod="kube-system/konnectivity-agent-vw726" Jul 17 17:39:08.352219 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.351812 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/85eee69e-719a-48b1-95fb-e2012eb6e31f-serviceca\") pod \"node-ca-b2qql\" (UID: \"85eee69e-719a-48b1-95fb-e2012eb6e31f\") " pod="openshift-image-registry/node-ca-b2qql" Jul 17 17:39:08.352219 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.351840 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-var-lib-openvswitch\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.352219 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.351865 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-ovnkube-script-lib\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.352219 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.351924 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-host-slash\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.352219 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.351945 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6d3cc0e8-3539-4637-b778-a4cd8663d4f2-kubelet-config\") pod \"global-pull-secret-syncer-xxhkm\" (UID: \"6d3cc0e8-3539-4637-b778-a4cd8663d4f2\") " pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:08.352219 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.351974 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f65fe5ae-90c2-4f29-8510-f6a0edca8c54-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b72vj\" (UID: \"f65fe5ae-90c2-4f29-8510-f6a0edca8c54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72vj" Jul 17 17:39:08.352219 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.352008 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f65fe5ae-90c2-4f29-8510-f6a0edca8c54-device-dir\") pod \"aws-ebs-csi-driver-node-b72vj\" (UID: \"f65fe5ae-90c2-4f29-8510-f6a0edca8c54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72vj" Jul 17 17:39:08.352219 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.352031 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c3987132-0222-45e9-8c90-7a3ad682329e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zfjf6\" (UID: \"c3987132-0222-45e9-8c90-7a3ad682329e\") " pod="openshift-multus/multus-additional-cni-plugins-zfjf6" Jul 17 17:39:08.352699 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.352444 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/85eee69e-719a-48b1-95fb-e2012eb6e31f-serviceca\") pod \"node-ca-b2qql\" (UID: \"85eee69e-719a-48b1-95fb-e2012eb6e31f\") " pod="openshift-image-registry/node-ca-b2qql" Jul 17 17:39:08.352699 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.352514 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6d3cc0e8-3539-4637-b778-a4cd8663d4f2-kubelet-config\") pod \"global-pull-secret-syncer-xxhkm\" (UID: \"6d3cc0e8-3539-4637-b778-a4cd8663d4f2\") " pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:08.352699 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.352583 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-var-lib-openvswitch\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.352699 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.352623 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c3987132-0222-45e9-8c90-7a3ad682329e-cni-binary-copy\") pod \"multus-additional-cni-plugins-zfjf6\" (UID: \"c3987132-0222-45e9-8c90-7a3ad682329e\") " pod="openshift-multus/multus-additional-cni-plugins-zfjf6" Jul 17 17:39:08.352699 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.352670 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhrrt\" (UniqueName: \"kubernetes.io/projected/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-kube-api-access-bhrrt\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.352699 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.352700 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f88ed1a5-3fe2-4745-8ceb-ad864fd4f686-iptables-alerter-script\") pod \"iptables-alerter-6dqlm\" (UID: \"f88ed1a5-3fe2-4745-8ceb-ad864fd4f686\") " pod="openshift-network-operator/iptables-alerter-6dqlm" Jul 17 17:39:08.353040 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.352726 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f88ed1a5-3fe2-4745-8ceb-ad864fd4f686-host-slash\") pod \"iptables-alerter-6dqlm\" (UID: \"f88ed1a5-3fe2-4745-8ceb-ad864fd4f686\") " pod="openshift-network-operator/iptables-alerter-6dqlm" Jul 17 17:39:08.353040 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.352758 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f65fe5ae-90c2-4f29-8510-f6a0edca8c54-sys-fs\") pod \"aws-ebs-csi-driver-node-b72vj\" (UID: \"f65fe5ae-90c2-4f29-8510-f6a0edca8c54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72vj" Jul 17 17:39:08.353040 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.352784 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3987132-0222-45e9-8c90-7a3ad682329e-system-cni-dir\") pod \"multus-additional-cni-plugins-zfjf6\" (UID: \"c3987132-0222-45e9-8c90-7a3ad682329e\") " pod="openshift-multus/multus-additional-cni-plugins-zfjf6" Jul 17 17:39:08.353040 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.352813 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c3987132-0222-45e9-8c90-7a3ad682329e-os-release\") pod \"multus-additional-cni-plugins-zfjf6\" (UID: \"c3987132-0222-45e9-8c90-7a3ad682329e\") " pod="openshift-multus/multus-additional-cni-plugins-zfjf6" Jul 17 17:39:08.353040 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.352844 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c3987132-0222-45e9-8c90-7a3ad682329e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zfjf6\" (UID: \"c3987132-0222-45e9-8c90-7a3ad682329e\") " pod="openshift-multus/multus-additional-cni-plugins-zfjf6" Jul 17 17:39:08.353297 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.353063 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-ovnkube-script-lib\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.353297 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.353128 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f65fe5ae-90c2-4f29-8510-f6a0edca8c54-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b72vj\" (UID: \"f65fe5ae-90c2-4f29-8510-f6a0edca8c54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72vj" Jul 17 17:39:08.353297 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.353205 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6d3cc0e8-3539-4637-b778-a4cd8663d4f2-dbus\") pod \"global-pull-secret-syncer-xxhkm\" (UID: \"6d3cc0e8-3539-4637-b778-a4cd8663d4f2\") " pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:08.353297 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.353250 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-systemd-units\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.353297 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.353291 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c3987132-0222-45e9-8c90-7a3ad682329e-cnibin\") pod \"multus-additional-cni-plugins-zfjf6\" (UID: \"c3987132-0222-45e9-8c90-7a3ad682329e\") " pod="openshift-multus/multus-additional-cni-plugins-zfjf6" Jul 17 17:39:08.353560 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.353446 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c3987132-0222-45e9-8c90-7a3ad682329e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zfjf6\" (UID: \"c3987132-0222-45e9-8c90-7a3ad682329e\") " pod="openshift-multus/multus-additional-cni-plugins-zfjf6" Jul 17 17:39:08.353560 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.353517 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c3987132-0222-45e9-8c90-7a3ad682329e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zfjf6\" (UID: \"c3987132-0222-45e9-8c90-7a3ad682329e\") " pod="openshift-multus/multus-additional-cni-plugins-zfjf6" Jul 17 17:39:08.353681 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.353567 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3987132-0222-45e9-8c90-7a3ad682329e-system-cni-dir\") pod \"multus-additional-cni-plugins-zfjf6\" (UID: \"c3987132-0222-45e9-8c90-7a3ad682329e\") " pod="openshift-multus/multus-additional-cni-plugins-zfjf6" Jul 17 17:39:08.353681 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.353576 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f65fe5ae-90c2-4f29-8510-f6a0edca8c54-sys-fs\") pod \"aws-ebs-csi-driver-node-b72vj\" (UID: \"f65fe5ae-90c2-4f29-8510-f6a0edca8c54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72vj" Jul 17 17:39:08.353681 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.353596 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c3987132-0222-45e9-8c90-7a3ad682329e-os-release\") pod \"multus-additional-cni-plugins-zfjf6\" (UID: \"c3987132-0222-45e9-8c90-7a3ad682329e\") " pod="openshift-multus/multus-additional-cni-plugins-zfjf6" Jul 17 17:39:08.353681 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.353636 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f88ed1a5-3fe2-4745-8ceb-ad864fd4f686-host-slash\") pod \"iptables-alerter-6dqlm\" (UID: \"f88ed1a5-3fe2-4745-8ceb-ad864fd4f686\") " pod="openshift-network-operator/iptables-alerter-6dqlm" Jul 17 17:39:08.353681 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.353668 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f88ed1a5-3fe2-4745-8ceb-ad864fd4f686-iptables-alerter-script\") pod \"iptables-alerter-6dqlm\" (UID: \"f88ed1a5-3fe2-4745-8ceb-ad864fd4f686\") " pod="openshift-network-operator/iptables-alerter-6dqlm" Jul 17 17:39:08.354276 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.354241 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-ovn-node-metrics-cert\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.356384 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:08.356180 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 17:39:08.356384 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:08.356206 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 17:39:08.356384 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:08.356220 2563 projected.go:196] Error preparing data for projected volume kube-api-access-wxcz9 for pod openshift-network-diagnostics/network-check-target-cpx5f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:39:08.356384 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:08.356294 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5789fef-e8da-4204-b2af-3468ba9fac6d-kube-api-access-wxcz9 podName:c5789fef-e8da-4204-b2af-3468ba9fac6d nodeName:}" failed. No retries permitted until 2026-07-17 17:39:08.85627643 +0000 UTC m=+3.040334190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wxcz9" (UniqueName: "kubernetes.io/projected/c5789fef-e8da-4204-b2af-3468ba9fac6d-kube-api-access-wxcz9") pod "network-check-target-cpx5f" (UID: "c5789fef-e8da-4204-b2af-3468ba9fac6d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:39:08.358952 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.358902 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7004a1df-981b-4eb2-bb70-742617ac70e4-agent-certs\") pod \"konnectivity-agent-vw726\" (UID: \"7004a1df-981b-4eb2-bb70-742617ac70e4\") " pod="kube-system/konnectivity-agent-vw726" Jul 17 17:39:08.361451 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.361431 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc77p\" (UniqueName: \"kubernetes.io/projected/85eee69e-719a-48b1-95fb-e2012eb6e31f-kube-api-access-rc77p\") pod \"node-ca-b2qql\" (UID: \"85eee69e-719a-48b1-95fb-e2012eb6e31f\") " pod="openshift-image-registry/node-ca-b2qql" Jul 17 17:39:08.366963 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.366935 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swqvs\" (UniqueName: \"kubernetes.io/projected/f88ed1a5-3fe2-4745-8ceb-ad864fd4f686-kube-api-access-swqvs\") pod \"iptables-alerter-6dqlm\" (UID: \"f88ed1a5-3fe2-4745-8ceb-ad864fd4f686\") " pod="openshift-network-operator/iptables-alerter-6dqlm" Jul 17 17:39:08.367073 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.367040 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztwn6\" (UniqueName: \"kubernetes.io/projected/f65fe5ae-90c2-4f29-8510-f6a0edca8c54-kube-api-access-ztwn6\") pod \"aws-ebs-csi-driver-node-b72vj\" (UID: \"f65fe5ae-90c2-4f29-8510-f6a0edca8c54\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72vj" Jul 17 17:39:08.368249 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.368193 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt665\" (UniqueName: \"kubernetes.io/projected/c3987132-0222-45e9-8c90-7a3ad682329e-kube-api-access-xt665\") pod \"multus-additional-cni-plugins-zfjf6\" (UID: \"c3987132-0222-45e9-8c90-7a3ad682329e\") " pod="openshift-multus/multus-additional-cni-plugins-zfjf6" Jul 17 17:39:08.368902 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.368822 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76zqs\" (UniqueName: \"kubernetes.io/projected/05410b3d-9fba-454e-be26-568dbfce20f4-kube-api-access-76zqs\") pod \"network-metrics-daemon-82zfd\" (UID: \"05410b3d-9fba-454e-be26-568dbfce20f4\") " pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:39:08.371132 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.371111 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhrrt\" (UniqueName: \"kubernetes.io/projected/b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c-kube-api-access-bhrrt\") pod \"ovnkube-node-lkfst\" (UID: \"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.448899 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.448857 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fxzks" Jul 17 17:39:08.457277 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.457246 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f97wh" Jul 17 17:39:08.459585 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:08.459548 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c9cdba6_ccaa_48e2_a37c_c84f560968bf.slice/crio-76f214eb02b48ece01c6d77a469a1581e6ad973a5e853c2f850de0ace5406f82 WatchSource:0}: Error finding container 76f214eb02b48ece01c6d77a469a1581e6ad973a5e853c2f850de0ace5406f82: Status 404 returned error can't find the container with id 76f214eb02b48ece01c6d77a469a1581e6ad973a5e853c2f850de0ace5406f82 Jul 17 17:39:08.468816 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:08.468776 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4dcc94c_110b_4b31_8a6c_dfbae393c058.slice/crio-91723ffaf2919aab7b25b33b65dad6300cbde980d0533deaf09342bbe56052b6 WatchSource:0}: Error finding container 91723ffaf2919aab7b25b33b65dad6300cbde980d0533deaf09342bbe56052b6: Status 404 returned error can't find the container with id 91723ffaf2919aab7b25b33b65dad6300cbde980d0533deaf09342bbe56052b6 Jul 17 17:39:08.472630 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.472604 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mhw56" Jul 17 17:39:08.478632 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.478604 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:08.483289 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:08.483251 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29d7b457_69a2_47e0_9da5_4b88178bea9d.slice/crio-494b40ad3576200ee1d20ceeeb2438293ec06d5fb043632c87291653665291a2 WatchSource:0}: Error finding container 494b40ad3576200ee1d20ceeeb2438293ec06d5fb043632c87291653665291a2: Status 404 returned error can't find the container with id 494b40ad3576200ee1d20ceeeb2438293ec06d5fb043632c87291653665291a2 Jul 17 17:39:08.486418 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.486229 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vw726" Jul 17 17:39:08.491074 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:08.490887 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1beb1f8_14fb_49e3_b5cd_bb0b592bc32c.slice/crio-1326b79d4c7817a2c4487e0e184449eb3a98050f837f34cc7116170287c59e7d WatchSource:0}: Error finding container 1326b79d4c7817a2c4487e0e184449eb3a98050f837f34cc7116170287c59e7d: Status 404 returned error can't find the container with id 1326b79d4c7817a2c4487e0e184449eb3a98050f837f34cc7116170287c59e7d Jul 17 17:39:08.495226 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.495201 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6dqlm" Jul 17 17:39:08.504093 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.504058 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72vj" Jul 17 17:39:08.508803 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:08.508770 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf88ed1a5_3fe2_4745_8ceb_ad864fd4f686.slice/crio-7f91a2f608e15611d753fc12309dda7e51823682e7528af004b3b731db20d22f WatchSource:0}: Error finding container 7f91a2f608e15611d753fc12309dda7e51823682e7528af004b3b731db20d22f: Status 404 returned error can't find the container with id 7f91a2f608e15611d753fc12309dda7e51823682e7528af004b3b731db20d22f Jul 17 17:39:08.512183 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.512161 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zfjf6" Jul 17 17:39:08.516849 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:08.516817 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf65fe5ae_90c2_4f29_8510_f6a0edca8c54.slice/crio-3c6245410baf84e71a69fe87f98057af657168e2792aa082b55475eb0f5a691b WatchSource:0}: Error finding container 3c6245410baf84e71a69fe87f98057af657168e2792aa082b55475eb0f5a691b: Status 404 returned error can't find the container with id 3c6245410baf84e71a69fe87f98057af657168e2792aa082b55475eb0f5a691b Jul 17 17:39:08.518063 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.518012 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b2qql" Jul 17 17:39:08.526762 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:08.526735 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3987132_0222_45e9_8c90_7a3ad682329e.slice/crio-4b0346e984141e6ea7eaea69a2440c55d7053ccb5a49af4c607c4fd89b01073c WatchSource:0}: Error finding container 4b0346e984141e6ea7eaea69a2440c55d7053ccb5a49af4c607c4fd89b01073c: Status 404 returned error can't find the container with id 4b0346e984141e6ea7eaea69a2440c55d7053ccb5a49af4c607c4fd89b01073c Jul 17 17:39:08.532771 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:08.532738 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85eee69e_719a_48b1_95fb_e2012eb6e31f.slice/crio-b6ccc5275ff3c93b0770945163d3ca37a54cddc106f88b4ec28de54553183424 WatchSource:0}: Error finding container b6ccc5275ff3c93b0770945163d3ca37a54cddc106f88b4ec28de54553183424: Status 404 returned error can't find the container with id b6ccc5275ff3c93b0770945163d3ca37a54cddc106f88b4ec28de54553183424 Jul 17 17:39:08.857410 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.857369 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxcz9\" (UniqueName: \"kubernetes.io/projected/c5789fef-e8da-4204-b2af-3468ba9fac6d-kube-api-access-wxcz9\") pod \"network-check-target-cpx5f\" (UID: \"c5789fef-e8da-4204-b2af-3468ba9fac6d\") " pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:39:08.857646 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.857427 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05410b3d-9fba-454e-be26-568dbfce20f4-metrics-certs\") pod \"network-metrics-daemon-82zfd\" (UID: \"05410b3d-9fba-454e-be26-568dbfce20f4\") " pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:39:08.857646 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.857462 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d3cc0e8-3539-4637-b778-a4cd8663d4f2-original-pull-secret\") pod \"global-pull-secret-syncer-xxhkm\" (UID: \"6d3cc0e8-3539-4637-b778-a4cd8663d4f2\") " pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:08.857646 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:08.857580 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:39:08.857646 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:08.857592 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 17:39:08.857646 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:08.857600 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 17:39:08.857646 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:08.857625 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 17:39:08.857646 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:08.857639 2563 projected.go:196] Error preparing data for projected volume kube-api-access-wxcz9 for pod openshift-network-diagnostics/network-check-target-cpx5f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:39:08.857646 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:08.857653 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05410b3d-9fba-454e-be26-568dbfce20f4-metrics-certs podName:05410b3d-9fba-454e-be26-568dbfce20f4 nodeName:}" failed. No retries permitted until 2026-07-17 17:39:09.857630419 +0000 UTC m=+4.041688194 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05410b3d-9fba-454e-be26-568dbfce20f4-metrics-certs") pod "network-metrics-daemon-82zfd" (UID: "05410b3d-9fba-454e-be26-568dbfce20f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:39:08.858037 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:08.857668 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d3cc0e8-3539-4637-b778-a4cd8663d4f2-original-pull-secret podName:6d3cc0e8-3539-4637-b778-a4cd8663d4f2 nodeName:}" failed. No retries permitted until 2026-07-17 17:39:09.85766183 +0000 UTC m=+4.041719587 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d3cc0e8-3539-4637-b778-a4cd8663d4f2-original-pull-secret") pod "global-pull-secret-syncer-xxhkm" (UID: "6d3cc0e8-3539-4637-b778-a4cd8663d4f2") : object "kube-system"/"original-pull-secret" not registered Jul 17 17:39:08.858037 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:08.857691 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5789fef-e8da-4204-b2af-3468ba9fac6d-kube-api-access-wxcz9 podName:c5789fef-e8da-4204-b2af-3468ba9fac6d nodeName:}" failed. No retries permitted until 2026-07-17 17:39:09.857674197 +0000 UTC m=+4.041731981 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wxcz9" (UniqueName: "kubernetes.io/projected/c5789fef-e8da-4204-b2af-3468ba9fac6d-kube-api-access-wxcz9") pod "network-check-target-cpx5f" (UID: "c5789fef-e8da-4204-b2af-3468ba9fac6d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:39:08.898874 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:08.898839 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 17:39:09.183193 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:09.183031 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 17:34:08 +0000 UTC" deadline="2028-03-05 07:58:28.082635382 +0000 UTC" Jul 17 17:39:09.183193 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:09.183071 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14318h19m18.899570266s" Jul 17 17:39:09.317397 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:09.317343 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mhw56" event={"ID":"29d7b457-69a2-47e0-9da5-4b88178bea9d","Type":"ContainerStarted","Data":"494b40ad3576200ee1d20ceeeb2438293ec06d5fb043632c87291653665291a2"} Jul 17 17:39:09.319034 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:09.318998 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b2qql" event={"ID":"85eee69e-719a-48b1-95fb-e2012eb6e31f","Type":"ContainerStarted","Data":"b6ccc5275ff3c93b0770945163d3ca37a54cddc106f88b4ec28de54553183424"} Jul 17 17:39:09.320287 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:09.320252 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72vj" event={"ID":"f65fe5ae-90c2-4f29-8510-f6a0edca8c54","Type":"ContainerStarted","Data":"3c6245410baf84e71a69fe87f98057af657168e2792aa082b55475eb0f5a691b"} Jul 17 17:39:09.321707 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:09.321680 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6dqlm" event={"ID":"f88ed1a5-3fe2-4745-8ceb-ad864fd4f686","Type":"ContainerStarted","Data":"7f91a2f608e15611d753fc12309dda7e51823682e7528af004b3b731db20d22f"} Jul 17 17:39:09.323328 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:09.323294 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vw726" event={"ID":"7004a1df-981b-4eb2-bb70-742617ac70e4","Type":"ContainerStarted","Data":"6bb7fe0965f2e5ea2558a0ab7eb8991697a9f5061de827a70f14b561bc1368c3"} Jul 17 17:39:09.325489 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:09.325279 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" event={"ID":"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c","Type":"ContainerStarted","Data":"1326b79d4c7817a2c4487e0e184449eb3a98050f837f34cc7116170287c59e7d"} Jul 17 17:39:09.326510 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:09.326439 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f97wh" event={"ID":"d4dcc94c-110b-4b31-8a6c-dfbae393c058","Type":"ContainerStarted","Data":"91723ffaf2919aab7b25b33b65dad6300cbde980d0533deaf09342bbe56052b6"} Jul 17 17:39:09.327729 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:09.327701 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fxzks" event={"ID":"1c9cdba6-ccaa-48e2-a37c-c84f560968bf","Type":"ContainerStarted","Data":"76f214eb02b48ece01c6d77a469a1581e6ad973a5e853c2f850de0ace5406f82"} Jul 17 17:39:09.329802 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:09.328906 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfjf6" event={"ID":"c3987132-0222-45e9-8c90-7a3ad682329e","Type":"ContainerStarted","Data":"4b0346e984141e6ea7eaea69a2440c55d7053ccb5a49af4c607c4fd89b01073c"} Jul 17 17:39:09.866249 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:09.865532 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05410b3d-9fba-454e-be26-568dbfce20f4-metrics-certs\") pod \"network-metrics-daemon-82zfd\" (UID: \"05410b3d-9fba-454e-be26-568dbfce20f4\") " pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:39:09.866249 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:09.865593 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d3cc0e8-3539-4637-b778-a4cd8663d4f2-original-pull-secret\") pod \"global-pull-secret-syncer-xxhkm\" (UID: \"6d3cc0e8-3539-4637-b778-a4cd8663d4f2\") " pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:09.866249 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:09.865684 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxcz9\" (UniqueName: \"kubernetes.io/projected/c5789fef-e8da-4204-b2af-3468ba9fac6d-kube-api-access-wxcz9\") pod \"network-check-target-cpx5f\" (UID: \"c5789fef-e8da-4204-b2af-3468ba9fac6d\") " pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:39:09.866249 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:09.865906 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 17:39:09.866249 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:09.865928 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 17:39:09.866249 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:09.865941 2563 projected.go:196] Error preparing data for projected volume kube-api-access-wxcz9 for pod openshift-network-diagnostics/network-check-target-cpx5f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:39:09.866249 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:09.866006 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5789fef-e8da-4204-b2af-3468ba9fac6d-kube-api-access-wxcz9 podName:c5789fef-e8da-4204-b2af-3468ba9fac6d nodeName:}" failed. No retries permitted until 2026-07-17 17:39:11.865985269 +0000 UTC m=+6.050043028 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wxcz9" (UniqueName: "kubernetes.io/projected/c5789fef-e8da-4204-b2af-3468ba9fac6d-kube-api-access-wxcz9") pod "network-check-target-cpx5f" (UID: "c5789fef-e8da-4204-b2af-3468ba9fac6d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:39:09.866249 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:09.866043 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:39:09.866249 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:09.866084 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05410b3d-9fba-454e-be26-568dbfce20f4-metrics-certs podName:05410b3d-9fba-454e-be26-568dbfce20f4 nodeName:}" failed. No retries permitted until 2026-07-17 17:39:11.86607204 +0000 UTC m=+6.050129812 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05410b3d-9fba-454e-be26-568dbfce20f4-metrics-certs") pod "network-metrics-daemon-82zfd" (UID: "05410b3d-9fba-454e-be26-568dbfce20f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:39:09.866249 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:09.866148 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 17:39:09.866249 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:09.866180 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d3cc0e8-3539-4637-b778-a4cd8663d4f2-original-pull-secret podName:6d3cc0e8-3539-4637-b778-a4cd8663d4f2 nodeName:}" failed. No retries permitted until 2026-07-17 17:39:11.866170139 +0000 UTC m=+6.050227915 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d3cc0e8-3539-4637-b778-a4cd8663d4f2-original-pull-secret") pod "global-pull-secret-syncer-xxhkm" (UID: "6d3cc0e8-3539-4637-b778-a4cd8663d4f2") : object "kube-system"/"original-pull-secret" not registered Jul 17 17:39:10.183756 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:10.183602 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 17:34:08 +0000 UTC" deadline="2028-04-17 07:24:17.71972701 +0000 UTC" Jul 17 17:39:10.183756 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:10.183690 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15349h45m7.536042389s" Jul 17 17:39:10.308169 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:10.308140 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:39:10.308354 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:10.308143 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:10.308354 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:10.308268 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpx5f" podUID="c5789fef-e8da-4204-b2af-3468ba9fac6d" Jul 17 17:39:10.308354 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:10.308335 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:39:10.308510 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:10.308448 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxhkm" podUID="6d3cc0e8-3539-4637-b778-a4cd8663d4f2" Jul 17 17:39:10.308587 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:10.308558 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82zfd" podUID="05410b3d-9fba-454e-be26-568dbfce20f4" Jul 17 17:39:11.356324 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:11.356037 2563 generic.go:356] "Generic (PLEG): container finished" podID="5268946509bf7913d6cec963b2c9ff24" containerID="58da2fb3587c3f03fab91616ce5d88f36c60d2a04c932a2328e424a74f791fc3" exitCode=0 Jul 17 17:39:11.356854 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:11.356363 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-127.ec2.internal" event={"ID":"5268946509bf7913d6cec963b2c9ff24","Type":"ContainerDied","Data":"58da2fb3587c3f03fab91616ce5d88f36c60d2a04c932a2328e424a74f791fc3"} Jul 17 17:39:11.365346 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:11.365269 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-127.ec2.internal" event={"ID":"7276ebbf3e3a8cdc488397a5fe19d27c","Type":"ContainerStarted","Data":"2c3f457a4891163278200a26d635966b2c47ec878438e6017071b602adb993c0"} Jul 17 17:39:11.892604 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:11.892563 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxcz9\" (UniqueName: \"kubernetes.io/projected/c5789fef-e8da-4204-b2af-3468ba9fac6d-kube-api-access-wxcz9\") pod \"network-check-target-cpx5f\" (UID: \"c5789fef-e8da-4204-b2af-3468ba9fac6d\") " pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:39:11.892784 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:11.892620 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05410b3d-9fba-454e-be26-568dbfce20f4-metrics-certs\") pod \"network-metrics-daemon-82zfd\" (UID: \"05410b3d-9fba-454e-be26-568dbfce20f4\") " pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:39:11.892784 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:11.892650 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d3cc0e8-3539-4637-b778-a4cd8663d4f2-original-pull-secret\") pod \"global-pull-secret-syncer-xxhkm\" (UID: \"6d3cc0e8-3539-4637-b778-a4cd8663d4f2\") " pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:11.892784 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:11.892768 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 17:39:11.892959 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:11.892836 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d3cc0e8-3539-4637-b778-a4cd8663d4f2-original-pull-secret podName:6d3cc0e8-3539-4637-b778-a4cd8663d4f2 nodeName:}" failed. No retries permitted until 2026-07-17 17:39:15.892814301 +0000 UTC m=+10.076872062 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d3cc0e8-3539-4637-b778-a4cd8663d4f2-original-pull-secret") pod "global-pull-secret-syncer-xxhkm" (UID: "6d3cc0e8-3539-4637-b778-a4cd8663d4f2") : object "kube-system"/"original-pull-secret" not registered Jul 17 17:39:11.893299 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:11.893282 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 17:39:11.893395 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:11.893305 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 17:39:11.893395 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:11.893318 2563 projected.go:196] Error preparing data for projected volume kube-api-access-wxcz9 for pod openshift-network-diagnostics/network-check-target-cpx5f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:39:11.893510 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:11.893473 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5789fef-e8da-4204-b2af-3468ba9fac6d-kube-api-access-wxcz9 podName:c5789fef-e8da-4204-b2af-3468ba9fac6d nodeName:}" failed. No retries permitted until 2026-07-17 17:39:15.893453862 +0000 UTC m=+10.077511634 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wxcz9" (UniqueName: "kubernetes.io/projected/c5789fef-e8da-4204-b2af-3468ba9fac6d-kube-api-access-wxcz9") pod "network-check-target-cpx5f" (UID: "c5789fef-e8da-4204-b2af-3468ba9fac6d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:39:11.893614 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:11.893578 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:39:11.893665 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:11.893623 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05410b3d-9fba-454e-be26-568dbfce20f4-metrics-certs podName:05410b3d-9fba-454e-be26-568dbfce20f4 nodeName:}" failed. No retries permitted until 2026-07-17 17:39:15.893608758 +0000 UTC m=+10.077666533 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05410b3d-9fba-454e-be26-568dbfce20f4-metrics-certs") pod "network-metrics-daemon-82zfd" (UID: "05410b3d-9fba-454e-be26-568dbfce20f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:39:12.306618 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:12.306585 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:39:12.306820 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:12.306723 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpx5f" podUID="c5789fef-e8da-4204-b2af-3468ba9fac6d" Jul 17 17:39:12.307103 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:12.306590 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:12.307186 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:12.307128 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:39:12.307254 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:12.307225 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxhkm" podUID="6d3cc0e8-3539-4637-b778-a4cd8663d4f2" Jul 17 17:39:12.307345 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:12.307320 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82zfd" podUID="05410b3d-9fba-454e-be26-568dbfce20f4" Jul 17 17:39:14.306141 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:14.306097 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:14.306141 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:14.306126 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:39:14.306574 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:14.306170 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:39:14.306574 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:14.306290 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82zfd" podUID="05410b3d-9fba-454e-be26-568dbfce20f4" Jul 17 17:39:14.306815 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:14.306718 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpx5f" podUID="c5789fef-e8da-4204-b2af-3468ba9fac6d" Jul 17 17:39:14.306815 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:14.306793 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxhkm" podUID="6d3cc0e8-3539-4637-b778-a4cd8663d4f2" Jul 17 17:39:15.923316 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:15.923275 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxcz9\" (UniqueName: \"kubernetes.io/projected/c5789fef-e8da-4204-b2af-3468ba9fac6d-kube-api-access-wxcz9\") pod \"network-check-target-cpx5f\" (UID: \"c5789fef-e8da-4204-b2af-3468ba9fac6d\") " pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:39:15.923789 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:15.923333 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05410b3d-9fba-454e-be26-568dbfce20f4-metrics-certs\") pod \"network-metrics-daemon-82zfd\" (UID: \"05410b3d-9fba-454e-be26-568dbfce20f4\") " pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:39:15.923789 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:15.923435 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:39:15.923789 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:15.923488 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 17:39:15.923789 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:15.923505 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05410b3d-9fba-454e-be26-568dbfce20f4-metrics-certs podName:05410b3d-9fba-454e-be26-568dbfce20f4 nodeName:}" failed. No retries permitted until 2026-07-17 17:39:23.923490528 +0000 UTC m=+18.107548284 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05410b3d-9fba-454e-be26-568dbfce20f4-metrics-certs") pod "network-metrics-daemon-82zfd" (UID: "05410b3d-9fba-454e-be26-568dbfce20f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:39:15.923789 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:15.923516 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 17:39:15.923789 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:15.923531 2563 projected.go:196] Error preparing data for projected volume kube-api-access-wxcz9 for pod openshift-network-diagnostics/network-check-target-cpx5f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:39:15.923789 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:15.923582 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5789fef-e8da-4204-b2af-3468ba9fac6d-kube-api-access-wxcz9 podName:c5789fef-e8da-4204-b2af-3468ba9fac6d nodeName:}" failed. No retries permitted until 2026-07-17 17:39:23.923565089 +0000 UTC m=+18.107622865 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wxcz9" (UniqueName: "kubernetes.io/projected/c5789fef-e8da-4204-b2af-3468ba9fac6d-kube-api-access-wxcz9") pod "network-check-target-cpx5f" (UID: "c5789fef-e8da-4204-b2af-3468ba9fac6d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:39:15.923789 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:15.923614 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d3cc0e8-3539-4637-b778-a4cd8663d4f2-original-pull-secret\") pod \"global-pull-secret-syncer-xxhkm\" (UID: \"6d3cc0e8-3539-4637-b778-a4cd8663d4f2\") " pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:15.923789 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:15.923759 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 17:39:15.923789 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:15.923796 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d3cc0e8-3539-4637-b778-a4cd8663d4f2-original-pull-secret podName:6d3cc0e8-3539-4637-b778-a4cd8663d4f2 nodeName:}" failed. No retries permitted until 2026-07-17 17:39:23.923784401 +0000 UTC m=+18.107842170 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d3cc0e8-3539-4637-b778-a4cd8663d4f2-original-pull-secret") pod "global-pull-secret-syncer-xxhkm" (UID: "6d3cc0e8-3539-4637-b778-a4cd8663d4f2") : object "kube-system"/"original-pull-secret" not registered Jul 17 17:39:16.306979 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:16.306952 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:39:16.307153 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:16.307040 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:39:16.307153 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:16.307045 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpx5f" podUID="c5789fef-e8da-4204-b2af-3468ba9fac6d" Jul 17 17:39:16.307282 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:16.307184 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82zfd" podUID="05410b3d-9fba-454e-be26-568dbfce20f4" Jul 17 17:39:16.307282 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:16.307253 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:16.307373 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:16.307345 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxhkm" podUID="6d3cc0e8-3539-4637-b778-a4cd8663d4f2" Jul 17 17:39:18.307921 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:18.307875 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:39:18.308416 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:18.308016 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpx5f" podUID="c5789fef-e8da-4204-b2af-3468ba9fac6d" Jul 17 17:39:18.308416 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:18.308075 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:18.308416 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:18.308144 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxhkm" podUID="6d3cc0e8-3539-4637-b778-a4cd8663d4f2" Jul 17 17:39:18.308416 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:18.308187 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:39:18.308416 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:18.308272 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82zfd" podUID="05410b3d-9fba-454e-be26-568dbfce20f4" Jul 17 17:39:20.306739 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:20.306698 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:39:20.307200 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:20.306849 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82zfd" podUID="05410b3d-9fba-454e-be26-568dbfce20f4" Jul 17 17:39:20.307200 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:20.306698 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:39:20.307200 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:20.306947 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpx5f" podUID="c5789fef-e8da-4204-b2af-3468ba9fac6d" Jul 17 17:39:20.307200 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:20.306698 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:20.307200 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:20.307025 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxhkm" podUID="6d3cc0e8-3539-4637-b778-a4cd8663d4f2" Jul 17 17:39:22.306492 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:22.306462 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:22.306936 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:22.306462 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:39:22.306936 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:22.306591 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:39:22.306936 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:22.306589 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxhkm" podUID="6d3cc0e8-3539-4637-b778-a4cd8663d4f2" Jul 17 17:39:22.306936 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:22.306696 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82zfd" podUID="05410b3d-9fba-454e-be26-568dbfce20f4" Jul 17 17:39:22.306936 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:22.306786 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpx5f" podUID="c5789fef-e8da-4204-b2af-3468ba9fac6d" Jul 17 17:39:23.986744 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:23.986706 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d3cc0e8-3539-4637-b778-a4cd8663d4f2-original-pull-secret\") pod \"global-pull-secret-syncer-xxhkm\" (UID: \"6d3cc0e8-3539-4637-b778-a4cd8663d4f2\") " pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:23.987177 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:23.986788 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxcz9\" (UniqueName: \"kubernetes.io/projected/c5789fef-e8da-4204-b2af-3468ba9fac6d-kube-api-access-wxcz9\") pod \"network-check-target-cpx5f\" (UID: \"c5789fef-e8da-4204-b2af-3468ba9fac6d\") " pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:39:23.987177 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:23.986807 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05410b3d-9fba-454e-be26-568dbfce20f4-metrics-certs\") pod \"network-metrics-daemon-82zfd\" (UID: \"05410b3d-9fba-454e-be26-568dbfce20f4\") " pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:39:23.987177 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:23.986922 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:39:23.987177 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:23.986977 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05410b3d-9fba-454e-be26-568dbfce20f4-metrics-certs podName:05410b3d-9fba-454e-be26-568dbfce20f4 nodeName:}" failed. No retries permitted until 2026-07-17 17:39:39.98695706 +0000 UTC m=+34.171014825 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05410b3d-9fba-454e-be26-568dbfce20f4-metrics-certs") pod "network-metrics-daemon-82zfd" (UID: "05410b3d-9fba-454e-be26-568dbfce20f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:39:23.987396 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:23.987372 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 17:39:23.987532 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:23.987427 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d3cc0e8-3539-4637-b778-a4cd8663d4f2-original-pull-secret podName:6d3cc0e8-3539-4637-b778-a4cd8663d4f2 nodeName:}" failed. No retries permitted until 2026-07-17 17:39:39.987415236 +0000 UTC m=+34.171472993 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d3cc0e8-3539-4637-b778-a4cd8663d4f2-original-pull-secret") pod "global-pull-secret-syncer-xxhkm" (UID: "6d3cc0e8-3539-4637-b778-a4cd8663d4f2") : object "kube-system"/"original-pull-secret" not registered Jul 17 17:39:23.987532 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:23.987511 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 17:39:23.987648 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:23.987537 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 17:39:23.987648 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:23.987547 2563 projected.go:196] Error preparing data for projected volume kube-api-access-wxcz9 for pod openshift-network-diagnostics/network-check-target-cpx5f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:39:23.987648 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:23.987598 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5789fef-e8da-4204-b2af-3468ba9fac6d-kube-api-access-wxcz9 podName:c5789fef-e8da-4204-b2af-3468ba9fac6d nodeName:}" failed. No retries permitted until 2026-07-17 17:39:39.987586731 +0000 UTC m=+34.171644490 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wxcz9" (UniqueName: "kubernetes.io/projected/c5789fef-e8da-4204-b2af-3468ba9fac6d-kube-api-access-wxcz9") pod "network-check-target-cpx5f" (UID: "c5789fef-e8da-4204-b2af-3468ba9fac6d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:39:24.306498 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:24.306393 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:39:24.306498 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:24.306418 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:24.306498 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:24.306417 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:39:24.306786 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:24.306532 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpx5f" podUID="c5789fef-e8da-4204-b2af-3468ba9fac6d" Jul 17 17:39:24.306786 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:24.306614 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxhkm" podUID="6d3cc0e8-3539-4637-b778-a4cd8663d4f2" Jul 17 17:39:24.306786 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:24.306714 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82zfd" podUID="05410b3d-9fba-454e-be26-568dbfce20f4" Jul 17 17:39:26.306965 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:26.306925 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:39:26.307362 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:26.307052 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpx5f" podUID="c5789fef-e8da-4204-b2af-3468ba9fac6d" Jul 17 17:39:26.307406 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:26.307394 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:26.307513 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:26.307489 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxhkm" podUID="6d3cc0e8-3539-4637-b778-a4cd8663d4f2" Jul 17 17:39:26.307648 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:26.307535 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:39:26.307648 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:26.307597 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82zfd" podUID="05410b3d-9fba-454e-be26-568dbfce20f4" Jul 17 17:39:28.306463 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:28.306288 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:39:28.307102 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:28.306288 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:39:28.307102 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:28.306546 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpx5f" podUID="c5789fef-e8da-4204-b2af-3468ba9fac6d" Jul 17 17:39:28.307102 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:28.306341 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:28.307102 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:28.306681 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxhkm" podUID="6d3cc0e8-3539-4637-b778-a4cd8663d4f2" Jul 17 17:39:28.307102 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:28.306627 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82zfd" podUID="05410b3d-9fba-454e-be26-568dbfce20f4" Jul 17 17:39:28.402662 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:28.402624 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" event={"ID":"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c","Type":"ContainerStarted","Data":"d60a7c48efaf4e7349287f0bca85a5b4e37f3a460202d9dee3d3a58526f80df6"} Jul 17 17:39:28.402802 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:28.402721 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" event={"ID":"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c","Type":"ContainerStarted","Data":"64bdcfa0868abbbc654062e51934c9bbfcbf83987091fe72254402e0655c5d13"} Jul 17 17:39:28.404122 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:28.404088 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f97wh" event={"ID":"d4dcc94c-110b-4b31-8a6c-dfbae393c058","Type":"ContainerStarted","Data":"500720046ff3253848ec29c1982906322eb69c1174e0e2690e1c91e124928e0f"} Jul 17 17:39:28.405538 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:28.405512 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fxzks" event={"ID":"1c9cdba6-ccaa-48e2-a37c-c84f560968bf","Type":"ContainerStarted","Data":"38b1f40299e0b90669a775768250e7fb5d2907e147811f42aaffc9192b746aad"} Jul 17 17:39:28.407545 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:28.407516 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-127.ec2.internal" event={"ID":"5268946509bf7913d6cec963b2c9ff24","Type":"ContainerStarted","Data":"92ec5c9dbe687b72c81e959b8ed2854a6e5b23608234fa8f93ed9c3f115af4dd"} Jul 17 17:39:28.409339 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:28.409314 2563 generic.go:356] "Generic (PLEG): container finished" podID="c3987132-0222-45e9-8c90-7a3ad682329e" containerID="3499cd63f5a4b479a6a2842f2ca05d339993f0f674f71a4036add944450c9a5a" exitCode=0 Jul 17 17:39:28.409463 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:28.409391 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfjf6" event={"ID":"c3987132-0222-45e9-8c90-7a3ad682329e","Type":"ContainerDied","Data":"3499cd63f5a4b479a6a2842f2ca05d339993f0f674f71a4036add944450c9a5a"} Jul 17 17:39:28.411100 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:28.411077 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mhw56" event={"ID":"29d7b457-69a2-47e0-9da5-4b88178bea9d","Type":"ContainerStarted","Data":"a546a8c7de1d148520e6acf4f14895c8f2143e2971b3707754c0709e4a487d73"} Jul 17 17:39:28.412716 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:28.412694 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b2qql" event={"ID":"85eee69e-719a-48b1-95fb-e2012eb6e31f","Type":"ContainerStarted","Data":"f5871aaccd322d3ee565038819e56d97daeb62d666b7b7d052d4100c4305e951"} Jul 17 17:39:28.414326 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:28.414272 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72vj" event={"ID":"f65fe5ae-90c2-4f29-8510-f6a0edca8c54","Type":"ContainerStarted","Data":"67b291de6c95ada81c282092c37fed1d48943dbc7d836c7c1bedfa94c4de7e3a"} Jul 17 17:39:28.415517 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:28.415499 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vw726" event={"ID":"7004a1df-981b-4eb2-bb70-742617ac70e4","Type":"ContainerStarted","Data":"e30eaf91cd56d2b60420617197951fadbda9757c33706284a542b6111f4a878d"} Jul 17 17:39:28.420539 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:28.420502 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-127.ec2.internal" podStartSLOduration=21.420490704 podStartE2EDuration="21.420490704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:39:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:39:11.394843246 +0000 UTC m=+5.578901026" watchObservedRunningTime="2026-07-17 17:39:28.420490704 +0000 UTC m=+22.604548481" Jul 17 17:39:28.420794 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:28.420775 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-f97wh" podStartSLOduration=3.027733714 podStartE2EDuration="22.420770171s" totalImagesPullingTime="19.393036457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:39:28.42015191 +0000 UTC m=+22.604209686" watchObservedRunningTime="2026-07-17 17:39:28.420770171 +0000 UTC m=+22.604827947" Jul 17 17:39:28.434510 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:28.434467 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b2qql" podStartSLOduration=2.10471859 podStartE2EDuration="21.434435244s" totalImagesPullingTime="19.329716654s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:39:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:39:28.434290675 +0000 UTC m=+22.618348459" watchObservedRunningTime="2026-07-17 17:39:28.434435244 +0000 UTC m=+22.618493025" Jul 17 17:39:28.452794 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:28.452751 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fxzks" podStartSLOduration=3.049565349 podStartE2EDuration="22.452736179s" totalImagesPullingTime="19.40317083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:39:28.452506659 +0000 UTC m=+22.636564438" watchObservedRunningTime="2026-07-17 17:39:28.452736179 +0000 UTC m=+22.636793956" Jul 17 17:39:28.477384 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:28.476166 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mhw56" podStartSLOduration=3.035982044 podStartE2EDuration="22.476139244s" totalImagesPullingTime="19.4401572s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:39:28.475536252 +0000 UTC m=+22.659594028" watchObservedRunningTime="2026-07-17 17:39:28.476139244 +0000 UTC m=+22.660197021" Jul 17 17:39:28.511544 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:28.511375 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-127.ec2.internal" podStartSLOduration=21.511360703 podStartE2EDuration="21.511360703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:39:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:39:28.511057903 +0000 UTC m=+22.695115679" watchObservedRunningTime="2026-07-17 17:39:28.511360703 +0000 UTC m=+22.695418481" Jul 17 17:39:28.526390 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:28.526349 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vw726" podStartSLOduration=7.751962241 podStartE2EDuration="22.526332597s" totalImagesPullingTime="14.774370356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:39:28.526050905 +0000 UTC m=+22.710108682" watchObservedRunningTime="2026-07-17 17:39:28.526332597 +0000 UTC m=+22.710390393" Jul 17 17:39:29.158835 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:29.158801 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 17 17:39:29.204161 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:29.203987 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T17:39:29.158820144Z","UUID":"aea2b8ca-a5e7-4a9b-b74e-0e08227e732a","Handler":null,"Name":"","Endpoint":""} Jul 17 17:39:29.205371 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:29.205354 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 17 17:39:29.205467 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:29.205389 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 17 17:39:29.420704 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:29.420667 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72vj" event={"ID":"f65fe5ae-90c2-4f29-8510-f6a0edca8c54","Type":"ContainerStarted","Data":"a2505c1f9e825ed2b1b3fb92497891e4371f3674ad563ebc5a8ca7b06caf78f4"} Jul 17 17:39:29.423730 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:29.423711 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lkfst_b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c/ovn-acl-logging/0.log" Jul 17 17:39:29.424083 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:29.424057 2563 generic.go:356] "Generic (PLEG): container finished" podID="b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c" containerID="d60a7c48efaf4e7349287f0bca85a5b4e37f3a460202d9dee3d3a58526f80df6" exitCode=1 Jul 17 17:39:29.424174 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:29.424150 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" event={"ID":"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c","Type":"ContainerDied","Data":"d60a7c48efaf4e7349287f0bca85a5b4e37f3a460202d9dee3d3a58526f80df6"} Jul 17 17:39:29.424233 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:29.424220 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" event={"ID":"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c","Type":"ContainerStarted","Data":"0fe1a33af068933035ad7bbf3f6b2843725e89323264d76350bd4e599aafc916"} Jul 17 17:39:29.424292 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:29.424255 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" event={"ID":"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c","Type":"ContainerStarted","Data":"0fee5d3379996da2263219c1f3b9b197ccf0bda28c730317e52fe54cffaa0454"} Jul 17 17:39:29.424292 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:29.424283 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" event={"ID":"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c","Type":"ContainerStarted","Data":"0af98d62343e22a7453b8dab4ea4574c7d8752706f6ef659614eff2436cdc1b2"} Jul 17 17:39:29.424395 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:29.424313 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" event={"ID":"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c","Type":"ContainerStarted","Data":"f45ae5576ff8a83c9332d8a8bfedffbbc6a0f97f4ba457acf1a63633f046605b"} Jul 17 17:39:30.306490 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:30.306458 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:39:30.306723 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:30.306600 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:30.306723 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:30.306647 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:39:30.306839 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:30.306595 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpx5f" podUID="c5789fef-e8da-4204-b2af-3468ba9fac6d" Jul 17 17:39:30.306894 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:30.306811 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxhkm" podUID="6d3cc0e8-3539-4637-b778-a4cd8663d4f2" Jul 17 17:39:30.306943 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:30.306885 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82zfd" podUID="05410b3d-9fba-454e-be26-568dbfce20f4" Jul 17 17:39:30.428160 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:30.428125 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6dqlm" event={"ID":"f88ed1a5-3fe2-4745-8ceb-ad864fd4f686","Type":"ContainerStarted","Data":"7c772ef77d0f62a25233fb05f490ebf3e1e443c0b9b42ebd0ca0c6fc2a9a5554"} Jul 17 17:39:30.445000 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:30.444941 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6dqlm" podStartSLOduration=5.092765799 podStartE2EDuration="24.444921298s" totalImagesPullingTime="19.352155499s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:39:30.44440406 +0000 UTC m=+24.628461837" watchObservedRunningTime="2026-07-17 17:39:30.444921298 +0000 UTC m=+24.628979076" Jul 17 17:39:31.433778 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:31.433565 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72vj" event={"ID":"f65fe5ae-90c2-4f29-8510-f6a0edca8c54","Type":"ContainerStarted","Data":"34fc3c1fd4cd6e6c090b516a35f35de23fdedc6b4d652977eefe0d2606be745d"} Jul 17 17:39:31.437082 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:31.437060 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lkfst_b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c/ovn-acl-logging/0.log" Jul 17 17:39:31.437541 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:31.437507 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" event={"ID":"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c","Type":"ContainerStarted","Data":"6944c4cdc8d4be7348509a9b8ba411f2c3c62532a143a8789026065e5914240a"} Jul 17 17:39:31.454640 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:31.454589 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72vj" podStartSLOduration=3.889235339 podStartE2EDuration="25.454573713s" totalImagesPullingTime="21.565338374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:39:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:39:31.454383549 +0000 UTC m=+25.638441327" watchObservedRunningTime="2026-07-17 17:39:31.454573713 +0000 UTC m=+25.638631490" Jul 17 17:39:32.116338 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:32.116299 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vw726" Jul 17 17:39:32.117100 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:32.117078 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vw726" Jul 17 17:39:32.305968 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:32.305933 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:39:32.306149 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:32.305934 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:32.306149 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:32.306059 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpx5f" podUID="c5789fef-e8da-4204-b2af-3468ba9fac6d" Jul 17 17:39:32.306149 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:32.306101 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:39:32.306285 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:32.306204 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxhkm" podUID="6d3cc0e8-3539-4637-b778-a4cd8663d4f2" Jul 17 17:39:32.306337 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:32.306292 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82zfd" podUID="05410b3d-9fba-454e-be26-568dbfce20f4" Jul 17 17:39:32.440067 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:32.439975 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vw726" Jul 17 17:39:32.440647 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:32.440241 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vw726" Jul 17 17:39:34.309845 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:34.309676 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:39:34.310480 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:34.309731 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:39:34.310480 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:34.309930 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82zfd" podUID="05410b3d-9fba-454e-be26-568dbfce20f4" Jul 17 17:39:34.310480 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:34.309731 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:34.310480 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:34.309988 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpx5f" podUID="c5789fef-e8da-4204-b2af-3468ba9fac6d" Jul 17 17:39:34.310480 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:34.310043 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxhkm" podUID="6d3cc0e8-3539-4637-b778-a4cd8663d4f2" Jul 17 17:39:34.448984 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:34.448908 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lkfst_b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c/ovn-acl-logging/0.log" Jul 17 17:39:34.449340 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:34.449314 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" event={"ID":"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c","Type":"ContainerStarted","Data":"4282e6ca183d669401476556bf3fdb057af96c068ff0d3716f8041056a47f5a1"} Jul 17 17:39:34.449580 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:34.449560 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:34.449686 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:34.449624 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:34.449775 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:34.449759 2563 scope.go:117] "RemoveContainer" containerID="d60a7c48efaf4e7349287f0bca85a5b4e37f3a460202d9dee3d3a58526f80df6" Jul 17 17:39:34.451866 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:34.451845 2563 generic.go:356] "Generic (PLEG): container finished" podID="c3987132-0222-45e9-8c90-7a3ad682329e" containerID="dbb7d9e3019541d9ae8931eb86fb54a8d6d66128d381ff13076a5c6b46d6f877" exitCode=0 Jul 17 17:39:34.451947 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:34.451929 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfjf6" event={"ID":"c3987132-0222-45e9-8c90-7a3ad682329e","Type":"ContainerDied","Data":"dbb7d9e3019541d9ae8931eb86fb54a8d6d66128d381ff13076a5c6b46d6f877"} Jul 17 17:39:34.468080 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:34.468058 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:35.458231 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:35.458031 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lkfst_b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c/ovn-acl-logging/0.log" Jul 17 17:39:35.458625 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:35.458531 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" event={"ID":"b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c","Type":"ContainerStarted","Data":"7df39835243e83daef88b58397e4606f3353867c8f04ac5b677d2296dfe1c65b"} Jul 17 17:39:35.458797 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:35.458779 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:35.460869 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:35.460844 2563 generic.go:356] "Generic (PLEG): container finished" podID="c3987132-0222-45e9-8c90-7a3ad682329e" containerID="b43409857113908f2539a2cbc086ee616c19bd1d241e427bf75a825df6a87ddb" exitCode=0 Jul 17 17:39:35.460976 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:35.460893 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfjf6" event={"ID":"c3987132-0222-45e9-8c90-7a3ad682329e","Type":"ContainerDied","Data":"b43409857113908f2539a2cbc086ee616c19bd1d241e427bf75a825df6a87ddb"} Jul 17 17:39:35.476056 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:35.476004 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:39:35.488324 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:35.488278 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" podStartSLOduration=9.792519825 podStartE2EDuration="29.48826408s" totalImagesPullingTime="19.695744255s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:39:35.486888671 +0000 UTC m=+29.670946447" watchObservedRunningTime="2026-07-17 17:39:35.48826408 +0000 UTC m=+29.672321856" Jul 17 17:39:35.489732 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:35.489711 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xxhkm"] Jul 17 17:39:35.489819 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:35.489805 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:35.489900 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:35.489883 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxhkm" podUID="6d3cc0e8-3539-4637-b778-a4cd8663d4f2" Jul 17 17:39:35.492884 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:35.492862 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-82zfd"] Jul 17 17:39:35.492981 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:35.492958 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:39:35.493055 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:35.493040 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82zfd" podUID="05410b3d-9fba-454e-be26-568dbfce20f4" Jul 17 17:39:35.506306 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:35.506271 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cpx5f"] Jul 17 17:39:35.506418 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:35.506359 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:39:35.506499 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:35.506425 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpx5f" podUID="c5789fef-e8da-4204-b2af-3468ba9fac6d" Jul 17 17:39:36.465775 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:36.465693 2563 generic.go:356] "Generic (PLEG): container finished" podID="c3987132-0222-45e9-8c90-7a3ad682329e" containerID="711ea709b94bbe4c82ea3ec39c3bbc4335223d600687c190125be98874e4ef42" exitCode=0 Jul 17 17:39:36.466261 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:36.465777 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfjf6" event={"ID":"c3987132-0222-45e9-8c90-7a3ad682329e","Type":"ContainerDied","Data":"711ea709b94bbe4c82ea3ec39c3bbc4335223d600687c190125be98874e4ef42"} Jul 17 17:39:37.306489 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:37.306385 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:37.306647 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:37.306512 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:39:37.306647 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:37.306525 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:39:37.306647 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:37.306523 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxhkm" podUID="6d3cc0e8-3539-4637-b778-a4cd8663d4f2" Jul 17 17:39:37.306647 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:37.306620 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpx5f" podUID="c5789fef-e8da-4204-b2af-3468ba9fac6d" Jul 17 17:39:37.306782 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:37.306704 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82zfd" podUID="05410b3d-9fba-454e-be26-568dbfce20f4" Jul 17 17:39:39.305883 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:39.305798 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:39:39.306484 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:39.305798 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:39.306484 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:39.305928 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82zfd" podUID="05410b3d-9fba-454e-be26-568dbfce20f4" Jul 17 17:39:39.306484 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:39.306030 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxhkm" podUID="6d3cc0e8-3539-4637-b778-a4cd8663d4f2" Jul 17 17:39:39.306484 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:39.305798 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:39:39.306484 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:39.306113 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpx5f" podUID="c5789fef-e8da-4204-b2af-3468ba9fac6d" Jul 17 17:39:40.001784 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:40.001745 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05410b3d-9fba-454e-be26-568dbfce20f4-metrics-certs\") pod \"network-metrics-daemon-82zfd\" (UID: \"05410b3d-9fba-454e-be26-568dbfce20f4\") " pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:39:40.001988 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:40.001801 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d3cc0e8-3539-4637-b778-a4cd8663d4f2-original-pull-secret\") pod \"global-pull-secret-syncer-xxhkm\" (UID: \"6d3cc0e8-3539-4637-b778-a4cd8663d4f2\") " pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:40.001988 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:40.001854 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxcz9\" (UniqueName: \"kubernetes.io/projected/c5789fef-e8da-4204-b2af-3468ba9fac6d-kube-api-access-wxcz9\") pod \"network-check-target-cpx5f\" (UID: \"c5789fef-e8da-4204-b2af-3468ba9fac6d\") " pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:39:40.001988 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:40.001905 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:39:40.001988 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:40.001956 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 17:39:40.001988 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:40.001972 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05410b3d-9fba-454e-be26-568dbfce20f4-metrics-certs podName:05410b3d-9fba-454e-be26-568dbfce20f4 nodeName:}" failed. No retries permitted until 2026-07-17 17:40:12.001955715 +0000 UTC m=+66.186013473 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05410b3d-9fba-454e-be26-568dbfce20f4-metrics-certs") pod "network-metrics-daemon-82zfd" (UID: "05410b3d-9fba-454e-be26-568dbfce20f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:39:40.001988 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:40.001974 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 17:39:40.001988 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:40.001990 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 17:39:40.002231 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:40.002003 2563 projected.go:196] Error preparing data for projected volume kube-api-access-wxcz9 for pod openshift-network-diagnostics/network-check-target-cpx5f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:39:40.002231 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:40.002011 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d3cc0e8-3539-4637-b778-a4cd8663d4f2-original-pull-secret podName:6d3cc0e8-3539-4637-b778-a4cd8663d4f2 nodeName:}" failed. No retries permitted until 2026-07-17 17:40:12.001996065 +0000 UTC m=+66.186053819 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d3cc0e8-3539-4637-b778-a4cd8663d4f2-original-pull-secret") pod "global-pull-secret-syncer-xxhkm" (UID: "6d3cc0e8-3539-4637-b778-a4cd8663d4f2") : object "kube-system"/"original-pull-secret" not registered Jul 17 17:39:40.002231 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:40.002036 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5789fef-e8da-4204-b2af-3468ba9fac6d-kube-api-access-wxcz9 podName:c5789fef-e8da-4204-b2af-3468ba9fac6d nodeName:}" failed. No retries permitted until 2026-07-17 17:40:12.002025887 +0000 UTC m=+66.186083646 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wxcz9" (UniqueName: "kubernetes.io/projected/c5789fef-e8da-4204-b2af-3468ba9fac6d-kube-api-access-wxcz9") pod "network-check-target-cpx5f" (UID: "c5789fef-e8da-4204-b2af-3468ba9fac6d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:39:40.699591 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:40.699560 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-127.ec2.internal" event="NodeReady" Jul 17 17:39:40.700067 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:40.699742 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 17 17:39:40.758537 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:40.758488 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-k8x8w"] Jul 17 17:39:40.784773 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:40.784693 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-228td"] Jul 17 17:39:40.784973 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:40.784810 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k8x8w" Jul 17 17:39:40.788733 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:40.788707 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 17 17:39:40.788852 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:40.788741 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 17 17:39:40.789627 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:40.789605 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ln8rh\"" Jul 17 17:39:40.796948 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:40.796928 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-228td"] Jul 17 17:39:40.797053 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:40.796962 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k8x8w"] Jul 17 17:39:40.797103 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:40.797057 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-228td" Jul 17 17:39:40.799778 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:40.799759 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 17 17:39:40.799878 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:40.799762 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 17 17:39:40.799878 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:40.799767 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 17 17:39:40.799878 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:40.799871 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ntftg\"" Jul 17 17:39:40.909055 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:40.908997 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7smnv\" (UniqueName: \"kubernetes.io/projected/0f38ee65-d199-4c5d-b8ad-4251ea4d3285-kube-api-access-7smnv\") pod \"ingress-canary-228td\" (UID: \"0f38ee65-d199-4c5d-b8ad-4251ea4d3285\") " pod="openshift-ingress-canary/ingress-canary-228td" Jul 17 17:39:40.909301 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:40.909063 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f38ee65-d199-4c5d-b8ad-4251ea4d3285-cert\") pod \"ingress-canary-228td\" (UID: \"0f38ee65-d199-4c5d-b8ad-4251ea4d3285\") " pod="openshift-ingress-canary/ingress-canary-228td" Jul 17 17:39:40.909301 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:40.909115 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13be2935-6a7b-4e88-9f49-99d389d8d95a-metrics-tls\") pod \"dns-default-k8x8w\" (UID: \"13be2935-6a7b-4e88-9f49-99d389d8d95a\") " pod="openshift-dns/dns-default-k8x8w" Jul 17 17:39:40.909301 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:40.909175 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n5pl\" (UniqueName: \"kubernetes.io/projected/13be2935-6a7b-4e88-9f49-99d389d8d95a-kube-api-access-4n5pl\") pod \"dns-default-k8x8w\" (UID: \"13be2935-6a7b-4e88-9f49-99d389d8d95a\") " pod="openshift-dns/dns-default-k8x8w" Jul 17 17:39:40.909301 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:40.909232 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13be2935-6a7b-4e88-9f49-99d389d8d95a-tmp-dir\") pod \"dns-default-k8x8w\" (UID: \"13be2935-6a7b-4e88-9f49-99d389d8d95a\") " pod="openshift-dns/dns-default-k8x8w" Jul 17 17:39:40.909301 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:40.909275 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/13be2935-6a7b-4e88-9f49-99d389d8d95a-config-volume\") pod \"dns-default-k8x8w\" (UID: \"13be2935-6a7b-4e88-9f49-99d389d8d95a\") " pod="openshift-dns/dns-default-k8x8w" Jul 17 17:39:41.010308 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:41.010276 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/13be2935-6a7b-4e88-9f49-99d389d8d95a-config-volume\") pod \"dns-default-k8x8w\" (UID: \"13be2935-6a7b-4e88-9f49-99d389d8d95a\") " pod="openshift-dns/dns-default-k8x8w" Jul 17 17:39:41.010504 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:41.010349 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7smnv\" (UniqueName: \"kubernetes.io/projected/0f38ee65-d199-4c5d-b8ad-4251ea4d3285-kube-api-access-7smnv\") pod \"ingress-canary-228td\" (UID: \"0f38ee65-d199-4c5d-b8ad-4251ea4d3285\") " pod="openshift-ingress-canary/ingress-canary-228td" Jul 17 17:39:41.010504 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:41.010398 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f38ee65-d199-4c5d-b8ad-4251ea4d3285-cert\") pod \"ingress-canary-228td\" (UID: \"0f38ee65-d199-4c5d-b8ad-4251ea4d3285\") " pod="openshift-ingress-canary/ingress-canary-228td" Jul 17 17:39:41.010504 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:41.010416 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13be2935-6a7b-4e88-9f49-99d389d8d95a-metrics-tls\") pod \"dns-default-k8x8w\" (UID: \"13be2935-6a7b-4e88-9f49-99d389d8d95a\") " pod="openshift-dns/dns-default-k8x8w" Jul 17 17:39:41.010504 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:41.010459 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n5pl\" (UniqueName: \"kubernetes.io/projected/13be2935-6a7b-4e88-9f49-99d389d8d95a-kube-api-access-4n5pl\") pod \"dns-default-k8x8w\" (UID: \"13be2935-6a7b-4e88-9f49-99d389d8d95a\") " pod="openshift-dns/dns-default-k8x8w" Jul 17 17:39:41.010504 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:41.010487 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13be2935-6a7b-4e88-9f49-99d389d8d95a-tmp-dir\") pod \"dns-default-k8x8w\" (UID: \"13be2935-6a7b-4e88-9f49-99d389d8d95a\") " pod="openshift-dns/dns-default-k8x8w" Jul 17 17:39:41.010807 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:41.010782 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13be2935-6a7b-4e88-9f49-99d389d8d95a-tmp-dir\") pod \"dns-default-k8x8w\" (UID: \"13be2935-6a7b-4e88-9f49-99d389d8d95a\") " pod="openshift-dns/dns-default-k8x8w" Jul 17 17:39:41.010879 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:41.010832 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 17:39:41.010931 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:41.010890 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13be2935-6a7b-4e88-9f49-99d389d8d95a-metrics-tls podName:13be2935-6a7b-4e88-9f49-99d389d8d95a nodeName:}" failed. No retries permitted until 2026-07-17 17:39:41.510872648 +0000 UTC m=+35.694930406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13be2935-6a7b-4e88-9f49-99d389d8d95a-metrics-tls") pod "dns-default-k8x8w" (UID: "13be2935-6a7b-4e88-9f49-99d389d8d95a") : secret "dns-default-metrics-tls" not found Jul 17 17:39:41.010980 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:41.010957 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/13be2935-6a7b-4e88-9f49-99d389d8d95a-config-volume\") pod \"dns-default-k8x8w\" (UID: \"13be2935-6a7b-4e88-9f49-99d389d8d95a\") " pod="openshift-dns/dns-default-k8x8w" Jul 17 17:39:41.016040 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:41.015902 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f38ee65-d199-4c5d-b8ad-4251ea4d3285-cert\") pod \"ingress-canary-228td\" (UID: \"0f38ee65-d199-4c5d-b8ad-4251ea4d3285\") " pod="openshift-ingress-canary/ingress-canary-228td" Jul 17 17:39:41.021164 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:41.021131 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n5pl\" (UniqueName: \"kubernetes.io/projected/13be2935-6a7b-4e88-9f49-99d389d8d95a-kube-api-access-4n5pl\") pod \"dns-default-k8x8w\" (UID: \"13be2935-6a7b-4e88-9f49-99d389d8d95a\") " pod="openshift-dns/dns-default-k8x8w" Jul 17 17:39:41.021739 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:41.021717 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7smnv\" (UniqueName: \"kubernetes.io/projected/0f38ee65-d199-4c5d-b8ad-4251ea4d3285-kube-api-access-7smnv\") pod \"ingress-canary-228td\" (UID: \"0f38ee65-d199-4c5d-b8ad-4251ea4d3285\") " pod="openshift-ingress-canary/ingress-canary-228td" Jul 17 17:39:41.106648 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:41.106536 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-228td" Jul 17 17:39:41.297641 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:41.297610 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-228td"] Jul 17 17:39:41.306133 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:41.306101 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:39:41.306233 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:41.306142 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:39:41.306233 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:41.306100 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:39:41.312857 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:41.312806 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t6fgk\"" Jul 17 17:39:41.313165 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:41.313143 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 17:39:41.313165 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:41.313148 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-829wt\"" Jul 17 17:39:41.313309 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:41.313165 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 17:39:41.313309 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:41.313177 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 17 17:39:41.313588 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:41.313573 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 17 17:39:41.403341 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:39:41.403266 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f38ee65_d199_4c5d_b8ad_4251ea4d3285.slice/crio-8e06c482f6a48db8b0e2bec9108127bba7dec8dd9fc406801c297c3b6fc66719 WatchSource:0}: Error finding container 8e06c482f6a48db8b0e2bec9108127bba7dec8dd9fc406801c297c3b6fc66719: Status 404 returned error can't find the container with id 8e06c482f6a48db8b0e2bec9108127bba7dec8dd9fc406801c297c3b6fc66719 Jul 17 17:39:41.478319 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:41.478285 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-228td" event={"ID":"0f38ee65-d199-4c5d-b8ad-4251ea4d3285","Type":"ContainerStarted","Data":"8e06c482f6a48db8b0e2bec9108127bba7dec8dd9fc406801c297c3b6fc66719"} Jul 17 17:39:41.514254 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:41.514222 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13be2935-6a7b-4e88-9f49-99d389d8d95a-metrics-tls\") pod \"dns-default-k8x8w\" (UID: \"13be2935-6a7b-4e88-9f49-99d389d8d95a\") " pod="openshift-dns/dns-default-k8x8w" Jul 17 17:39:41.514399 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:41.514382 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 17:39:41.514491 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:41.514468 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13be2935-6a7b-4e88-9f49-99d389d8d95a-metrics-tls podName:13be2935-6a7b-4e88-9f49-99d389d8d95a nodeName:}" failed. No retries permitted until 2026-07-17 17:39:42.514428683 +0000 UTC m=+36.698486441 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13be2935-6a7b-4e88-9f49-99d389d8d95a-metrics-tls") pod "dns-default-k8x8w" (UID: "13be2935-6a7b-4e88-9f49-99d389d8d95a") : secret "dns-default-metrics-tls" not found Jul 17 17:39:42.484205 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:42.484073 2563 generic.go:356] "Generic (PLEG): container finished" podID="c3987132-0222-45e9-8c90-7a3ad682329e" containerID="606cda13121f593ca2a4ae999b7b1435f8314874fa79e75945658e9ff38b052c" exitCode=0 Jul 17 17:39:42.484205 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:42.484149 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfjf6" event={"ID":"c3987132-0222-45e9-8c90-7a3ad682329e","Type":"ContainerDied","Data":"606cda13121f593ca2a4ae999b7b1435f8314874fa79e75945658e9ff38b052c"} Jul 17 17:39:42.521867 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:42.521830 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13be2935-6a7b-4e88-9f49-99d389d8d95a-metrics-tls\") pod \"dns-default-k8x8w\" (UID: \"13be2935-6a7b-4e88-9f49-99d389d8d95a\") " pod="openshift-dns/dns-default-k8x8w" Jul 17 17:39:42.521995 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:42.521956 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 17:39:42.522054 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:42.522015 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13be2935-6a7b-4e88-9f49-99d389d8d95a-metrics-tls podName:13be2935-6a7b-4e88-9f49-99d389d8d95a nodeName:}" failed. No retries permitted until 2026-07-17 17:39:44.521996375 +0000 UTC m=+38.706054133 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13be2935-6a7b-4e88-9f49-99d389d8d95a-metrics-tls") pod "dns-default-k8x8w" (UID: "13be2935-6a7b-4e88-9f49-99d389d8d95a") : secret "dns-default-metrics-tls" not found Jul 17 17:39:43.490462 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:43.490200 2563 generic.go:356] "Generic (PLEG): container finished" podID="c3987132-0222-45e9-8c90-7a3ad682329e" containerID="030a6f74c02a8b22b147c8dc17c99c9f8b6dfb8ae842862de10511a3ef631d3f" exitCode=0 Jul 17 17:39:43.490462 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:43.490255 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfjf6" event={"ID":"c3987132-0222-45e9-8c90-7a3ad682329e","Type":"ContainerDied","Data":"030a6f74c02a8b22b147c8dc17c99c9f8b6dfb8ae842862de10511a3ef631d3f"} Jul 17 17:39:44.496491 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:44.496433 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfjf6" event={"ID":"c3987132-0222-45e9-8c90-7a3ad682329e","Type":"ContainerStarted","Data":"99db1315e3d4f2bdca337d335e922a82227e3787a395669a9477796305213253"} Jul 17 17:39:44.497948 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:44.497927 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-228td" event={"ID":"0f38ee65-d199-4c5d-b8ad-4251ea4d3285","Type":"ContainerStarted","Data":"b504d1044d4a24dbb6ed33b252715d12bf6dad6491738410d0fe1791d0605137"} Jul 17 17:39:44.529895 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:44.529838 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zfjf6" podStartSLOduration=7.78471644 podStartE2EDuration="38.529819445s" totalImagesPullingTime="30.745103005s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:39:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:39:44.528513804 +0000 UTC m=+38.712571580" watchObservedRunningTime="2026-07-17 17:39:44.529819445 +0000 UTC m=+38.713877223" Jul 17 17:39:44.538681 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:44.538656 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13be2935-6a7b-4e88-9f49-99d389d8d95a-metrics-tls\") pod \"dns-default-k8x8w\" (UID: \"13be2935-6a7b-4e88-9f49-99d389d8d95a\") " pod="openshift-dns/dns-default-k8x8w" Jul 17 17:39:44.538855 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:44.538834 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 17:39:44.538924 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:44.538914 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13be2935-6a7b-4e88-9f49-99d389d8d95a-metrics-tls podName:13be2935-6a7b-4e88-9f49-99d389d8d95a nodeName:}" failed. No retries permitted until 2026-07-17 17:39:48.538893017 +0000 UTC m=+42.722950787 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13be2935-6a7b-4e88-9f49-99d389d8d95a-metrics-tls") pod "dns-default-k8x8w" (UID: "13be2935-6a7b-4e88-9f49-99d389d8d95a") : secret "dns-default-metrics-tls" not found Jul 17 17:39:44.546713 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:44.546664 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-228td" podStartSLOduration=1.9596016139999999 podStartE2EDuration="4.546649056s" totalImagesPullingTime="2.587047442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:39:44.546547212 +0000 UTC m=+38.730604986" watchObservedRunningTime="2026-07-17 17:39:44.546649056 +0000 UTC m=+38.730706882" Jul 17 17:39:48.569736 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:48.569696 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13be2935-6a7b-4e88-9f49-99d389d8d95a-metrics-tls\") pod \"dns-default-k8x8w\" (UID: \"13be2935-6a7b-4e88-9f49-99d389d8d95a\") " pod="openshift-dns/dns-default-k8x8w" Jul 17 17:39:48.570209 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:48.569808 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 17:39:48.570209 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:48.569859 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13be2935-6a7b-4e88-9f49-99d389d8d95a-metrics-tls podName:13be2935-6a7b-4e88-9f49-99d389d8d95a nodeName:}" failed. No retries permitted until 2026-07-17 17:39:56.569846118 +0000 UTC m=+50.753903873 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13be2935-6a7b-4e88-9f49-99d389d8d95a-metrics-tls") pod "dns-default-k8x8w" (UID: "13be2935-6a7b-4e88-9f49-99d389d8d95a") : secret "dns-default-metrics-tls" not found Jul 17 17:39:56.625105 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:39:56.625062 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13be2935-6a7b-4e88-9f49-99d389d8d95a-metrics-tls\") pod \"dns-default-k8x8w\" (UID: \"13be2935-6a7b-4e88-9f49-99d389d8d95a\") " pod="openshift-dns/dns-default-k8x8w" Jul 17 17:39:56.625510 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:56.625186 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 17:39:56.625510 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:39:56.625246 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13be2935-6a7b-4e88-9f49-99d389d8d95a-metrics-tls podName:13be2935-6a7b-4e88-9f49-99d389d8d95a nodeName:}" failed. No retries permitted until 2026-07-17 17:40:12.625231552 +0000 UTC m=+66.809289306 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13be2935-6a7b-4e88-9f49-99d389d8d95a-metrics-tls") pod "dns-default-k8x8w" (UID: "13be2935-6a7b-4e88-9f49-99d389d8d95a") : secret "dns-default-metrics-tls" not found Jul 17 17:40:07.478600 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:07.478572 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lkfst" Jul 17 17:40:12.027356 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:12.027321 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxcz9\" (UniqueName: \"kubernetes.io/projected/c5789fef-e8da-4204-b2af-3468ba9fac6d-kube-api-access-wxcz9\") pod \"network-check-target-cpx5f\" (UID: \"c5789fef-e8da-4204-b2af-3468ba9fac6d\") " pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:40:12.027735 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:12.027364 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05410b3d-9fba-454e-be26-568dbfce20f4-metrics-certs\") pod \"network-metrics-daemon-82zfd\" (UID: \"05410b3d-9fba-454e-be26-568dbfce20f4\") " pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:40:12.027735 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:12.027390 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d3cc0e8-3539-4637-b778-a4cd8663d4f2-original-pull-secret\") pod \"global-pull-secret-syncer-xxhkm\" (UID: \"6d3cc0e8-3539-4637-b778-a4cd8663d4f2\") " pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:40:12.030016 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:12.029992 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 17:40:12.030136 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:12.030019 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 17:40:12.030136 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:12.030096 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 17 17:40:12.038149 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:12.038126 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 17 17:40:12.038287 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:12.038203 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05410b3d-9fba-454e-be26-568dbfce20f4-metrics-certs podName:05410b3d-9fba-454e-be26-568dbfce20f4 nodeName:}" failed. No retries permitted until 2026-07-17 17:41:16.038185966 +0000 UTC m=+130.222243720 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05410b3d-9fba-454e-be26-568dbfce20f4-metrics-certs") pod "network-metrics-daemon-82zfd" (UID: "05410b3d-9fba-454e-be26-568dbfce20f4") : secret "metrics-daemon-secret" not found Jul 17 17:40:12.040658 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:12.040638 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 17 17:40:12.041861 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:12.041840 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d3cc0e8-3539-4637-b778-a4cd8663d4f2-original-pull-secret\") pod \"global-pull-secret-syncer-xxhkm\" (UID: \"6d3cc0e8-3539-4637-b778-a4cd8663d4f2\") " pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:40:12.050709 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:12.050681 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxcz9\" (UniqueName: \"kubernetes.io/projected/c5789fef-e8da-4204-b2af-3468ba9fac6d-kube-api-access-wxcz9\") pod \"network-check-target-cpx5f\" (UID: \"c5789fef-e8da-4204-b2af-3468ba9fac6d\") " pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:40:12.224843 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:12.224810 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t6fgk\"" Jul 17 17:40:12.226913 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:12.226895 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxhkm" Jul 17 17:40:12.232512 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:12.232490 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:40:12.422426 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:12.422385 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xxhkm"] Jul 17 17:40:12.425940 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:40:12.425903 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d3cc0e8_3539_4637_b778_a4cd8663d4f2.slice/crio-8ee1402c0748c391405e0208fe007e15456ecb3910ab4e82f75ac7fcced647be WatchSource:0}: Error finding container 8ee1402c0748c391405e0208fe007e15456ecb3910ab4e82f75ac7fcced647be: Status 404 returned error can't find the container with id 8ee1402c0748c391405e0208fe007e15456ecb3910ab4e82f75ac7fcced647be Jul 17 17:40:12.436816 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:12.436791 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cpx5f"] Jul 17 17:40:12.440191 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:40:12.440169 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5789fef_e8da_4204_b2af_3468ba9fac6d.slice/crio-2517d198c73b2a037473bd4e99ae560c50fe74f13e62ca907c7a706dad7fff83 WatchSource:0}: Error finding container 2517d198c73b2a037473bd4e99ae560c50fe74f13e62ca907c7a706dad7fff83: Status 404 returned error can't find the container with id 2517d198c73b2a037473bd4e99ae560c50fe74f13e62ca907c7a706dad7fff83 Jul 17 17:40:12.564166 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:12.564072 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cpx5f" event={"ID":"c5789fef-e8da-4204-b2af-3468ba9fac6d","Type":"ContainerStarted","Data":"2517d198c73b2a037473bd4e99ae560c50fe74f13e62ca907c7a706dad7fff83"} Jul 17 17:40:12.565213 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:12.565193 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xxhkm" event={"ID":"6d3cc0e8-3539-4637-b778-a4cd8663d4f2","Type":"ContainerStarted","Data":"8ee1402c0748c391405e0208fe007e15456ecb3910ab4e82f75ac7fcced647be"} Jul 17 17:40:12.633106 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:12.633067 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13be2935-6a7b-4e88-9f49-99d389d8d95a-metrics-tls\") pod \"dns-default-k8x8w\" (UID: \"13be2935-6a7b-4e88-9f49-99d389d8d95a\") " pod="openshift-dns/dns-default-k8x8w" Jul 17 17:40:12.633284 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:12.633206 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 17:40:12.633284 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:12.633275 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13be2935-6a7b-4e88-9f49-99d389d8d95a-metrics-tls podName:13be2935-6a7b-4e88-9f49-99d389d8d95a nodeName:}" failed. No retries permitted until 2026-07-17 17:40:44.63325642 +0000 UTC m=+98.817314175 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/13be2935-6a7b-4e88-9f49-99d389d8d95a-metrics-tls") pod "dns-default-k8x8w" (UID: "13be2935-6a7b-4e88-9f49-99d389d8d95a") : secret "dns-default-metrics-tls" not found Jul 17 17:40:15.909238 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:15.909208 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rtgck"] Jul 17 17:40:15.911136 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:15.911111 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rtgck" Jul 17 17:40:15.913780 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:15.913757 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 17 17:40:15.913915 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:15.913829 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-zldtk\"" Jul 17 17:40:15.913915 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:15.913890 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 17 17:40:15.914713 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:15.914682 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 17 17:40:15.914819 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:15.914755 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 17 17:40:15.925024 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:15.924997 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rtgck"] Jul 17 17:40:15.959462 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:15.959409 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/66642d29-f84e-4114-930a-5213ceafbaa0-config\") pod \"service-ca-operator-5bcbc94c78-rtgck\" (UID: \"66642d29-f84e-4114-930a-5213ceafbaa0\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rtgck" Jul 17 17:40:15.959689 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:15.959511 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x56c7\" (UniqueName: \"kubernetes.io/projected/66642d29-f84e-4114-930a-5213ceafbaa0-kube-api-access-x56c7\") pod \"service-ca-operator-5bcbc94c78-rtgck\" (UID: \"66642d29-f84e-4114-930a-5213ceafbaa0\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rtgck" Jul 17 17:40:15.959689 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:15.959546 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/66642d29-f84e-4114-930a-5213ceafbaa0-serving-cert\") pod \"service-ca-operator-5bcbc94c78-rtgck\" (UID: \"66642d29-f84e-4114-930a-5213ceafbaa0\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rtgck" Jul 17 17:40:16.018161 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.018124 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-4sxf2"] Jul 17 17:40:16.020330 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.020305 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-282rm"] Jul 17 17:40:16.020477 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.020423 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-4sxf2" Jul 17 17:40:16.022092 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.022070 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-282rm" Jul 17 17:40:16.026416 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.026191 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 17 17:40:16.026416 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.026259 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 17 17:40:16.026416 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.026340 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 17 17:40:16.027727 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.027707 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 17 17:40:16.027820 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.027737 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 17 17:40:16.028988 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.028963 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 17 17:40:16.031250 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.031228 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qv5xh\"" Jul 17 17:40:16.032170 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.032148 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-964sb\"" Jul 17 17:40:16.033246 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.033214 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 17 17:40:16.052515 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.052474 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-282rm"] Jul 17 17:40:16.053291 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.053262 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-4sxf2"] Jul 17 17:40:16.060536 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.060511 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x56c7\" (UniqueName: \"kubernetes.io/projected/66642d29-f84e-4114-930a-5213ceafbaa0-kube-api-access-x56c7\") pod \"service-ca-operator-5bcbc94c78-rtgck\" (UID: \"66642d29-f84e-4114-930a-5213ceafbaa0\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rtgck" Jul 17 17:40:16.060660 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.060548 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d3e06cb-cb4f-4459-97ef-e618a74ebfc3-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-282rm\" (UID: \"8d3e06cb-cb4f-4459-97ef-e618a74ebfc3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-282rm" Jul 17 17:40:16.060660 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.060572 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/66642d29-f84e-4114-930a-5213ceafbaa0-serving-cert\") pod \"service-ca-operator-5bcbc94c78-rtgck\" (UID: \"66642d29-f84e-4114-930a-5213ceafbaa0\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rtgck" Jul 17 17:40:16.060660 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.060598 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdsvp\" (UniqueName: \"kubernetes.io/projected/8d3e06cb-cb4f-4459-97ef-e618a74ebfc3-kube-api-access-bdsvp\") pod \"cluster-samples-operator-79b7c55f87-282rm\" (UID: \"8d3e06cb-cb4f-4459-97ef-e618a74ebfc3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-282rm" Jul 17 17:40:16.060660 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.060619 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1b994728-13e4-4275-ad5f-541496a45529-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-4sxf2\" (UID: \"1b994728-13e4-4275-ad5f-541496a45529\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-4sxf2" Jul 17 17:40:16.060660 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.060638 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b994728-13e4-4275-ad5f-541496a45529-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-4sxf2\" (UID: \"1b994728-13e4-4275-ad5f-541496a45529\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-4sxf2" Jul 17 17:40:16.060838 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.060665 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkktx\" (UniqueName: \"kubernetes.io/projected/1b994728-13e4-4275-ad5f-541496a45529-kube-api-access-kkktx\") pod \"cluster-monitoring-operator-76cf8966f8-4sxf2\" (UID: \"1b994728-13e4-4275-ad5f-541496a45529\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-4sxf2" Jul 17 17:40:16.060838 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.060705 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/66642d29-f84e-4114-930a-5213ceafbaa0-config\") pod \"service-ca-operator-5bcbc94c78-rtgck\" (UID: \"66642d29-f84e-4114-930a-5213ceafbaa0\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rtgck" Jul 17 17:40:16.061218 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.061195 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/66642d29-f84e-4114-930a-5213ceafbaa0-config\") pod \"service-ca-operator-5bcbc94c78-rtgck\" (UID: \"66642d29-f84e-4114-930a-5213ceafbaa0\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rtgck" Jul 17 17:40:16.064058 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.064002 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/66642d29-f84e-4114-930a-5213ceafbaa0-serving-cert\") pod \"service-ca-operator-5bcbc94c78-rtgck\" (UID: \"66642d29-f84e-4114-930a-5213ceafbaa0\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rtgck" Jul 17 17:40:16.080780 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.080752 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x56c7\" (UniqueName: \"kubernetes.io/projected/66642d29-f84e-4114-930a-5213ceafbaa0-kube-api-access-x56c7\") pod \"service-ca-operator-5bcbc94c78-rtgck\" (UID: \"66642d29-f84e-4114-930a-5213ceafbaa0\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rtgck" Jul 17 17:40:16.118615 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.118581 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-584994d4f4-ldl5z"] Jul 17 17:40:16.120506 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.120486 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:16.123581 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.123553 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 17 17:40:16.124056 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.124024 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 17 17:40:16.124384 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.124359 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nbkf2\"" Jul 17 17:40:16.124384 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.124374 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 17 17:40:16.130577 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.130556 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 17 17:40:16.138165 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.138138 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-584994d4f4-ldl5z"] Jul 17 17:40:16.161530 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.161426 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-image-registry-private-configuration\") pod \"image-registry-584994d4f4-ldl5z\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:16.161530 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.161488 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-ca-trust-extracted\") pod \"image-registry-584994d4f4-ldl5z\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:16.161752 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.161551 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-registry-certificates\") pod \"image-registry-584994d4f4-ldl5z\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:16.161752 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.161628 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d3e06cb-cb4f-4459-97ef-e618a74ebfc3-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-282rm\" (UID: \"8d3e06cb-cb4f-4459-97ef-e618a74ebfc3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-282rm" Jul 17 17:40:16.161752 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.161652 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-trusted-ca\") pod \"image-registry-584994d4f4-ldl5z\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:16.161752 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.161674 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-bound-sa-token\") pod \"image-registry-584994d4f4-ldl5z\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:16.161752 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.161702 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdsvp\" (UniqueName: \"kubernetes.io/projected/8d3e06cb-cb4f-4459-97ef-e618a74ebfc3-kube-api-access-bdsvp\") pod \"cluster-samples-operator-79b7c55f87-282rm\" (UID: \"8d3e06cb-cb4f-4459-97ef-e618a74ebfc3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-282rm" Jul 17 17:40:16.161752 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.161723 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1b994728-13e4-4275-ad5f-541496a45529-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-4sxf2\" (UID: \"1b994728-13e4-4275-ad5f-541496a45529\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-4sxf2" Jul 17 17:40:16.161752 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.161740 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b994728-13e4-4275-ad5f-541496a45529-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-4sxf2\" (UID: \"1b994728-13e4-4275-ad5f-541496a45529\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-4sxf2" Jul 17 17:40:16.162103 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.161761 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-registry-tls\") pod \"image-registry-584994d4f4-ldl5z\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:16.162103 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.161784 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-installation-pull-secrets\") pod \"image-registry-584994d4f4-ldl5z\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:16.162103 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:16.161805 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 17:40:16.162103 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.161809 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s24j5\" (UniqueName: \"kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-kube-api-access-s24j5\") pod \"image-registry-584994d4f4-ldl5z\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:16.162103 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:16.161874 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d3e06cb-cb4f-4459-97ef-e618a74ebfc3-samples-operator-tls podName:8d3e06cb-cb4f-4459-97ef-e618a74ebfc3 nodeName:}" failed. No retries permitted until 2026-07-17 17:40:16.66185357 +0000 UTC m=+70.845911324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8d3e06cb-cb4f-4459-97ef-e618a74ebfc3-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-282rm" (UID: "8d3e06cb-cb4f-4459-97ef-e618a74ebfc3") : secret "samples-operator-tls" not found Jul 17 17:40:16.162103 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:16.161875 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 17:40:16.162103 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.161940 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkktx\" (UniqueName: \"kubernetes.io/projected/1b994728-13e4-4275-ad5f-541496a45529-kube-api-access-kkktx\") pod \"cluster-monitoring-operator-76cf8966f8-4sxf2\" (UID: \"1b994728-13e4-4275-ad5f-541496a45529\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-4sxf2" Jul 17 17:40:16.162103 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:16.161953 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b994728-13e4-4275-ad5f-541496a45529-cluster-monitoring-operator-tls podName:1b994728-13e4-4275-ad5f-541496a45529 nodeName:}" failed. No retries permitted until 2026-07-17 17:40:16.661933443 +0000 UTC m=+70.845991212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1b994728-13e4-4275-ad5f-541496a45529-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-4sxf2" (UID: "1b994728-13e4-4275-ad5f-541496a45529") : secret "cluster-monitoring-operator-tls" not found Jul 17 17:40:16.162529 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.162438 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1b994728-13e4-4275-ad5f-541496a45529-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-4sxf2\" (UID: \"1b994728-13e4-4275-ad5f-541496a45529\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-4sxf2" Jul 17 17:40:16.176916 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.176882 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkktx\" (UniqueName: \"kubernetes.io/projected/1b994728-13e4-4275-ad5f-541496a45529-kube-api-access-kkktx\") pod \"cluster-monitoring-operator-76cf8966f8-4sxf2\" (UID: \"1b994728-13e4-4275-ad5f-541496a45529\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-4sxf2" Jul 17 17:40:16.176916 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.176902 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdsvp\" (UniqueName: \"kubernetes.io/projected/8d3e06cb-cb4f-4459-97ef-e618a74ebfc3-kube-api-access-bdsvp\") pod \"cluster-samples-operator-79b7c55f87-282rm\" (UID: \"8d3e06cb-cb4f-4459-97ef-e618a74ebfc3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-282rm" Jul 17 17:40:16.221074 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.221035 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rtgck" Jul 17 17:40:16.262663 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.262627 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-image-registry-private-configuration\") pod \"image-registry-584994d4f4-ldl5z\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:16.262663 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.262667 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-ca-trust-extracted\") pod \"image-registry-584994d4f4-ldl5z\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:16.262926 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.262690 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-registry-certificates\") pod \"image-registry-584994d4f4-ldl5z\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:16.262926 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.262739 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-trusted-ca\") pod \"image-registry-584994d4f4-ldl5z\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:16.262926 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.262771 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-bound-sa-token\") pod \"image-registry-584994d4f4-ldl5z\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:16.262926 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.262811 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-registry-tls\") pod \"image-registry-584994d4f4-ldl5z\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:16.262926 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.262832 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-installation-pull-secrets\") pod \"image-registry-584994d4f4-ldl5z\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:16.262926 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.262850 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s24j5\" (UniqueName: \"kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-kube-api-access-s24j5\") pod \"image-registry-584994d4f4-ldl5z\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:16.263217 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.263111 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-ca-trust-extracted\") pod \"image-registry-584994d4f4-ldl5z\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:16.263275 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:16.263224 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 17:40:16.263275 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:16.263239 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584994d4f4-ldl5z: secret "image-registry-tls" not found Jul 17 17:40:16.263360 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:16.263292 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-registry-tls podName:8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f nodeName:}" failed. No retries permitted until 2026-07-17 17:40:16.7632719 +0000 UTC m=+70.947329663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-registry-tls") pod "image-registry-584994d4f4-ldl5z" (UID: "8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f") : secret "image-registry-tls" not found Jul 17 17:40:16.263831 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.263790 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-registry-certificates\") pod \"image-registry-584994d4f4-ldl5z\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:16.264344 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.264323 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-trusted-ca\") pod \"image-registry-584994d4f4-ldl5z\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:16.268471 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.266353 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-installation-pull-secrets\") pod \"image-registry-584994d4f4-ldl5z\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:16.268471 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.266421 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-image-registry-private-configuration\") pod \"image-registry-584994d4f4-ldl5z\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:16.272793 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.272765 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s24j5\" (UniqueName: \"kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-kube-api-access-s24j5\") pod \"image-registry-584994d4f4-ldl5z\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:16.272901 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.272791 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-bound-sa-token\") pod \"image-registry-584994d4f4-ldl5z\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:16.667179 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.667142 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d3e06cb-cb4f-4459-97ef-e618a74ebfc3-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-282rm\" (UID: \"8d3e06cb-cb4f-4459-97ef-e618a74ebfc3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-282rm" Jul 17 17:40:16.667179 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.667188 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b994728-13e4-4275-ad5f-541496a45529-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-4sxf2\" (UID: \"1b994728-13e4-4275-ad5f-541496a45529\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-4sxf2" Jul 17 17:40:16.667433 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:16.667319 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 17:40:16.667433 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:16.667348 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 17:40:16.667433 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:16.667400 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d3e06cb-cb4f-4459-97ef-e618a74ebfc3-samples-operator-tls podName:8d3e06cb-cb4f-4459-97ef-e618a74ebfc3 nodeName:}" failed. No retries permitted until 2026-07-17 17:40:17.667377755 +0000 UTC m=+71.851435518 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8d3e06cb-cb4f-4459-97ef-e618a74ebfc3-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-282rm" (UID: "8d3e06cb-cb4f-4459-97ef-e618a74ebfc3") : secret "samples-operator-tls" not found Jul 17 17:40:16.667433 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:16.667418 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b994728-13e4-4275-ad5f-541496a45529-cluster-monitoring-operator-tls podName:1b994728-13e4-4275-ad5f-541496a45529 nodeName:}" failed. No retries permitted until 2026-07-17 17:40:17.667411013 +0000 UTC m=+71.851468768 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1b994728-13e4-4275-ad5f-541496a45529-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-4sxf2" (UID: "1b994728-13e4-4275-ad5f-541496a45529") : secret "cluster-monitoring-operator-tls" not found Jul 17 17:40:16.768097 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:16.768056 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-registry-tls\") pod \"image-registry-584994d4f4-ldl5z\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:16.768276 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:16.768229 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 17:40:16.768276 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:16.768248 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584994d4f4-ldl5z: secret "image-registry-tls" not found Jul 17 17:40:16.768363 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:16.768297 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-registry-tls podName:8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f nodeName:}" failed. No retries permitted until 2026-07-17 17:40:17.768282292 +0000 UTC m=+71.952340047 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-registry-tls") pod "image-registry-584994d4f4-ldl5z" (UID: "8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f") : secret "image-registry-tls" not found Jul 17 17:40:17.111985 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:17.109788 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rtgck"] Jul 17 17:40:17.579845 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:17.579803 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cpx5f" event={"ID":"c5789fef-e8da-4204-b2af-3468ba9fac6d","Type":"ContainerStarted","Data":"ad594e6499fa664d7f48484d3c9046b5b20c4e890c765bb61e0add9c750fda93"} Jul 17 17:40:17.580041 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:17.579875 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:40:17.581579 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:17.581549 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xxhkm" event={"ID":"6d3cc0e8-3539-4637-b778-a4cd8663d4f2","Type":"ContainerStarted","Data":"da78897d37d067603be691add6f628a8c6e0bc5b68e92b00ecc23e2a7e641a90"} Jul 17 17:40:17.582868 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:17.582845 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rtgck" event={"ID":"66642d29-f84e-4114-930a-5213ceafbaa0","Type":"ContainerStarted","Data":"38184efbb24f898e97c1e6ef4e4e80c6e443ea47bb8ddcdbc81efe7967760b6f"} Jul 17 17:40:17.597737 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:17.597670 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cpx5f" podStartSLOduration=66.071771031 podStartE2EDuration="1m10.597654052s" totalImagesPullingTime="4.525883021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:39:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:40:17.597349322 +0000 UTC m=+71.781407100" watchObservedRunningTime="2026-07-17 17:40:17.597654052 +0000 UTC m=+71.781711829" Jul 17 17:40:17.613861 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:17.613797 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xxhkm" podStartSLOduration=66.067192133 podStartE2EDuration="1m10.613776105s" totalImagesPullingTime="4.546583972s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:39:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:40:17.612997749 +0000 UTC m=+71.797055528" watchObservedRunningTime="2026-07-17 17:40:17.613776105 +0000 UTC m=+71.797833882" Jul 17 17:40:17.676676 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:17.676637 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d3e06cb-cb4f-4459-97ef-e618a74ebfc3-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-282rm\" (UID: \"8d3e06cb-cb4f-4459-97ef-e618a74ebfc3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-282rm" Jul 17 17:40:17.676918 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:17.676705 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b994728-13e4-4275-ad5f-541496a45529-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-4sxf2\" (UID: \"1b994728-13e4-4275-ad5f-541496a45529\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-4sxf2" Jul 17 17:40:17.676918 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:17.676806 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 17:40:17.676918 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:17.676843 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 17:40:17.676918 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:17.676880 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d3e06cb-cb4f-4459-97ef-e618a74ebfc3-samples-operator-tls podName:8d3e06cb-cb4f-4459-97ef-e618a74ebfc3 nodeName:}" failed. No retries permitted until 2026-07-17 17:40:19.676857007 +0000 UTC m=+73.860914790 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8d3e06cb-cb4f-4459-97ef-e618a74ebfc3-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-282rm" (UID: "8d3e06cb-cb4f-4459-97ef-e618a74ebfc3") : secret "samples-operator-tls" not found Jul 17 17:40:17.676918 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:17.676901 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b994728-13e4-4275-ad5f-541496a45529-cluster-monitoring-operator-tls podName:1b994728-13e4-4275-ad5f-541496a45529 nodeName:}" failed. No retries permitted until 2026-07-17 17:40:19.676891404 +0000 UTC m=+73.860949165 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1b994728-13e4-4275-ad5f-541496a45529-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-4sxf2" (UID: "1b994728-13e4-4275-ad5f-541496a45529") : secret "cluster-monitoring-operator-tls" not found Jul 17 17:40:17.777980 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:17.777943 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-registry-tls\") pod \"image-registry-584994d4f4-ldl5z\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:17.778169 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:17.778125 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 17:40:17.778169 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:17.778147 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584994d4f4-ldl5z: secret "image-registry-tls" not found Jul 17 17:40:17.778250 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:17.778210 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-registry-tls podName:8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f nodeName:}" failed. No retries permitted until 2026-07-17 17:40:19.778190303 +0000 UTC m=+73.962248065 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-registry-tls") pod "image-registry-584994d4f4-ldl5z" (UID: "8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f") : secret "image-registry-tls" not found Jul 17 17:40:19.315640 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:19.315561 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-trcj8"] Jul 17 17:40:19.317488 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:19.317469 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-trcj8" Jul 17 17:40:19.323396 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:19.323364 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 17 17:40:19.323573 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:19.323432 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6f5vs\"" Jul 17 17:40:19.324502 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:19.324479 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 17 17:40:19.324502 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:19.324499 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 17 17:40:19.324695 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:19.324498 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 17 17:40:19.349281 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:19.349245 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-trcj8"] Jul 17 17:40:19.391592 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:19.391559 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c46ea5c6-3992-4e9d-b278-22afb27c04a4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trcj8\" (UID: \"c46ea5c6-3992-4e9d-b278-22afb27c04a4\") " pod="openshift-insights/insights-runtime-extractor-trcj8" Jul 17 17:40:19.391784 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:19.391706 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c46ea5c6-3992-4e9d-b278-22afb27c04a4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trcj8\" (UID: \"c46ea5c6-3992-4e9d-b278-22afb27c04a4\") " pod="openshift-insights/insights-runtime-extractor-trcj8" Jul 17 17:40:19.391784 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:19.391736 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqwvj\" (UniqueName: \"kubernetes.io/projected/c46ea5c6-3992-4e9d-b278-22afb27c04a4-kube-api-access-gqwvj\") pod \"insights-runtime-extractor-trcj8\" (UID: \"c46ea5c6-3992-4e9d-b278-22afb27c04a4\") " pod="openshift-insights/insights-runtime-extractor-trcj8" Jul 17 17:40:19.391784 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:19.391756 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c46ea5c6-3992-4e9d-b278-22afb27c04a4-crio-socket\") pod \"insights-runtime-extractor-trcj8\" (UID: \"c46ea5c6-3992-4e9d-b278-22afb27c04a4\") " pod="openshift-insights/insights-runtime-extractor-trcj8" Jul 17 17:40:19.391784 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:19.391774 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c46ea5c6-3992-4e9d-b278-22afb27c04a4-data-volume\") pod \"insights-runtime-extractor-trcj8\" (UID: \"c46ea5c6-3992-4e9d-b278-22afb27c04a4\") " pod="openshift-insights/insights-runtime-extractor-trcj8" Jul 17 17:40:19.492432 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:19.492388 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c46ea5c6-3992-4e9d-b278-22afb27c04a4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trcj8\" (UID: \"c46ea5c6-3992-4e9d-b278-22afb27c04a4\") " pod="openshift-insights/insights-runtime-extractor-trcj8" Jul 17 17:40:19.492647 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:19.492524 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 17:40:19.492647 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:19.492532 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c46ea5c6-3992-4e9d-b278-22afb27c04a4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trcj8\" (UID: \"c46ea5c6-3992-4e9d-b278-22afb27c04a4\") " pod="openshift-insights/insights-runtime-extractor-trcj8" Jul 17 17:40:19.492647 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:19.492609 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 17:40:19.492647 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:19.492617 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c46ea5c6-3992-4e9d-b278-22afb27c04a4-kube-rbac-proxy-cm podName:c46ea5c6-3992-4e9d-b278-22afb27c04a4 nodeName:}" failed. No retries permitted until 2026-07-17 17:40:19.992597114 +0000 UTC m=+74.176654885 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c46ea5c6-3992-4e9d-b278-22afb27c04a4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-trcj8" (UID: "c46ea5c6-3992-4e9d-b278-22afb27c04a4") : configmap "kube-rbac-proxy" not found Jul 17 17:40:19.492647 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:19.492644 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c46ea5c6-3992-4e9d-b278-22afb27c04a4-insights-runtime-extractor-tls podName:c46ea5c6-3992-4e9d-b278-22afb27c04a4 nodeName:}" failed. No retries permitted until 2026-07-17 17:40:19.992634163 +0000 UTC m=+74.176691917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c46ea5c6-3992-4e9d-b278-22afb27c04a4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-trcj8" (UID: "c46ea5c6-3992-4e9d-b278-22afb27c04a4") : secret "insights-runtime-extractor-tls" not found Jul 17 17:40:19.492908 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:19.492659 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqwvj\" (UniqueName: \"kubernetes.io/projected/c46ea5c6-3992-4e9d-b278-22afb27c04a4-kube-api-access-gqwvj\") pod \"insights-runtime-extractor-trcj8\" (UID: \"c46ea5c6-3992-4e9d-b278-22afb27c04a4\") " pod="openshift-insights/insights-runtime-extractor-trcj8" Jul 17 17:40:19.492908 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:19.492687 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c46ea5c6-3992-4e9d-b278-22afb27c04a4-crio-socket\") pod \"insights-runtime-extractor-trcj8\" (UID: \"c46ea5c6-3992-4e9d-b278-22afb27c04a4\") " pod="openshift-insights/insights-runtime-extractor-trcj8" Jul 17 17:40:19.492908 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:19.492710 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c46ea5c6-3992-4e9d-b278-22afb27c04a4-data-volume\") pod \"insights-runtime-extractor-trcj8\" (UID: \"c46ea5c6-3992-4e9d-b278-22afb27c04a4\") " pod="openshift-insights/insights-runtime-extractor-trcj8" Jul 17 17:40:19.492908 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:19.492802 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c46ea5c6-3992-4e9d-b278-22afb27c04a4-crio-socket\") pod \"insights-runtime-extractor-trcj8\" (UID: \"c46ea5c6-3992-4e9d-b278-22afb27c04a4\") " pod="openshift-insights/insights-runtime-extractor-trcj8" Jul 17 17:40:19.493086 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:19.493064 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c46ea5c6-3992-4e9d-b278-22afb27c04a4-data-volume\") pod \"insights-runtime-extractor-trcj8\" (UID: \"c46ea5c6-3992-4e9d-b278-22afb27c04a4\") " pod="openshift-insights/insights-runtime-extractor-trcj8" Jul 17 17:40:19.511364 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:19.511335 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqwvj\" (UniqueName: \"kubernetes.io/projected/c46ea5c6-3992-4e9d-b278-22afb27c04a4-kube-api-access-gqwvj\") pod \"insights-runtime-extractor-trcj8\" (UID: \"c46ea5c6-3992-4e9d-b278-22afb27c04a4\") " pod="openshift-insights/insights-runtime-extractor-trcj8" Jul 17 17:40:19.589617 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:19.589526 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rtgck" event={"ID":"66642d29-f84e-4114-930a-5213ceafbaa0","Type":"ContainerStarted","Data":"8eeb191fee56fc0235b7b2b8c15534ad15733d8da60e33dfed931d7578cb6d7d"} Jul 17 17:40:19.609051 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:19.608997 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rtgck" podStartSLOduration=2.672356461 podStartE2EDuration="4.608976214s" totalImagesPullingTime="1.936619753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:40:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:40:19.607610155 +0000 UTC m=+73.791667932" watchObservedRunningTime="2026-07-17 17:40:19.608976214 +0000 UTC m=+73.793033969" Jul 17 17:40:19.694258 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:19.694212 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b994728-13e4-4275-ad5f-541496a45529-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-4sxf2\" (UID: \"1b994728-13e4-4275-ad5f-541496a45529\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-4sxf2" Jul 17 17:40:19.694429 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:19.694282 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d3e06cb-cb4f-4459-97ef-e618a74ebfc3-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-282rm\" (UID: \"8d3e06cb-cb4f-4459-97ef-e618a74ebfc3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-282rm" Jul 17 17:40:19.694547 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:19.694419 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 17:40:19.694547 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:19.694463 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 17:40:19.694547 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:19.694515 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b994728-13e4-4275-ad5f-541496a45529-cluster-monitoring-operator-tls podName:1b994728-13e4-4275-ad5f-541496a45529 nodeName:}" failed. No retries permitted until 2026-07-17 17:40:23.694495699 +0000 UTC m=+77.878553455 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1b994728-13e4-4275-ad5f-541496a45529-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-4sxf2" (UID: "1b994728-13e4-4275-ad5f-541496a45529") : secret "cluster-monitoring-operator-tls" not found Jul 17 17:40:19.694547 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:19.694540 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d3e06cb-cb4f-4459-97ef-e618a74ebfc3-samples-operator-tls podName:8d3e06cb-cb4f-4459-97ef-e618a74ebfc3 nodeName:}" failed. No retries permitted until 2026-07-17 17:40:23.694529883 +0000 UTC m=+77.878587638 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8d3e06cb-cb4f-4459-97ef-e618a74ebfc3-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-282rm" (UID: "8d3e06cb-cb4f-4459-97ef-e618a74ebfc3") : secret "samples-operator-tls" not found Jul 17 17:40:19.795329 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:19.795284 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-registry-tls\") pod \"image-registry-584994d4f4-ldl5z\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:19.795535 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:19.795470 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 17:40:19.795535 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:19.795489 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584994d4f4-ldl5z: secret "image-registry-tls" not found Jul 17 17:40:19.795620 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:19.795542 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-registry-tls podName:8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f nodeName:}" failed. No retries permitted until 2026-07-17 17:40:23.795528168 +0000 UTC m=+77.979585922 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-registry-tls") pod "image-registry-584994d4f4-ldl5z" (UID: "8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f") : secret "image-registry-tls" not found Jul 17 17:40:19.996835 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:19.996803 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c46ea5c6-3992-4e9d-b278-22afb27c04a4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trcj8\" (UID: \"c46ea5c6-3992-4e9d-b278-22afb27c04a4\") " pod="openshift-insights/insights-runtime-extractor-trcj8" Jul 17 17:40:19.997011 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:19.996853 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c46ea5c6-3992-4e9d-b278-22afb27c04a4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trcj8\" (UID: \"c46ea5c6-3992-4e9d-b278-22afb27c04a4\") " pod="openshift-insights/insights-runtime-extractor-trcj8" Jul 17 17:40:19.997011 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:19.996924 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 17:40:19.997011 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:19.996976 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c46ea5c6-3992-4e9d-b278-22afb27c04a4-kube-rbac-proxy-cm podName:c46ea5c6-3992-4e9d-b278-22afb27c04a4 nodeName:}" failed. No retries permitted until 2026-07-17 17:40:20.996962682 +0000 UTC m=+75.181020437 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c46ea5c6-3992-4e9d-b278-22afb27c04a4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-trcj8" (UID: "c46ea5c6-3992-4e9d-b278-22afb27c04a4") : configmap "kube-rbac-proxy" not found Jul 17 17:40:19.997011 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:19.996975 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 17:40:19.997174 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:19.997039 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c46ea5c6-3992-4e9d-b278-22afb27c04a4-insights-runtime-extractor-tls podName:c46ea5c6-3992-4e9d-b278-22afb27c04a4 nodeName:}" failed. No retries permitted until 2026-07-17 17:40:20.997022332 +0000 UTC m=+75.181080091 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c46ea5c6-3992-4e9d-b278-22afb27c04a4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-trcj8" (UID: "c46ea5c6-3992-4e9d-b278-22afb27c04a4") : secret "insights-runtime-extractor-tls" not found Jul 17 17:40:21.003992 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:21.003955 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c46ea5c6-3992-4e9d-b278-22afb27c04a4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trcj8\" (UID: \"c46ea5c6-3992-4e9d-b278-22afb27c04a4\") " pod="openshift-insights/insights-runtime-extractor-trcj8" Jul 17 17:40:21.004395 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:21.004012 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c46ea5c6-3992-4e9d-b278-22afb27c04a4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trcj8\" (UID: \"c46ea5c6-3992-4e9d-b278-22afb27c04a4\") " pod="openshift-insights/insights-runtime-extractor-trcj8" Jul 17 17:40:21.004395 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:21.004071 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 17:40:21.004395 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:21.004113 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 17:40:21.004395 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:21.004127 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c46ea5c6-3992-4e9d-b278-22afb27c04a4-kube-rbac-proxy-cm podName:c46ea5c6-3992-4e9d-b278-22afb27c04a4 nodeName:}" failed. No retries permitted until 2026-07-17 17:40:23.004106298 +0000 UTC m=+77.188164053 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c46ea5c6-3992-4e9d-b278-22afb27c04a4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-trcj8" (UID: "c46ea5c6-3992-4e9d-b278-22afb27c04a4") : configmap "kube-rbac-proxy" not found Jul 17 17:40:21.004395 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:21.004185 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c46ea5c6-3992-4e9d-b278-22afb27c04a4-insights-runtime-extractor-tls podName:c46ea5c6-3992-4e9d-b278-22afb27c04a4 nodeName:}" failed. No retries permitted until 2026-07-17 17:40:23.004170436 +0000 UTC m=+77.188228191 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c46ea5c6-3992-4e9d-b278-22afb27c04a4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-trcj8" (UID: "c46ea5c6-3992-4e9d-b278-22afb27c04a4") : secret "insights-runtime-extractor-tls" not found Jul 17 17:40:21.372408 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:21.372329 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f97wh_d4dcc94c-110b-4b31-8a6c-dfbae393c058/dns-node-resolver/0.log" Jul 17 17:40:22.168163 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:22.168130 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b2qql_85eee69e-719a-48b1-95fb-e2012eb6e31f/node-ca/0.log" Jul 17 17:40:22.967890 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:22.967855 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-228td_0f38ee65-d199-4c5d-b8ad-4251ea4d3285/serve-healthcheck-canary/0.log" Jul 17 17:40:23.019179 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:23.019149 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c46ea5c6-3992-4e9d-b278-22afb27c04a4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trcj8\" (UID: \"c46ea5c6-3992-4e9d-b278-22afb27c04a4\") " pod="openshift-insights/insights-runtime-extractor-trcj8" Jul 17 17:40:23.019335 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:23.019195 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c46ea5c6-3992-4e9d-b278-22afb27c04a4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trcj8\" (UID: \"c46ea5c6-3992-4e9d-b278-22afb27c04a4\") " pod="openshift-insights/insights-runtime-extractor-trcj8" Jul 17 17:40:23.019335 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:23.019286 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 17:40:23.019335 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:23.019296 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 17:40:23.019465 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:23.019337 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c46ea5c6-3992-4e9d-b278-22afb27c04a4-kube-rbac-proxy-cm podName:c46ea5c6-3992-4e9d-b278-22afb27c04a4 nodeName:}" failed. No retries permitted until 2026-07-17 17:40:27.019324672 +0000 UTC m=+81.203382428 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c46ea5c6-3992-4e9d-b278-22afb27c04a4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-trcj8" (UID: "c46ea5c6-3992-4e9d-b278-22afb27c04a4") : configmap "kube-rbac-proxy" not found Jul 17 17:40:23.019465 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:23.019352 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c46ea5c6-3992-4e9d-b278-22afb27c04a4-insights-runtime-extractor-tls podName:c46ea5c6-3992-4e9d-b278-22afb27c04a4 nodeName:}" failed. No retries permitted until 2026-07-17 17:40:27.019344523 +0000 UTC m=+81.203402278 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c46ea5c6-3992-4e9d-b278-22afb27c04a4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-trcj8" (UID: "c46ea5c6-3992-4e9d-b278-22afb27c04a4") : secret "insights-runtime-extractor-tls" not found Jul 17 17:40:23.724990 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:23.724952 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b994728-13e4-4275-ad5f-541496a45529-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-4sxf2\" (UID: \"1b994728-13e4-4275-ad5f-541496a45529\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-4sxf2" Jul 17 17:40:23.725389 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:23.725001 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d3e06cb-cb4f-4459-97ef-e618a74ebfc3-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-282rm\" (UID: \"8d3e06cb-cb4f-4459-97ef-e618a74ebfc3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-282rm" Jul 17 17:40:23.725389 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:23.725095 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 17:40:23.725389 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:23.725096 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 17:40:23.725389 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:23.725147 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d3e06cb-cb4f-4459-97ef-e618a74ebfc3-samples-operator-tls podName:8d3e06cb-cb4f-4459-97ef-e618a74ebfc3 nodeName:}" failed. No retries permitted until 2026-07-17 17:40:31.725133691 +0000 UTC m=+85.909191446 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8d3e06cb-cb4f-4459-97ef-e618a74ebfc3-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-282rm" (UID: "8d3e06cb-cb4f-4459-97ef-e618a74ebfc3") : secret "samples-operator-tls" not found Jul 17 17:40:23.725389 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:23.725159 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b994728-13e4-4275-ad5f-541496a45529-cluster-monitoring-operator-tls podName:1b994728-13e4-4275-ad5f-541496a45529 nodeName:}" failed. No retries permitted until 2026-07-17 17:40:31.725153408 +0000 UTC m=+85.909211163 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1b994728-13e4-4275-ad5f-541496a45529-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-4sxf2" (UID: "1b994728-13e4-4275-ad5f-541496a45529") : secret "cluster-monitoring-operator-tls" not found Jul 17 17:40:23.826019 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:23.825983 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-registry-tls\") pod \"image-registry-584994d4f4-ldl5z\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:23.826182 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:23.826105 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 17:40:23.826182 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:23.826119 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584994d4f4-ldl5z: secret "image-registry-tls" not found Jul 17 17:40:23.826182 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:23.826168 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-registry-tls podName:8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f nodeName:}" failed. No retries permitted until 2026-07-17 17:40:31.826154307 +0000 UTC m=+86.010212063 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-registry-tls") pod "image-registry-584994d4f4-ldl5z" (UID: "8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f") : secret "image-registry-tls" not found Jul 17 17:40:27.049658 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:27.049533 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c46ea5c6-3992-4e9d-b278-22afb27c04a4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trcj8\" (UID: \"c46ea5c6-3992-4e9d-b278-22afb27c04a4\") " pod="openshift-insights/insights-runtime-extractor-trcj8" Jul 17 17:40:27.049658 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:27.049593 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c46ea5c6-3992-4e9d-b278-22afb27c04a4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trcj8\" (UID: \"c46ea5c6-3992-4e9d-b278-22afb27c04a4\") " pod="openshift-insights/insights-runtime-extractor-trcj8" Jul 17 17:40:27.050057 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:27.049672 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 17:40:27.050057 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:27.049682 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 17:40:27.050057 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:27.049734 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c46ea5c6-3992-4e9d-b278-22afb27c04a4-kube-rbac-proxy-cm podName:c46ea5c6-3992-4e9d-b278-22afb27c04a4 nodeName:}" failed. No retries permitted until 2026-07-17 17:40:35.049715945 +0000 UTC m=+89.233773700 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c46ea5c6-3992-4e9d-b278-22afb27c04a4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-trcj8" (UID: "c46ea5c6-3992-4e9d-b278-22afb27c04a4") : configmap "kube-rbac-proxy" not found Jul 17 17:40:27.050057 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:27.049749 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c46ea5c6-3992-4e9d-b278-22afb27c04a4-insights-runtime-extractor-tls podName:c46ea5c6-3992-4e9d-b278-22afb27c04a4 nodeName:}" failed. No retries permitted until 2026-07-17 17:40:35.049742272 +0000 UTC m=+89.233800027 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c46ea5c6-3992-4e9d-b278-22afb27c04a4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-trcj8" (UID: "c46ea5c6-3992-4e9d-b278-22afb27c04a4") : secret "insights-runtime-extractor-tls" not found Jul 17 17:40:31.790229 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:31.790188 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b994728-13e4-4275-ad5f-541496a45529-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-4sxf2\" (UID: \"1b994728-13e4-4275-ad5f-541496a45529\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-4sxf2" Jul 17 17:40:31.790647 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:31.790245 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d3e06cb-cb4f-4459-97ef-e618a74ebfc3-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-282rm\" (UID: \"8d3e06cb-cb4f-4459-97ef-e618a74ebfc3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-282rm" Jul 17 17:40:31.790647 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:31.790336 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 17:40:31.790647 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:31.790394 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b994728-13e4-4275-ad5f-541496a45529-cluster-monitoring-operator-tls podName:1b994728-13e4-4275-ad5f-541496a45529 nodeName:}" failed. No retries permitted until 2026-07-17 17:40:47.790379143 +0000 UTC m=+101.974436897 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1b994728-13e4-4275-ad5f-541496a45529-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-4sxf2" (UID: "1b994728-13e4-4275-ad5f-541496a45529") : secret "cluster-monitoring-operator-tls" not found Jul 17 17:40:31.792809 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:31.792789 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d3e06cb-cb4f-4459-97ef-e618a74ebfc3-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-282rm\" (UID: \"8d3e06cb-cb4f-4459-97ef-e618a74ebfc3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-282rm" Jul 17 17:40:31.891165 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:31.891128 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-registry-tls\") pod \"image-registry-584994d4f4-ldl5z\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:31.893709 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:31.893684 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-registry-tls\") pod \"image-registry-584994d4f4-ldl5z\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:31.941880 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:31.941842 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-282rm" Jul 17 17:40:32.033094 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:32.033056 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:32.075211 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:32.075177 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-282rm"] Jul 17 17:40:32.168182 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:32.168144 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-584994d4f4-ldl5z"] Jul 17 17:40:32.171956 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:40:32.171924 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8842fb59_c30d_46ea_a5d8_4e2bd6d2dd6f.slice/crio-e89a316c2e0bbbc9a373add2b6c64a18f347d83d00a2e8dfe16e4dd55ff62575 WatchSource:0}: Error finding container e89a316c2e0bbbc9a373add2b6c64a18f347d83d00a2e8dfe16e4dd55ff62575: Status 404 returned error can't find the container with id e89a316c2e0bbbc9a373add2b6c64a18f347d83d00a2e8dfe16e4dd55ff62575 Jul 17 17:40:32.626226 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:32.626191 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" event={"ID":"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f","Type":"ContainerStarted","Data":"e7896c0bc2769f125678e3383e71719d804ddaa78ee374b119f7cff89deb6bb5"} Jul 17 17:40:32.626404 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:32.626279 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:40:32.626404 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:32.626304 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" event={"ID":"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f","Type":"ContainerStarted","Data":"e89a316c2e0bbbc9a373add2b6c64a18f347d83d00a2e8dfe16e4dd55ff62575"} Jul 17 17:40:32.627307 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:32.627285 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-282rm" event={"ID":"8d3e06cb-cb4f-4459-97ef-e618a74ebfc3","Type":"ContainerStarted","Data":"09c0838601d8bb4f60d0b3638074cb9001993a11b53b02b03660b595362ffeb0"} Jul 17 17:40:32.644028 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:32.643976 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" podStartSLOduration=16.64395528 podStartE2EDuration="16.64395528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:40:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:40:32.643652289 +0000 UTC m=+86.827710065" watchObservedRunningTime="2026-07-17 17:40:32.64395528 +0000 UTC m=+86.828013054" Jul 17 17:40:34.636667 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:34.636633 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-282rm" event={"ID":"8d3e06cb-cb4f-4459-97ef-e618a74ebfc3","Type":"ContainerStarted","Data":"2a5667c9bcc2d91bdfe3bcb017db8be548e4f69c63341f2a50d76ee0f4bfe0ea"} Jul 17 17:40:34.637084 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:34.636688 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-282rm" event={"ID":"8d3e06cb-cb4f-4459-97ef-e618a74ebfc3","Type":"ContainerStarted","Data":"9e2e4b82379b78a1fa63a1c918108be3ce55ee7f315568444bc220ddddafe786"} Jul 17 17:40:34.660386 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:34.660329 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-282rm" podStartSLOduration=17.96317395 podStartE2EDuration="19.660313181s" totalImagesPullingTime="1.697139231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:40:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:40:34.658078232 +0000 UTC m=+88.842136009" watchObservedRunningTime="2026-07-17 17:40:34.660313181 +0000 UTC m=+88.844370957" Jul 17 17:40:35.122994 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:35.122950 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c46ea5c6-3992-4e9d-b278-22afb27c04a4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trcj8\" (UID: \"c46ea5c6-3992-4e9d-b278-22afb27c04a4\") " pod="openshift-insights/insights-runtime-extractor-trcj8" Jul 17 17:40:35.123195 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:35.123018 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c46ea5c6-3992-4e9d-b278-22afb27c04a4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trcj8\" (UID: \"c46ea5c6-3992-4e9d-b278-22afb27c04a4\") " pod="openshift-insights/insights-runtime-extractor-trcj8" Jul 17 17:40:35.123195 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:35.123109 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 17:40:35.123195 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:40:35.123184 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c46ea5c6-3992-4e9d-b278-22afb27c04a4-insights-runtime-extractor-tls podName:c46ea5c6-3992-4e9d-b278-22afb27c04a4 nodeName:}" failed. No retries permitted until 2026-07-17 17:40:51.123167984 +0000 UTC m=+105.307225740 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c46ea5c6-3992-4e9d-b278-22afb27c04a4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-trcj8" (UID: "c46ea5c6-3992-4e9d-b278-22afb27c04a4") : secret "insights-runtime-extractor-tls" not found Jul 17 17:40:35.123603 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:35.123585 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c46ea5c6-3992-4e9d-b278-22afb27c04a4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trcj8\" (UID: \"c46ea5c6-3992-4e9d-b278-22afb27c04a4\") " pod="openshift-insights/insights-runtime-extractor-trcj8" Jul 17 17:40:44.696064 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:44.696023 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13be2935-6a7b-4e88-9f49-99d389d8d95a-metrics-tls\") pod \"dns-default-k8x8w\" (UID: \"13be2935-6a7b-4e88-9f49-99d389d8d95a\") " pod="openshift-dns/dns-default-k8x8w" Jul 17 17:40:44.698406 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:44.698379 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/13be2935-6a7b-4e88-9f49-99d389d8d95a-metrics-tls\") pod \"dns-default-k8x8w\" (UID: \"13be2935-6a7b-4e88-9f49-99d389d8d95a\") " pod="openshift-dns/dns-default-k8x8w" Jul 17 17:40:44.999857 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:44.999831 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ln8rh\"" Jul 17 17:40:45.005693 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:45.005667 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k8x8w" Jul 17 17:40:45.142713 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:45.142675 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k8x8w"] Jul 17 17:40:45.146032 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:40:45.145997 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13be2935_6a7b_4e88_9f49_99d389d8d95a.slice/crio-1b7e5eb8999c2d3e30351faf856ff8dfd5f19b74e1dd03adfed069c776ef8714 WatchSource:0}: Error finding container 1b7e5eb8999c2d3e30351faf856ff8dfd5f19b74e1dd03adfed069c776ef8714: Status 404 returned error can't find the container with id 1b7e5eb8999c2d3e30351faf856ff8dfd5f19b74e1dd03adfed069c776ef8714 Jul 17 17:40:45.672923 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:45.672881 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k8x8w" event={"ID":"13be2935-6a7b-4e88-9f49-99d389d8d95a","Type":"ContainerStarted","Data":"1b7e5eb8999c2d3e30351faf856ff8dfd5f19b74e1dd03adfed069c776ef8714"} Jul 17 17:40:46.508041 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.507996 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76bd7b6554-wjb29"] Jul 17 17:40:46.523290 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.523247 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-9skxw"] Jul 17 17:40:46.523839 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.523790 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76bd7b6554-wjb29" Jul 17 17:40:46.529266 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.527428 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 17 17:40:46.531353 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.529565 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-m7fqg\"" Jul 17 17:40:46.532001 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.531974 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 17 17:40:46.532131 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.532098 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 17 17:40:46.532416 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.532393 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 17 17:40:46.541595 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.541558 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76bd7b6554-wjb29"] Jul 17 17:40:46.541769 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.541606 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-9skxw"] Jul 17 17:40:46.541769 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.541702 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9skxw" Jul 17 17:40:46.545310 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.545287 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-8jcv4\"" Jul 17 17:40:46.546035 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.545996 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 17 17:40:46.546323 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.546300 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 17 17:40:46.547558 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.547534 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-584994d4f4-ldl5z"] Jul 17 17:40:46.611908 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.611869 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4788a0fd-fcd4-4843-bb6c-b06231e9895a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76bd7b6554-wjb29\" (UID: \"4788a0fd-fcd4-4843-bb6c-b06231e9895a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76bd7b6554-wjb29" Jul 17 17:40:46.612092 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.611967 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6541a578-5d14-4e5e-99a4-2dc54bd9295d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-9skxw\" (UID: \"6541a578-5d14-4e5e-99a4-2dc54bd9295d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9skxw" Jul 17 17:40:46.612092 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.612007 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6541a578-5d14-4e5e-99a4-2dc54bd9295d-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-9skxw\" (UID: \"6541a578-5d14-4e5e-99a4-2dc54bd9295d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9skxw" Jul 17 17:40:46.612092 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.612026 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgqxb\" (UniqueName: \"kubernetes.io/projected/4788a0fd-fcd4-4843-bb6c-b06231e9895a-kube-api-access-wgqxb\") pod \"managed-serviceaccount-addon-agent-76bd7b6554-wjb29\" (UID: \"4788a0fd-fcd4-4843-bb6c-b06231e9895a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76bd7b6554-wjb29" Jul 17 17:40:46.633813 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.633778 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f665644df-5pp64"] Jul 17 17:40:46.645567 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.645538 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f665644df-5pp64" Jul 17 17:40:46.667034 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.667000 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f665644df-5pp64"] Jul 17 17:40:46.712813 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.712775 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5c5e35b-d118-42df-8627-5e48df3a1417-registry-certificates\") pod \"image-registry-f665644df-5pp64\" (UID: \"d5c5e35b-d118-42df-8627-5e48df3a1417\") " pod="openshift-image-registry/image-registry-f665644df-5pp64" Jul 17 17:40:46.713011 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.712850 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6541a578-5d14-4e5e-99a4-2dc54bd9295d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-9skxw\" (UID: \"6541a578-5d14-4e5e-99a4-2dc54bd9295d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9skxw" Jul 17 17:40:46.713011 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.712884 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5c5e35b-d118-42df-8627-5e48df3a1417-registry-tls\") pod \"image-registry-f665644df-5pp64\" (UID: \"d5c5e35b-d118-42df-8627-5e48df3a1417\") " pod="openshift-image-registry/image-registry-f665644df-5pp64" Jul 17 17:40:46.713011 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.712908 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5c5e35b-d118-42df-8627-5e48df3a1417-bound-sa-token\") pod \"image-registry-f665644df-5pp64\" (UID: \"d5c5e35b-d118-42df-8627-5e48df3a1417\") " pod="openshift-image-registry/image-registry-f665644df-5pp64" Jul 17 17:40:46.713011 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.712949 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5c5e35b-d118-42df-8627-5e48df3a1417-image-registry-private-configuration\") pod \"image-registry-f665644df-5pp64\" (UID: \"d5c5e35b-d118-42df-8627-5e48df3a1417\") " pod="openshift-image-registry/image-registry-f665644df-5pp64" Jul 17 17:40:46.713011 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.712978 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6541a578-5d14-4e5e-99a4-2dc54bd9295d-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-9skxw\" (UID: \"6541a578-5d14-4e5e-99a4-2dc54bd9295d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9skxw" Jul 17 17:40:46.713011 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.713002 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgqxb\" (UniqueName: \"kubernetes.io/projected/4788a0fd-fcd4-4843-bb6c-b06231e9895a-kube-api-access-wgqxb\") pod \"managed-serviceaccount-addon-agent-76bd7b6554-wjb29\" (UID: \"4788a0fd-fcd4-4843-bb6c-b06231e9895a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76bd7b6554-wjb29" Jul 17 17:40:46.713299 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.713025 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5c5e35b-d118-42df-8627-5e48df3a1417-trusted-ca\") pod \"image-registry-f665644df-5pp64\" (UID: \"d5c5e35b-d118-42df-8627-5e48df3a1417\") " pod="openshift-image-registry/image-registry-f665644df-5pp64" Jul 17 17:40:46.713299 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.713060 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5c5e35b-d118-42df-8627-5e48df3a1417-ca-trust-extracted\") pod \"image-registry-f665644df-5pp64\" (UID: \"d5c5e35b-d118-42df-8627-5e48df3a1417\") " pod="openshift-image-registry/image-registry-f665644df-5pp64" Jul 17 17:40:46.713299 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.713118 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw9zn\" (UniqueName: \"kubernetes.io/projected/d5c5e35b-d118-42df-8627-5e48df3a1417-kube-api-access-qw9zn\") pod \"image-registry-f665644df-5pp64\" (UID: \"d5c5e35b-d118-42df-8627-5e48df3a1417\") " pod="openshift-image-registry/image-registry-f665644df-5pp64" Jul 17 17:40:46.713299 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.713159 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4788a0fd-fcd4-4843-bb6c-b06231e9895a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76bd7b6554-wjb29\" (UID: \"4788a0fd-fcd4-4843-bb6c-b06231e9895a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76bd7b6554-wjb29" Jul 17 17:40:46.713299 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.713206 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5c5e35b-d118-42df-8627-5e48df3a1417-installation-pull-secrets\") pod \"image-registry-f665644df-5pp64\" (UID: \"d5c5e35b-d118-42df-8627-5e48df3a1417\") " pod="openshift-image-registry/image-registry-f665644df-5pp64" Jul 17 17:40:46.713896 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.713835 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6541a578-5d14-4e5e-99a4-2dc54bd9295d-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-9skxw\" (UID: \"6541a578-5d14-4e5e-99a4-2dc54bd9295d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9skxw" Jul 17 17:40:46.716086 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.716060 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6541a578-5d14-4e5e-99a4-2dc54bd9295d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-9skxw\" (UID: \"6541a578-5d14-4e5e-99a4-2dc54bd9295d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9skxw" Jul 17 17:40:46.716826 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.716804 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4788a0fd-fcd4-4843-bb6c-b06231e9895a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76bd7b6554-wjb29\" (UID: \"4788a0fd-fcd4-4843-bb6c-b06231e9895a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76bd7b6554-wjb29" Jul 17 17:40:46.766779 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.766696 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgqxb\" (UniqueName: \"kubernetes.io/projected/4788a0fd-fcd4-4843-bb6c-b06231e9895a-kube-api-access-wgqxb\") pod \"managed-serviceaccount-addon-agent-76bd7b6554-wjb29\" (UID: \"4788a0fd-fcd4-4843-bb6c-b06231e9895a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76bd7b6554-wjb29" Jul 17 17:40:46.813648 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.813615 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5c5e35b-d118-42df-8627-5e48df3a1417-registry-certificates\") pod \"image-registry-f665644df-5pp64\" (UID: \"d5c5e35b-d118-42df-8627-5e48df3a1417\") " pod="openshift-image-registry/image-registry-f665644df-5pp64" Jul 17 17:40:46.813846 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.813673 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5c5e35b-d118-42df-8627-5e48df3a1417-registry-tls\") pod \"image-registry-f665644df-5pp64\" (UID: \"d5c5e35b-d118-42df-8627-5e48df3a1417\") " pod="openshift-image-registry/image-registry-f665644df-5pp64" Jul 17 17:40:46.813846 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.813701 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5c5e35b-d118-42df-8627-5e48df3a1417-bound-sa-token\") pod \"image-registry-f665644df-5pp64\" (UID: \"d5c5e35b-d118-42df-8627-5e48df3a1417\") " pod="openshift-image-registry/image-registry-f665644df-5pp64" Jul 17 17:40:46.813846 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.813739 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5c5e35b-d118-42df-8627-5e48df3a1417-image-registry-private-configuration\") pod \"image-registry-f665644df-5pp64\" (UID: \"d5c5e35b-d118-42df-8627-5e48df3a1417\") " pod="openshift-image-registry/image-registry-f665644df-5pp64" Jul 17 17:40:46.813846 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.813769 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5c5e35b-d118-42df-8627-5e48df3a1417-trusted-ca\") pod \"image-registry-f665644df-5pp64\" (UID: \"d5c5e35b-d118-42df-8627-5e48df3a1417\") " pod="openshift-image-registry/image-registry-f665644df-5pp64" Jul 17 17:40:46.813846 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.813809 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5c5e35b-d118-42df-8627-5e48df3a1417-ca-trust-extracted\") pod \"image-registry-f665644df-5pp64\" (UID: \"d5c5e35b-d118-42df-8627-5e48df3a1417\") " pod="openshift-image-registry/image-registry-f665644df-5pp64" Jul 17 17:40:46.813846 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.813837 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw9zn\" (UniqueName: \"kubernetes.io/projected/d5c5e35b-d118-42df-8627-5e48df3a1417-kube-api-access-qw9zn\") pod \"image-registry-f665644df-5pp64\" (UID: \"d5c5e35b-d118-42df-8627-5e48df3a1417\") " pod="openshift-image-registry/image-registry-f665644df-5pp64" Jul 17 17:40:46.814127 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.813897 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5c5e35b-d118-42df-8627-5e48df3a1417-installation-pull-secrets\") pod \"image-registry-f665644df-5pp64\" (UID: \"d5c5e35b-d118-42df-8627-5e48df3a1417\") " pod="openshift-image-registry/image-registry-f665644df-5pp64" Jul 17 17:40:46.814727 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.814672 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5c5e35b-d118-42df-8627-5e48df3a1417-registry-certificates\") pod \"image-registry-f665644df-5pp64\" (UID: \"d5c5e35b-d118-42df-8627-5e48df3a1417\") " pod="openshift-image-registry/image-registry-f665644df-5pp64" Jul 17 17:40:46.814847 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.814752 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5c5e35b-d118-42df-8627-5e48df3a1417-ca-trust-extracted\") pod \"image-registry-f665644df-5pp64\" (UID: \"d5c5e35b-d118-42df-8627-5e48df3a1417\") " pod="openshift-image-registry/image-registry-f665644df-5pp64" Jul 17 17:40:46.815075 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.815014 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5c5e35b-d118-42df-8627-5e48df3a1417-trusted-ca\") pod \"image-registry-f665644df-5pp64\" (UID: \"d5c5e35b-d118-42df-8627-5e48df3a1417\") " pod="openshift-image-registry/image-registry-f665644df-5pp64" Jul 17 17:40:46.817241 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.817219 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5c5e35b-d118-42df-8627-5e48df3a1417-installation-pull-secrets\") pod \"image-registry-f665644df-5pp64\" (UID: \"d5c5e35b-d118-42df-8627-5e48df3a1417\") " pod="openshift-image-registry/image-registry-f665644df-5pp64" Jul 17 17:40:46.817349 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.817339 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5c5e35b-d118-42df-8627-5e48df3a1417-registry-tls\") pod \"image-registry-f665644df-5pp64\" (UID: \"d5c5e35b-d118-42df-8627-5e48df3a1417\") " pod="openshift-image-registry/image-registry-f665644df-5pp64" Jul 17 17:40:46.817588 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.817550 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5c5e35b-d118-42df-8627-5e48df3a1417-image-registry-private-configuration\") pod \"image-registry-f665644df-5pp64\" (UID: \"d5c5e35b-d118-42df-8627-5e48df3a1417\") " pod="openshift-image-registry/image-registry-f665644df-5pp64" Jul 17 17:40:46.828176 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.828113 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5c5e35b-d118-42df-8627-5e48df3a1417-bound-sa-token\") pod \"image-registry-f665644df-5pp64\" (UID: \"d5c5e35b-d118-42df-8627-5e48df3a1417\") " pod="openshift-image-registry/image-registry-f665644df-5pp64" Jul 17 17:40:46.828325 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.828252 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw9zn\" (UniqueName: \"kubernetes.io/projected/d5c5e35b-d118-42df-8627-5e48df3a1417-kube-api-access-qw9zn\") pod \"image-registry-f665644df-5pp64\" (UID: \"d5c5e35b-d118-42df-8627-5e48df3a1417\") " pod="openshift-image-registry/image-registry-f665644df-5pp64" Jul 17 17:40:46.848864 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.848827 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76bd7b6554-wjb29" Jul 17 17:40:46.859127 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.859090 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9skxw" Jul 17 17:40:46.956547 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:46.956380 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f665644df-5pp64" Jul 17 17:40:47.084277 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:47.084156 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76bd7b6554-wjb29"] Jul 17 17:40:47.111877 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:47.111844 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-9skxw"] Jul 17 17:40:47.138338 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:47.138307 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f665644df-5pp64"] Jul 17 17:40:47.153220 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:40:47.153181 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4788a0fd_fcd4_4843_bb6c_b06231e9895a.slice/crio-a8752c69e2fa66df55c8048d4fc45039f402c7704840c72158e4fe208b299d57 WatchSource:0}: Error finding container a8752c69e2fa66df55c8048d4fc45039f402c7704840c72158e4fe208b299d57: Status 404 returned error can't find the container with id a8752c69e2fa66df55c8048d4fc45039f402c7704840c72158e4fe208b299d57 Jul 17 17:40:47.153675 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:40:47.153655 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6541a578_5d14_4e5e_99a4_2dc54bd9295d.slice/crio-b1f9cef38ab7ce16738ebcd5426b30ad2c4e3c6cb3756ea9af0c259509b00103 WatchSource:0}: Error finding container b1f9cef38ab7ce16738ebcd5426b30ad2c4e3c6cb3756ea9af0c259509b00103: Status 404 returned error can't find the container with id b1f9cef38ab7ce16738ebcd5426b30ad2c4e3c6cb3756ea9af0c259509b00103 Jul 17 17:40:47.154586 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:40:47.154550 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5c5e35b_d118_42df_8627_5e48df3a1417.slice/crio-cee6e1cb9512b1a9e2b52d640f4b2e0f483f8e5c0f5595d93c38ebf0b9f0e9c7 WatchSource:0}: Error finding container cee6e1cb9512b1a9e2b52d640f4b2e0f483f8e5c0f5595d93c38ebf0b9f0e9c7: Status 404 returned error can't find the container with id cee6e1cb9512b1a9e2b52d640f4b2e0f483f8e5c0f5595d93c38ebf0b9f0e9c7 Jul 17 17:40:47.682395 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:47.682307 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k8x8w" event={"ID":"13be2935-6a7b-4e88-9f49-99d389d8d95a","Type":"ContainerStarted","Data":"91cc68671a653c0cae51f54d2c0d5ee89e16e835681e7c3a9487d4b6d862be10"} Jul 17 17:40:47.682395 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:47.682359 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k8x8w" event={"ID":"13be2935-6a7b-4e88-9f49-99d389d8d95a","Type":"ContainerStarted","Data":"76156f00a5a46d1e146f800bd207c937e3f363ed420a330a107b38f9500e9ccb"} Jul 17 17:40:47.682997 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:47.682462 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-k8x8w" Jul 17 17:40:47.683775 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:47.683752 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f665644df-5pp64" event={"ID":"d5c5e35b-d118-42df-8627-5e48df3a1417","Type":"ContainerStarted","Data":"f3454f0e1fd69286861250d82650ee1bf3cc80153795f217a77e402b2798db5f"} Jul 17 17:40:47.683892 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:47.683792 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f665644df-5pp64" event={"ID":"d5c5e35b-d118-42df-8627-5e48df3a1417","Type":"ContainerStarted","Data":"cee6e1cb9512b1a9e2b52d640f4b2e0f483f8e5c0f5595d93c38ebf0b9f0e9c7"} Jul 17 17:40:47.683892 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:47.683850 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f665644df-5pp64" Jul 17 17:40:47.684917 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:47.684897 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9skxw" event={"ID":"6541a578-5d14-4e5e-99a4-2dc54bd9295d","Type":"ContainerStarted","Data":"b1f9cef38ab7ce16738ebcd5426b30ad2c4e3c6cb3756ea9af0c259509b00103"} Jul 17 17:40:47.685835 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:47.685811 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76bd7b6554-wjb29" event={"ID":"4788a0fd-fcd4-4843-bb6c-b06231e9895a","Type":"ContainerStarted","Data":"a8752c69e2fa66df55c8048d4fc45039f402c7704840c72158e4fe208b299d57"} Jul 17 17:40:47.700519 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:47.700471 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-k8x8w" podStartSLOduration=65.670327588 podStartE2EDuration="1m7.700435019s" totalImagesPullingTime="2.030107431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:40:47.69977697 +0000 UTC m=+101.883834748" watchObservedRunningTime="2026-07-17 17:40:47.700435019 +0000 UTC m=+101.884492796" Jul 17 17:40:47.721372 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:47.721309 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-f665644df-5pp64" podStartSLOduration=1.72129339 podStartE2EDuration="1.72129339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:40:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:40:47.720297491 +0000 UTC m=+101.904355265" watchObservedRunningTime="2026-07-17 17:40:47.72129339 +0000 UTC m=+101.905351145" Jul 17 17:40:47.822696 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:47.822658 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b994728-13e4-4275-ad5f-541496a45529-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-4sxf2\" (UID: \"1b994728-13e4-4275-ad5f-541496a45529\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-4sxf2" Jul 17 17:40:47.825352 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:47.825320 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b994728-13e4-4275-ad5f-541496a45529-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-4sxf2\" (UID: \"1b994728-13e4-4275-ad5f-541496a45529\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-4sxf2" Jul 17 17:40:47.832290 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:47.832268 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-4sxf2" Jul 17 17:40:48.001960 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:48.001926 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-4sxf2"] Jul 17 17:40:48.005517 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:40:48.005476 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b994728_13e4_4275_ad5f_541496a45529.slice/crio-625cfb1ddeb0507b5b1fc4271a0bccaafbafde24b932ba97ee00880dd08b8392 WatchSource:0}: Error finding container 625cfb1ddeb0507b5b1fc4271a0bccaafbafde24b932ba97ee00880dd08b8392: Status 404 returned error can't find the container with id 625cfb1ddeb0507b5b1fc4271a0bccaafbafde24b932ba97ee00880dd08b8392 Jul 17 17:40:48.588013 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:48.587976 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cpx5f" Jul 17 17:40:48.701517 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:48.701472 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-4sxf2" event={"ID":"1b994728-13e4-4275-ad5f-541496a45529","Type":"ContainerStarted","Data":"625cfb1ddeb0507b5b1fc4271a0bccaafbafde24b932ba97ee00880dd08b8392"} Jul 17 17:40:51.149843 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:51.149751 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c46ea5c6-3992-4e9d-b278-22afb27c04a4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trcj8\" (UID: \"c46ea5c6-3992-4e9d-b278-22afb27c04a4\") " pod="openshift-insights/insights-runtime-extractor-trcj8" Jul 17 17:40:51.152456 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:51.152413 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c46ea5c6-3992-4e9d-b278-22afb27c04a4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trcj8\" (UID: \"c46ea5c6-3992-4e9d-b278-22afb27c04a4\") " pod="openshift-insights/insights-runtime-extractor-trcj8" Jul 17 17:40:51.427357 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:51.427253 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-trcj8" Jul 17 17:40:51.567609 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:51.567580 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-trcj8"] Jul 17 17:40:51.570819 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:40:51.570794 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc46ea5c6_3992_4e9d_b278_22afb27c04a4.slice/crio-146b125094108fdefd00f574544099a5604971e07db506696c370d954ba09bc3 WatchSource:0}: Error finding container 146b125094108fdefd00f574544099a5604971e07db506696c370d954ba09bc3: Status 404 returned error can't find the container with id 146b125094108fdefd00f574544099a5604971e07db506696c370d954ba09bc3 Jul 17 17:40:51.713685 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:51.713591 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9skxw" event={"ID":"6541a578-5d14-4e5e-99a4-2dc54bd9295d","Type":"ContainerStarted","Data":"1608e792934402405e558dc37adf8248f5d5a21614b6c8493c0385530fcdf523"} Jul 17 17:40:51.714990 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:51.714966 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76bd7b6554-wjb29" event={"ID":"4788a0fd-fcd4-4843-bb6c-b06231e9895a","Type":"ContainerStarted","Data":"d350b75eae6c2cad269da8dc2db7bf1e324e43d88adc3f95df1a416a82aaa746"} Jul 17 17:40:51.716084 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:51.716057 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-trcj8" event={"ID":"c46ea5c6-3992-4e9d-b278-22afb27c04a4","Type":"ContainerStarted","Data":"146b125094108fdefd00f574544099a5604971e07db506696c370d954ba09bc3"} Jul 17 17:40:51.717374 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:51.717356 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-4sxf2" event={"ID":"1b994728-13e4-4275-ad5f-541496a45529","Type":"ContainerStarted","Data":"1e923cf53b630680fb41beaeab3271cf8d1ec2d80777bdd981ea934055435a39"} Jul 17 17:40:51.731131 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:51.731084 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9skxw" podStartSLOduration=2.50399858 podStartE2EDuration="5.731068757s" totalImagesPullingTime="3.227070177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:40:51.729727063 +0000 UTC m=+105.913784840" watchObservedRunningTime="2026-07-17 17:40:51.731068757 +0000 UTC m=+105.915126534" Jul 17 17:40:51.746694 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:51.746621 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-4sxf2" podStartSLOduration=33.837966267 podStartE2EDuration="36.746601848s" totalImagesPullingTime="2.908635581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:40:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:40:51.746106689 +0000 UTC m=+105.930164476" watchObservedRunningTime="2026-07-17 17:40:51.746601848 +0000 UTC m=+105.930659626" Jul 17 17:40:51.763019 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:51.762973 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76bd7b6554-wjb29" podStartSLOduration=2.022938418 podStartE2EDuration="5.762958776s" totalImagesPullingTime="3.740020358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:40:51.76165063 +0000 UTC m=+105.945708413" watchObservedRunningTime="2026-07-17 17:40:51.762958776 +0000 UTC m=+105.947016550" Jul 17 17:40:55.473697 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:55.473663 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-zb8rr"] Jul 17 17:40:55.485618 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:55.485588 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-zb8rr" Jul 17 17:40:55.488429 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:55.488407 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 17 17:40:55.489586 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:55.489541 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-m95kj\"" Jul 17 17:40:55.489586 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:55.489578 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 17 17:40:55.489837 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:55.489561 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 17 17:40:55.491654 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:55.491542 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-zb8rr"] Jul 17 17:40:55.587822 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:55.587786 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d6bd8db-22c5-4534-92e9-39810d189b83-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-zb8rr\" (UID: \"5d6bd8db-22c5-4534-92e9-39810d189b83\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zb8rr" Jul 17 17:40:55.588008 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:55.587828 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d6bd8db-22c5-4534-92e9-39810d189b83-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-zb8rr\" (UID: \"5d6bd8db-22c5-4534-92e9-39810d189b83\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zb8rr" Jul 17 17:40:55.588008 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:55.587866 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d6bd8db-22c5-4534-92e9-39810d189b83-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-zb8rr\" (UID: \"5d6bd8db-22c5-4534-92e9-39810d189b83\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zb8rr" Jul 17 17:40:55.588008 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:55.587925 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4khxm\" (UniqueName: \"kubernetes.io/projected/5d6bd8db-22c5-4534-92e9-39810d189b83-kube-api-access-4khxm\") pod \"prometheus-operator-5945b5cfd-zb8rr\" (UID: \"5d6bd8db-22c5-4534-92e9-39810d189b83\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zb8rr" Jul 17 17:40:55.689337 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:55.689269 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d6bd8db-22c5-4534-92e9-39810d189b83-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-zb8rr\" (UID: \"5d6bd8db-22c5-4534-92e9-39810d189b83\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zb8rr" Jul 17 17:40:55.689534 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:55.689358 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d6bd8db-22c5-4534-92e9-39810d189b83-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-zb8rr\" (UID: \"5d6bd8db-22c5-4534-92e9-39810d189b83\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zb8rr" Jul 17 17:40:55.689534 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:55.689400 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d6bd8db-22c5-4534-92e9-39810d189b83-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-zb8rr\" (UID: \"5d6bd8db-22c5-4534-92e9-39810d189b83\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zb8rr" Jul 17 17:40:55.689671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:55.689586 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4khxm\" (UniqueName: \"kubernetes.io/projected/5d6bd8db-22c5-4534-92e9-39810d189b83-kube-api-access-4khxm\") pod \"prometheus-operator-5945b5cfd-zb8rr\" (UID: \"5d6bd8db-22c5-4534-92e9-39810d189b83\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zb8rr" Jul 17 17:40:55.690197 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:55.690165 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d6bd8db-22c5-4534-92e9-39810d189b83-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-zb8rr\" (UID: \"5d6bd8db-22c5-4534-92e9-39810d189b83\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zb8rr" Jul 17 17:40:55.692150 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:55.692121 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d6bd8db-22c5-4534-92e9-39810d189b83-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-zb8rr\" (UID: \"5d6bd8db-22c5-4534-92e9-39810d189b83\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zb8rr" Jul 17 17:40:55.692408 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:55.692388 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d6bd8db-22c5-4534-92e9-39810d189b83-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-zb8rr\" (UID: \"5d6bd8db-22c5-4534-92e9-39810d189b83\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zb8rr" Jul 17 17:40:55.704168 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:55.704137 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4khxm\" (UniqueName: \"kubernetes.io/projected/5d6bd8db-22c5-4534-92e9-39810d189b83-kube-api-access-4khxm\") pod \"prometheus-operator-5945b5cfd-zb8rr\" (UID: \"5d6bd8db-22c5-4534-92e9-39810d189b83\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-zb8rr" Jul 17 17:40:55.797833 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:55.797793 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-zb8rr" Jul 17 17:40:56.440419 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:56.440377 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-zb8rr"] Jul 17 17:40:56.443341 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:40:56.443310 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d6bd8db_22c5_4534_92e9_39810d189b83.slice/crio-320b8741c16e93fb7e7b30f0335cd9c33f974ee34b44c3948774ce2baa3026fd WatchSource:0}: Error finding container 320b8741c16e93fb7e7b30f0335cd9c33f974ee34b44c3948774ce2baa3026fd: Status 404 returned error can't find the container with id 320b8741c16e93fb7e7b30f0335cd9c33f974ee34b44c3948774ce2baa3026fd Jul 17 17:40:56.553864 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:56.553779 2563 patch_prober.go:28] interesting pod/image-registry-584994d4f4-ldl5z container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 17 17:40:56.553864 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:56.553832 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" podUID="8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 17 17:40:56.737328 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:56.737290 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-trcj8" event={"ID":"c46ea5c6-3992-4e9d-b278-22afb27c04a4","Type":"ContainerStarted","Data":"1ca5acd2d866831c854f61f826a28399d13ac5dfa69c47b63c2f9ae650a49a1f"} Jul 17 17:40:56.738500 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:56.738474 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-zb8rr" event={"ID":"5d6bd8db-22c5-4534-92e9-39810d189b83","Type":"ContainerStarted","Data":"320b8741c16e93fb7e7b30f0335cd9c33f974ee34b44c3948774ce2baa3026fd"} Jul 17 17:40:57.704482 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:40:57.704262 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-k8x8w" Jul 17 17:41:00.756681 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:00.756641 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-trcj8" event={"ID":"c46ea5c6-3992-4e9d-b278-22afb27c04a4","Type":"ContainerStarted","Data":"0bde6f1de737cc6332f653a9998d8996d6f516f876eec9deabe716c831dced95"} Jul 17 17:41:00.758480 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:00.758435 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-zb8rr" event={"ID":"5d6bd8db-22c5-4534-92e9-39810d189b83","Type":"ContainerStarted","Data":"b7109749de62da2a30317a2cf267b22b1294013d77d95f005a5155af263939e1"} Jul 17 17:41:00.758605 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:00.758500 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-zb8rr" event={"ID":"5d6bd8db-22c5-4534-92e9-39810d189b83","Type":"ContainerStarted","Data":"73ee2724c7fb913950a66c0e8524794b6d180c66de8f1dd91685173d402e9b0b"} Jul 17 17:41:00.781943 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:00.781884 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-zb8rr" podStartSLOduration=2.388081415 podStartE2EDuration="5.781867391s" totalImagesPullingTime="3.393785976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:40:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:41:00.780507514 +0000 UTC m=+114.964565292" watchObservedRunningTime="2026-07-17 17:41:00.781867391 +0000 UTC m=+114.965925196" Jul 17 17:41:02.838028 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:02.837990 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nrwkb"] Jul 17 17:41:02.857715 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:02.857678 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nrwkb" Jul 17 17:41:02.860601 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:02.860573 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 17 17:41:02.860762 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:02.860635 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 17 17:41:02.860908 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:02.860889 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 17 17:41:02.861035 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:02.860976 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jntqj\"" Jul 17 17:41:03.056210 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.056160 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0-sys\") pod \"node-exporter-nrwkb\" (UID: \"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0\") " pod="openshift-monitoring/node-exporter-nrwkb" Jul 17 17:41:03.056210 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.056213 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0-node-exporter-textfile\") pod \"node-exporter-nrwkb\" (UID: \"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0\") " pod="openshift-monitoring/node-exporter-nrwkb" Jul 17 17:41:03.056465 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.056287 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0-metrics-client-ca\") pod \"node-exporter-nrwkb\" (UID: \"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0\") " pod="openshift-monitoring/node-exporter-nrwkb" Jul 17 17:41:03.056465 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.056347 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfwht\" (UniqueName: \"kubernetes.io/projected/7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0-kube-api-access-pfwht\") pod \"node-exporter-nrwkb\" (UID: \"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0\") " pod="openshift-monitoring/node-exporter-nrwkb" Jul 17 17:41:03.056465 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.056377 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nrwkb\" (UID: \"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0\") " pod="openshift-monitoring/node-exporter-nrwkb" Jul 17 17:41:03.056465 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.056408 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0-node-exporter-accelerators-collector-config\") pod \"node-exporter-nrwkb\" (UID: \"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0\") " pod="openshift-monitoring/node-exporter-nrwkb" Jul 17 17:41:03.056684 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.056491 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0-node-exporter-tls\") pod \"node-exporter-nrwkb\" (UID: \"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0\") " pod="openshift-monitoring/node-exporter-nrwkb" Jul 17 17:41:03.056684 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.056523 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0-root\") pod \"node-exporter-nrwkb\" (UID: \"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0\") " pod="openshift-monitoring/node-exporter-nrwkb" Jul 17 17:41:03.056684 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.056548 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0-node-exporter-wtmp\") pod \"node-exporter-nrwkb\" (UID: \"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0\") " pod="openshift-monitoring/node-exporter-nrwkb" Jul 17 17:41:03.157089 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.156992 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0-root\") pod \"node-exporter-nrwkb\" (UID: \"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0\") " pod="openshift-monitoring/node-exporter-nrwkb" Jul 17 17:41:03.157089 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.157037 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0-node-exporter-wtmp\") pod \"node-exporter-nrwkb\" (UID: \"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0\") " pod="openshift-monitoring/node-exporter-nrwkb" Jul 17 17:41:03.157089 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.157067 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0-sys\") pod \"node-exporter-nrwkb\" (UID: \"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0\") " pod="openshift-monitoring/node-exporter-nrwkb" Jul 17 17:41:03.157320 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.157098 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0-node-exporter-textfile\") pod \"node-exporter-nrwkb\" (UID: \"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0\") " pod="openshift-monitoring/node-exporter-nrwkb" Jul 17 17:41:03.157320 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.157115 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0-root\") pod \"node-exporter-nrwkb\" (UID: \"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0\") " pod="openshift-monitoring/node-exporter-nrwkb" Jul 17 17:41:03.157320 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.157130 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0-metrics-client-ca\") pod \"node-exporter-nrwkb\" (UID: \"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0\") " pod="openshift-monitoring/node-exporter-nrwkb" Jul 17 17:41:03.157320 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.157184 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfwht\" (UniqueName: \"kubernetes.io/projected/7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0-kube-api-access-pfwht\") pod \"node-exporter-nrwkb\" (UID: \"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0\") " pod="openshift-monitoring/node-exporter-nrwkb" Jul 17 17:41:03.157320 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.157191 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0-node-exporter-wtmp\") pod \"node-exporter-nrwkb\" (UID: \"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0\") " pod="openshift-monitoring/node-exporter-nrwkb" Jul 17 17:41:03.157320 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.157205 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0-sys\") pod \"node-exporter-nrwkb\" (UID: \"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0\") " pod="openshift-monitoring/node-exporter-nrwkb" Jul 17 17:41:03.157320 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.157219 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nrwkb\" (UID: \"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0\") " pod="openshift-monitoring/node-exporter-nrwkb" Jul 17 17:41:03.157320 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.157262 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0-node-exporter-accelerators-collector-config\") pod \"node-exporter-nrwkb\" (UID: \"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0\") " pod="openshift-monitoring/node-exporter-nrwkb" Jul 17 17:41:03.157320 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.157317 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0-node-exporter-tls\") pod \"node-exporter-nrwkb\" (UID: \"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0\") " pod="openshift-monitoring/node-exporter-nrwkb" Jul 17 17:41:03.157787 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:41:03.157414 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 17 17:41:03.157787 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:41:03.157519 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0-node-exporter-tls podName:7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0 nodeName:}" failed. No retries permitted until 2026-07-17 17:41:03.657485868 +0000 UTC m=+117.841543630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0-node-exporter-tls") pod "node-exporter-nrwkb" (UID: "7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0") : secret "node-exporter-tls" not found Jul 17 17:41:03.157787 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.157550 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0-node-exporter-textfile\") pod \"node-exporter-nrwkb\" (UID: \"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0\") " pod="openshift-monitoring/node-exporter-nrwkb" Jul 17 17:41:03.157787 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.157737 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0-metrics-client-ca\") pod \"node-exporter-nrwkb\" (UID: \"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0\") " pod="openshift-monitoring/node-exporter-nrwkb" Jul 17 17:41:03.158018 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.157932 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0-node-exporter-accelerators-collector-config\") pod \"node-exporter-nrwkb\" (UID: \"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0\") " pod="openshift-monitoring/node-exporter-nrwkb" Jul 17 17:41:03.160085 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.160057 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nrwkb\" (UID: \"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0\") " pod="openshift-monitoring/node-exporter-nrwkb" Jul 17 17:41:03.166857 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.166829 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfwht\" (UniqueName: \"kubernetes.io/projected/7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0-kube-api-access-pfwht\") pod \"node-exporter-nrwkb\" (UID: \"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0\") " pod="openshift-monitoring/node-exporter-nrwkb" Jul 17 17:41:03.661208 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.661173 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0-node-exporter-tls\") pod \"node-exporter-nrwkb\" (UID: \"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0\") " pod="openshift-monitoring/node-exporter-nrwkb" Jul 17 17:41:03.663538 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.663512 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0-node-exporter-tls\") pod \"node-exporter-nrwkb\" (UID: \"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0\") " pod="openshift-monitoring/node-exporter-nrwkb" Jul 17 17:41:03.768914 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.768839 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nrwkb" Jul 17 17:41:03.773043 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.773011 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-trcj8" event={"ID":"c46ea5c6-3992-4e9d-b278-22afb27c04a4","Type":"ContainerStarted","Data":"f473085f4f0eae3f7160147f4ee28453013ed3f240279d53dc899fc62c5037de"} Jul 17 17:41:03.781145 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:41:03.781121 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e0214fe_32f1_4b89_b8b4_194fc5a0c8e0.slice/crio-e12c17ae24ebbebc70edcf4bd5d6a3e20ab3129c263a5b7edd46dc271c7cf8b1 WatchSource:0}: Error finding container e12c17ae24ebbebc70edcf4bd5d6a3e20ab3129c263a5b7edd46dc271c7cf8b1: Status 404 returned error can't find the container with id e12c17ae24ebbebc70edcf4bd5d6a3e20ab3129c263a5b7edd46dc271c7cf8b1 Jul 17 17:41:03.795178 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.795125 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-trcj8" podStartSLOduration=33.040755404 podStartE2EDuration="44.795107991s" totalImagesPullingTime="11.754352587s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:40:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:41:03.79465343 +0000 UTC m=+117.978711209" watchObservedRunningTime="2026-07-17 17:41:03.795107991 +0000 UTC m=+117.979165767" Jul 17 17:41:03.906940 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.906896 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 17:41:03.911685 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.911659 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:03.914902 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.914878 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 17 17:41:03.914902 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.914896 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-98jts\"" Jul 17 17:41:03.915186 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.915171 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 17 17:41:03.915872 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.915858 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 17 17:41:03.917099 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.917073 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 17 17:41:03.917099 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.917073 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 17 17:41:03.919817 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.919682 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 17 17:41:03.919978 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.919951 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 17 17:41:03.920186 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.920168 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 17 17:41:03.920276 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.920187 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 17 17:41:03.945143 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.941735 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 17:41:03.964018 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.963979 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b46dad87-81cd-48d8-a9c6-897401f0a6aa-config-out\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:03.964018 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.964016 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:03.964255 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.964035 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b46dad87-81cd-48d8-a9c6-897401f0a6aa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:03.964255 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.964060 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:03.964255 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.964080 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:03.964255 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.964116 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:03.964255 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.964141 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kdqx\" (UniqueName: \"kubernetes.io/projected/b46dad87-81cd-48d8-a9c6-897401f0a6aa-kube-api-access-5kdqx\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:03.964255 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.964182 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:03.964255 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.964203 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-web-config\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:03.964255 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.964216 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b46dad87-81cd-48d8-a9c6-897401f0a6aa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:03.964255 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.964235 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b46dad87-81cd-48d8-a9c6-897401f0a6aa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:03.964255 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.964250 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-config-volume\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:03.964619 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:03.964267 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b46dad87-81cd-48d8-a9c6-897401f0a6aa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:04.066102 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:04.065088 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-web-config\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:04.066102 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:04.065138 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b46dad87-81cd-48d8-a9c6-897401f0a6aa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:04.066102 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:04.065177 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b46dad87-81cd-48d8-a9c6-897401f0a6aa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:04.066102 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:04.065203 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-config-volume\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:04.066102 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:04.065233 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b46dad87-81cd-48d8-a9c6-897401f0a6aa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:04.066102 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:04.065262 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b46dad87-81cd-48d8-a9c6-897401f0a6aa-config-out\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:04.066102 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:04.065290 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:04.066102 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:04.065316 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b46dad87-81cd-48d8-a9c6-897401f0a6aa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:04.066102 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:04.065353 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:04.066102 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:04.065384 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:04.066102 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:04.065481 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:04.066102 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:04.065509 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kdqx\" (UniqueName: \"kubernetes.io/projected/b46dad87-81cd-48d8-a9c6-897401f0a6aa-kube-api-access-5kdqx\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:04.066102 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:04.065555 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:04.066994 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:41:04.066968 2563 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 17 17:41:04.068304 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:41:04.068287 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-secret-alertmanager-main-tls podName:b46dad87-81cd-48d8-a9c6-897401f0a6aa nodeName:}" failed. No retries permitted until 2026-07-17 17:41:04.568264595 +0000 UTC m=+118.752322350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "b46dad87-81cd-48d8-a9c6-897401f0a6aa") : secret "alertmanager-main-tls" not found Jul 17 17:41:04.069006 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:04.068195 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b46dad87-81cd-48d8-a9c6-897401f0a6aa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:04.069006 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:04.068646 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b46dad87-81cd-48d8-a9c6-897401f0a6aa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:04.069006 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:04.067260 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b46dad87-81cd-48d8-a9c6-897401f0a6aa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:04.070080 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:04.070057 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b46dad87-81cd-48d8-a9c6-897401f0a6aa-config-out\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:04.070213 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:04.070187 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:04.070647 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:04.070627 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b46dad87-81cd-48d8-a9c6-897401f0a6aa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:04.070739 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:04.070644 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:04.070805 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:04.070784 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:04.071602 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:04.071577 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:04.071994 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:04.071966 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-config-volume\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:04.072076 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:04.072055 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-web-config\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:04.076049 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:04.076026 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kdqx\" (UniqueName: \"kubernetes.io/projected/b46dad87-81cd-48d8-a9c6-897401f0a6aa-kube-api-access-5kdqx\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:04.570645 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:04.570606 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:04.573157 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:04.573123 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:04.781647 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:04.781613 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nrwkb" event={"ID":"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0","Type":"ContainerStarted","Data":"e12c17ae24ebbebc70edcf4bd5d6a3e20ab3129c263a5b7edd46dc271c7cf8b1"} Jul 17 17:41:04.823185 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:04.823101 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:41:05.120217 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.120183 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 17:41:05.125480 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:41:05.125423 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb46dad87_81cd_48d8_a9c6_897401f0a6aa.slice/crio-4e71de8a77e1d490b12077468902fe561e33f85afe1959f32e293f9b43056a97 WatchSource:0}: Error finding container 4e71de8a77e1d490b12077468902fe561e33f85afe1959f32e293f9b43056a97: Status 404 returned error can't find the container with id 4e71de8a77e1d490b12077468902fe561e33f85afe1959f32e293f9b43056a97 Jul 17 17:41:05.786769 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.786727 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b46dad87-81cd-48d8-a9c6-897401f0a6aa","Type":"ContainerStarted","Data":"4e71de8a77e1d490b12077468902fe561e33f85afe1959f32e293f9b43056a97"} Jul 17 17:41:05.788256 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.788226 2563 generic.go:356] "Generic (PLEG): container finished" podID="7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0" containerID="6c636b17ce046d1b847fd8419d424b85bb8698aa01336fabdedbbe8c7a8f9219" exitCode=0 Jul 17 17:41:05.788379 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.788264 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nrwkb" event={"ID":"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0","Type":"ContainerDied","Data":"6c636b17ce046d1b847fd8419d424b85bb8698aa01336fabdedbbe8c7a8f9219"} Jul 17 17:41:05.830106 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.830075 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-79cd4f8576-b45ch"] Jul 17 17:41:05.835036 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.834863 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" Jul 17 17:41:05.837934 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.837755 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 17 17:41:05.837934 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.837794 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wkxnp\"" Jul 17 17:41:05.837934 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.837801 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 17 17:41:05.837934 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.837835 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 17 17:41:05.838252 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.837977 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 17 17:41:05.838252 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.838084 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bo9o98191lo34\"" Jul 17 17:41:05.838252 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.838197 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 17 17:41:05.846977 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.846952 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-79cd4f8576-b45ch"] Jul 17 17:41:05.883697 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.883645 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx8wl\" (UniqueName: \"kubernetes.io/projected/c1b8e8f8-197e-4a22-8585-d13cefcddd8c-kube-api-access-kx8wl\") pod \"thanos-querier-79cd4f8576-b45ch\" (UID: \"c1b8e8f8-197e-4a22-8585-d13cefcddd8c\") " pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" Jul 17 17:41:05.883866 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.883712 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c1b8e8f8-197e-4a22-8585-d13cefcddd8c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79cd4f8576-b45ch\" (UID: \"c1b8e8f8-197e-4a22-8585-d13cefcddd8c\") " pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" Jul 17 17:41:05.883866 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.883755 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c1b8e8f8-197e-4a22-8585-d13cefcddd8c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79cd4f8576-b45ch\" (UID: \"c1b8e8f8-197e-4a22-8585-d13cefcddd8c\") " pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" Jul 17 17:41:05.883866 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.883803 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1b8e8f8-197e-4a22-8585-d13cefcddd8c-metrics-client-ca\") pod \"thanos-querier-79cd4f8576-b45ch\" (UID: \"c1b8e8f8-197e-4a22-8585-d13cefcddd8c\") " pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" Jul 17 17:41:05.883866 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.883839 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c1b8e8f8-197e-4a22-8585-d13cefcddd8c-secret-grpc-tls\") pod \"thanos-querier-79cd4f8576-b45ch\" (UID: \"c1b8e8f8-197e-4a22-8585-d13cefcddd8c\") " pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" Jul 17 17:41:05.884047 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.883950 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c1b8e8f8-197e-4a22-8585-d13cefcddd8c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79cd4f8576-b45ch\" (UID: \"c1b8e8f8-197e-4a22-8585-d13cefcddd8c\") " pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" Jul 17 17:41:05.884047 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.883990 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c1b8e8f8-197e-4a22-8585-d13cefcddd8c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79cd4f8576-b45ch\" (UID: \"c1b8e8f8-197e-4a22-8585-d13cefcddd8c\") " pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" Jul 17 17:41:05.884165 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.884078 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c1b8e8f8-197e-4a22-8585-d13cefcddd8c-secret-thanos-querier-tls\") pod \"thanos-querier-79cd4f8576-b45ch\" (UID: \"c1b8e8f8-197e-4a22-8585-d13cefcddd8c\") " pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" Jul 17 17:41:05.984552 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.984506 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx8wl\" (UniqueName: \"kubernetes.io/projected/c1b8e8f8-197e-4a22-8585-d13cefcddd8c-kube-api-access-kx8wl\") pod \"thanos-querier-79cd4f8576-b45ch\" (UID: \"c1b8e8f8-197e-4a22-8585-d13cefcddd8c\") " pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" Jul 17 17:41:05.984743 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.984563 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c1b8e8f8-197e-4a22-8585-d13cefcddd8c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79cd4f8576-b45ch\" (UID: \"c1b8e8f8-197e-4a22-8585-d13cefcddd8c\") " pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" Jul 17 17:41:05.984743 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.984611 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c1b8e8f8-197e-4a22-8585-d13cefcddd8c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79cd4f8576-b45ch\" (UID: \"c1b8e8f8-197e-4a22-8585-d13cefcddd8c\") " pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" Jul 17 17:41:05.984743 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.984638 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1b8e8f8-197e-4a22-8585-d13cefcddd8c-metrics-client-ca\") pod \"thanos-querier-79cd4f8576-b45ch\" (UID: \"c1b8e8f8-197e-4a22-8585-d13cefcddd8c\") " pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" Jul 17 17:41:05.984908 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.984819 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c1b8e8f8-197e-4a22-8585-d13cefcddd8c-secret-grpc-tls\") pod \"thanos-querier-79cd4f8576-b45ch\" (UID: \"c1b8e8f8-197e-4a22-8585-d13cefcddd8c\") " pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" Jul 17 17:41:05.984963 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.984901 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c1b8e8f8-197e-4a22-8585-d13cefcddd8c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79cd4f8576-b45ch\" (UID: \"c1b8e8f8-197e-4a22-8585-d13cefcddd8c\") " pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" Jul 17 17:41:05.984963 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.984946 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c1b8e8f8-197e-4a22-8585-d13cefcddd8c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79cd4f8576-b45ch\" (UID: \"c1b8e8f8-197e-4a22-8585-d13cefcddd8c\") " pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" Jul 17 17:41:05.985058 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.984986 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c1b8e8f8-197e-4a22-8585-d13cefcddd8c-secret-thanos-querier-tls\") pod \"thanos-querier-79cd4f8576-b45ch\" (UID: \"c1b8e8f8-197e-4a22-8585-d13cefcddd8c\") " pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" Jul 17 17:41:05.985539 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.985488 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1b8e8f8-197e-4a22-8585-d13cefcddd8c-metrics-client-ca\") pod \"thanos-querier-79cd4f8576-b45ch\" (UID: \"c1b8e8f8-197e-4a22-8585-d13cefcddd8c\") " pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" Jul 17 17:41:05.987975 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.987948 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c1b8e8f8-197e-4a22-8585-d13cefcddd8c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79cd4f8576-b45ch\" (UID: \"c1b8e8f8-197e-4a22-8585-d13cefcddd8c\") " pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" Jul 17 17:41:05.988098 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.988025 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c1b8e8f8-197e-4a22-8585-d13cefcddd8c-secret-grpc-tls\") pod \"thanos-querier-79cd4f8576-b45ch\" (UID: \"c1b8e8f8-197e-4a22-8585-d13cefcddd8c\") " pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" Jul 17 17:41:05.988172 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.988102 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c1b8e8f8-197e-4a22-8585-d13cefcddd8c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79cd4f8576-b45ch\" (UID: \"c1b8e8f8-197e-4a22-8585-d13cefcddd8c\") " pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" Jul 17 17:41:05.988172 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.988152 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c1b8e8f8-197e-4a22-8585-d13cefcddd8c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79cd4f8576-b45ch\" (UID: \"c1b8e8f8-197e-4a22-8585-d13cefcddd8c\") " pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" Jul 17 17:41:05.988548 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.988522 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c1b8e8f8-197e-4a22-8585-d13cefcddd8c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79cd4f8576-b45ch\" (UID: \"c1b8e8f8-197e-4a22-8585-d13cefcddd8c\") " pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" Jul 17 17:41:05.988947 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.988928 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c1b8e8f8-197e-4a22-8585-d13cefcddd8c-secret-thanos-querier-tls\") pod \"thanos-querier-79cd4f8576-b45ch\" (UID: \"c1b8e8f8-197e-4a22-8585-d13cefcddd8c\") " pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" Jul 17 17:41:05.993911 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:05.993884 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx8wl\" (UniqueName: \"kubernetes.io/projected/c1b8e8f8-197e-4a22-8585-d13cefcddd8c-kube-api-access-kx8wl\") pod \"thanos-querier-79cd4f8576-b45ch\" (UID: \"c1b8e8f8-197e-4a22-8585-d13cefcddd8c\") " pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" Jul 17 17:41:06.148009 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:06.147916 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wkxnp\"" Jul 17 17:41:06.155463 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:06.155412 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" Jul 17 17:41:06.327255 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:06.327223 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-79cd4f8576-b45ch"] Jul 17 17:41:06.527912 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:41:06.527879 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1b8e8f8_197e_4a22_8585_d13cefcddd8c.slice/crio-be9afb0168b55da4b8214527a21777d7acf162b11a757ccbd403b2aae7ee1984 WatchSource:0}: Error finding container be9afb0168b55da4b8214527a21777d7acf162b11a757ccbd403b2aae7ee1984: Status 404 returned error can't find the container with id be9afb0168b55da4b8214527a21777d7acf162b11a757ccbd403b2aae7ee1984 Jul 17 17:41:06.551976 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:06.551955 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:41:06.793555 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:06.793470 2563 generic.go:356] "Generic (PLEG): container finished" podID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerID="d406aa319d0a39720b2f961e597da1387297eae115e452704e9d3b9745c654d8" exitCode=0 Jul 17 17:41:06.793555 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:06.793546 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b46dad87-81cd-48d8-a9c6-897401f0a6aa","Type":"ContainerDied","Data":"d406aa319d0a39720b2f961e597da1387297eae115e452704e9d3b9745c654d8"} Jul 17 17:41:06.794851 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:06.794821 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" event={"ID":"c1b8e8f8-197e-4a22-8585-d13cefcddd8c","Type":"ContainerStarted","Data":"be9afb0168b55da4b8214527a21777d7acf162b11a757ccbd403b2aae7ee1984"} Jul 17 17:41:06.796950 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:06.796930 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nrwkb" event={"ID":"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0","Type":"ContainerStarted","Data":"543eb54403a9ce3b45f3ff44e4c256068a1ea7ab4cbdc59839b3ab750bd597bf"} Jul 17 17:41:06.797057 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:06.796975 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nrwkb" event={"ID":"7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0","Type":"ContainerStarted","Data":"dc0c5a31aaa73516a507721852787c6b2ae7cb2b3f7f01f4a52cf5f48b3242dc"} Jul 17 17:41:06.855941 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:06.855883 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nrwkb" podStartSLOduration=3.550194818 podStartE2EDuration="4.855867593s" totalImagesPullingTime="1.233848696s" totalInitContainerRuntime="71.824079ms" isStatefulPod=true podCreationTimestamp="2026-07-17 17:41:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:41:06.85527937 +0000 UTC m=+121.039337146" watchObservedRunningTime="2026-07-17 17:41:06.855867593 +0000 UTC m=+121.039925369" Jul 17 17:41:07.152748 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.152650 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-58777f4675-vq66k"] Jul 17 17:41:07.154714 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.154698 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-58777f4675-vq66k" Jul 17 17:41:07.157266 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.157242 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 17 17:41:07.157386 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.157282 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-f9ihe2qr2op4\"" Jul 17 17:41:07.157469 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.157419 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-qxrdd\"" Jul 17 17:41:07.157469 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.157465 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 17 17:41:07.157665 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.157646 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 17 17:41:07.157723 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.157683 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 17 17:41:07.165245 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.165218 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-58777f4675-vq66k"] Jul 17 17:41:07.196510 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.196471 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/93ac6c26-ada3-40f6-b390-9ac217e32791-audit-log\") pod \"metrics-server-58777f4675-vq66k\" (UID: \"93ac6c26-ada3-40f6-b390-9ac217e32791\") " pod="openshift-monitoring/metrics-server-58777f4675-vq66k" Jul 17 17:41:07.196682 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.196530 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/93ac6c26-ada3-40f6-b390-9ac217e32791-secret-metrics-server-client-certs\") pod \"metrics-server-58777f4675-vq66k\" (UID: \"93ac6c26-ada3-40f6-b390-9ac217e32791\") " pod="openshift-monitoring/metrics-server-58777f4675-vq66k" Jul 17 17:41:07.196682 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.196575 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/93ac6c26-ada3-40f6-b390-9ac217e32791-secret-metrics-server-tls\") pod \"metrics-server-58777f4675-vq66k\" (UID: \"93ac6c26-ada3-40f6-b390-9ac217e32791\") " pod="openshift-monitoring/metrics-server-58777f4675-vq66k" Jul 17 17:41:07.196682 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.196604 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/93ac6c26-ada3-40f6-b390-9ac217e32791-metrics-server-audit-profiles\") pod \"metrics-server-58777f4675-vq66k\" (UID: \"93ac6c26-ada3-40f6-b390-9ac217e32791\") " pod="openshift-monitoring/metrics-server-58777f4675-vq66k" Jul 17 17:41:07.196682 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.196681 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93ac6c26-ada3-40f6-b390-9ac217e32791-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58777f4675-vq66k\" (UID: \"93ac6c26-ada3-40f6-b390-9ac217e32791\") " pod="openshift-monitoring/metrics-server-58777f4675-vq66k" Jul 17 17:41:07.196828 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.196698 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93ac6c26-ada3-40f6-b390-9ac217e32791-client-ca-bundle\") pod \"metrics-server-58777f4675-vq66k\" (UID: \"93ac6c26-ada3-40f6-b390-9ac217e32791\") " pod="openshift-monitoring/metrics-server-58777f4675-vq66k" Jul 17 17:41:07.196828 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.196714 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrrmm\" (UniqueName: \"kubernetes.io/projected/93ac6c26-ada3-40f6-b390-9ac217e32791-kube-api-access-vrrmm\") pod \"metrics-server-58777f4675-vq66k\" (UID: \"93ac6c26-ada3-40f6-b390-9ac217e32791\") " pod="openshift-monitoring/metrics-server-58777f4675-vq66k" Jul 17 17:41:07.297147 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.297109 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93ac6c26-ada3-40f6-b390-9ac217e32791-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58777f4675-vq66k\" (UID: \"93ac6c26-ada3-40f6-b390-9ac217e32791\") " pod="openshift-monitoring/metrics-server-58777f4675-vq66k" Jul 17 17:41:07.297147 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.297154 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93ac6c26-ada3-40f6-b390-9ac217e32791-client-ca-bundle\") pod \"metrics-server-58777f4675-vq66k\" (UID: \"93ac6c26-ada3-40f6-b390-9ac217e32791\") " pod="openshift-monitoring/metrics-server-58777f4675-vq66k" Jul 17 17:41:07.297371 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.297179 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrrmm\" (UniqueName: \"kubernetes.io/projected/93ac6c26-ada3-40f6-b390-9ac217e32791-kube-api-access-vrrmm\") pod \"metrics-server-58777f4675-vq66k\" (UID: \"93ac6c26-ada3-40f6-b390-9ac217e32791\") " pod="openshift-monitoring/metrics-server-58777f4675-vq66k" Jul 17 17:41:07.297371 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.297204 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/93ac6c26-ada3-40f6-b390-9ac217e32791-audit-log\") pod \"metrics-server-58777f4675-vq66k\" (UID: \"93ac6c26-ada3-40f6-b390-9ac217e32791\") " pod="openshift-monitoring/metrics-server-58777f4675-vq66k" Jul 17 17:41:07.297371 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.297257 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/93ac6c26-ada3-40f6-b390-9ac217e32791-secret-metrics-server-client-certs\") pod \"metrics-server-58777f4675-vq66k\" (UID: \"93ac6c26-ada3-40f6-b390-9ac217e32791\") " pod="openshift-monitoring/metrics-server-58777f4675-vq66k" Jul 17 17:41:07.297371 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.297285 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/93ac6c26-ada3-40f6-b390-9ac217e32791-secret-metrics-server-tls\") pod \"metrics-server-58777f4675-vq66k\" (UID: \"93ac6c26-ada3-40f6-b390-9ac217e32791\") " pod="openshift-monitoring/metrics-server-58777f4675-vq66k" Jul 17 17:41:07.297371 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.297308 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/93ac6c26-ada3-40f6-b390-9ac217e32791-metrics-server-audit-profiles\") pod \"metrics-server-58777f4675-vq66k\" (UID: \"93ac6c26-ada3-40f6-b390-9ac217e32791\") " pod="openshift-monitoring/metrics-server-58777f4675-vq66k" Jul 17 17:41:07.297893 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.297866 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/93ac6c26-ada3-40f6-b390-9ac217e32791-audit-log\") pod \"metrics-server-58777f4675-vq66k\" (UID: \"93ac6c26-ada3-40f6-b390-9ac217e32791\") " pod="openshift-monitoring/metrics-server-58777f4675-vq66k" Jul 17 17:41:07.298018 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.297996 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93ac6c26-ada3-40f6-b390-9ac217e32791-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58777f4675-vq66k\" (UID: \"93ac6c26-ada3-40f6-b390-9ac217e32791\") " pod="openshift-monitoring/metrics-server-58777f4675-vq66k" Jul 17 17:41:07.298717 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.298692 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/93ac6c26-ada3-40f6-b390-9ac217e32791-metrics-server-audit-profiles\") pod \"metrics-server-58777f4675-vq66k\" (UID: \"93ac6c26-ada3-40f6-b390-9ac217e32791\") " pod="openshift-monitoring/metrics-server-58777f4675-vq66k" Jul 17 17:41:07.300164 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.300123 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93ac6c26-ada3-40f6-b390-9ac217e32791-client-ca-bundle\") pod \"metrics-server-58777f4675-vq66k\" (UID: \"93ac6c26-ada3-40f6-b390-9ac217e32791\") " pod="openshift-monitoring/metrics-server-58777f4675-vq66k" Jul 17 17:41:07.300376 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.300353 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/93ac6c26-ada3-40f6-b390-9ac217e32791-secret-metrics-server-tls\") pod \"metrics-server-58777f4675-vq66k\" (UID: \"93ac6c26-ada3-40f6-b390-9ac217e32791\") " pod="openshift-monitoring/metrics-server-58777f4675-vq66k" Jul 17 17:41:07.300494 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.300439 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/93ac6c26-ada3-40f6-b390-9ac217e32791-secret-metrics-server-client-certs\") pod \"metrics-server-58777f4675-vq66k\" (UID: \"93ac6c26-ada3-40f6-b390-9ac217e32791\") " pod="openshift-monitoring/metrics-server-58777f4675-vq66k" Jul 17 17:41:07.306031 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.306008 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrrmm\" (UniqueName: \"kubernetes.io/projected/93ac6c26-ada3-40f6-b390-9ac217e32791-kube-api-access-vrrmm\") pod \"metrics-server-58777f4675-vq66k\" (UID: \"93ac6c26-ada3-40f6-b390-9ac217e32791\") " pod="openshift-monitoring/metrics-server-58777f4675-vq66k" Jul 17 17:41:07.469310 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.469217 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-58777f4675-vq66k" Jul 17 17:41:07.651251 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.651220 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-58777f4675-vq66k"] Jul 17 17:41:07.656431 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:41:07.656393 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93ac6c26_ada3_40f6_b390_9ac217e32791.slice/crio-92bb92a3702ab83d1426729fa9613b9842104f4ef90fb5ab252d1d7142cdaf24 WatchSource:0}: Error finding container 92bb92a3702ab83d1426729fa9613b9842104f4ef90fb5ab252d1d7142cdaf24: Status 404 returned error can't find the container with id 92bb92a3702ab83d1426729fa9613b9842104f4ef90fb5ab252d1d7142cdaf24 Jul 17 17:41:07.803160 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:07.803113 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-58777f4675-vq66k" event={"ID":"93ac6c26-ada3-40f6-b390-9ac217e32791","Type":"ContainerStarted","Data":"92bb92a3702ab83d1426729fa9613b9842104f4ef90fb5ab252d1d7142cdaf24"} Jul 17 17:41:08.707552 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:08.707519 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-f665644df-5pp64" Jul 17 17:41:09.818960 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:09.818190 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-58777f4675-vq66k" event={"ID":"93ac6c26-ada3-40f6-b390-9ac217e32791","Type":"ContainerStarted","Data":"25e64c94214f7b706b6a6e30c6e985ba6e4de9fee803ead633f008fb2d07826a"} Jul 17 17:41:09.821341 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:09.821320 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b46dad87-81cd-48d8-a9c6-897401f0a6aa","Type":"ContainerStarted","Data":"9dafbc4ae2e7c9f7a11b1b9d224fc8d2c487de876fe69eed20ffbc184bee2b3d"} Jul 17 17:41:09.821421 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:09.821380 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b46dad87-81cd-48d8-a9c6-897401f0a6aa","Type":"ContainerStarted","Data":"64498c6889f4ceb5db4b3157528d0929fc9da7f418d25374220cc0b3d866cd0e"} Jul 17 17:41:09.821421 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:09.821405 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b46dad87-81cd-48d8-a9c6-897401f0a6aa","Type":"ContainerStarted","Data":"a5aff5d0ff3ae7f2d1a182deac5b6312792e7e51baeb9ce1170b5cb663307797"} Jul 17 17:41:09.824680 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:09.824656 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" event={"ID":"c1b8e8f8-197e-4a22-8585-d13cefcddd8c","Type":"ContainerStarted","Data":"98df1051f26f064d4258c40174211ba9efa0d14569a575222c0ff42e91bbbc37"} Jul 17 17:41:09.824765 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:09.824733 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" event={"ID":"c1b8e8f8-197e-4a22-8585-d13cefcddd8c","Type":"ContainerStarted","Data":"516ed9a12f4e9d74c326c1beee7cc47bf484c60c789ea79e9dd3eb40702b3a7c"} Jul 17 17:41:09.824808 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:09.824779 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" event={"ID":"c1b8e8f8-197e-4a22-8585-d13cefcddd8c","Type":"ContainerStarted","Data":"aa8dfabeaeaabe180c4af01d9cb033fb4bda8fea02d6fe35c733ad0c06e49372"} Jul 17 17:41:09.839890 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:09.839757 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-58777f4675-vq66k" podStartSLOduration=0.920605039 podStartE2EDuration="2.839740817s" totalImagesPullingTime="1.919135778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:41:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:41:09.838214266 +0000 UTC m=+124.022272045" watchObservedRunningTime="2026-07-17 17:41:09.839740817 +0000 UTC m=+124.023798593" Jul 17 17:41:10.832813 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:10.832783 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" event={"ID":"c1b8e8f8-197e-4a22-8585-d13cefcddd8c","Type":"ContainerStarted","Data":"a0c4e51d719554fa80a49cdf19bbe77cbe8c35768330ed3340b98d252496cc6c"} Jul 17 17:41:10.833181 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:10.832852 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" event={"ID":"c1b8e8f8-197e-4a22-8585-d13cefcddd8c","Type":"ContainerStarted","Data":"c25823a29dab09fae0a55201c34e7d7104845f580a1d3ed859b89ff6a2fb885c"} Jul 17 17:41:10.836766 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:10.836734 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b46dad87-81cd-48d8-a9c6-897401f0a6aa","Type":"ContainerStarted","Data":"801adbc36acf39830c91c9eb980588f0119f758d159011d0450ad5e818bae231"} Jul 17 17:41:10.836875 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:10.836820 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b46dad87-81cd-48d8-a9c6-897401f0a6aa","Type":"ContainerStarted","Data":"1edac5ba23e64837c904baaa6304a41e12633b7bf29b95f3579ad80dd13abbcc"} Jul 17 17:41:10.836875 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:10.836865 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b46dad87-81cd-48d8-a9c6-897401f0a6aa","Type":"ContainerStarted","Data":"b7496898f0056743838b381f2d57de4bd064544ad70165adf271bbb102706e6b"} Jul 17 17:41:10.869157 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:10.869115 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.876813131 podStartE2EDuration="7.869098233s" totalImagesPullingTime="4.974959832s" totalInitContainerRuntime="17.32527ms" isStatefulPod=false podCreationTimestamp="2026-07-17 17:41:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:41:10.868081006 +0000 UTC m=+125.052138782" watchObservedRunningTime="2026-07-17 17:41:10.869098233 +0000 UTC m=+125.053156009" Jul 17 17:41:11.571742 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.571700 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" podUID="8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f" containerName="registry" containerID="cri-o://e7896c0bc2769f125678e3383e71719d804ddaa78ee374b119f7cff89deb6bb5" gracePeriod=30 Jul 17 17:41:11.816541 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.816512 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:41:11.843109 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.843020 2563 generic.go:356] "Generic (PLEG): container finished" podID="8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f" containerID="e7896c0bc2769f125678e3383e71719d804ddaa78ee374b119f7cff89deb6bb5" exitCode=0 Jul 17 17:41:11.843109 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.843073 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" Jul 17 17:41:11.843623 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.843103 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" event={"ID":"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f","Type":"ContainerDied","Data":"e7896c0bc2769f125678e3383e71719d804ddaa78ee374b119f7cff89deb6bb5"} Jul 17 17:41:11.843623 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.843171 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-584994d4f4-ldl5z" event={"ID":"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f","Type":"ContainerDied","Data":"e89a316c2e0bbbc9a373add2b6c64a18f347d83d00a2e8dfe16e4dd55ff62575"} Jul 17 17:41:11.843623 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.843208 2563 scope.go:117] "RemoveContainer" containerID="e7896c0bc2769f125678e3383e71719d804ddaa78ee374b119f7cff89deb6bb5" Jul 17 17:41:11.845209 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.845188 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s24j5\" (UniqueName: \"kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-kube-api-access-s24j5\") pod \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " Jul 17 17:41:11.845312 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.845222 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-ca-trust-extracted\") pod \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " Jul 17 17:41:11.845312 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.845245 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-bound-sa-token\") pod \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " Jul 17 17:41:11.845312 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.845279 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-registry-certificates\") pod \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " Jul 17 17:41:11.845312 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.845301 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-registry-tls\") pod \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " Jul 17 17:41:11.845517 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.845335 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-installation-pull-secrets\") pod \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " Jul 17 17:41:11.845517 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.845366 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-trusted-ca\") pod \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " Jul 17 17:41:11.845517 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.845389 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-image-registry-private-configuration\") pod \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\" (UID: \"8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f\") " Jul 17 17:41:11.846465 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.846397 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f" (UID: "8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:41:11.847079 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.846900 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f" (UID: "8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:41:11.848392 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.848362 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-kube-api-access-s24j5" (OuterVolumeSpecName: "kube-api-access-s24j5") pod "8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f" (UID: "8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f"). InnerVolumeSpecName "kube-api-access-s24j5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:41:11.849072 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.849041 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f" (UID: "8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:41:11.849337 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.849317 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f" (UID: "8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:41:11.849432 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.849344 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f" (UID: "8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:41:11.849588 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.849499 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f" (UID: "8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:41:11.850228 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.850198 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" event={"ID":"c1b8e8f8-197e-4a22-8585-d13cefcddd8c","Type":"ContainerStarted","Data":"09e53afee5b22ef9427da87fe71aecaf30c9710971cb977bcfceb2129b7d0005"} Jul 17 17:41:11.850515 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.850425 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" Jul 17 17:41:11.856571 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.856541 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f" (UID: "8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:41:11.864848 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.864830 2563 scope.go:117] "RemoveContainer" containerID="e7896c0bc2769f125678e3383e71719d804ddaa78ee374b119f7cff89deb6bb5" Jul 17 17:41:11.865169 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:41:11.865148 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7896c0bc2769f125678e3383e71719d804ddaa78ee374b119f7cff89deb6bb5\": container with ID starting with e7896c0bc2769f125678e3383e71719d804ddaa78ee374b119f7cff89deb6bb5 not found: ID does not exist" containerID="e7896c0bc2769f125678e3383e71719d804ddaa78ee374b119f7cff89deb6bb5" Jul 17 17:41:11.865233 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.865181 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7896c0bc2769f125678e3383e71719d804ddaa78ee374b119f7cff89deb6bb5"} err="failed to get container status \"e7896c0bc2769f125678e3383e71719d804ddaa78ee374b119f7cff89deb6bb5\": rpc error: code = NotFound desc = could not find container \"e7896c0bc2769f125678e3383e71719d804ddaa78ee374b119f7cff89deb6bb5\": container with ID starting with e7896c0bc2769f125678e3383e71719d804ddaa78ee374b119f7cff89deb6bb5 not found: ID does not exist" Jul 17 17:41:11.873129 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.873090 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" podStartSLOduration=2.942660712 podStartE2EDuration="6.873076114s" totalImagesPullingTime="3.930415402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:41:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:41:11.87182596 +0000 UTC m=+126.055883737" watchObservedRunningTime="2026-07-17 17:41:11.873076114 +0000 UTC m=+126.057133890" Jul 17 17:41:11.946901 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.946763 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-registry-certificates\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:41:11.946901 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.946797 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-registry-tls\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:41:11.946901 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.946812 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-installation-pull-secrets\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:41:11.946901 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.946827 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-trusted-ca\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:41:11.946901 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.946842 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-image-registry-private-configuration\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:41:11.946901 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.946860 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s24j5\" (UniqueName: \"kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-kube-api-access-s24j5\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:41:11.946901 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.946874 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-ca-trust-extracted\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:41:11.947245 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:11.946918 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f-bound-sa-token\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:41:12.168354 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:12.168322 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-584994d4f4-ldl5z"] Jul 17 17:41:12.174728 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:12.174694 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-584994d4f4-ldl5z"] Jul 17 17:41:12.313771 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:12.313733 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f" path="/var/lib/kubelet/pods/8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f/volumes" Jul 17 17:41:16.082144 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:16.082103 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05410b3d-9fba-454e-be26-568dbfce20f4-metrics-certs\") pod \"network-metrics-daemon-82zfd\" (UID: \"05410b3d-9fba-454e-be26-568dbfce20f4\") " pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:41:16.084513 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:16.084493 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05410b3d-9fba-454e-be26-568dbfce20f4-metrics-certs\") pod \"network-metrics-daemon-82zfd\" (UID: \"05410b3d-9fba-454e-be26-568dbfce20f4\") " pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:41:16.120627 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:16.120592 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-829wt\"" Jul 17 17:41:16.127209 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:16.127184 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82zfd" Jul 17 17:41:16.262725 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:16.262692 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-82zfd"] Jul 17 17:41:16.265756 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:41:16.265731 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05410b3d_9fba_454e_be26_568dbfce20f4.slice/crio-cae01a937f40bc9067acce290cb4b85a08b61b88c6532e861e664131983bd274 WatchSource:0}: Error finding container cae01a937f40bc9067acce290cb4b85a08b61b88c6532e861e664131983bd274: Status 404 returned error can't find the container with id cae01a937f40bc9067acce290cb4b85a08b61b88c6532e861e664131983bd274 Jul 17 17:41:16.874908 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:16.874859 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-82zfd" event={"ID":"05410b3d-9fba-454e-be26-568dbfce20f4","Type":"ContainerStarted","Data":"cae01a937f40bc9067acce290cb4b85a08b61b88c6532e861e664131983bd274"} Jul 17 17:41:17.862112 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:17.862030 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-79cd4f8576-b45ch" Jul 17 17:41:17.879845 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:17.879818 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-82zfd" event={"ID":"05410b3d-9fba-454e-be26-568dbfce20f4","Type":"ContainerStarted","Data":"1ed34af39b321f6a1deaa64a38178469a5a0ab7d8746fba6e80710c97f2b6aa9"} Jul 17 17:41:17.879970 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:17.879877 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-82zfd" event={"ID":"05410b3d-9fba-454e-be26-568dbfce20f4","Type":"ContainerStarted","Data":"e18ec991064b244b6be6d5d33ea928de1e2cfb3680253e00d89b537df2639cf2"} Jul 17 17:41:17.905553 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:17.905399 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-82zfd" podStartSLOduration=130.65925208 podStartE2EDuration="2m11.905383728s" totalImagesPullingTime="1.246131648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:41:17.904250717 +0000 UTC m=+132.088308507" watchObservedRunningTime="2026-07-17 17:41:17.905383728 +0000 UTC m=+132.089441505" Jul 17 17:41:27.469628 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:27.469588 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-58777f4675-vq66k" Jul 17 17:41:27.470113 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:27.469701 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-58777f4675-vq66k" Jul 17 17:41:39.977838 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:39.977802 2563 generic.go:356] "Generic (PLEG): container finished" podID="66642d29-f84e-4114-930a-5213ceafbaa0" containerID="8eeb191fee56fc0235b7b2b8c15534ad15733d8da60e33dfed931d7578cb6d7d" exitCode=0 Jul 17 17:41:39.978233 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:39.977875 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rtgck" event={"ID":"66642d29-f84e-4114-930a-5213ceafbaa0","Type":"ContainerDied","Data":"8eeb191fee56fc0235b7b2b8c15534ad15733d8da60e33dfed931d7578cb6d7d"} Jul 17 17:41:39.978233 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:39.978207 2563 scope.go:117] "RemoveContainer" containerID="8eeb191fee56fc0235b7b2b8c15534ad15733d8da60e33dfed931d7578cb6d7d" Jul 17 17:41:40.983535 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:40.983505 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rtgck" event={"ID":"66642d29-f84e-4114-930a-5213ceafbaa0","Type":"ContainerStarted","Data":"0fd5515594726eec132c90034e64dd4fc9dde76e53a660c126ad35e25bcadbc1"} Jul 17 17:41:47.475607 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:47.475578 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-58777f4675-vq66k" Jul 17 17:41:47.480293 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:41:47.480266 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-58777f4675-vq66k" Jul 17 17:42:23.213670 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:23.213634 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 17:42:23.214114 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:23.213916 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerName="alertmanager" containerID="cri-o://a5aff5d0ff3ae7f2d1a182deac5b6312792e7e51baeb9ce1170b5cb663307797" gracePeriod=120 Jul 17 17:42:23.214114 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:23.213993 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerName="kube-rbac-proxy-web" containerID="cri-o://9dafbc4ae2e7c9f7a11b1b9d224fc8d2c487de876fe69eed20ffbc184bee2b3d" gracePeriod=120 Jul 17 17:42:23.214114 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:23.213995 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerName="kube-rbac-proxy-metric" containerID="cri-o://1edac5ba23e64837c904baaa6304a41e12633b7bf29b95f3579ad80dd13abbcc" gracePeriod=120 Jul 17 17:42:23.214114 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:23.214049 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerName="prom-label-proxy" containerID="cri-o://801adbc36acf39830c91c9eb980588f0119f758d159011d0450ad5e818bae231" gracePeriod=120 Jul 17 17:42:23.214114 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:23.214074 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerName="config-reloader" containerID="cri-o://64498c6889f4ceb5db4b3157528d0929fc9da7f418d25374220cc0b3d866cd0e" gracePeriod=120 Jul 17 17:42:23.214512 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:23.214081 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerName="kube-rbac-proxy" containerID="cri-o://b7496898f0056743838b381f2d57de4bd064544ad70165adf271bbb102706e6b" gracePeriod=120 Jul 17 17:42:24.152392 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.152356 2563 generic.go:356] "Generic (PLEG): container finished" podID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerID="801adbc36acf39830c91c9eb980588f0119f758d159011d0450ad5e818bae231" exitCode=0 Jul 17 17:42:24.152392 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.152379 2563 generic.go:356] "Generic (PLEG): container finished" podID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerID="b7496898f0056743838b381f2d57de4bd064544ad70165adf271bbb102706e6b" exitCode=0 Jul 17 17:42:24.152392 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.152385 2563 generic.go:356] "Generic (PLEG): container finished" podID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerID="64498c6889f4ceb5db4b3157528d0929fc9da7f418d25374220cc0b3d866cd0e" exitCode=0 Jul 17 17:42:24.152392 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.152390 2563 generic.go:356] "Generic (PLEG): container finished" podID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerID="a5aff5d0ff3ae7f2d1a182deac5b6312792e7e51baeb9ce1170b5cb663307797" exitCode=0 Jul 17 17:42:24.152672 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.152429 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b46dad87-81cd-48d8-a9c6-897401f0a6aa","Type":"ContainerDied","Data":"801adbc36acf39830c91c9eb980588f0119f758d159011d0450ad5e818bae231"} Jul 17 17:42:24.152672 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.152507 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b46dad87-81cd-48d8-a9c6-897401f0a6aa","Type":"ContainerDied","Data":"b7496898f0056743838b381f2d57de4bd064544ad70165adf271bbb102706e6b"} Jul 17 17:42:24.152672 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.152536 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b46dad87-81cd-48d8-a9c6-897401f0a6aa","Type":"ContainerDied","Data":"64498c6889f4ceb5db4b3157528d0929fc9da7f418d25374220cc0b3d866cd0e"} Jul 17 17:42:24.152672 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.152563 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b46dad87-81cd-48d8-a9c6-897401f0a6aa","Type":"ContainerDied","Data":"a5aff5d0ff3ae7f2d1a182deac5b6312792e7e51baeb9ce1170b5cb663307797"} Jul 17 17:42:24.455572 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.455543 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:24.575877 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.575844 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kdqx\" (UniqueName: \"kubernetes.io/projected/b46dad87-81cd-48d8-a9c6-897401f0a6aa-kube-api-access-5kdqx\") pod \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " Jul 17 17:42:24.576050 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.575884 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-web-config\") pod \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " Jul 17 17:42:24.576050 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.575921 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-cluster-tls-config\") pod \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " Jul 17 17:42:24.576163 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.576062 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-secret-alertmanager-kube-rbac-proxy\") pod \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " Jul 17 17:42:24.576163 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.576093 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-secret-alertmanager-kube-rbac-proxy-web\") pod \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " Jul 17 17:42:24.576163 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.576149 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b46dad87-81cd-48d8-a9c6-897401f0a6aa-config-out\") pod \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " Jul 17 17:42:24.576325 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.576185 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-secret-alertmanager-main-tls\") pod \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " Jul 17 17:42:24.576325 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.576239 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b46dad87-81cd-48d8-a9c6-897401f0a6aa-alertmanager-main-db\") pod \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " Jul 17 17:42:24.576325 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.576263 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b46dad87-81cd-48d8-a9c6-897401f0a6aa-alertmanager-trusted-ca-bundle\") pod \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " Jul 17 17:42:24.576325 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.576293 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b46dad87-81cd-48d8-a9c6-897401f0a6aa-tls-assets\") pod \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " Jul 17 17:42:24.576564 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.576335 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-config-volume\") pod \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " Jul 17 17:42:24.576564 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.576364 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " Jul 17 17:42:24.576564 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.576398 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b46dad87-81cd-48d8-a9c6-897401f0a6aa-metrics-client-ca\") pod \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\" (UID: \"b46dad87-81cd-48d8-a9c6-897401f0a6aa\") " Jul 17 17:42:24.577278 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.577242 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b46dad87-81cd-48d8-a9c6-897401f0a6aa-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "b46dad87-81cd-48d8-a9c6-897401f0a6aa" (UID: "b46dad87-81cd-48d8-a9c6-897401f0a6aa"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:42:24.577398 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.577314 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b46dad87-81cd-48d8-a9c6-897401f0a6aa-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "b46dad87-81cd-48d8-a9c6-897401f0a6aa" (UID: "b46dad87-81cd-48d8-a9c6-897401f0a6aa"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:42:24.577784 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.577745 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b46dad87-81cd-48d8-a9c6-897401f0a6aa-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "b46dad87-81cd-48d8-a9c6-897401f0a6aa" (UID: "b46dad87-81cd-48d8-a9c6-897401f0a6aa"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:42:24.580679 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.580613 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "b46dad87-81cd-48d8-a9c6-897401f0a6aa" (UID: "b46dad87-81cd-48d8-a9c6-897401f0a6aa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:42:24.580679 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.580617 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b46dad87-81cd-48d8-a9c6-897401f0a6aa-config-out" (OuterVolumeSpecName: "config-out") pod "b46dad87-81cd-48d8-a9c6-897401f0a6aa" (UID: "b46dad87-81cd-48d8-a9c6-897401f0a6aa"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:42:24.580679 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.580652 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "b46dad87-81cd-48d8-a9c6-897401f0a6aa" (UID: "b46dad87-81cd-48d8-a9c6-897401f0a6aa"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:42:24.580932 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.580908 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "b46dad87-81cd-48d8-a9c6-897401f0a6aa" (UID: "b46dad87-81cd-48d8-a9c6-897401f0a6aa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:42:24.580932 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.580914 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b46dad87-81cd-48d8-a9c6-897401f0a6aa-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b46dad87-81cd-48d8-a9c6-897401f0a6aa" (UID: "b46dad87-81cd-48d8-a9c6-897401f0a6aa"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:42:24.581150 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.581125 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b46dad87-81cd-48d8-a9c6-897401f0a6aa-kube-api-access-5kdqx" (OuterVolumeSpecName: "kube-api-access-5kdqx") pod "b46dad87-81cd-48d8-a9c6-897401f0a6aa" (UID: "b46dad87-81cd-48d8-a9c6-897401f0a6aa"). InnerVolumeSpecName "kube-api-access-5kdqx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:42:24.581637 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.581602 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "b46dad87-81cd-48d8-a9c6-897401f0a6aa" (UID: "b46dad87-81cd-48d8-a9c6-897401f0a6aa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:42:24.582112 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.582088 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-config-volume" (OuterVolumeSpecName: "config-volume") pod "b46dad87-81cd-48d8-a9c6-897401f0a6aa" (UID: "b46dad87-81cd-48d8-a9c6-897401f0a6aa"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:42:24.584765 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.584730 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "b46dad87-81cd-48d8-a9c6-897401f0a6aa" (UID: "b46dad87-81cd-48d8-a9c6-897401f0a6aa"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:42:24.591423 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.591397 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-web-config" (OuterVolumeSpecName: "web-config") pod "b46dad87-81cd-48d8-a9c6-897401f0a6aa" (UID: "b46dad87-81cd-48d8-a9c6-897401f0a6aa"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:42:24.677719 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.677680 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kdqx\" (UniqueName: \"kubernetes.io/projected/b46dad87-81cd-48d8-a9c6-897401f0a6aa-kube-api-access-5kdqx\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:42:24.677719 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.677712 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-web-config\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:42:24.677719 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.677727 2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-cluster-tls-config\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:42:24.677962 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.677741 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:42:24.677962 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.677753 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:42:24.677962 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.677764 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b46dad87-81cd-48d8-a9c6-897401f0a6aa-config-out\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:42:24.677962 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.677775 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-secret-alertmanager-main-tls\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:42:24.677962 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.677788 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b46dad87-81cd-48d8-a9c6-897401f0a6aa-alertmanager-main-db\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:42:24.677962 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.677800 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b46dad87-81cd-48d8-a9c6-897401f0a6aa-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:42:24.677962 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.677812 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b46dad87-81cd-48d8-a9c6-897401f0a6aa-tls-assets\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:42:24.677962 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.677822 2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-config-volume\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:42:24.677962 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.677832 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b46dad87-81cd-48d8-a9c6-897401f0a6aa-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:42:24.677962 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:24.677845 2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b46dad87-81cd-48d8-a9c6-897401f0a6aa-metrics-client-ca\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:42:25.158991 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.158956 2563 generic.go:356] "Generic (PLEG): container finished" podID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerID="1edac5ba23e64837c904baaa6304a41e12633b7bf29b95f3579ad80dd13abbcc" exitCode=0 Jul 17 17:42:25.158991 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.158981 2563 generic.go:356] "Generic (PLEG): container finished" podID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerID="9dafbc4ae2e7c9f7a11b1b9d224fc8d2c487de876fe69eed20ffbc184bee2b3d" exitCode=0 Jul 17 17:42:25.159197 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.159036 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.159197 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.159036 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b46dad87-81cd-48d8-a9c6-897401f0a6aa","Type":"ContainerDied","Data":"1edac5ba23e64837c904baaa6304a41e12633b7bf29b95f3579ad80dd13abbcc"} Jul 17 17:42:25.159197 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.159123 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b46dad87-81cd-48d8-a9c6-897401f0a6aa","Type":"ContainerDied","Data":"9dafbc4ae2e7c9f7a11b1b9d224fc8d2c487de876fe69eed20ffbc184bee2b3d"} Jul 17 17:42:25.159197 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.159166 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b46dad87-81cd-48d8-a9c6-897401f0a6aa","Type":"ContainerDied","Data":"4e71de8a77e1d490b12077468902fe561e33f85afe1959f32e293f9b43056a97"} Jul 17 17:42:25.159317 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.159194 2563 scope.go:117] "RemoveContainer" containerID="801adbc36acf39830c91c9eb980588f0119f758d159011d0450ad5e818bae231" Jul 17 17:42:25.167577 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.167559 2563 scope.go:117] "RemoveContainer" containerID="1edac5ba23e64837c904baaa6304a41e12633b7bf29b95f3579ad80dd13abbcc" Jul 17 17:42:25.175195 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.175175 2563 scope.go:117] "RemoveContainer" containerID="b7496898f0056743838b381f2d57de4bd064544ad70165adf271bbb102706e6b" Jul 17 17:42:25.182546 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.182427 2563 scope.go:117] "RemoveContainer" containerID="9dafbc4ae2e7c9f7a11b1b9d224fc8d2c487de876fe69eed20ffbc184bee2b3d" Jul 17 17:42:25.183082 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.183061 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 17:42:25.192105 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.192082 2563 scope.go:117] "RemoveContainer" containerID="64498c6889f4ceb5db4b3157528d0929fc9da7f418d25374220cc0b3d866cd0e" Jul 17 17:42:25.194843 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.194820 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 17:42:25.200318 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.200298 2563 scope.go:117] "RemoveContainer" containerID="a5aff5d0ff3ae7f2d1a182deac5b6312792e7e51baeb9ce1170b5cb663307797" Jul 17 17:42:25.207666 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.207647 2563 scope.go:117] "RemoveContainer" containerID="d406aa319d0a39720b2f961e597da1387297eae115e452704e9d3b9745c654d8" Jul 17 17:42:25.214687 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.214667 2563 scope.go:117] "RemoveContainer" containerID="801adbc36acf39830c91c9eb980588f0119f758d159011d0450ad5e818bae231" Jul 17 17:42:25.214947 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:42:25.214930 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"801adbc36acf39830c91c9eb980588f0119f758d159011d0450ad5e818bae231\": container with ID starting with 801adbc36acf39830c91c9eb980588f0119f758d159011d0450ad5e818bae231 not found: ID does not exist" containerID="801adbc36acf39830c91c9eb980588f0119f758d159011d0450ad5e818bae231" Jul 17 17:42:25.214989 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.214956 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"801adbc36acf39830c91c9eb980588f0119f758d159011d0450ad5e818bae231"} err="failed to get container status \"801adbc36acf39830c91c9eb980588f0119f758d159011d0450ad5e818bae231\": rpc error: code = NotFound desc = could not find container \"801adbc36acf39830c91c9eb980588f0119f758d159011d0450ad5e818bae231\": container with ID starting with 801adbc36acf39830c91c9eb980588f0119f758d159011d0450ad5e818bae231 not found: ID does not exist" Jul 17 17:42:25.214989 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.214976 2563 scope.go:117] "RemoveContainer" containerID="1edac5ba23e64837c904baaa6304a41e12633b7bf29b95f3579ad80dd13abbcc" Jul 17 17:42:25.215198 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:42:25.215184 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1edac5ba23e64837c904baaa6304a41e12633b7bf29b95f3579ad80dd13abbcc\": container with ID starting with 1edac5ba23e64837c904baaa6304a41e12633b7bf29b95f3579ad80dd13abbcc not found: ID does not exist" containerID="1edac5ba23e64837c904baaa6304a41e12633b7bf29b95f3579ad80dd13abbcc" Jul 17 17:42:25.215241 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.215201 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1edac5ba23e64837c904baaa6304a41e12633b7bf29b95f3579ad80dd13abbcc"} err="failed to get container status \"1edac5ba23e64837c904baaa6304a41e12633b7bf29b95f3579ad80dd13abbcc\": rpc error: code = NotFound desc = could not find container \"1edac5ba23e64837c904baaa6304a41e12633b7bf29b95f3579ad80dd13abbcc\": container with ID starting with 1edac5ba23e64837c904baaa6304a41e12633b7bf29b95f3579ad80dd13abbcc not found: ID does not exist" Jul 17 17:42:25.215241 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.215229 2563 scope.go:117] "RemoveContainer" containerID="b7496898f0056743838b381f2d57de4bd064544ad70165adf271bbb102706e6b" Jul 17 17:42:25.215699 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:42:25.215644 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7496898f0056743838b381f2d57de4bd064544ad70165adf271bbb102706e6b\": container with ID starting with b7496898f0056743838b381f2d57de4bd064544ad70165adf271bbb102706e6b not found: ID does not exist" containerID="b7496898f0056743838b381f2d57de4bd064544ad70165adf271bbb102706e6b" Jul 17 17:42:25.215699 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.215688 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7496898f0056743838b381f2d57de4bd064544ad70165adf271bbb102706e6b"} err="failed to get container status \"b7496898f0056743838b381f2d57de4bd064544ad70165adf271bbb102706e6b\": rpc error: code = NotFound desc = could not find container \"b7496898f0056743838b381f2d57de4bd064544ad70165adf271bbb102706e6b\": container with ID starting with b7496898f0056743838b381f2d57de4bd064544ad70165adf271bbb102706e6b not found: ID does not exist" Jul 17 17:42:25.215873 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.215710 2563 scope.go:117] "RemoveContainer" containerID="9dafbc4ae2e7c9f7a11b1b9d224fc8d2c487de876fe69eed20ffbc184bee2b3d" Jul 17 17:42:25.216174 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:42:25.216150 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9dafbc4ae2e7c9f7a11b1b9d224fc8d2c487de876fe69eed20ffbc184bee2b3d\": container with ID starting with 9dafbc4ae2e7c9f7a11b1b9d224fc8d2c487de876fe69eed20ffbc184bee2b3d not found: ID does not exist" containerID="9dafbc4ae2e7c9f7a11b1b9d224fc8d2c487de876fe69eed20ffbc184bee2b3d" Jul 17 17:42:25.216251 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.216190 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dafbc4ae2e7c9f7a11b1b9d224fc8d2c487de876fe69eed20ffbc184bee2b3d"} err="failed to get container status \"9dafbc4ae2e7c9f7a11b1b9d224fc8d2c487de876fe69eed20ffbc184bee2b3d\": rpc error: code = NotFound desc = could not find container \"9dafbc4ae2e7c9f7a11b1b9d224fc8d2c487de876fe69eed20ffbc184bee2b3d\": container with ID starting with 9dafbc4ae2e7c9f7a11b1b9d224fc8d2c487de876fe69eed20ffbc184bee2b3d not found: ID does not exist" Jul 17 17:42:25.216251 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.216209 2563 scope.go:117] "RemoveContainer" containerID="64498c6889f4ceb5db4b3157528d0929fc9da7f418d25374220cc0b3d866cd0e" Jul 17 17:42:25.216529 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:42:25.216509 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64498c6889f4ceb5db4b3157528d0929fc9da7f418d25374220cc0b3d866cd0e\": container with ID starting with 64498c6889f4ceb5db4b3157528d0929fc9da7f418d25374220cc0b3d866cd0e not found: ID does not exist" containerID="64498c6889f4ceb5db4b3157528d0929fc9da7f418d25374220cc0b3d866cd0e" Jul 17 17:42:25.216587 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.216535 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64498c6889f4ceb5db4b3157528d0929fc9da7f418d25374220cc0b3d866cd0e"} err="failed to get container status \"64498c6889f4ceb5db4b3157528d0929fc9da7f418d25374220cc0b3d866cd0e\": rpc error: code = NotFound desc = could not find container \"64498c6889f4ceb5db4b3157528d0929fc9da7f418d25374220cc0b3d866cd0e\": container with ID starting with 64498c6889f4ceb5db4b3157528d0929fc9da7f418d25374220cc0b3d866cd0e not found: ID does not exist" Jul 17 17:42:25.216587 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.216549 2563 scope.go:117] "RemoveContainer" containerID="a5aff5d0ff3ae7f2d1a182deac5b6312792e7e51baeb9ce1170b5cb663307797" Jul 17 17:42:25.216772 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:42:25.216756 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5aff5d0ff3ae7f2d1a182deac5b6312792e7e51baeb9ce1170b5cb663307797\": container with ID starting with a5aff5d0ff3ae7f2d1a182deac5b6312792e7e51baeb9ce1170b5cb663307797 not found: ID does not exist" containerID="a5aff5d0ff3ae7f2d1a182deac5b6312792e7e51baeb9ce1170b5cb663307797" Jul 17 17:42:25.216807 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.216776 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5aff5d0ff3ae7f2d1a182deac5b6312792e7e51baeb9ce1170b5cb663307797"} err="failed to get container status \"a5aff5d0ff3ae7f2d1a182deac5b6312792e7e51baeb9ce1170b5cb663307797\": rpc error: code = NotFound desc = could not find container \"a5aff5d0ff3ae7f2d1a182deac5b6312792e7e51baeb9ce1170b5cb663307797\": container with ID starting with a5aff5d0ff3ae7f2d1a182deac5b6312792e7e51baeb9ce1170b5cb663307797 not found: ID does not exist" Jul 17 17:42:25.216807 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.216789 2563 scope.go:117] "RemoveContainer" containerID="d406aa319d0a39720b2f961e597da1387297eae115e452704e9d3b9745c654d8" Jul 17 17:42:25.217023 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:42:25.216999 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d406aa319d0a39720b2f961e597da1387297eae115e452704e9d3b9745c654d8\": container with ID starting with d406aa319d0a39720b2f961e597da1387297eae115e452704e9d3b9745c654d8 not found: ID does not exist" containerID="d406aa319d0a39720b2f961e597da1387297eae115e452704e9d3b9745c654d8" Jul 17 17:42:25.217070 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217031 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d406aa319d0a39720b2f961e597da1387297eae115e452704e9d3b9745c654d8"} err="failed to get container status \"d406aa319d0a39720b2f961e597da1387297eae115e452704e9d3b9745c654d8\": rpc error: code = NotFound desc = could not find container \"d406aa319d0a39720b2f961e597da1387297eae115e452704e9d3b9745c654d8\": container with ID starting with d406aa319d0a39720b2f961e597da1387297eae115e452704e9d3b9745c654d8 not found: ID does not exist" Jul 17 17:42:25.217070 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217052 2563 scope.go:117] "RemoveContainer" containerID="801adbc36acf39830c91c9eb980588f0119f758d159011d0450ad5e818bae231" Jul 17 17:42:25.217294 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217276 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"801adbc36acf39830c91c9eb980588f0119f758d159011d0450ad5e818bae231"} err="failed to get container status \"801adbc36acf39830c91c9eb980588f0119f758d159011d0450ad5e818bae231\": rpc error: code = NotFound desc = could not find container \"801adbc36acf39830c91c9eb980588f0119f758d159011d0450ad5e818bae231\": container with ID starting with 801adbc36acf39830c91c9eb980588f0119f758d159011d0450ad5e818bae231 not found: ID does not exist" Jul 17 17:42:25.217342 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217294 2563 scope.go:117] "RemoveContainer" containerID="1edac5ba23e64837c904baaa6304a41e12633b7bf29b95f3579ad80dd13abbcc" Jul 17 17:42:25.217435 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217420 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 17:42:25.217558 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217542 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1edac5ba23e64837c904baaa6304a41e12633b7bf29b95f3579ad80dd13abbcc"} err="failed to get container status \"1edac5ba23e64837c904baaa6304a41e12633b7bf29b95f3579ad80dd13abbcc\": rpc error: code = NotFound desc = could not find container \"1edac5ba23e64837c904baaa6304a41e12633b7bf29b95f3579ad80dd13abbcc\": container with ID starting with 1edac5ba23e64837c904baaa6304a41e12633b7bf29b95f3579ad80dd13abbcc not found: ID does not exist" Jul 17 17:42:25.217607 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217559 2563 scope.go:117] "RemoveContainer" containerID="b7496898f0056743838b381f2d57de4bd064544ad70165adf271bbb102706e6b" Jul 17 17:42:25.217762 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217748 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7496898f0056743838b381f2d57de4bd064544ad70165adf271bbb102706e6b"} err="failed to get container status \"b7496898f0056743838b381f2d57de4bd064544ad70165adf271bbb102706e6b\": rpc error: code = NotFound desc = could not find container \"b7496898f0056743838b381f2d57de4bd064544ad70165adf271bbb102706e6b\": container with ID starting with b7496898f0056743838b381f2d57de4bd064544ad70165adf271bbb102706e6b not found: ID does not exist" Jul 17 17:42:25.217762 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217762 2563 scope.go:117] "RemoveContainer" containerID="9dafbc4ae2e7c9f7a11b1b9d224fc8d2c487de876fe69eed20ffbc184bee2b3d" Jul 17 17:42:25.217830 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217767 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerName="prom-label-proxy" Jul 17 17:42:25.217830 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217778 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerName="prom-label-proxy" Jul 17 17:42:25.217830 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217789 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerName="kube-rbac-proxy-metric" Jul 17 17:42:25.217830 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217794 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerName="kube-rbac-proxy-metric" Jul 17 17:42:25.217830 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217804 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerName="kube-rbac-proxy-web" Jul 17 17:42:25.217830 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217810 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerName="kube-rbac-proxy-web" Jul 17 17:42:25.217830 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217823 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f" containerName="registry" Jul 17 17:42:25.217830 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217829 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f" containerName="registry" Jul 17 17:42:25.218115 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217836 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerName="init-config-reloader" Jul 17 17:42:25.218115 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217841 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerName="init-config-reloader" Jul 17 17:42:25.218115 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217853 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerName="alertmanager" Jul 17 17:42:25.218115 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217860 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerName="alertmanager" Jul 17 17:42:25.218115 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217866 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerName="config-reloader" Jul 17 17:42:25.218115 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217871 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerName="config-reloader" Jul 17 17:42:25.218115 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217887 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerName="kube-rbac-proxy" Jul 17 17:42:25.218115 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217892 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerName="kube-rbac-proxy" Jul 17 17:42:25.218115 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217955 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerName="kube-rbac-proxy-metric" Jul 17 17:42:25.218115 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217957 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dafbc4ae2e7c9f7a11b1b9d224fc8d2c487de876fe69eed20ffbc184bee2b3d"} err="failed to get container status \"9dafbc4ae2e7c9f7a11b1b9d224fc8d2c487de876fe69eed20ffbc184bee2b3d\": rpc error: code = NotFound desc = could not find container \"9dafbc4ae2e7c9f7a11b1b9d224fc8d2c487de876fe69eed20ffbc184bee2b3d\": container with ID starting with 9dafbc4ae2e7c9f7a11b1b9d224fc8d2c487de876fe69eed20ffbc184bee2b3d not found: ID does not exist" Jul 17 17:42:25.218115 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217965 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerName="config-reloader" Jul 17 17:42:25.218115 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217969 2563 scope.go:117] "RemoveContainer" containerID="64498c6889f4ceb5db4b3157528d0929fc9da7f418d25374220cc0b3d866cd0e" Jul 17 17:42:25.218115 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217972 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerName="kube-rbac-proxy-web" Jul 17 17:42:25.218115 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217978 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerName="kube-rbac-proxy" Jul 17 17:42:25.218115 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217984 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8842fb59-c30d-46ea-a5d8-4e2bd6d2dd6f" containerName="registry" Jul 17 17:42:25.218115 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217990 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerName="alertmanager" Jul 17 17:42:25.218115 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.217995 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" containerName="prom-label-proxy" Jul 17 17:42:25.218742 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.218200 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64498c6889f4ceb5db4b3157528d0929fc9da7f418d25374220cc0b3d866cd0e"} err="failed to get container status \"64498c6889f4ceb5db4b3157528d0929fc9da7f418d25374220cc0b3d866cd0e\": rpc error: code = NotFound desc = could not find container \"64498c6889f4ceb5db4b3157528d0929fc9da7f418d25374220cc0b3d866cd0e\": container with ID starting with 64498c6889f4ceb5db4b3157528d0929fc9da7f418d25374220cc0b3d866cd0e not found: ID does not exist" Jul 17 17:42:25.218742 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.218221 2563 scope.go:117] "RemoveContainer" containerID="a5aff5d0ff3ae7f2d1a182deac5b6312792e7e51baeb9ce1170b5cb663307797" Jul 17 17:42:25.218742 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.218522 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5aff5d0ff3ae7f2d1a182deac5b6312792e7e51baeb9ce1170b5cb663307797"} err="failed to get container status \"a5aff5d0ff3ae7f2d1a182deac5b6312792e7e51baeb9ce1170b5cb663307797\": rpc error: code = NotFound desc = could not find container \"a5aff5d0ff3ae7f2d1a182deac5b6312792e7e51baeb9ce1170b5cb663307797\": container with ID starting with a5aff5d0ff3ae7f2d1a182deac5b6312792e7e51baeb9ce1170b5cb663307797 not found: ID does not exist" Jul 17 17:42:25.218742 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.218545 2563 scope.go:117] "RemoveContainer" containerID="d406aa319d0a39720b2f961e597da1387297eae115e452704e9d3b9745c654d8" Jul 17 17:42:25.218912 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.218800 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d406aa319d0a39720b2f961e597da1387297eae115e452704e9d3b9745c654d8"} err="failed to get container status \"d406aa319d0a39720b2f961e597da1387297eae115e452704e9d3b9745c654d8\": rpc error: code = NotFound desc = could not find container \"d406aa319d0a39720b2f961e597da1387297eae115e452704e9d3b9745c654d8\": container with ID starting with d406aa319d0a39720b2f961e597da1387297eae115e452704e9d3b9745c654d8 not found: ID does not exist" Jul 17 17:42:25.224302 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.224283 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.227846 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.227820 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 17 17:42:25.227943 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.227917 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 17 17:42:25.228032 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.228012 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-98jts\"" Jul 17 17:42:25.228337 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.228320 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 17 17:42:25.228430 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.228412 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 17 17:42:25.228511 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.228493 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 17 17:42:25.228668 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.228647 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 17 17:42:25.228768 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.228701 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 17 17:42:25.231879 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.231859 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 17 17:42:25.236037 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.236018 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 17 17:42:25.240741 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.240721 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 17:42:25.383167 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.383132 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d223849f-f51a-44c2-8088-31ec8e118084-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.383167 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.383172 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d223849f-f51a-44c2-8088-31ec8e118084-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.383409 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.383200 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d223849f-f51a-44c2-8088-31ec8e118084-config-volume\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.383409 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.383248 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d223849f-f51a-44c2-8088-31ec8e118084-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.383409 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.383307 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d223849f-f51a-44c2-8088-31ec8e118084-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.383409 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.383344 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d223849f-f51a-44c2-8088-31ec8e118084-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.383409 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.383381 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d223849f-f51a-44c2-8088-31ec8e118084-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.383409 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.383410 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d223849f-f51a-44c2-8088-31ec8e118084-config-out\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.383671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.383437 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d223849f-f51a-44c2-8088-31ec8e118084-web-config\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.383671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.383491 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d223849f-f51a-44c2-8088-31ec8e118084-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.383671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.383509 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d223849f-f51a-44c2-8088-31ec8e118084-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.383671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.383536 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d223849f-f51a-44c2-8088-31ec8e118084-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.383671 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.383571 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48w8z\" (UniqueName: \"kubernetes.io/projected/d223849f-f51a-44c2-8088-31ec8e118084-kube-api-access-48w8z\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.484896 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.484861 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d223849f-f51a-44c2-8088-31ec8e118084-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.485350 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.484905 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48w8z\" (UniqueName: \"kubernetes.io/projected/d223849f-f51a-44c2-8088-31ec8e118084-kube-api-access-48w8z\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.485350 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.484933 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d223849f-f51a-44c2-8088-31ec8e118084-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.485350 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.484968 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d223849f-f51a-44c2-8088-31ec8e118084-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.485350 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.485015 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d223849f-f51a-44c2-8088-31ec8e118084-config-volume\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.485350 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.485042 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d223849f-f51a-44c2-8088-31ec8e118084-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.485350 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.485100 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d223849f-f51a-44c2-8088-31ec8e118084-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.485350 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.485125 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d223849f-f51a-44c2-8088-31ec8e118084-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.485350 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.485205 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d223849f-f51a-44c2-8088-31ec8e118084-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.485350 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.485235 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d223849f-f51a-44c2-8088-31ec8e118084-config-out\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.485350 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.485275 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d223849f-f51a-44c2-8088-31ec8e118084-web-config\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.485350 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.485302 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d223849f-f51a-44c2-8088-31ec8e118084-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.485350 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.485334 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d223849f-f51a-44c2-8088-31ec8e118084-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.485954 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.485530 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d223849f-f51a-44c2-8088-31ec8e118084-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.485954 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.485928 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d223849f-f51a-44c2-8088-31ec8e118084-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.486368 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.486337 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d223849f-f51a-44c2-8088-31ec8e118084-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.488065 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.488037 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d223849f-f51a-44c2-8088-31ec8e118084-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.488150 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.488104 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d223849f-f51a-44c2-8088-31ec8e118084-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.488385 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.488342 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d223849f-f51a-44c2-8088-31ec8e118084-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.488811 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.488785 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d223849f-f51a-44c2-8088-31ec8e118084-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.488887 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.488827 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d223849f-f51a-44c2-8088-31ec8e118084-config-out\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.489122 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.489101 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d223849f-f51a-44c2-8088-31ec8e118084-web-config\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.489157 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.489143 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d223849f-f51a-44c2-8088-31ec8e118084-config-volume\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.489625 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.489605 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d223849f-f51a-44c2-8088-31ec8e118084-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.490131 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.490115 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d223849f-f51a-44c2-8088-31ec8e118084-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.494860 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.494836 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48w8z\" (UniqueName: \"kubernetes.io/projected/d223849f-f51a-44c2-8088-31ec8e118084-kube-api-access-48w8z\") pod \"alertmanager-main-0\" (UID: \"d223849f-f51a-44c2-8088-31ec8e118084\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.534601 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.534564 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 17 17:42:25.675926 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:25.675834 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 17:42:25.679124 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:42:25.679099 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd223849f_f51a_44c2_8088_31ec8e118084.slice/crio-987f1c57210a683e7d80aab3be3a10641b2755bcac2922bc069b4bc234c31194 WatchSource:0}: Error finding container 987f1c57210a683e7d80aab3be3a10641b2755bcac2922bc069b4bc234c31194: Status 404 returned error can't find the container with id 987f1c57210a683e7d80aab3be3a10641b2755bcac2922bc069b4bc234c31194 Jul 17 17:42:26.165473 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:26.165369 2563 generic.go:356] "Generic (PLEG): container finished" podID="d223849f-f51a-44c2-8088-31ec8e118084" containerID="01b41896af2d5b1afd1c00f97233a1b0450ac7ad1b7e0cbb6cb3e311552557cc" exitCode=0 Jul 17 17:42:26.165473 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:26.165408 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d223849f-f51a-44c2-8088-31ec8e118084","Type":"ContainerDied","Data":"01b41896af2d5b1afd1c00f97233a1b0450ac7ad1b7e0cbb6cb3e311552557cc"} Jul 17 17:42:26.165646 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:26.165481 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d223849f-f51a-44c2-8088-31ec8e118084","Type":"ContainerStarted","Data":"987f1c57210a683e7d80aab3be3a10641b2755bcac2922bc069b4bc234c31194"} Jul 17 17:42:26.313721 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:26.313672 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b46dad87-81cd-48d8-a9c6-897401f0a6aa" path="/var/lib/kubelet/pods/b46dad87-81cd-48d8-a9c6-897401f0a6aa/volumes" Jul 17 17:42:27.172431 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:27.172397 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d223849f-f51a-44c2-8088-31ec8e118084","Type":"ContainerStarted","Data":"c59e2babcd956c104930ca6a708802f329de498bc45247cbbc9b73b04612f31b"} Jul 17 17:42:27.172847 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:27.172512 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d223849f-f51a-44c2-8088-31ec8e118084","Type":"ContainerStarted","Data":"67848b7350a0a8a4fce94813e93592f59fbeeb196d0e96afa3833a2bfdff48e4"} Jul 17 17:42:27.172847 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:27.172541 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d223849f-f51a-44c2-8088-31ec8e118084","Type":"ContainerStarted","Data":"3881f2956e93d7f03186d8147923c55706f7f95bafbecbbd86c482352fe5e997"} Jul 17 17:42:27.172847 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:27.172564 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d223849f-f51a-44c2-8088-31ec8e118084","Type":"ContainerStarted","Data":"28f2a206ad8f02d8336d299bf08edcf5d6532881bee6fccb0f721113557ff1f8"} Jul 17 17:42:27.172847 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:27.172587 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d223849f-f51a-44c2-8088-31ec8e118084","Type":"ContainerStarted","Data":"63a8f2f68496901ba5e74f978b53a2232290a0581b66718e8457e237bf83c1d0"} Jul 17 17:42:27.172847 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:27.172609 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d223849f-f51a-44c2-8088-31ec8e118084","Type":"ContainerStarted","Data":"4bf68f3f703227693f2b38897abee9b1858400e87bf2b36dbbb33521779c2ded"} Jul 17 17:42:27.204376 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:42:27.204269 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.184362196 podStartE2EDuration="2.204248296s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.8861ms" isStatefulPod=false podCreationTimestamp="2026-07-17 17:42:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:42:27.202071497 +0000 UTC m=+201.386129275" watchObservedRunningTime="2026-07-17 17:42:27.204248296 +0000 UTC m=+201.388306074" Jul 17 17:43:43.734578 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:43.734490 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-j75bj"] Jul 17 17:43:43.738062 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:43.738041 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-j75bj" Jul 17 17:43:43.741685 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:43.741667 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-svmgx\"" Jul 17 17:43:43.741685 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:43.741674 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 17 17:43:43.742548 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:43.742536 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 17 17:43:43.749429 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:43.749408 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-j75bj"] Jul 17 17:43:43.827601 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:43.827563 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb2p8\" (UniqueName: \"kubernetes.io/projected/400dcbb2-118c-48a1-b387-7f2e515143f2-kube-api-access-tb2p8\") pod \"cert-manager-webhook-6486ffd997-j75bj\" (UID: \"400dcbb2-118c-48a1-b387-7f2e515143f2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j75bj" Jul 17 17:43:43.827779 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:43.827620 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/400dcbb2-118c-48a1-b387-7f2e515143f2-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-j75bj\" (UID: \"400dcbb2-118c-48a1-b387-7f2e515143f2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j75bj" Jul 17 17:43:43.928834 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:43.928806 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/400dcbb2-118c-48a1-b387-7f2e515143f2-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-j75bj\" (UID: \"400dcbb2-118c-48a1-b387-7f2e515143f2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j75bj" Jul 17 17:43:43.928970 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:43.928865 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tb2p8\" (UniqueName: \"kubernetes.io/projected/400dcbb2-118c-48a1-b387-7f2e515143f2-kube-api-access-tb2p8\") pod \"cert-manager-webhook-6486ffd997-j75bj\" (UID: \"400dcbb2-118c-48a1-b387-7f2e515143f2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j75bj" Jul 17 17:43:43.940128 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:43.940091 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/400dcbb2-118c-48a1-b387-7f2e515143f2-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-j75bj\" (UID: \"400dcbb2-118c-48a1-b387-7f2e515143f2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j75bj" Jul 17 17:43:43.940645 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:43.940627 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb2p8\" (UniqueName: \"kubernetes.io/projected/400dcbb2-118c-48a1-b387-7f2e515143f2-kube-api-access-tb2p8\") pod \"cert-manager-webhook-6486ffd997-j75bj\" (UID: \"400dcbb2-118c-48a1-b387-7f2e515143f2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j75bj" Jul 17 17:43:44.046432 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:44.046351 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-j75bj" Jul 17 17:43:44.184190 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:44.184158 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-j75bj"] Jul 17 17:43:44.187913 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:43:44.187886 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod400dcbb2_118c_48a1_b387_7f2e515143f2.slice/crio-707639a71498faf54288607f9717d0c872781005bf2f3146ec372e56529e82cf WatchSource:0}: Error finding container 707639a71498faf54288607f9717d0c872781005bf2f3146ec372e56529e82cf: Status 404 returned error can't find the container with id 707639a71498faf54288607f9717d0c872781005bf2f3146ec372e56529e82cf Jul 17 17:43:44.456686 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:44.456608 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-j75bj" event={"ID":"400dcbb2-118c-48a1-b387-7f2e515143f2","Type":"ContainerStarted","Data":"707639a71498faf54288607f9717d0c872781005bf2f3146ec372e56529e82cf"} Jul 17 17:43:46.877668 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:46.877622 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mlrjp"] Jul 17 17:43:46.881572 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:46.881550 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mlrjp" Jul 17 17:43:46.884162 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:46.884138 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-m4x6c\"" Jul 17 17:43:46.890072 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:46.890049 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mlrjp"] Jul 17 17:43:46.954078 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:46.954036 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k47k\" (UniqueName: \"kubernetes.io/projected/53b26c75-e4b9-4c84-88f1-f1fb8d40ff0a-kube-api-access-4k47k\") pod \"cert-manager-cainjector-559cdd8c87-mlrjp\" (UID: \"53b26c75-e4b9-4c84-88f1-f1fb8d40ff0a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mlrjp" Jul 17 17:43:46.954263 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:46.954118 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53b26c75-e4b9-4c84-88f1-f1fb8d40ff0a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mlrjp\" (UID: \"53b26c75-e4b9-4c84-88f1-f1fb8d40ff0a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mlrjp" Jul 17 17:43:47.054590 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:47.054556 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k47k\" (UniqueName: \"kubernetes.io/projected/53b26c75-e4b9-4c84-88f1-f1fb8d40ff0a-kube-api-access-4k47k\") pod \"cert-manager-cainjector-559cdd8c87-mlrjp\" (UID: \"53b26c75-e4b9-4c84-88f1-f1fb8d40ff0a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mlrjp" Jul 17 17:43:47.054792 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:47.054620 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53b26c75-e4b9-4c84-88f1-f1fb8d40ff0a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mlrjp\" (UID: \"53b26c75-e4b9-4c84-88f1-f1fb8d40ff0a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mlrjp" Jul 17 17:43:47.065570 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:47.065538 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53b26c75-e4b9-4c84-88f1-f1fb8d40ff0a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mlrjp\" (UID: \"53b26c75-e4b9-4c84-88f1-f1fb8d40ff0a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mlrjp" Jul 17 17:43:47.065725 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:47.065686 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k47k\" (UniqueName: \"kubernetes.io/projected/53b26c75-e4b9-4c84-88f1-f1fb8d40ff0a-kube-api-access-4k47k\") pod \"cert-manager-cainjector-559cdd8c87-mlrjp\" (UID: \"53b26c75-e4b9-4c84-88f1-f1fb8d40ff0a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mlrjp" Jul 17 17:43:47.192830 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:47.192738 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mlrjp" Jul 17 17:43:47.513588 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:47.513556 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mlrjp"] Jul 17 17:43:47.516435 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:43:47.516408 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53b26c75_e4b9_4c84_88f1_f1fb8d40ff0a.slice/crio-7483773a8ab16b92b0a38b15fa415bdbee2dbdacd2885083e81ccc26f033546f WatchSource:0}: Error finding container 7483773a8ab16b92b0a38b15fa415bdbee2dbdacd2885083e81ccc26f033546f: Status 404 returned error can't find the container with id 7483773a8ab16b92b0a38b15fa415bdbee2dbdacd2885083e81ccc26f033546f Jul 17 17:43:48.476184 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:48.476147 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-j75bj" event={"ID":"400dcbb2-118c-48a1-b387-7f2e515143f2","Type":"ContainerStarted","Data":"e1519efeca34b6084e67c3cecf509de3adc5380745c1a0e5972a3e09396c5aaf"} Jul 17 17:43:48.476636 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:48.476204 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-j75bj" Jul 17 17:43:48.477716 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:48.477692 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mlrjp" event={"ID":"53b26c75-e4b9-4c84-88f1-f1fb8d40ff0a","Type":"ContainerStarted","Data":"1f672569e3c9f663a2eb172d908de04387aed7718be4f7d5b8fad9595f2e9e48"} Jul 17 17:43:48.477826 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:48.477721 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mlrjp" event={"ID":"53b26c75-e4b9-4c84-88f1-f1fb8d40ff0a","Type":"ContainerStarted","Data":"7483773a8ab16b92b0a38b15fa415bdbee2dbdacd2885083e81ccc26f033546f"} Jul 17 17:43:48.495300 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:48.495246 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-j75bj" podStartSLOduration=2.241119129 podStartE2EDuration="5.495229788s" totalImagesPullingTime="3.254110659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:43:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:43:48.494365225 +0000 UTC m=+282.678423003" watchObservedRunningTime="2026-07-17 17:43:48.495229788 +0000 UTC m=+282.679287564" Jul 17 17:43:48.515370 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:48.515259 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mlrjp" podStartSLOduration=2.515240561 podStartE2EDuration="2.515240561s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:43:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:43:48.513971385 +0000 UTC m=+282.698029163" watchObservedRunningTime="2026-07-17 17:43:48.515240561 +0000 UTC m=+282.699298337" Jul 17 17:43:54.483965 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:43:54.483933 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-j75bj" Jul 17 17:44:06.149304 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:06.149270 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lkfst_b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c/ovn-acl-logging/0.log" Jul 17 17:44:06.151518 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:06.151494 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lkfst_b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c/ovn-acl-logging/0.log" Jul 17 17:44:06.153219 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:06.153201 2563 kubelet.go:1648] "Image garbage collection succeeded" Jul 17 17:44:15.646680 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:15.643879 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7467c84498-kv6tk"] Jul 17 17:44:15.649019 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:15.648917 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7467c84498-kv6tk" Jul 17 17:44:15.651670 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:15.651642 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 17 17:44:15.651814 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:15.651671 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 17 17:44:15.651814 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:15.651752 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 17 17:44:15.651814 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:15.651759 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-76xkw\"" Jul 17 17:44:15.652002 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:15.651888 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 17 17:44:15.675495 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:15.675463 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7467c84498-kv6tk"] Jul 17 17:44:15.799908 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:15.799867 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e5ca9048-fe22-45d9-8e76-706544527f39-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7467c84498-kv6tk\" (UID: \"e5ca9048-fe22-45d9-8e76-706544527f39\") " pod="opendatahub/opendatahub-operator-controller-manager-7467c84498-kv6tk" Jul 17 17:44:15.800121 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:15.799935 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrz6p\" (UniqueName: \"kubernetes.io/projected/e5ca9048-fe22-45d9-8e76-706544527f39-kube-api-access-vrz6p\") pod \"opendatahub-operator-controller-manager-7467c84498-kv6tk\" (UID: \"e5ca9048-fe22-45d9-8e76-706544527f39\") " pod="opendatahub/opendatahub-operator-controller-manager-7467c84498-kv6tk" Jul 17 17:44:15.800121 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:15.799978 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e5ca9048-fe22-45d9-8e76-706544527f39-manifests\") pod \"opendatahub-operator-controller-manager-7467c84498-kv6tk\" (UID: \"e5ca9048-fe22-45d9-8e76-706544527f39\") " pod="opendatahub/opendatahub-operator-controller-manager-7467c84498-kv6tk" Jul 17 17:44:15.800121 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:15.800042 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5ca9048-fe22-45d9-8e76-706544527f39-tmp\") pod \"opendatahub-operator-controller-manager-7467c84498-kv6tk\" (UID: \"e5ca9048-fe22-45d9-8e76-706544527f39\") " pod="opendatahub/opendatahub-operator-controller-manager-7467c84498-kv6tk" Jul 17 17:44:15.800121 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:15.800083 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e5ca9048-fe22-45d9-8e76-706544527f39-webhook-cert\") pod \"opendatahub-operator-controller-manager-7467c84498-kv6tk\" (UID: \"e5ca9048-fe22-45d9-8e76-706544527f39\") " pod="opendatahub/opendatahub-operator-controller-manager-7467c84498-kv6tk" Jul 17 17:44:15.900761 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:15.900690 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrz6p\" (UniqueName: \"kubernetes.io/projected/e5ca9048-fe22-45d9-8e76-706544527f39-kube-api-access-vrz6p\") pod \"opendatahub-operator-controller-manager-7467c84498-kv6tk\" (UID: \"e5ca9048-fe22-45d9-8e76-706544527f39\") " pod="opendatahub/opendatahub-operator-controller-manager-7467c84498-kv6tk" Jul 17 17:44:15.900761 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:15.900739 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e5ca9048-fe22-45d9-8e76-706544527f39-manifests\") pod \"opendatahub-operator-controller-manager-7467c84498-kv6tk\" (UID: \"e5ca9048-fe22-45d9-8e76-706544527f39\") " pod="opendatahub/opendatahub-operator-controller-manager-7467c84498-kv6tk" Jul 17 17:44:15.900935 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:15.900763 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5ca9048-fe22-45d9-8e76-706544527f39-tmp\") pod \"opendatahub-operator-controller-manager-7467c84498-kv6tk\" (UID: \"e5ca9048-fe22-45d9-8e76-706544527f39\") " pod="opendatahub/opendatahub-operator-controller-manager-7467c84498-kv6tk" Jul 17 17:44:15.900935 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:15.900790 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e5ca9048-fe22-45d9-8e76-706544527f39-webhook-cert\") pod \"opendatahub-operator-controller-manager-7467c84498-kv6tk\" (UID: \"e5ca9048-fe22-45d9-8e76-706544527f39\") " pod="opendatahub/opendatahub-operator-controller-manager-7467c84498-kv6tk" Jul 17 17:44:15.900935 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:15.900817 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e5ca9048-fe22-45d9-8e76-706544527f39-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7467c84498-kv6tk\" (UID: \"e5ca9048-fe22-45d9-8e76-706544527f39\") " pod="opendatahub/opendatahub-operator-controller-manager-7467c84498-kv6tk" Jul 17 17:44:15.901179 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:15.901157 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e5ca9048-fe22-45d9-8e76-706544527f39-manifests\") pod \"opendatahub-operator-controller-manager-7467c84498-kv6tk\" (UID: \"e5ca9048-fe22-45d9-8e76-706544527f39\") " pod="opendatahub/opendatahub-operator-controller-manager-7467c84498-kv6tk" Jul 17 17:44:15.903172 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:15.903148 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5ca9048-fe22-45d9-8e76-706544527f39-tmp\") pod \"opendatahub-operator-controller-manager-7467c84498-kv6tk\" (UID: \"e5ca9048-fe22-45d9-8e76-706544527f39\") " pod="opendatahub/opendatahub-operator-controller-manager-7467c84498-kv6tk" Jul 17 17:44:15.903480 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:15.903459 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e5ca9048-fe22-45d9-8e76-706544527f39-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7467c84498-kv6tk\" (UID: \"e5ca9048-fe22-45d9-8e76-706544527f39\") " pod="opendatahub/opendatahub-operator-controller-manager-7467c84498-kv6tk" Jul 17 17:44:15.903557 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:15.903536 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e5ca9048-fe22-45d9-8e76-706544527f39-webhook-cert\") pod \"opendatahub-operator-controller-manager-7467c84498-kv6tk\" (UID: \"e5ca9048-fe22-45d9-8e76-706544527f39\") " pod="opendatahub/opendatahub-operator-controller-manager-7467c84498-kv6tk" Jul 17 17:44:15.910416 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:15.910394 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrz6p\" (UniqueName: \"kubernetes.io/projected/e5ca9048-fe22-45d9-8e76-706544527f39-kube-api-access-vrz6p\") pod \"opendatahub-operator-controller-manager-7467c84498-kv6tk\" (UID: \"e5ca9048-fe22-45d9-8e76-706544527f39\") " pod="opendatahub/opendatahub-operator-controller-manager-7467c84498-kv6tk" Jul 17 17:44:15.959409 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:15.959367 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7467c84498-kv6tk" Jul 17 17:44:16.105629 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:16.105595 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7467c84498-kv6tk"] Jul 17 17:44:16.108990 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:44:16.108958 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5ca9048_fe22_45d9_8e76_706544527f39.slice/crio-fd7073df48c3c27547f4f2519f4c8ed171c5491b1ea471b41258fbfa9c3579d7 WatchSource:0}: Error finding container fd7073df48c3c27547f4f2519f4c8ed171c5491b1ea471b41258fbfa9c3579d7: Status 404 returned error can't find the container with id fd7073df48c3c27547f4f2519f4c8ed171c5491b1ea471b41258fbfa9c3579d7 Jul 17 17:44:16.110864 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:16.110843 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 17:44:16.593651 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:16.593612 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7467c84498-kv6tk" event={"ID":"e5ca9048-fe22-45d9-8e76-706544527f39","Type":"ContainerStarted","Data":"fd7073df48c3c27547f4f2519f4c8ed171c5491b1ea471b41258fbfa9c3579d7"} Jul 17 17:44:19.609501 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:19.609455 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7467c84498-kv6tk" event={"ID":"e5ca9048-fe22-45d9-8e76-706544527f39","Type":"ContainerStarted","Data":"f4ebbcaade88c5f24b19e5b65157eaa66153f1db13df13a8aa4d1a48a73b9f43"} Jul 17 17:44:20.615126 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:20.615091 2563 generic.go:356] "Generic (PLEG): container finished" podID="e5ca9048-fe22-45d9-8e76-706544527f39" containerID="f4ebbcaade88c5f24b19e5b65157eaa66153f1db13df13a8aa4d1a48a73b9f43" exitCode=0 Jul 17 17:44:20.615591 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:20.615160 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7467c84498-kv6tk" event={"ID":"e5ca9048-fe22-45d9-8e76-706544527f39","Type":"ContainerDied","Data":"f4ebbcaade88c5f24b19e5b65157eaa66153f1db13df13a8aa4d1a48a73b9f43"} Jul 17 17:44:21.621911 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:21.621816 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7467c84498-kv6tk" event={"ID":"e5ca9048-fe22-45d9-8e76-706544527f39","Type":"ContainerStarted","Data":"1196ba42cab2193c6e33902288955b5f486a608c2206cab288ca84650a79253e"} Jul 17 17:44:21.622269 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:21.621969 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7467c84498-kv6tk" Jul 17 17:44:21.655617 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:21.655571 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7467c84498-kv6tk" podStartSLOduration=2.075236827 podStartE2EDuration="6.655553662s" totalImagesPullingTime="3.482564716s" totalInitContainerRuntime="1.097752119s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:44:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:44:21.654408259 +0000 UTC m=+315.838466036" watchObservedRunningTime="2026-07-17 17:44:21.655553662 +0000 UTC m=+315.839611439" Jul 17 17:44:32.628201 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:32.628167 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7467c84498-kv6tk" Jul 17 17:44:35.711467 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:35.711417 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-c67cg"] Jul 17 17:44:35.714729 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:35.714713 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-c67cg" Jul 17 17:44:35.717392 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:35.717375 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 17 17:44:35.727318 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:35.727292 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-c67cg"] Jul 17 17:44:35.760865 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:35.760841 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr58h\" (UniqueName: \"kubernetes.io/projected/52e9ba48-5c48-49cc-bd37-997fcdff80c4-kube-api-access-fr58h\") pod \"model-serving-api-54d89bd5fc-c67cg\" (UID: \"52e9ba48-5c48-49cc-bd37-997fcdff80c4\") " pod="opendatahub/model-serving-api-54d89bd5fc-c67cg" Jul 17 17:44:35.761005 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:35.760913 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52e9ba48-5c48-49cc-bd37-997fcdff80c4-tls-certs\") pod \"model-serving-api-54d89bd5fc-c67cg\" (UID: \"52e9ba48-5c48-49cc-bd37-997fcdff80c4\") " pod="opendatahub/model-serving-api-54d89bd5fc-c67cg" Jul 17 17:44:35.862213 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:35.862178 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52e9ba48-5c48-49cc-bd37-997fcdff80c4-tls-certs\") pod \"model-serving-api-54d89bd5fc-c67cg\" (UID: \"52e9ba48-5c48-49cc-bd37-997fcdff80c4\") " pod="opendatahub/model-serving-api-54d89bd5fc-c67cg" Jul 17 17:44:35.862383 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:35.862235 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr58h\" (UniqueName: \"kubernetes.io/projected/52e9ba48-5c48-49cc-bd37-997fcdff80c4-kube-api-access-fr58h\") pod \"model-serving-api-54d89bd5fc-c67cg\" (UID: \"52e9ba48-5c48-49cc-bd37-997fcdff80c4\") " pod="opendatahub/model-serving-api-54d89bd5fc-c67cg" Jul 17 17:44:35.862383 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:44:35.862334 2563 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 17 17:44:35.862488 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:44:35.862399 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52e9ba48-5c48-49cc-bd37-997fcdff80c4-tls-certs podName:52e9ba48-5c48-49cc-bd37-997fcdff80c4 nodeName:}" failed. No retries permitted until 2026-07-17 17:44:36.362383056 +0000 UTC m=+330.546440810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/52e9ba48-5c48-49cc-bd37-997fcdff80c4-tls-certs") pod "model-serving-api-54d89bd5fc-c67cg" (UID: "52e9ba48-5c48-49cc-bd37-997fcdff80c4") : secret "model-serving-api-tls" not found Jul 17 17:44:35.871652 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:35.871632 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr58h\" (UniqueName: \"kubernetes.io/projected/52e9ba48-5c48-49cc-bd37-997fcdff80c4-kube-api-access-fr58h\") pod \"model-serving-api-54d89bd5fc-c67cg\" (UID: \"52e9ba48-5c48-49cc-bd37-997fcdff80c4\") " pod="opendatahub/model-serving-api-54d89bd5fc-c67cg" Jul 17 17:44:36.365657 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:36.365619 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52e9ba48-5c48-49cc-bd37-997fcdff80c4-tls-certs\") pod \"model-serving-api-54d89bd5fc-c67cg\" (UID: \"52e9ba48-5c48-49cc-bd37-997fcdff80c4\") " pod="opendatahub/model-serving-api-54d89bd5fc-c67cg" Jul 17 17:44:36.368099 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:36.368075 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52e9ba48-5c48-49cc-bd37-997fcdff80c4-tls-certs\") pod \"model-serving-api-54d89bd5fc-c67cg\" (UID: \"52e9ba48-5c48-49cc-bd37-997fcdff80c4\") " pod="opendatahub/model-serving-api-54d89bd5fc-c67cg" Jul 17 17:44:36.624953 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:36.624862 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-c67cg" Jul 17 17:44:36.758119 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:36.758032 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-c67cg"] Jul 17 17:44:36.760857 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:44:36.760830 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52e9ba48_5c48_49cc_bd37_997fcdff80c4.slice/crio-3f6d24acc5d7627b397d7090ebc21414e6b28099ac2e0cbc0fa5f6671725992b WatchSource:0}: Error finding container 3f6d24acc5d7627b397d7090ebc21414e6b28099ac2e0cbc0fa5f6671725992b: Status 404 returned error can't find the container with id 3f6d24acc5d7627b397d7090ebc21414e6b28099ac2e0cbc0fa5f6671725992b Jul 17 17:44:37.691001 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:37.690948 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-c67cg" event={"ID":"52e9ba48-5c48-49cc-bd37-997fcdff80c4","Type":"ContainerStarted","Data":"3f6d24acc5d7627b397d7090ebc21414e6b28099ac2e0cbc0fa5f6671725992b"} Jul 17 17:44:38.696973 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:38.696889 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-c67cg" event={"ID":"52e9ba48-5c48-49cc-bd37-997fcdff80c4","Type":"ContainerStarted","Data":"eb1acdf4eb175efa5f088a73bc235193de1ca9000258d6c58db3acc3f0ad17a8"} Jul 17 17:44:38.696973 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:38.696971 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-c67cg" Jul 17 17:44:38.715753 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:38.715704 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-c67cg" podStartSLOduration=2.084386869 podStartE2EDuration="3.715690584s" totalImagesPullingTime="1.631303715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:44:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:44:38.714943196 +0000 UTC m=+332.899000973" watchObservedRunningTime="2026-07-17 17:44:38.715690584 +0000 UTC m=+332.899748361" Jul 17 17:44:42.671181 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:42.671143 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-855d9d8444-wjhnz"] Jul 17 17:44:42.674533 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:42.674517 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-855d9d8444-wjhnz" Jul 17 17:44:42.678258 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:42.678235 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 17 17:44:42.681356 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:42.681192 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 17 17:44:42.681356 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:42.681223 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 17 17:44:42.681356 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:42.681300 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 17 17:44:42.681356 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:42.681348 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qh288\"" Jul 17 17:44:42.681598 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:42.681200 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 17 17:44:42.686196 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:42.686176 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-855d9d8444-wjhnz"] Jul 17 17:44:42.711000 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:42.710961 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb9pd\" (UniqueName: \"kubernetes.io/projected/4c89f493-d645-4590-9aac-0f2dbadd99b7-kube-api-access-wb9pd\") pod \"lws-controller-manager-855d9d8444-wjhnz\" (UID: \"4c89f493-d645-4590-9aac-0f2dbadd99b7\") " pod="openshift-lws-operator/lws-controller-manager-855d9d8444-wjhnz" Jul 17 17:44:42.711000 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:42.711003 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4c89f493-d645-4590-9aac-0f2dbadd99b7-metrics-cert\") pod \"lws-controller-manager-855d9d8444-wjhnz\" (UID: \"4c89f493-d645-4590-9aac-0f2dbadd99b7\") " pod="openshift-lws-operator/lws-controller-manager-855d9d8444-wjhnz" Jul 17 17:44:42.711200 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:42.711077 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4c89f493-d645-4590-9aac-0f2dbadd99b7-manager-config\") pod \"lws-controller-manager-855d9d8444-wjhnz\" (UID: \"4c89f493-d645-4590-9aac-0f2dbadd99b7\") " pod="openshift-lws-operator/lws-controller-manager-855d9d8444-wjhnz" Jul 17 17:44:42.711200 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:42.711116 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c89f493-d645-4590-9aac-0f2dbadd99b7-cert\") pod \"lws-controller-manager-855d9d8444-wjhnz\" (UID: \"4c89f493-d645-4590-9aac-0f2dbadd99b7\") " pod="openshift-lws-operator/lws-controller-manager-855d9d8444-wjhnz" Jul 17 17:44:42.812260 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:42.812219 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c89f493-d645-4590-9aac-0f2dbadd99b7-cert\") pod \"lws-controller-manager-855d9d8444-wjhnz\" (UID: \"4c89f493-d645-4590-9aac-0f2dbadd99b7\") " pod="openshift-lws-operator/lws-controller-manager-855d9d8444-wjhnz" Jul 17 17:44:42.812414 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:42.812269 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb9pd\" (UniqueName: \"kubernetes.io/projected/4c89f493-d645-4590-9aac-0f2dbadd99b7-kube-api-access-wb9pd\") pod \"lws-controller-manager-855d9d8444-wjhnz\" (UID: \"4c89f493-d645-4590-9aac-0f2dbadd99b7\") " pod="openshift-lws-operator/lws-controller-manager-855d9d8444-wjhnz" Jul 17 17:44:42.812414 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:42.812293 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4c89f493-d645-4590-9aac-0f2dbadd99b7-metrics-cert\") pod \"lws-controller-manager-855d9d8444-wjhnz\" (UID: \"4c89f493-d645-4590-9aac-0f2dbadd99b7\") " pod="openshift-lws-operator/lws-controller-manager-855d9d8444-wjhnz" Jul 17 17:44:42.812414 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:42.812339 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4c89f493-d645-4590-9aac-0f2dbadd99b7-manager-config\") pod \"lws-controller-manager-855d9d8444-wjhnz\" (UID: \"4c89f493-d645-4590-9aac-0f2dbadd99b7\") " pod="openshift-lws-operator/lws-controller-manager-855d9d8444-wjhnz" Jul 17 17:44:42.812997 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:42.812976 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4c89f493-d645-4590-9aac-0f2dbadd99b7-manager-config\") pod \"lws-controller-manager-855d9d8444-wjhnz\" (UID: \"4c89f493-d645-4590-9aac-0f2dbadd99b7\") " pod="openshift-lws-operator/lws-controller-manager-855d9d8444-wjhnz" Jul 17 17:44:42.814967 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:42.814944 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4c89f493-d645-4590-9aac-0f2dbadd99b7-metrics-cert\") pod \"lws-controller-manager-855d9d8444-wjhnz\" (UID: \"4c89f493-d645-4590-9aac-0f2dbadd99b7\") " pod="openshift-lws-operator/lws-controller-manager-855d9d8444-wjhnz" Jul 17 17:44:42.815053 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:42.815000 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c89f493-d645-4590-9aac-0f2dbadd99b7-cert\") pod \"lws-controller-manager-855d9d8444-wjhnz\" (UID: \"4c89f493-d645-4590-9aac-0f2dbadd99b7\") " pod="openshift-lws-operator/lws-controller-manager-855d9d8444-wjhnz" Jul 17 17:44:42.844274 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:42.844240 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb9pd\" (UniqueName: \"kubernetes.io/projected/4c89f493-d645-4590-9aac-0f2dbadd99b7-kube-api-access-wb9pd\") pod \"lws-controller-manager-855d9d8444-wjhnz\" (UID: \"4c89f493-d645-4590-9aac-0f2dbadd99b7\") " pod="openshift-lws-operator/lws-controller-manager-855d9d8444-wjhnz" Jul 17 17:44:42.983735 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:42.983713 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-855d9d8444-wjhnz" Jul 17 17:44:43.121117 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:43.121086 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-855d9d8444-wjhnz"] Jul 17 17:44:43.124462 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:44:43.124416 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c89f493_d645_4590_9aac_0f2dbadd99b7.slice/crio-bd48b5fd79063b9f15fb36f29e325bda96067267afced9b3e206d363659cdcd5 WatchSource:0}: Error finding container bd48b5fd79063b9f15fb36f29e325bda96067267afced9b3e206d363659cdcd5: Status 404 returned error can't find the container with id bd48b5fd79063b9f15fb36f29e325bda96067267afced9b3e206d363659cdcd5 Jul 17 17:44:43.726279 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:43.726231 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-855d9d8444-wjhnz" event={"ID":"4c89f493-d645-4590-9aac-0f2dbadd99b7","Type":"ContainerStarted","Data":"bd48b5fd79063b9f15fb36f29e325bda96067267afced9b3e206d363659cdcd5"} Jul 17 17:44:45.737070 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:45.737030 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-855d9d8444-wjhnz" event={"ID":"4c89f493-d645-4590-9aac-0f2dbadd99b7","Type":"ContainerStarted","Data":"534f188abdb3f822d34ce1e591a875487cfc5dd6a9ad1579e1e8341ea88ecb09"} Jul 17 17:44:45.737495 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:45.737155 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-855d9d8444-wjhnz" Jul 17 17:44:45.785614 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:45.785559 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-855d9d8444-wjhnz" podStartSLOduration=1.5161122599999999 podStartE2EDuration="3.785542544s" totalImagesPullingTime="2.269430284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:44:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:44:45.783030662 +0000 UTC m=+339.967088438" watchObservedRunningTime="2026-07-17 17:44:45.785542544 +0000 UTC m=+339.969600321" Jul 17 17:44:49.705681 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:49.705655 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-c67cg" Jul 17 17:44:54.495313 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.495274 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2"] Jul 17 17:44:54.505577 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.505542 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:54.508529 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.508505 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 17 17:44:54.508529 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.508526 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 17 17:44:54.508746 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.508568 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 17 17:44:54.508746 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.508668 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hzpqd\"" Jul 17 17:44:54.524518 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.524479 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2"] Jul 17 17:44:54.616856 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.616820 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7fdf0f1-7d29-4ff3-a263-558589c3ce0b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44kgm2\" (UID: \"c7fdf0f1-7d29-4ff3-a263-558589c3ce0b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:54.616856 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.616856 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7fdf0f1-7d29-4ff3-a263-558589c3ce0b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44kgm2\" (UID: \"c7fdf0f1-7d29-4ff3-a263-558589c3ce0b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:54.617161 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.616882 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clgjb\" (UniqueName: \"kubernetes.io/projected/c7fdf0f1-7d29-4ff3-a263-558589c3ce0b-kube-api-access-clgjb\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44kgm2\" (UID: \"c7fdf0f1-7d29-4ff3-a263-558589c3ce0b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:54.617161 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.616961 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7fdf0f1-7d29-4ff3-a263-558589c3ce0b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44kgm2\" (UID: \"c7fdf0f1-7d29-4ff3-a263-558589c3ce0b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:54.617161 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.616997 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7fdf0f1-7d29-4ff3-a263-558589c3ce0b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44kgm2\" (UID: \"c7fdf0f1-7d29-4ff3-a263-558589c3ce0b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:54.617161 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.617032 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7fdf0f1-7d29-4ff3-a263-558589c3ce0b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44kgm2\" (UID: \"c7fdf0f1-7d29-4ff3-a263-558589c3ce0b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:54.617161 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.617090 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7fdf0f1-7d29-4ff3-a263-558589c3ce0b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44kgm2\" (UID: \"c7fdf0f1-7d29-4ff3-a263-558589c3ce0b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:54.617161 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.617116 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7fdf0f1-7d29-4ff3-a263-558589c3ce0b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44kgm2\" (UID: \"c7fdf0f1-7d29-4ff3-a263-558589c3ce0b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:54.617364 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.617185 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7fdf0f1-7d29-4ff3-a263-558589c3ce0b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44kgm2\" (UID: \"c7fdf0f1-7d29-4ff3-a263-558589c3ce0b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:54.718607 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.718573 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7fdf0f1-7d29-4ff3-a263-558589c3ce0b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44kgm2\" (UID: \"c7fdf0f1-7d29-4ff3-a263-558589c3ce0b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:54.718802 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.718620 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7fdf0f1-7d29-4ff3-a263-558589c3ce0b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44kgm2\" (UID: \"c7fdf0f1-7d29-4ff3-a263-558589c3ce0b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:54.718802 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.718653 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7fdf0f1-7d29-4ff3-a263-558589c3ce0b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44kgm2\" (UID: \"c7fdf0f1-7d29-4ff3-a263-558589c3ce0b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:54.718802 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.718671 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7fdf0f1-7d29-4ff3-a263-558589c3ce0b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44kgm2\" (UID: \"c7fdf0f1-7d29-4ff3-a263-558589c3ce0b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:54.718802 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.718728 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7fdf0f1-7d29-4ff3-a263-558589c3ce0b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44kgm2\" (UID: \"c7fdf0f1-7d29-4ff3-a263-558589c3ce0b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:54.718802 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.718751 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7fdf0f1-7d29-4ff3-a263-558589c3ce0b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44kgm2\" (UID: \"c7fdf0f1-7d29-4ff3-a263-558589c3ce0b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:54.718802 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.718784 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clgjb\" (UniqueName: \"kubernetes.io/projected/c7fdf0f1-7d29-4ff3-a263-558589c3ce0b-kube-api-access-clgjb\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44kgm2\" (UID: \"c7fdf0f1-7d29-4ff3-a263-558589c3ce0b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:54.719105 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.718816 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7fdf0f1-7d29-4ff3-a263-558589c3ce0b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44kgm2\" (UID: \"c7fdf0f1-7d29-4ff3-a263-558589c3ce0b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:54.719105 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.718843 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7fdf0f1-7d29-4ff3-a263-558589c3ce0b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44kgm2\" (UID: \"c7fdf0f1-7d29-4ff3-a263-558589c3ce0b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:54.719105 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.719053 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7fdf0f1-7d29-4ff3-a263-558589c3ce0b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44kgm2\" (UID: \"c7fdf0f1-7d29-4ff3-a263-558589c3ce0b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:54.719253 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.719169 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7fdf0f1-7d29-4ff3-a263-558589c3ce0b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44kgm2\" (UID: \"c7fdf0f1-7d29-4ff3-a263-558589c3ce0b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:54.719318 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.719297 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7fdf0f1-7d29-4ff3-a263-558589c3ce0b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44kgm2\" (UID: \"c7fdf0f1-7d29-4ff3-a263-558589c3ce0b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:54.719386 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.719367 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7fdf0f1-7d29-4ff3-a263-558589c3ce0b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44kgm2\" (UID: \"c7fdf0f1-7d29-4ff3-a263-558589c3ce0b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:54.719493 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.719476 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7fdf0f1-7d29-4ff3-a263-558589c3ce0b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44kgm2\" (UID: \"c7fdf0f1-7d29-4ff3-a263-558589c3ce0b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:54.721055 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.721036 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7fdf0f1-7d29-4ff3-a263-558589c3ce0b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44kgm2\" (UID: \"c7fdf0f1-7d29-4ff3-a263-558589c3ce0b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:54.721298 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.721281 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7fdf0f1-7d29-4ff3-a263-558589c3ce0b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44kgm2\" (UID: \"c7fdf0f1-7d29-4ff3-a263-558589c3ce0b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:54.728337 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.728308 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clgjb\" (UniqueName: \"kubernetes.io/projected/c7fdf0f1-7d29-4ff3-a263-558589c3ce0b-kube-api-access-clgjb\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44kgm2\" (UID: \"c7fdf0f1-7d29-4ff3-a263-558589c3ce0b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:54.728689 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.728662 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7fdf0f1-7d29-4ff3-a263-558589c3ce0b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44kgm2\" (UID: \"c7fdf0f1-7d29-4ff3-a263-558589c3ce0b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:54.815967 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.815880 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:54.961675 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:54.961521 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2"] Jul 17 17:44:54.964123 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:44:54.964087 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7fdf0f1_7d29_4ff3_a263_558589c3ce0b.slice/crio-377c61252a7d1929ea2a510f7fc0e0dcb14f3bc68faa79dc09bd70f26aa16b4f WatchSource:0}: Error finding container 377c61252a7d1929ea2a510f7fc0e0dcb14f3bc68faa79dc09bd70f26aa16b4f: Status 404 returned error can't find the container with id 377c61252a7d1929ea2a510f7fc0e0dcb14f3bc68faa79dc09bd70f26aa16b4f Jul 17 17:44:55.780168 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:55.780126 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" event={"ID":"c7fdf0f1-7d29-4ff3-a263-558589c3ce0b","Type":"ContainerStarted","Data":"377c61252a7d1929ea2a510f7fc0e0dcb14f3bc68faa79dc09bd70f26aa16b4f"} Jul 17 17:44:56.743136 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:56.743106 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-855d9d8444-wjhnz" Jul 17 17:44:57.776847 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:57.776806 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 17:44:57.777119 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:57.776883 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 17:44:57.777119 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:57.776916 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 17:44:58.795454 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:58.795417 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" event={"ID":"c7fdf0f1-7d29-4ff3-a263-558589c3ce0b","Type":"ContainerStarted","Data":"64fb9384f72bdbe24aeefdb2b924285b34774480b48997be4cd588a6105a3e2f"} Jul 17 17:44:58.816131 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:58.816095 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:58.821399 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:58.821352 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" podStartSLOduration=2.014023564 podStartE2EDuration="4.821335615s" totalImagesPullingTime="2.807312051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:44:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:44:58.820087836 +0000 UTC m=+353.004145613" watchObservedRunningTime="2026-07-17 17:44:58.821335615 +0000 UTC m=+353.005393391" Jul 17 17:44:58.821667 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:58.821648 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:59.799743 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:59.799715 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:44:59.800703 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:44:59.800684 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44kgm2" Jul 17 17:45:36.049454 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:36.049416 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gqczn"] Jul 17 17:45:36.058406 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:36.058379 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gqczn" Jul 17 17:45:36.062628 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:36.062595 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 17 17:45:36.063583 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:36.063563 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 17 17:45:36.063690 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:36.063563 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-27cm9\"" Jul 17 17:45:36.078283 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:36.078255 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gqczn"] Jul 17 17:45:36.094168 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:36.094140 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv2h2\" (UniqueName: \"kubernetes.io/projected/3d100704-be67-4169-9033-09298762b187-kube-api-access-tv2h2\") pod \"kuadrant-operator-catalog-gqczn\" (UID: \"3d100704-be67-4169-9033-09298762b187\") " pod="kuadrant-system/kuadrant-operator-catalog-gqczn" Jul 17 17:45:36.195515 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:36.195481 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv2h2\" (UniqueName: \"kubernetes.io/projected/3d100704-be67-4169-9033-09298762b187-kube-api-access-tv2h2\") pod \"kuadrant-operator-catalog-gqczn\" (UID: \"3d100704-be67-4169-9033-09298762b187\") " pod="kuadrant-system/kuadrant-operator-catalog-gqczn" Jul 17 17:45:36.205457 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:36.205427 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv2h2\" (UniqueName: \"kubernetes.io/projected/3d100704-be67-4169-9033-09298762b187-kube-api-access-tv2h2\") pod \"kuadrant-operator-catalog-gqczn\" (UID: \"3d100704-be67-4169-9033-09298762b187\") " pod="kuadrant-system/kuadrant-operator-catalog-gqczn" Jul 17 17:45:36.369269 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:36.369180 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gqczn" Jul 17 17:45:36.400289 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:36.400250 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gqczn"] Jul 17 17:45:36.516339 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:36.516317 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gqczn"] Jul 17 17:45:36.518979 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:45:36.518952 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d100704_be67_4169_9033_09298762b187.slice/crio-e80af19fc9a6bddca9ecc050797c7f92e890c8385d0c660e39bf2b15360d333b WatchSource:0}: Error finding container e80af19fc9a6bddca9ecc050797c7f92e890c8385d0c660e39bf2b15360d333b: Status 404 returned error can't find the container with id e80af19fc9a6bddca9ecc050797c7f92e890c8385d0c660e39bf2b15360d333b Jul 17 17:45:36.636308 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:36.636227 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-89gfr"] Jul 17 17:45:36.640982 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:36.640962 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-89gfr" Jul 17 17:45:36.666900 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:36.666869 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-89gfr"] Jul 17 17:45:36.699603 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:36.699548 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5zgx\" (UniqueName: \"kubernetes.io/projected/803e3d3d-ed4d-4284-bb57-e10c750430f4-kube-api-access-l5zgx\") pod \"kuadrant-operator-catalog-89gfr\" (UID: \"803e3d3d-ed4d-4284-bb57-e10c750430f4\") " pod="kuadrant-system/kuadrant-operator-catalog-89gfr" Jul 17 17:45:36.800831 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:36.800794 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5zgx\" (UniqueName: \"kubernetes.io/projected/803e3d3d-ed4d-4284-bb57-e10c750430f4-kube-api-access-l5zgx\") pod \"kuadrant-operator-catalog-89gfr\" (UID: \"803e3d3d-ed4d-4284-bb57-e10c750430f4\") " pod="kuadrant-system/kuadrant-operator-catalog-89gfr" Jul 17 17:45:36.815051 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:36.815012 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5zgx\" (UniqueName: \"kubernetes.io/projected/803e3d3d-ed4d-4284-bb57-e10c750430f4-kube-api-access-l5zgx\") pod \"kuadrant-operator-catalog-89gfr\" (UID: \"803e3d3d-ed4d-4284-bb57-e10c750430f4\") " pod="kuadrant-system/kuadrant-operator-catalog-89gfr" Jul 17 17:45:36.950054 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:36.949967 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-89gfr" Jul 17 17:45:36.965420 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:36.965379 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gqczn" event={"ID":"3d100704-be67-4169-9033-09298762b187","Type":"ContainerStarted","Data":"e80af19fc9a6bddca9ecc050797c7f92e890c8385d0c660e39bf2b15360d333b"} Jul 17 17:45:37.090905 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:37.090883 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-89gfr"] Jul 17 17:45:37.093327 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:45:37.093298 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod803e3d3d_ed4d_4284_bb57_e10c750430f4.slice/crio-f49faeb3c3f275a8cc27a88d89c6b3863014615716f107aea559d064ccb53348 WatchSource:0}: Error finding container f49faeb3c3f275a8cc27a88d89c6b3863014615716f107aea559d064ccb53348: Status 404 returned error can't find the container with id f49faeb3c3f275a8cc27a88d89c6b3863014615716f107aea559d064ccb53348 Jul 17 17:45:37.973510 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:37.973466 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-89gfr" event={"ID":"803e3d3d-ed4d-4284-bb57-e10c750430f4","Type":"ContainerStarted","Data":"f49faeb3c3f275a8cc27a88d89c6b3863014615716f107aea559d064ccb53348"} Jul 17 17:45:38.979433 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:38.979392 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-89gfr" event={"ID":"803e3d3d-ed4d-4284-bb57-e10c750430f4","Type":"ContainerStarted","Data":"c8fc367f5f8d0f5429b7d1b10f18391260f10fd7eb001760414f267d963a7156"} Jul 17 17:45:38.980825 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:38.980792 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gqczn" event={"ID":"3d100704-be67-4169-9033-09298762b187","Type":"ContainerStarted","Data":"237100a018ccb3a62665bbd0baa586594c677f68acb910d5802a4b7161baa85d"} Jul 17 17:45:38.980946 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:38.980851 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-gqczn" podUID="3d100704-be67-4169-9033-09298762b187" containerName="registry-server" containerID="cri-o://237100a018ccb3a62665bbd0baa586594c677f68acb910d5802a4b7161baa85d" gracePeriod=2 Jul 17 17:45:39.000828 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:39.000783 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-89gfr" podStartSLOduration=1.452975661 podStartE2EDuration="3.00076706s" totalImagesPullingTime="1.547791399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:45:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:45:38.999182994 +0000 UTC m=+393.183240783" watchObservedRunningTime="2026-07-17 17:45:39.00076706 +0000 UTC m=+393.184824839" Jul 17 17:45:39.018606 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:39.018557 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-gqczn" podStartSLOduration=0.899552875 podStartE2EDuration="3.018542545s" totalImagesPullingTime="2.11898967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:45:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:45:39.016598352 +0000 UTC m=+393.200656130" watchObservedRunningTime="2026-07-17 17:45:39.018542545 +0000 UTC m=+393.202600321" Jul 17 17:45:39.226312 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:39.226288 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gqczn" Jul 17 17:45:39.322618 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:39.322521 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tv2h2\" (UniqueName: \"kubernetes.io/projected/3d100704-be67-4169-9033-09298762b187-kube-api-access-tv2h2\") pod \"3d100704-be67-4169-9033-09298762b187\" (UID: \"3d100704-be67-4169-9033-09298762b187\") " Jul 17 17:45:39.324885 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:39.324856 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d100704-be67-4169-9033-09298762b187-kube-api-access-tv2h2" (OuterVolumeSpecName: "kube-api-access-tv2h2") pod "3d100704-be67-4169-9033-09298762b187" (UID: "3d100704-be67-4169-9033-09298762b187"). InnerVolumeSpecName "kube-api-access-tv2h2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:45:39.423786 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:39.423741 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tv2h2\" (UniqueName: \"kubernetes.io/projected/3d100704-be67-4169-9033-09298762b187-kube-api-access-tv2h2\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:45:39.987017 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:39.986985 2563 generic.go:356] "Generic (PLEG): container finished" podID="3d100704-be67-4169-9033-09298762b187" containerID="237100a018ccb3a62665bbd0baa586594c677f68acb910d5802a4b7161baa85d" exitCode=0 Jul 17 17:45:39.987528 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:39.987041 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gqczn" Jul 17 17:45:39.987528 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:39.987082 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gqczn" event={"ID":"3d100704-be67-4169-9033-09298762b187","Type":"ContainerDied","Data":"237100a018ccb3a62665bbd0baa586594c677f68acb910d5802a4b7161baa85d"} Jul 17 17:45:39.987528 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:39.987135 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gqczn" event={"ID":"3d100704-be67-4169-9033-09298762b187","Type":"ContainerDied","Data":"e80af19fc9a6bddca9ecc050797c7f92e890c8385d0c660e39bf2b15360d333b"} Jul 17 17:45:39.987528 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:39.987156 2563 scope.go:117] "RemoveContainer" containerID="237100a018ccb3a62665bbd0baa586594c677f68acb910d5802a4b7161baa85d" Jul 17 17:45:39.996937 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:39.996912 2563 scope.go:117] "RemoveContainer" containerID="237100a018ccb3a62665bbd0baa586594c677f68acb910d5802a4b7161baa85d" Jul 17 17:45:39.997219 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:45:39.997202 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"237100a018ccb3a62665bbd0baa586594c677f68acb910d5802a4b7161baa85d\": container with ID starting with 237100a018ccb3a62665bbd0baa586594c677f68acb910d5802a4b7161baa85d not found: ID does not exist" containerID="237100a018ccb3a62665bbd0baa586594c677f68acb910d5802a4b7161baa85d" Jul 17 17:45:39.997269 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:39.997229 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"237100a018ccb3a62665bbd0baa586594c677f68acb910d5802a4b7161baa85d"} err="failed to get container status \"237100a018ccb3a62665bbd0baa586594c677f68acb910d5802a4b7161baa85d\": rpc error: code = NotFound desc = could not find container \"237100a018ccb3a62665bbd0baa586594c677f68acb910d5802a4b7161baa85d\": container with ID starting with 237100a018ccb3a62665bbd0baa586594c677f68acb910d5802a4b7161baa85d not found: ID does not exist" Jul 17 17:45:40.009520 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:40.009493 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gqczn"] Jul 17 17:45:40.013711 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:40.013686 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gqczn"] Jul 17 17:45:40.311210 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:40.311119 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d100704-be67-4169-9033-09298762b187" path="/var/lib/kubelet/pods/3d100704-be67-4169-9033-09298762b187/volumes" Jul 17 17:45:46.950873 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:46.950835 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-89gfr" Jul 17 17:45:46.951288 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:46.950895 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-89gfr" Jul 17 17:45:46.973983 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:46.973956 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-89gfr" Jul 17 17:45:47.048091 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:45:47.048052 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-89gfr" Jul 17 17:46:09.766328 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:09.766288 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4kjqg"] Jul 17 17:46:09.766799 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:09.766658 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d100704-be67-4169-9033-09298762b187" containerName="registry-server" Jul 17 17:46:09.766799 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:09.766670 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d100704-be67-4169-9033-09298762b187" containerName="registry-server" Jul 17 17:46:09.766799 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:09.766743 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d100704-be67-4169-9033-09298762b187" containerName="registry-server" Jul 17 17:46:09.771139 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:09.771122 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4kjqg" Jul 17 17:46:09.774132 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:09.774113 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5q5cq\"" Jul 17 17:46:09.791372 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:09.791338 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4kjqg"] Jul 17 17:46:09.903570 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:09.903533 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlwvr\" (UniqueName: \"kubernetes.io/projected/6c1c8894-96ad-4411-b694-a249b04f6f02-kube-api-access-vlwvr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4kjqg\" (UID: \"6c1c8894-96ad-4411-b694-a249b04f6f02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4kjqg" Jul 17 17:46:09.903739 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:09.903603 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c1c8894-96ad-4411-b694-a249b04f6f02-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4kjqg\" (UID: \"6c1c8894-96ad-4411-b694-a249b04f6f02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4kjqg" Jul 17 17:46:10.004626 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:10.004584 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c1c8894-96ad-4411-b694-a249b04f6f02-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4kjqg\" (UID: \"6c1c8894-96ad-4411-b694-a249b04f6f02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4kjqg" Jul 17 17:46:10.004815 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:10.004687 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlwvr\" (UniqueName: \"kubernetes.io/projected/6c1c8894-96ad-4411-b694-a249b04f6f02-kube-api-access-vlwvr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4kjqg\" (UID: \"6c1c8894-96ad-4411-b694-a249b04f6f02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4kjqg" Jul 17 17:46:10.004982 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:10.004959 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c1c8894-96ad-4411-b694-a249b04f6f02-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4kjqg\" (UID: \"6c1c8894-96ad-4411-b694-a249b04f6f02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4kjqg" Jul 17 17:46:10.021209 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:10.021136 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlwvr\" (UniqueName: \"kubernetes.io/projected/6c1c8894-96ad-4411-b694-a249b04f6f02-kube-api-access-vlwvr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4kjqg\" (UID: \"6c1c8894-96ad-4411-b694-a249b04f6f02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4kjqg" Jul 17 17:46:10.081558 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:10.081517 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4kjqg" Jul 17 17:46:10.227540 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:10.227517 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4kjqg"] Jul 17 17:46:10.229433 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:46:10.229405 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c1c8894_96ad_4411_b694_a249b04f6f02.slice/crio-36dd61feb3e21adb33565477afa21b416064cf30a1b163639aaa38caaba409cb WatchSource:0}: Error finding container 36dd61feb3e21adb33565477afa21b416064cf30a1b163639aaa38caaba409cb: Status 404 returned error can't find the container with id 36dd61feb3e21adb33565477afa21b416064cf30a1b163639aaa38caaba409cb Jul 17 17:46:11.132668 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:11.132631 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4kjqg" event={"ID":"6c1c8894-96ad-4411-b694-a249b04f6f02","Type":"ContainerStarted","Data":"36dd61feb3e21adb33565477afa21b416064cf30a1b163639aaa38caaba409cb"} Jul 17 17:46:14.631790 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:14.631749 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-z7k64"] Jul 17 17:46:14.638544 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:14.638526 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z7k64" Jul 17 17:46:14.641269 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:14.641241 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-4fmnf\"" Jul 17 17:46:14.641414 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:14.641273 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 17 17:46:14.646045 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:14.645735 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fx7b\" (UniqueName: \"kubernetes.io/projected/a7b65ba9-383b-48f3-986c-67362fbd2d5b-kube-api-access-4fx7b\") pod \"dns-operator-controller-manager-864dd78c4c-z7k64\" (UID: \"a7b65ba9-383b-48f3-986c-67362fbd2d5b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z7k64" Jul 17 17:46:14.647589 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:14.647566 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-z7k64"] Jul 17 17:46:14.746659 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:14.746624 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fx7b\" (UniqueName: \"kubernetes.io/projected/a7b65ba9-383b-48f3-986c-67362fbd2d5b-kube-api-access-4fx7b\") pod \"dns-operator-controller-manager-864dd78c4c-z7k64\" (UID: \"a7b65ba9-383b-48f3-986c-67362fbd2d5b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z7k64" Jul 17 17:46:14.767028 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:14.766959 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fx7b\" (UniqueName: \"kubernetes.io/projected/a7b65ba9-383b-48f3-986c-67362fbd2d5b-kube-api-access-4fx7b\") pod \"dns-operator-controller-manager-864dd78c4c-z7k64\" (UID: \"a7b65ba9-383b-48f3-986c-67362fbd2d5b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z7k64" Jul 17 17:46:14.949788 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:14.949697 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z7k64" Jul 17 17:46:15.103043 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:15.103020 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-z7k64"] Jul 17 17:46:15.104735 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:46:15.104706 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7b65ba9_383b_48f3_986c_67362fbd2d5b.slice/crio-955278dfc74a97751289908f7d7f4d6870b815d2d1c25914ef62b4f993ca3966 WatchSource:0}: Error finding container 955278dfc74a97751289908f7d7f4d6870b815d2d1c25914ef62b4f993ca3966: Status 404 returned error can't find the container with id 955278dfc74a97751289908f7d7f4d6870b815d2d1c25914ef62b4f993ca3966 Jul 17 17:46:15.159336 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:15.159302 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z7k64" event={"ID":"a7b65ba9-383b-48f3-986c-67362fbd2d5b","Type":"ContainerStarted","Data":"955278dfc74a97751289908f7d7f4d6870b815d2d1c25914ef62b4f993ca3966"} Jul 17 17:46:16.650729 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:16.650695 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54jxx"] Jul 17 17:46:16.652797 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:16.652780 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54jxx" Jul 17 17:46:16.656417 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:16.656393 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-sd6mh\"" Jul 17 17:46:16.664347 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:16.664322 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54jxx"] Jul 17 17:46:16.667101 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:16.667078 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5lmf\" (UniqueName: \"kubernetes.io/projected/6216c6dd-4e8c-41db-8c61-9b0d1d672e50-kube-api-access-m5lmf\") pod \"limitador-operator-controller-manager-859d7b78bd-54jxx\" (UID: \"6216c6dd-4e8c-41db-8c61-9b0d1d672e50\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54jxx" Jul 17 17:46:16.768436 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:16.768399 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5lmf\" (UniqueName: \"kubernetes.io/projected/6216c6dd-4e8c-41db-8c61-9b0d1d672e50-kube-api-access-m5lmf\") pod \"limitador-operator-controller-manager-859d7b78bd-54jxx\" (UID: \"6216c6dd-4e8c-41db-8c61-9b0d1d672e50\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54jxx" Jul 17 17:46:16.776634 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:16.776602 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5lmf\" (UniqueName: \"kubernetes.io/projected/6216c6dd-4e8c-41db-8c61-9b0d1d672e50-kube-api-access-m5lmf\") pod \"limitador-operator-controller-manager-859d7b78bd-54jxx\" (UID: \"6216c6dd-4e8c-41db-8c61-9b0d1d672e50\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54jxx" Jul 17 17:46:16.963616 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:16.963529 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54jxx" Jul 17 17:46:17.175215 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:17.175175 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4kjqg" event={"ID":"6c1c8894-96ad-4411-b694-a249b04f6f02","Type":"ContainerStarted","Data":"119946a2eb9f78657a48db6ca8de10caa84ace8bada14d6e609fb9b7b606a538"} Jul 17 17:46:17.175398 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:17.175302 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4kjqg" Jul 17 17:46:17.220329 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:17.220226 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4kjqg" podStartSLOduration=1.884849285 podStartE2EDuration="8.220203514s" totalImagesPullingTime="6.335354229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:46:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:46:17.219221379 +0000 UTC m=+431.403279156" watchObservedRunningTime="2026-07-17 17:46:17.220203514 +0000 UTC m=+431.404261292" Jul 17 17:46:17.435057 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:17.435029 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54jxx"] Jul 17 17:46:17.438516 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:46:17.438481 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6216c6dd_4e8c_41db_8c61_9b0d1d672e50.slice/crio-6d7b845c05bb1de02ec5cd78bab827066e8e6b56d297dd7b0dcb54642d511ece WatchSource:0}: Error finding container 6d7b845c05bb1de02ec5cd78bab827066e8e6b56d297dd7b0dcb54642d511ece: Status 404 returned error can't find the container with id 6d7b845c05bb1de02ec5cd78bab827066e8e6b56d297dd7b0dcb54642d511ece Jul 17 17:46:18.183425 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:18.183388 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54jxx" event={"ID":"6216c6dd-4e8c-41db-8c61-9b0d1d672e50","Type":"ContainerStarted","Data":"6d7b845c05bb1de02ec5cd78bab827066e8e6b56d297dd7b0dcb54642d511ece"} Jul 17 17:46:19.189954 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:19.189922 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z7k64" event={"ID":"a7b65ba9-383b-48f3-986c-67362fbd2d5b","Type":"ContainerStarted","Data":"2cea00f9ec5a3130958b582f8e2ebf1e6f019acfab9076a259b151f1ef01fb26"} Jul 17 17:46:19.190386 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:19.189997 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z7k64" Jul 17 17:46:19.210323 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:19.210267 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z7k64" podStartSLOduration=1.863546798 podStartE2EDuration="5.21024943s" totalImagesPullingTime="3.346702632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:46:19.208126149 +0000 UTC m=+433.392183927" watchObservedRunningTime="2026-07-17 17:46:19.21024943 +0000 UTC m=+433.394307207" Jul 17 17:46:20.199667 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:20.199635 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54jxx" event={"ID":"6216c6dd-4e8c-41db-8c61-9b0d1d672e50","Type":"ContainerStarted","Data":"27d37028cf9fee3708e6be6c9c5a6831632e3f30e7e7c607a1d0c92af3adc85a"} Jul 17 17:46:20.200067 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:20.199925 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54jxx" Jul 17 17:46:20.217628 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:20.217588 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54jxx" podStartSLOduration=2.438431294 podStartE2EDuration="4.217572975s" totalImagesPullingTime="1.779141681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:46:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:46:20.216901521 +0000 UTC m=+434.400959298" watchObservedRunningTime="2026-07-17 17:46:20.217572975 +0000 UTC m=+434.401630751" Jul 17 17:46:28.185912 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:28.185839 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4kjqg" Jul 17 17:46:30.168107 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.168071 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4kjqg"] Jul 17 17:46:30.168532 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.168265 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4kjqg" podUID="6c1c8894-96ad-4411-b694-a249b04f6f02" containerName="manager" containerID="cri-o://119946a2eb9f78657a48db6ca8de10caa84ace8bada14d6e609fb9b7b606a538" gracePeriod=2 Jul 17 17:46:30.178762 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.178733 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4kjqg"] Jul 17 17:46:30.187212 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:46:30.187171 2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6c1c8894-96ad-4411-b694-a249b04f6f02\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-4kjqg\": pods \"kuadrant-operator-controller-manager-8684c9ff49-4kjqg\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4kjqg" Jul 17 17:46:30.192587 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.192564 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54jxx"] Jul 17 17:46:30.192771 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.192743 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54jxx" podUID="6216c6dd-4e8c-41db-8c61-9b0d1d672e50" containerName="manager" containerID="cri-o://27d37028cf9fee3708e6be6c9c5a6831632e3f30e7e7c607a1d0c92af3adc85a" gracePeriod=2 Jul 17 17:46:30.194845 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.194823 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54jxx" Jul 17 17:46:30.196607 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.196588 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lj6bj"] Jul 17 17:46:30.197036 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.197020 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c1c8894-96ad-4411-b694-a249b04f6f02" containerName="manager" Jul 17 17:46:30.197112 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.197040 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c1c8894-96ad-4411-b694-a249b04f6f02" containerName="manager" Jul 17 17:46:30.197167 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.197141 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c1c8894-96ad-4411-b694-a249b04f6f02" containerName="manager" Jul 17 17:46:30.199790 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.199752 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lj6bj" Jul 17 17:46:30.201558 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.201535 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z7k64" Jul 17 17:46:30.205084 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.205061 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54jxx"] Jul 17 17:46:30.210850 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.210828 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lj6bj"] Jul 17 17:46:30.215464 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:46:30.215405 2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6216c6dd-4e8c-41db-8c61-9b0d1d672e50\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-54jxx\": pods \"limitador-operator-controller-manager-859d7b78bd-54jxx\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54jxx" Jul 17 17:46:30.217511 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:46:30.217484 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4kjqg\" is forbidden: User \"system:node:ip-10-0-133-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-127.ec2.internal' and this object" podUID="6c1c8894-96ad-4411-b694-a249b04f6f02" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4kjqg" Jul 17 17:46:30.217632 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.217608 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7wrcc"] Jul 17 17:46:30.218102 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.218082 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6216c6dd-4e8c-41db-8c61-9b0d1d672e50" containerName="manager" Jul 17 17:46:30.218102 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.218103 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6216c6dd-4e8c-41db-8c61-9b0d1d672e50" containerName="manager" Jul 17 17:46:30.218209 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.218176 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6216c6dd-4e8c-41db-8c61-9b0d1d672e50" containerName="manager" Jul 17 17:46:30.219977 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.219963 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7wrcc" Jul 17 17:46:30.234788 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.234761 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7wrcc"] Jul 17 17:46:30.248099 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:46:30.248069 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4kjqg\" is forbidden: User \"system:node:ip-10-0-133-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-127.ec2.internal' and this object" podUID="6c1c8894-96ad-4411-b694-a249b04f6f02" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4kjqg" Jul 17 17:46:30.269825 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:46:30.269793 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-54jxx\" is forbidden: User \"system:node:ip-10-0-133-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-127.ec2.internal' and this object" podUID="6216c6dd-4e8c-41db-8c61-9b0d1d672e50" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54jxx" Jul 17 17:46:30.283046 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.283015 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/33e5d3ab-7145-4d88-834d-53947807a627-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lj6bj\" (UID: \"33e5d3ab-7145-4d88-834d-53947807a627\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lj6bj" Jul 17 17:46:30.283168 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.283067 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbss9\" (UniqueName: \"kubernetes.io/projected/8bf455e3-eb99-4a51-a3ca-ec56fc70416b-kube-api-access-jbss9\") pod \"limitador-operator-controller-manager-859d7b78bd-7wrcc\" (UID: \"8bf455e3-eb99-4a51-a3ca-ec56fc70416b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7wrcc" Jul 17 17:46:30.283168 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.283134 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2x2v\" (UniqueName: \"kubernetes.io/projected/33e5d3ab-7145-4d88-834d-53947807a627-kube-api-access-s2x2v\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lj6bj\" (UID: \"33e5d3ab-7145-4d88-834d-53947807a627\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lj6bj" Jul 17 17:46:30.291436 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:46:30.291410 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4kjqg\" is forbidden: User \"system:node:ip-10-0-133-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-127.ec2.internal' and this object" podUID="6c1c8894-96ad-4411-b694-a249b04f6f02" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4kjqg" Jul 17 17:46:30.293382 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:46:30.293353 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-54jxx\" is forbidden: User \"system:node:ip-10-0-133-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-127.ec2.internal' and this object" podUID="6216c6dd-4e8c-41db-8c61-9b0d1d672e50" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54jxx" Jul 17 17:46:30.384014 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.383985 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/33e5d3ab-7145-4d88-834d-53947807a627-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lj6bj\" (UID: \"33e5d3ab-7145-4d88-834d-53947807a627\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lj6bj" Jul 17 17:46:30.384173 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.384029 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbss9\" (UniqueName: \"kubernetes.io/projected/8bf455e3-eb99-4a51-a3ca-ec56fc70416b-kube-api-access-jbss9\") pod \"limitador-operator-controller-manager-859d7b78bd-7wrcc\" (UID: \"8bf455e3-eb99-4a51-a3ca-ec56fc70416b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7wrcc" Jul 17 17:46:30.384173 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.384095 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2x2v\" (UniqueName: \"kubernetes.io/projected/33e5d3ab-7145-4d88-834d-53947807a627-kube-api-access-s2x2v\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lj6bj\" (UID: \"33e5d3ab-7145-4d88-834d-53947807a627\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lj6bj" Jul 17 17:46:30.384483 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.384416 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/33e5d3ab-7145-4d88-834d-53947807a627-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lj6bj\" (UID: \"33e5d3ab-7145-4d88-834d-53947807a627\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lj6bj" Jul 17 17:46:30.394978 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.394947 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbss9\" (UniqueName: \"kubernetes.io/projected/8bf455e3-eb99-4a51-a3ca-ec56fc70416b-kube-api-access-jbss9\") pod \"limitador-operator-controller-manager-859d7b78bd-7wrcc\" (UID: \"8bf455e3-eb99-4a51-a3ca-ec56fc70416b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7wrcc" Jul 17 17:46:30.395247 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.395229 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2x2v\" (UniqueName: \"kubernetes.io/projected/33e5d3ab-7145-4d88-834d-53947807a627-kube-api-access-s2x2v\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lj6bj\" (UID: \"33e5d3ab-7145-4d88-834d-53947807a627\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lj6bj" Jul 17 17:46:30.440649 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.440625 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4kjqg" Jul 17 17:46:30.442641 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.442626 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54jxx" Jul 17 17:46:30.485336 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.485310 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5lmf\" (UniqueName: \"kubernetes.io/projected/6216c6dd-4e8c-41db-8c61-9b0d1d672e50-kube-api-access-m5lmf\") pod \"6216c6dd-4e8c-41db-8c61-9b0d1d672e50\" (UID: \"6216c6dd-4e8c-41db-8c61-9b0d1d672e50\") " Jul 17 17:46:30.485459 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.485350 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c1c8894-96ad-4411-b694-a249b04f6f02-extensions-socket-volume\") pod \"6c1c8894-96ad-4411-b694-a249b04f6f02\" (UID: \"6c1c8894-96ad-4411-b694-a249b04f6f02\") " Jul 17 17:46:30.485459 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.485401 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlwvr\" (UniqueName: \"kubernetes.io/projected/6c1c8894-96ad-4411-b694-a249b04f6f02-kube-api-access-vlwvr\") pod \"6c1c8894-96ad-4411-b694-a249b04f6f02\" (UID: \"6c1c8894-96ad-4411-b694-a249b04f6f02\") " Jul 17 17:46:30.485835 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.485814 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c1c8894-96ad-4411-b694-a249b04f6f02-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6c1c8894-96ad-4411-b694-a249b04f6f02" (UID: "6c1c8894-96ad-4411-b694-a249b04f6f02"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:46:30.487603 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.487571 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c1c8894-96ad-4411-b694-a249b04f6f02-kube-api-access-vlwvr" (OuterVolumeSpecName: "kube-api-access-vlwvr") pod "6c1c8894-96ad-4411-b694-a249b04f6f02" (UID: "6c1c8894-96ad-4411-b694-a249b04f6f02"). InnerVolumeSpecName "kube-api-access-vlwvr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:46:30.487689 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.487571 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6216c6dd-4e8c-41db-8c61-9b0d1d672e50-kube-api-access-m5lmf" (OuterVolumeSpecName: "kube-api-access-m5lmf") pod "6216c6dd-4e8c-41db-8c61-9b0d1d672e50" (UID: "6216c6dd-4e8c-41db-8c61-9b0d1d672e50"). InnerVolumeSpecName "kube-api-access-m5lmf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:46:30.586493 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.586428 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5lmf\" (UniqueName: \"kubernetes.io/projected/6216c6dd-4e8c-41db-8c61-9b0d1d672e50-kube-api-access-m5lmf\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:46:30.586493 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.586489 2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c1c8894-96ad-4411-b694-a249b04f6f02-extensions-socket-volume\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:46:30.586493 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.586499 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlwvr\" (UniqueName: \"kubernetes.io/projected/6c1c8894-96ad-4411-b694-a249b04f6f02-kube-api-access-vlwvr\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:46:30.604366 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.604342 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lj6bj" Jul 17 17:46:30.612489 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.612461 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7wrcc" Jul 17 17:46:30.753061 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.753032 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lj6bj"] Jul 17 17:46:30.756424 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:46:30.756401 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33e5d3ab_7145_4d88_834d_53947807a627.slice/crio-bd39461bbbfd80f18e736a3c1c0138a01291dfab69ba6ab3a5e92be59256eb7a WatchSource:0}: Error finding container bd39461bbbfd80f18e736a3c1c0138a01291dfab69ba6ab3a5e92be59256eb7a: Status 404 returned error can't find the container with id bd39461bbbfd80f18e736a3c1c0138a01291dfab69ba6ab3a5e92be59256eb7a Jul 17 17:46:30.782164 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:30.782143 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7wrcc"] Jul 17 17:46:30.793597 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:46:30.793571 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bf455e3_eb99_4a51_a3ca_ec56fc70416b.slice/crio-cd06fa7b2813204cd14393ca0e170d942d4c8f6f50704926fb9b56e727484f48 WatchSource:0}: Error finding container cd06fa7b2813204cd14393ca0e170d942d4c8f6f50704926fb9b56e727484f48: Status 404 returned error can't find the container with id cd06fa7b2813204cd14393ca0e170d942d4c8f6f50704926fb9b56e727484f48 Jul 17 17:46:31.249424 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:31.249395 2563 generic.go:356] "Generic (PLEG): container finished" podID="6216c6dd-4e8c-41db-8c61-9b0d1d672e50" containerID="27d37028cf9fee3708e6be6c9c5a6831632e3f30e7e7c607a1d0c92af3adc85a" exitCode=0 Jul 17 17:46:31.249885 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:31.249457 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54jxx" Jul 17 17:46:31.249885 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:31.249492 2563 scope.go:117] "RemoveContainer" containerID="27d37028cf9fee3708e6be6c9c5a6831632e3f30e7e7c607a1d0c92af3adc85a" Jul 17 17:46:31.251319 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:31.251293 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7wrcc" event={"ID":"8bf455e3-eb99-4a51-a3ca-ec56fc70416b","Type":"ContainerStarted","Data":"eecc501ee2114b566c16a7a55a4c445fbb17a5f29e98ec2f3e9d942d253b11f2"} Jul 17 17:46:31.251422 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:31.251357 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7wrcc" event={"ID":"8bf455e3-eb99-4a51-a3ca-ec56fc70416b","Type":"ContainerStarted","Data":"cd06fa7b2813204cd14393ca0e170d942d4c8f6f50704926fb9b56e727484f48"} Jul 17 17:46:31.251422 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:31.251405 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7wrcc" Jul 17 17:46:31.252897 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:31.252877 2563 generic.go:356] "Generic (PLEG): container finished" podID="6c1c8894-96ad-4411-b694-a249b04f6f02" containerID="119946a2eb9f78657a48db6ca8de10caa84ace8bada14d6e609fb9b7b606a538" exitCode=0 Jul 17 17:46:31.253013 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:31.252920 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4kjqg" Jul 17 17:46:31.254738 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:31.254683 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lj6bj" event={"ID":"33e5d3ab-7145-4d88-834d-53947807a627","Type":"ContainerStarted","Data":"88f9aeefe05a1418e443a4f2d7a786037244ecdf1457e766c65e9b3e07687900"} Jul 17 17:46:31.254738 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:31.254726 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lj6bj" event={"ID":"33e5d3ab-7145-4d88-834d-53947807a627","Type":"ContainerStarted","Data":"bd39461bbbfd80f18e736a3c1c0138a01291dfab69ba6ab3a5e92be59256eb7a"} Jul 17 17:46:31.254893 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:31.254812 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lj6bj" Jul 17 17:46:31.259179 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:31.259157 2563 scope.go:117] "RemoveContainer" containerID="27d37028cf9fee3708e6be6c9c5a6831632e3f30e7e7c607a1d0c92af3adc85a" Jul 17 17:46:31.259484 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:46:31.259436 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27d37028cf9fee3708e6be6c9c5a6831632e3f30e7e7c607a1d0c92af3adc85a\": container with ID starting with 27d37028cf9fee3708e6be6c9c5a6831632e3f30e7e7c607a1d0c92af3adc85a not found: ID does not exist" containerID="27d37028cf9fee3708e6be6c9c5a6831632e3f30e7e7c607a1d0c92af3adc85a" Jul 17 17:46:31.259557 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:31.259496 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27d37028cf9fee3708e6be6c9c5a6831632e3f30e7e7c607a1d0c92af3adc85a"} err="failed to get container status \"27d37028cf9fee3708e6be6c9c5a6831632e3f30e7e7c607a1d0c92af3adc85a\": rpc error: code = NotFound desc = could not find container \"27d37028cf9fee3708e6be6c9c5a6831632e3f30e7e7c607a1d0c92af3adc85a\": container with ID starting with 27d37028cf9fee3708e6be6c9c5a6831632e3f30e7e7c607a1d0c92af3adc85a not found: ID does not exist" Jul 17 17:46:31.259557 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:31.259522 2563 scope.go:117] "RemoveContainer" containerID="119946a2eb9f78657a48db6ca8de10caa84ace8bada14d6e609fb9b7b606a538" Jul 17 17:46:31.267145 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:31.267130 2563 scope.go:117] "RemoveContainer" containerID="119946a2eb9f78657a48db6ca8de10caa84ace8bada14d6e609fb9b7b606a538" Jul 17 17:46:31.267382 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:46:31.267367 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"119946a2eb9f78657a48db6ca8de10caa84ace8bada14d6e609fb9b7b606a538\": container with ID starting with 119946a2eb9f78657a48db6ca8de10caa84ace8bada14d6e609fb9b7b606a538 not found: ID does not exist" containerID="119946a2eb9f78657a48db6ca8de10caa84ace8bada14d6e609fb9b7b606a538" Jul 17 17:46:31.267430 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:31.267386 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"119946a2eb9f78657a48db6ca8de10caa84ace8bada14d6e609fb9b7b606a538"} err="failed to get container status \"119946a2eb9f78657a48db6ca8de10caa84ace8bada14d6e609fb9b7b606a538\": rpc error: code = NotFound desc = could not find container \"119946a2eb9f78657a48db6ca8de10caa84ace8bada14d6e609fb9b7b606a538\": container with ID starting with 119946a2eb9f78657a48db6ca8de10caa84ace8bada14d6e609fb9b7b606a538 not found: ID does not exist" Jul 17 17:46:31.272724 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:31.272687 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7wrcc" podStartSLOduration=1.272674177 podStartE2EDuration="1.272674177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:46:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:46:31.271751345 +0000 UTC m=+445.455809123" watchObservedRunningTime="2026-07-17 17:46:31.272674177 +0000 UTC m=+445.456731954" Jul 17 17:46:31.273855 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:46:31.273834 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-54jxx\" is forbidden: User \"system:node:ip-10-0-133-127.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-127.ec2.internal' and this object" podUID="6216c6dd-4e8c-41db-8c61-9b0d1d672e50" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-54jxx" Jul 17 17:46:31.298311 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:31.298253 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lj6bj" podStartSLOduration=1.298236609 podStartE2EDuration="1.298236609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:46:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:46:31.296427102 +0000 UTC m=+445.480484880" watchObservedRunningTime="2026-07-17 17:46:31.298236609 +0000 UTC m=+445.482294387" Jul 17 17:46:32.311282 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:32.311247 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6216c6dd-4e8c-41db-8c61-9b0d1d672e50" path="/var/lib/kubelet/pods/6216c6dd-4e8c-41db-8c61-9b0d1d672e50/volumes" Jul 17 17:46:32.311667 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:32.311619 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c1c8894-96ad-4411-b694-a249b04f6f02" path="/var/lib/kubelet/pods/6c1c8894-96ad-4411-b694-a249b04f6f02/volumes" Jul 17 17:46:42.263884 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:42.263853 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lj6bj" Jul 17 17:46:42.264375 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:42.263933 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7wrcc" Jul 17 17:46:47.084428 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:47.084395 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lj6bj"] Jul 17 17:46:47.084829 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:47.084621 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lj6bj" podUID="33e5d3ab-7145-4d88-834d-53947807a627" containerName="manager" containerID="cri-o://88f9aeefe05a1418e443a4f2d7a786037244ecdf1457e766c65e9b3e07687900" gracePeriod=10 Jul 17 17:46:47.338561 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:47.338499 2563 generic.go:356] "Generic (PLEG): container finished" podID="33e5d3ab-7145-4d88-834d-53947807a627" containerID="88f9aeefe05a1418e443a4f2d7a786037244ecdf1457e766c65e9b3e07687900" exitCode=0 Jul 17 17:46:47.338691 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:47.338568 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lj6bj" event={"ID":"33e5d3ab-7145-4d88-834d-53947807a627","Type":"ContainerDied","Data":"88f9aeefe05a1418e443a4f2d7a786037244ecdf1457e766c65e9b3e07687900"} Jul 17 17:46:47.338691 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:47.338616 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lj6bj" event={"ID":"33e5d3ab-7145-4d88-834d-53947807a627","Type":"ContainerDied","Data":"bd39461bbbfd80f18e736a3c1c0138a01291dfab69ba6ab3a5e92be59256eb7a"} Jul 17 17:46:47.338691 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:47.338632 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd39461bbbfd80f18e736a3c1c0138a01291dfab69ba6ab3a5e92be59256eb7a" Jul 17 17:46:47.338938 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:47.338911 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lj6bj" Jul 17 17:46:47.347462 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:47.347426 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jp4mb"] Jul 17 17:46:47.347773 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:47.347760 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33e5d3ab-7145-4d88-834d-53947807a627" containerName="manager" Jul 17 17:46:47.347831 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:47.347774 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="33e5d3ab-7145-4d88-834d-53947807a627" containerName="manager" Jul 17 17:46:47.347869 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:47.347845 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="33e5d3ab-7145-4d88-834d-53947807a627" containerName="manager" Jul 17 17:46:47.349374 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:47.349361 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jp4mb" Jul 17 17:46:47.365204 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:47.365181 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jp4mb"] Jul 17 17:46:47.429435 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:47.429402 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/33e5d3ab-7145-4d88-834d-53947807a627-extensions-socket-volume\") pod \"33e5d3ab-7145-4d88-834d-53947807a627\" (UID: \"33e5d3ab-7145-4d88-834d-53947807a627\") " Jul 17 17:46:47.429435 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:47.429435 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2x2v\" (UniqueName: \"kubernetes.io/projected/33e5d3ab-7145-4d88-834d-53947807a627-kube-api-access-s2x2v\") pod \"33e5d3ab-7145-4d88-834d-53947807a627\" (UID: \"33e5d3ab-7145-4d88-834d-53947807a627\") " Jul 17 17:46:47.429687 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:47.429593 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aac38bd7-1621-4fbb-9e6e-ff2882c12a42-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jp4mb\" (UID: \"aac38bd7-1621-4fbb-9e6e-ff2882c12a42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jp4mb" Jul 17 17:46:47.429687 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:47.429614 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwnvr\" (UniqueName: \"kubernetes.io/projected/aac38bd7-1621-4fbb-9e6e-ff2882c12a42-kube-api-access-cwnvr\") pod \"kuadrant-operator-controller-manager-86878c769f-jp4mb\" (UID: \"aac38bd7-1621-4fbb-9e6e-ff2882c12a42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jp4mb" Jul 17 17:46:47.429850 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:47.429825 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33e5d3ab-7145-4d88-834d-53947807a627-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "33e5d3ab-7145-4d88-834d-53947807a627" (UID: "33e5d3ab-7145-4d88-834d-53947807a627"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:46:47.431616 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:47.431593 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33e5d3ab-7145-4d88-834d-53947807a627-kube-api-access-s2x2v" (OuterVolumeSpecName: "kube-api-access-s2x2v") pod "33e5d3ab-7145-4d88-834d-53947807a627" (UID: "33e5d3ab-7145-4d88-834d-53947807a627"). InnerVolumeSpecName "kube-api-access-s2x2v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:46:47.530236 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:47.530200 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aac38bd7-1621-4fbb-9e6e-ff2882c12a42-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jp4mb\" (UID: \"aac38bd7-1621-4fbb-9e6e-ff2882c12a42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jp4mb" Jul 17 17:46:47.530236 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:47.530233 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwnvr\" (UniqueName: \"kubernetes.io/projected/aac38bd7-1621-4fbb-9e6e-ff2882c12a42-kube-api-access-cwnvr\") pod \"kuadrant-operator-controller-manager-86878c769f-jp4mb\" (UID: \"aac38bd7-1621-4fbb-9e6e-ff2882c12a42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jp4mb" Jul 17 17:46:47.530542 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:47.530269 2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/33e5d3ab-7145-4d88-834d-53947807a627-extensions-socket-volume\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:46:47.530542 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:47.530280 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2x2v\" (UniqueName: \"kubernetes.io/projected/33e5d3ab-7145-4d88-834d-53947807a627-kube-api-access-s2x2v\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:46:47.530705 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:47.530682 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aac38bd7-1621-4fbb-9e6e-ff2882c12a42-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jp4mb\" (UID: \"aac38bd7-1621-4fbb-9e6e-ff2882c12a42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jp4mb" Jul 17 17:46:47.548899 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:47.548867 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwnvr\" (UniqueName: \"kubernetes.io/projected/aac38bd7-1621-4fbb-9e6e-ff2882c12a42-kube-api-access-cwnvr\") pod \"kuadrant-operator-controller-manager-86878c769f-jp4mb\" (UID: \"aac38bd7-1621-4fbb-9e6e-ff2882c12a42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jp4mb" Jul 17 17:46:47.658882 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:47.658796 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jp4mb" Jul 17 17:46:47.815618 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:47.815589 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jp4mb"] Jul 17 17:46:47.818342 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:46:47.818320 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaac38bd7_1621_4fbb_9e6e_ff2882c12a42.slice/crio-f7412a7ec1133f2e469428b46db2121be9a9b01096742993372fffe7b3100c88 WatchSource:0}: Error finding container f7412a7ec1133f2e469428b46db2121be9a9b01096742993372fffe7b3100c88: Status 404 returned error can't find the container with id f7412a7ec1133f2e469428b46db2121be9a9b01096742993372fffe7b3100c88 Jul 17 17:46:48.345278 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:48.345255 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lj6bj" Jul 17 17:46:48.345278 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:48.345271 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jp4mb" event={"ID":"aac38bd7-1621-4fbb-9e6e-ff2882c12a42","Type":"ContainerStarted","Data":"39544828a53cb1df89d9517723cdc82d2a0f77e400f2a375bcb67b44b23b184e"} Jul 17 17:46:48.345774 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:48.345319 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jp4mb" event={"ID":"aac38bd7-1621-4fbb-9e6e-ff2882c12a42","Type":"ContainerStarted","Data":"f7412a7ec1133f2e469428b46db2121be9a9b01096742993372fffe7b3100c88"} Jul 17 17:46:48.345774 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:48.345550 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jp4mb" Jul 17 17:46:48.374189 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:48.374137 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jp4mb" podStartSLOduration=1.37411719 podStartE2EDuration="1.37411719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:46:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:46:48.373487171 +0000 UTC m=+462.557544951" watchObservedRunningTime="2026-07-17 17:46:48.37411719 +0000 UTC m=+462.558174966" Jul 17 17:46:48.391389 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:48.391353 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lj6bj"] Jul 17 17:46:48.394356 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:48.394330 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lj6bj"] Jul 17 17:46:50.312829 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:50.312793 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33e5d3ab-7145-4d88-834d-53947807a627" path="/var/lib/kubelet/pods/33e5d3ab-7145-4d88-834d-53947807a627/volumes" Jul 17 17:46:59.351911 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:46:59.351877 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jp4mb" Jul 17 17:47:03.513425 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.513389 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs"] Jul 17 17:47:03.516197 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.516176 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:03.518959 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.518939 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-p2289\"" Jul 17 17:47:03.536730 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.536691 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs"] Jul 17 17:47:03.677155 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.677111 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1847e0b1-18aa-4dcf-b7de-2152913cd7d2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-7ptrs\" (UID: \"1847e0b1-18aa-4dcf-b7de-2152913cd7d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:03.677356 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.677181 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1847e0b1-18aa-4dcf-b7de-2152913cd7d2-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-7ptrs\" (UID: \"1847e0b1-18aa-4dcf-b7de-2152913cd7d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:03.677356 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.677235 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1847e0b1-18aa-4dcf-b7de-2152913cd7d2-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7ptrs\" (UID: \"1847e0b1-18aa-4dcf-b7de-2152913cd7d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:03.677356 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.677295 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1847e0b1-18aa-4dcf-b7de-2152913cd7d2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-7ptrs\" (UID: \"1847e0b1-18aa-4dcf-b7de-2152913cd7d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:03.677356 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.677320 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1847e0b1-18aa-4dcf-b7de-2152913cd7d2-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7ptrs\" (UID: \"1847e0b1-18aa-4dcf-b7de-2152913cd7d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:03.677606 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.677367 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1847e0b1-18aa-4dcf-b7de-2152913cd7d2-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-7ptrs\" (UID: \"1847e0b1-18aa-4dcf-b7de-2152913cd7d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:03.677606 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.677435 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gr7h\" (UniqueName: \"kubernetes.io/projected/1847e0b1-18aa-4dcf-b7de-2152913cd7d2-kube-api-access-7gr7h\") pod \"maas-default-gateway-openshift-default-56654dcf7-7ptrs\" (UID: \"1847e0b1-18aa-4dcf-b7de-2152913cd7d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:03.677606 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.677498 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1847e0b1-18aa-4dcf-b7de-2152913cd7d2-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-7ptrs\" (UID: \"1847e0b1-18aa-4dcf-b7de-2152913cd7d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:03.677606 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.677531 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1847e0b1-18aa-4dcf-b7de-2152913cd7d2-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-7ptrs\" (UID: \"1847e0b1-18aa-4dcf-b7de-2152913cd7d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:03.778777 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.778670 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1847e0b1-18aa-4dcf-b7de-2152913cd7d2-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7ptrs\" (UID: \"1847e0b1-18aa-4dcf-b7de-2152913cd7d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:03.778777 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.778730 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1847e0b1-18aa-4dcf-b7de-2152913cd7d2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-7ptrs\" (UID: \"1847e0b1-18aa-4dcf-b7de-2152913cd7d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:03.779013 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.778895 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1847e0b1-18aa-4dcf-b7de-2152913cd7d2-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7ptrs\" (UID: \"1847e0b1-18aa-4dcf-b7de-2152913cd7d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:03.779013 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.778927 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1847e0b1-18aa-4dcf-b7de-2152913cd7d2-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-7ptrs\" (UID: \"1847e0b1-18aa-4dcf-b7de-2152913cd7d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:03.779013 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.778947 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gr7h\" (UniqueName: \"kubernetes.io/projected/1847e0b1-18aa-4dcf-b7de-2152913cd7d2-kube-api-access-7gr7h\") pod \"maas-default-gateway-openshift-default-56654dcf7-7ptrs\" (UID: \"1847e0b1-18aa-4dcf-b7de-2152913cd7d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:03.779013 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.778965 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1847e0b1-18aa-4dcf-b7de-2152913cd7d2-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-7ptrs\" (UID: \"1847e0b1-18aa-4dcf-b7de-2152913cd7d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:03.779013 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.778988 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1847e0b1-18aa-4dcf-b7de-2152913cd7d2-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-7ptrs\" (UID: \"1847e0b1-18aa-4dcf-b7de-2152913cd7d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:03.779313 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.779042 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1847e0b1-18aa-4dcf-b7de-2152913cd7d2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-7ptrs\" (UID: \"1847e0b1-18aa-4dcf-b7de-2152913cd7d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:03.779313 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.779106 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1847e0b1-18aa-4dcf-b7de-2152913cd7d2-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-7ptrs\" (UID: \"1847e0b1-18aa-4dcf-b7de-2152913cd7d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:03.779313 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.779129 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1847e0b1-18aa-4dcf-b7de-2152913cd7d2-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7ptrs\" (UID: \"1847e0b1-18aa-4dcf-b7de-2152913cd7d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:03.779313 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.779214 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1847e0b1-18aa-4dcf-b7de-2152913cd7d2-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7ptrs\" (UID: \"1847e0b1-18aa-4dcf-b7de-2152913cd7d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:03.779550 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.779510 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1847e0b1-18aa-4dcf-b7de-2152913cd7d2-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-7ptrs\" (UID: \"1847e0b1-18aa-4dcf-b7de-2152913cd7d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:03.779599 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.779558 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1847e0b1-18aa-4dcf-b7de-2152913cd7d2-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-7ptrs\" (UID: \"1847e0b1-18aa-4dcf-b7de-2152913cd7d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:03.779764 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.779745 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1847e0b1-18aa-4dcf-b7de-2152913cd7d2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-7ptrs\" (UID: \"1847e0b1-18aa-4dcf-b7de-2152913cd7d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:03.781753 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.781731 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1847e0b1-18aa-4dcf-b7de-2152913cd7d2-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-7ptrs\" (UID: \"1847e0b1-18aa-4dcf-b7de-2152913cd7d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:03.781978 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.781959 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1847e0b1-18aa-4dcf-b7de-2152913cd7d2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-7ptrs\" (UID: \"1847e0b1-18aa-4dcf-b7de-2152913cd7d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:03.787564 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.787545 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1847e0b1-18aa-4dcf-b7de-2152913cd7d2-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-7ptrs\" (UID: \"1847e0b1-18aa-4dcf-b7de-2152913cd7d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:03.787684 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.787668 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gr7h\" (UniqueName: \"kubernetes.io/projected/1847e0b1-18aa-4dcf-b7de-2152913cd7d2-kube-api-access-7gr7h\") pod \"maas-default-gateway-openshift-default-56654dcf7-7ptrs\" (UID: \"1847e0b1-18aa-4dcf-b7de-2152913cd7d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:03.826706 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.826677 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:03.968871 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.968818 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs"] Jul 17 17:47:03.971255 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:47:03.971228 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1847e0b1_18aa_4dcf_b7de_2152913cd7d2.slice/crio-6a7875c9f00eec66474c6377b8e451451edc5275252908993b63110acb783803 WatchSource:0}: Error finding container 6a7875c9f00eec66474c6377b8e451451edc5275252908993b63110acb783803: Status 404 returned error can't find the container with id 6a7875c9f00eec66474c6377b8e451451edc5275252908993b63110acb783803 Jul 17 17:47:03.973365 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.973333 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 17:47:03.973486 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.973413 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 17:47:03.973559 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:03.973508 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 17:47:04.420646 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:04.420613 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" event={"ID":"1847e0b1-18aa-4dcf-b7de-2152913cd7d2","Type":"ContainerStarted","Data":"0cceb889e6ac361f2bdd222ee9bb991149aa6d1ddbf6ad47bc8cb1264a75db25"} Jul 17 17:47:04.420827 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:04.420669 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" event={"ID":"1847e0b1-18aa-4dcf-b7de-2152913cd7d2","Type":"ContainerStarted","Data":"6a7875c9f00eec66474c6377b8e451451edc5275252908993b63110acb783803"} Jul 17 17:47:04.446991 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:04.446936 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" podStartSLOduration=1.446918419 podStartE2EDuration="1.446918419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:47:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:47:04.444413962 +0000 UTC m=+478.628471738" watchObservedRunningTime="2026-07-17 17:47:04.446918419 +0000 UTC m=+478.630976196" Jul 17 17:47:04.827159 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:04.827116 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:05.832519 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:05.832486 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:06.430513 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:06.430485 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:06.431536 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:06.431512 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:47:16.772641 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:16.772609 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-ztgt9"] Jul 17 17:47:16.775805 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:16.775784 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ztgt9" Jul 17 17:47:16.778311 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:16.778294 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-fb6fm\"" Jul 17 17:47:16.786606 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:16.786581 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-ztgt9"] Jul 17 17:47:16.890581 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:16.890538 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czlfx\" (UniqueName: \"kubernetes.io/projected/1d3a94a2-59c5-4327-89bc-e90832338964-kube-api-access-czlfx\") pod \"authorino-58cd955675-ztgt9\" (UID: \"1d3a94a2-59c5-4327-89bc-e90832338964\") " pod="kuadrant-system/authorino-58cd955675-ztgt9" Jul 17 17:47:16.991483 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:16.991428 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czlfx\" (UniqueName: \"kubernetes.io/projected/1d3a94a2-59c5-4327-89bc-e90832338964-kube-api-access-czlfx\") pod \"authorino-58cd955675-ztgt9\" (UID: \"1d3a94a2-59c5-4327-89bc-e90832338964\") " pod="kuadrant-system/authorino-58cd955675-ztgt9" Jul 17 17:47:17.000271 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:17.000246 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czlfx\" (UniqueName: \"kubernetes.io/projected/1d3a94a2-59c5-4327-89bc-e90832338964-kube-api-access-czlfx\") pod \"authorino-58cd955675-ztgt9\" (UID: \"1d3a94a2-59c5-4327-89bc-e90832338964\") " pod="kuadrant-system/authorino-58cd955675-ztgt9" Jul 17 17:47:17.084736 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:17.084661 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ztgt9" Jul 17 17:47:17.239460 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:17.239417 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-ztgt9"] Jul 17 17:47:17.244408 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:47:17.244377 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d3a94a2_59c5_4327_89bc_e90832338964.slice/crio-f950144b775496c4f950aa03b3340de0f6538c81c44659c8d528d2a1f5ffaeef WatchSource:0}: Error finding container f950144b775496c4f950aa03b3340de0f6538c81c44659c8d528d2a1f5ffaeef: Status 404 returned error can't find the container with id f950144b775496c4f950aa03b3340de0f6538c81c44659c8d528d2a1f5ffaeef Jul 17 17:47:17.485510 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:17.485474 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ztgt9" event={"ID":"1d3a94a2-59c5-4327-89bc-e90832338964","Type":"ContainerStarted","Data":"f950144b775496c4f950aa03b3340de0f6538c81c44659c8d528d2a1f5ffaeef"} Jul 17 17:47:20.506522 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:20.506488 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ztgt9" event={"ID":"1d3a94a2-59c5-4327-89bc-e90832338964","Type":"ContainerStarted","Data":"21d108da2f549e0ebc34e7d3c28c5ef6d875f58fe81243c839aa5f7646318976"} Jul 17 17:47:20.525844 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:20.525789 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-ztgt9" podStartSLOduration=1.462897961 podStartE2EDuration="4.525771338s" totalImagesPullingTime="3.062873377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:47:20.524827523 +0000 UTC m=+494.708885299" watchObservedRunningTime="2026-07-17 17:47:20.525771338 +0000 UTC m=+494.709829117" Jul 17 17:47:21.399147 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:21.399117 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-ztgt9"] Jul 17 17:47:22.517083 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:22.517044 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-ztgt9" podUID="1d3a94a2-59c5-4327-89bc-e90832338964" containerName="authorino" containerID="cri-o://21d108da2f549e0ebc34e7d3c28c5ef6d875f58fe81243c839aa5f7646318976" gracePeriod=30 Jul 17 17:47:22.766560 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:22.766537 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ztgt9" Jul 17 17:47:22.846200 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:22.846109 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czlfx\" (UniqueName: \"kubernetes.io/projected/1d3a94a2-59c5-4327-89bc-e90832338964-kube-api-access-czlfx\") pod \"1d3a94a2-59c5-4327-89bc-e90832338964\" (UID: \"1d3a94a2-59c5-4327-89bc-e90832338964\") " Jul 17 17:47:22.848408 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:22.848380 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d3a94a2-59c5-4327-89bc-e90832338964-kube-api-access-czlfx" (OuterVolumeSpecName: "kube-api-access-czlfx") pod "1d3a94a2-59c5-4327-89bc-e90832338964" (UID: "1d3a94a2-59c5-4327-89bc-e90832338964"). InnerVolumeSpecName "kube-api-access-czlfx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:47:22.947484 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:22.947431 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czlfx\" (UniqueName: \"kubernetes.io/projected/1d3a94a2-59c5-4327-89bc-e90832338964-kube-api-access-czlfx\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:47:23.522978 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:23.522941 2563 generic.go:356] "Generic (PLEG): container finished" podID="1d3a94a2-59c5-4327-89bc-e90832338964" containerID="21d108da2f549e0ebc34e7d3c28c5ef6d875f58fe81243c839aa5f7646318976" exitCode=0 Jul 17 17:47:23.523474 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:23.523007 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ztgt9" Jul 17 17:47:23.523474 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:23.523029 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ztgt9" event={"ID":"1d3a94a2-59c5-4327-89bc-e90832338964","Type":"ContainerDied","Data":"21d108da2f549e0ebc34e7d3c28c5ef6d875f58fe81243c839aa5f7646318976"} Jul 17 17:47:23.523474 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:23.523072 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ztgt9" event={"ID":"1d3a94a2-59c5-4327-89bc-e90832338964","Type":"ContainerDied","Data":"f950144b775496c4f950aa03b3340de0f6538c81c44659c8d528d2a1f5ffaeef"} Jul 17 17:47:23.523474 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:23.523089 2563 scope.go:117] "RemoveContainer" containerID="21d108da2f549e0ebc34e7d3c28c5ef6d875f58fe81243c839aa5f7646318976" Jul 17 17:47:23.531755 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:23.531737 2563 scope.go:117] "RemoveContainer" containerID="21d108da2f549e0ebc34e7d3c28c5ef6d875f58fe81243c839aa5f7646318976" Jul 17 17:47:23.532029 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:47:23.532010 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21d108da2f549e0ebc34e7d3c28c5ef6d875f58fe81243c839aa5f7646318976\": container with ID starting with 21d108da2f549e0ebc34e7d3c28c5ef6d875f58fe81243c839aa5f7646318976 not found: ID does not exist" containerID="21d108da2f549e0ebc34e7d3c28c5ef6d875f58fe81243c839aa5f7646318976" Jul 17 17:47:23.532076 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:23.532046 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21d108da2f549e0ebc34e7d3c28c5ef6d875f58fe81243c839aa5f7646318976"} err="failed to get container status \"21d108da2f549e0ebc34e7d3c28c5ef6d875f58fe81243c839aa5f7646318976\": rpc error: code = NotFound desc = could not find container \"21d108da2f549e0ebc34e7d3c28c5ef6d875f58fe81243c839aa5f7646318976\": container with ID starting with 21d108da2f549e0ebc34e7d3c28c5ef6d875f58fe81243c839aa5f7646318976 not found: ID does not exist" Jul 17 17:47:23.544122 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:23.544085 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-ztgt9"] Jul 17 17:47:23.547902 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:23.547879 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-ztgt9"] Jul 17 17:47:24.312034 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:24.311999 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d3a94a2-59c5-4327-89bc-e90832338964" path="/var/lib/kubelet/pods/1d3a94a2-59c5-4327-89bc-e90832338964/volumes" Jul 17 17:47:50.045536 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.045500 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6jpkz"] Jul 17 17:47:50.046014 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.045935 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d3a94a2-59c5-4327-89bc-e90832338964" containerName="authorino" Jul 17 17:47:50.046014 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.045954 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d3a94a2-59c5-4327-89bc-e90832338964" containerName="authorino" Jul 17 17:47:50.046087 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.046039 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d3a94a2-59c5-4327-89bc-e90832338964" containerName="authorino" Jul 17 17:47:50.052467 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.052428 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6jpkz" Jul 17 17:47:50.055793 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.055777 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-fb6fm\"" Jul 17 17:47:50.060341 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.060314 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6jpkz"] Jul 17 17:47:50.096895 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.096865 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47d6z\" (UniqueName: \"kubernetes.io/projected/987665bd-11c5-42a1-8fe1-8abc5786cc96-kube-api-access-47d6z\") pod \"authorino-5d4b67c446-6jpkz\" (UID: \"987665bd-11c5-42a1-8fe1-8abc5786cc96\") " pod="kuadrant-system/authorino-5d4b67c446-6jpkz" Jul 17 17:47:50.197287 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.197255 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47d6z\" (UniqueName: \"kubernetes.io/projected/987665bd-11c5-42a1-8fe1-8abc5786cc96-kube-api-access-47d6z\") pod \"authorino-5d4b67c446-6jpkz\" (UID: \"987665bd-11c5-42a1-8fe1-8abc5786cc96\") " pod="kuadrant-system/authorino-5d4b67c446-6jpkz" Jul 17 17:47:50.206966 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.206937 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47d6z\" (UniqueName: \"kubernetes.io/projected/987665bd-11c5-42a1-8fe1-8abc5786cc96-kube-api-access-47d6z\") pod \"authorino-5d4b67c446-6jpkz\" (UID: \"987665bd-11c5-42a1-8fe1-8abc5786cc96\") " pod="kuadrant-system/authorino-5d4b67c446-6jpkz" Jul 17 17:47:50.278291 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.278263 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6jpkz"] Jul 17 17:47:50.278601 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.278589 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6jpkz" Jul 17 17:47:50.314120 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.314023 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-fnnfd"] Jul 17 17:47:50.318959 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.318934 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-fnnfd" Jul 17 17:47:50.321667 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.321642 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 17 17:47:50.325217 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.325186 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-fnnfd"] Jul 17 17:47:50.348845 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.348812 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-fnnfd"] Jul 17 17:47:50.349172 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:47:50.349146 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-ls669 tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-ls669 tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-fnnfd" podUID="ce2a6f57-14ab-417d-9101-1a5996260a7d" Jul 17 17:47:50.382292 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.382258 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6c4f8d7d98-gxljd"] Jul 17 17:47:50.386282 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.386261 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c4f8d7d98-gxljd" Jul 17 17:47:50.393684 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.393229 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c4f8d7d98-gxljd"] Jul 17 17:47:50.435589 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.435551 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6jpkz"] Jul 17 17:47:50.440245 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:47:50.440215 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod987665bd_11c5_42a1_8fe1_8abc5786cc96.slice/crio-2649efe6b01fe5b9d5a3afcfbaf51fd061552e0ecb5d351501555f03e62e179f WatchSource:0}: Error finding container 2649efe6b01fe5b9d5a3afcfbaf51fd061552e0ecb5d351501555f03e62e179f: Status 404 returned error can't find the container with id 2649efe6b01fe5b9d5a3afcfbaf51fd061552e0ecb5d351501555f03e62e179f Jul 17 17:47:50.500790 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.500757 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce2a6f57-14ab-417d-9101-1a5996260a7d-tls-cert\") pod \"authorino-76877994-fnnfd\" (UID: \"ce2a6f57-14ab-417d-9101-1a5996260a7d\") " pod="kuadrant-system/authorino-76877994-fnnfd" Jul 17 17:47:50.500790 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.500797 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpdvd\" (UniqueName: \"kubernetes.io/projected/17e81206-e118-4066-82fb-183c7bf4cbea-kube-api-access-dpdvd\") pod \"authorino-6c4f8d7d98-gxljd\" (UID: \"17e81206-e118-4066-82fb-183c7bf4cbea\") " pod="kuadrant-system/authorino-6c4f8d7d98-gxljd" Jul 17 17:47:50.501043 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.500904 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls669\" (UniqueName: \"kubernetes.io/projected/ce2a6f57-14ab-417d-9101-1a5996260a7d-kube-api-access-ls669\") pod \"authorino-76877994-fnnfd\" (UID: \"ce2a6f57-14ab-417d-9101-1a5996260a7d\") " pod="kuadrant-system/authorino-76877994-fnnfd" Jul 17 17:47:50.501043 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.500951 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/17e81206-e118-4066-82fb-183c7bf4cbea-tls-cert\") pod \"authorino-6c4f8d7d98-gxljd\" (UID: \"17e81206-e118-4066-82fb-183c7bf4cbea\") " pod="kuadrant-system/authorino-6c4f8d7d98-gxljd" Jul 17 17:47:50.602256 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.602152 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpdvd\" (UniqueName: \"kubernetes.io/projected/17e81206-e118-4066-82fb-183c7bf4cbea-kube-api-access-dpdvd\") pod \"authorino-6c4f8d7d98-gxljd\" (UID: \"17e81206-e118-4066-82fb-183c7bf4cbea\") " pod="kuadrant-system/authorino-6c4f8d7d98-gxljd" Jul 17 17:47:50.602426 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.602261 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls669\" (UniqueName: \"kubernetes.io/projected/ce2a6f57-14ab-417d-9101-1a5996260a7d-kube-api-access-ls669\") pod \"authorino-76877994-fnnfd\" (UID: \"ce2a6f57-14ab-417d-9101-1a5996260a7d\") " pod="kuadrant-system/authorino-76877994-fnnfd" Jul 17 17:47:50.602426 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.602300 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/17e81206-e118-4066-82fb-183c7bf4cbea-tls-cert\") pod \"authorino-6c4f8d7d98-gxljd\" (UID: \"17e81206-e118-4066-82fb-183c7bf4cbea\") " pod="kuadrant-system/authorino-6c4f8d7d98-gxljd" Jul 17 17:47:50.602426 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.602407 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce2a6f57-14ab-417d-9101-1a5996260a7d-tls-cert\") pod \"authorino-76877994-fnnfd\" (UID: \"ce2a6f57-14ab-417d-9101-1a5996260a7d\") " pod="kuadrant-system/authorino-76877994-fnnfd" Jul 17 17:47:50.605751 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.605720 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce2a6f57-14ab-417d-9101-1a5996260a7d-tls-cert\") pod \"authorino-76877994-fnnfd\" (UID: \"ce2a6f57-14ab-417d-9101-1a5996260a7d\") " pod="kuadrant-system/authorino-76877994-fnnfd" Jul 17 17:47:50.609547 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.608925 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/17e81206-e118-4066-82fb-183c7bf4cbea-tls-cert\") pod \"authorino-6c4f8d7d98-gxljd\" (UID: \"17e81206-e118-4066-82fb-183c7bf4cbea\") " pod="kuadrant-system/authorino-6c4f8d7d98-gxljd" Jul 17 17:47:50.620369 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.620343 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpdvd\" (UniqueName: \"kubernetes.io/projected/17e81206-e118-4066-82fb-183c7bf4cbea-kube-api-access-dpdvd\") pod \"authorino-6c4f8d7d98-gxljd\" (UID: \"17e81206-e118-4066-82fb-183c7bf4cbea\") " pod="kuadrant-system/authorino-6c4f8d7d98-gxljd" Jul 17 17:47:50.622168 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.622146 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls669\" (UniqueName: \"kubernetes.io/projected/ce2a6f57-14ab-417d-9101-1a5996260a7d-kube-api-access-ls669\") pod \"authorino-76877994-fnnfd\" (UID: \"ce2a6f57-14ab-417d-9101-1a5996260a7d\") " pod="kuadrant-system/authorino-76877994-fnnfd" Jul 17 17:47:50.652734 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.652705 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-fnnfd" Jul 17 17:47:50.652734 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.652720 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6jpkz" event={"ID":"987665bd-11c5-42a1-8fe1-8abc5786cc96","Type":"ContainerStarted","Data":"2649efe6b01fe5b9d5a3afcfbaf51fd061552e0ecb5d351501555f03e62e179f"} Jul 17 17:47:50.660836 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.660816 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-fnnfd" Jul 17 17:47:50.699822 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.699798 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c4f8d7d98-gxljd" Jul 17 17:47:50.702776 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.702751 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce2a6f57-14ab-417d-9101-1a5996260a7d-tls-cert\") pod \"ce2a6f57-14ab-417d-9101-1a5996260a7d\" (UID: \"ce2a6f57-14ab-417d-9101-1a5996260a7d\") " Jul 17 17:47:50.702895 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.702808 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ls669\" (UniqueName: \"kubernetes.io/projected/ce2a6f57-14ab-417d-9101-1a5996260a7d-kube-api-access-ls669\") pod \"ce2a6f57-14ab-417d-9101-1a5996260a7d\" (UID: \"ce2a6f57-14ab-417d-9101-1a5996260a7d\") " Jul 17 17:47:50.704936 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.704912 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce2a6f57-14ab-417d-9101-1a5996260a7d-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "ce2a6f57-14ab-417d-9101-1a5996260a7d" (UID: "ce2a6f57-14ab-417d-9101-1a5996260a7d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:47:50.705018 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.704956 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce2a6f57-14ab-417d-9101-1a5996260a7d-kube-api-access-ls669" (OuterVolumeSpecName: "kube-api-access-ls669") pod "ce2a6f57-14ab-417d-9101-1a5996260a7d" (UID: "ce2a6f57-14ab-417d-9101-1a5996260a7d"). InnerVolumeSpecName "kube-api-access-ls669". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:47:50.803780 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.803752 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ls669\" (UniqueName: \"kubernetes.io/projected/ce2a6f57-14ab-417d-9101-1a5996260a7d-kube-api-access-ls669\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:47:50.803780 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.803779 2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce2a6f57-14ab-417d-9101-1a5996260a7d-tls-cert\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:47:50.839506 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:50.839417 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c4f8d7d98-gxljd"] Jul 17 17:47:50.842086 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:47:50.842060 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17e81206_e118_4066_82fb_183c7bf4cbea.slice/crio-3e75e73b6e6ef645a9773ae4b0c5516d35e039ae2617b5e29aeef3017be3f6ed WatchSource:0}: Error finding container 3e75e73b6e6ef645a9773ae4b0c5516d35e039ae2617b5e29aeef3017be3f6ed: Status 404 returned error can't find the container with id 3e75e73b6e6ef645a9773ae4b0c5516d35e039ae2617b5e29aeef3017be3f6ed Jul 17 17:47:51.659502 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:51.659465 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6jpkz" event={"ID":"987665bd-11c5-42a1-8fe1-8abc5786cc96","Type":"ContainerStarted","Data":"ae4057753b9fb1c31f0c1ce7b71c66bb35db6c1c2226a393b444761e38441e73"} Jul 17 17:47:51.659969 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:51.659544 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-6jpkz" podUID="987665bd-11c5-42a1-8fe1-8abc5786cc96" containerName="authorino" containerID="cri-o://ae4057753b9fb1c31f0c1ce7b71c66bb35db6c1c2226a393b444761e38441e73" gracePeriod=30 Jul 17 17:47:51.661278 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:51.661257 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-fnnfd" Jul 17 17:47:51.661278 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:51.661267 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c4f8d7d98-gxljd" event={"ID":"17e81206-e118-4066-82fb-183c7bf4cbea","Type":"ContainerStarted","Data":"59dd8c53cddafe241544eb06cf97a0da0816fad75f1e7a15ff170e562f5757cf"} Jul 17 17:47:51.661402 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:51.661302 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c4f8d7d98-gxljd" event={"ID":"17e81206-e118-4066-82fb-183c7bf4cbea","Type":"ContainerStarted","Data":"3e75e73b6e6ef645a9773ae4b0c5516d35e039ae2617b5e29aeef3017be3f6ed"} Jul 17 17:47:51.684514 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:51.684470 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-6jpkz" podStartSLOduration=1.360440121 podStartE2EDuration="1.684423133s" totalImagesPullingTime="323.983012ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:47:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:47:51.683851851 +0000 UTC m=+525.867909630" watchObservedRunningTime="2026-07-17 17:47:51.684423133 +0000 UTC m=+525.868480909" Jul 17 17:47:51.713326 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:51.713270 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6c4f8d7d98-gxljd" podStartSLOduration=1.388563395 podStartE2EDuration="1.713254535s" totalImagesPullingTime="324.69114ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:47:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:47:51.711643325 +0000 UTC m=+525.895701102" watchObservedRunningTime="2026-07-17 17:47:51.713254535 +0000 UTC m=+525.897312312" Jul 17 17:47:51.782145 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:51.782114 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-fnnfd"] Jul 17 17:47:51.795104 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:51.795073 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-fnnfd"] Jul 17 17:47:51.911655 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:51.911599 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6jpkz" Jul 17 17:47:51.912675 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:51.912658 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47d6z\" (UniqueName: \"kubernetes.io/projected/987665bd-11c5-42a1-8fe1-8abc5786cc96-kube-api-access-47d6z\") pod \"987665bd-11c5-42a1-8fe1-8abc5786cc96\" (UID: \"987665bd-11c5-42a1-8fe1-8abc5786cc96\") " Jul 17 17:47:51.914790 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:51.914767 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/987665bd-11c5-42a1-8fe1-8abc5786cc96-kube-api-access-47d6z" (OuterVolumeSpecName: "kube-api-access-47d6z") pod "987665bd-11c5-42a1-8fe1-8abc5786cc96" (UID: "987665bd-11c5-42a1-8fe1-8abc5786cc96"). InnerVolumeSpecName "kube-api-access-47d6z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:47:52.013223 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:52.013190 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47d6z\" (UniqueName: \"kubernetes.io/projected/987665bd-11c5-42a1-8fe1-8abc5786cc96-kube-api-access-47d6z\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:47:52.312496 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:52.312463 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce2a6f57-14ab-417d-9101-1a5996260a7d" path="/var/lib/kubelet/pods/ce2a6f57-14ab-417d-9101-1a5996260a7d/volumes" Jul 17 17:47:52.667146 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:52.667057 2563 generic.go:356] "Generic (PLEG): container finished" podID="987665bd-11c5-42a1-8fe1-8abc5786cc96" containerID="ae4057753b9fb1c31f0c1ce7b71c66bb35db6c1c2226a393b444761e38441e73" exitCode=0 Jul 17 17:47:52.667146 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:52.667096 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6jpkz" Jul 17 17:47:52.667670 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:52.667143 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6jpkz" event={"ID":"987665bd-11c5-42a1-8fe1-8abc5786cc96","Type":"ContainerDied","Data":"ae4057753b9fb1c31f0c1ce7b71c66bb35db6c1c2226a393b444761e38441e73"} Jul 17 17:47:52.667670 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:52.667191 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6jpkz" event={"ID":"987665bd-11c5-42a1-8fe1-8abc5786cc96","Type":"ContainerDied","Data":"2649efe6b01fe5b9d5a3afcfbaf51fd061552e0ecb5d351501555f03e62e179f"} Jul 17 17:47:52.667670 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:52.667213 2563 scope.go:117] "RemoveContainer" containerID="ae4057753b9fb1c31f0c1ce7b71c66bb35db6c1c2226a393b444761e38441e73" Jul 17 17:47:52.675797 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:52.675781 2563 scope.go:117] "RemoveContainer" containerID="ae4057753b9fb1c31f0c1ce7b71c66bb35db6c1c2226a393b444761e38441e73" Jul 17 17:47:52.676099 ip-10-0-133-127 kubenswrapper[2563]: E0717 17:47:52.676080 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae4057753b9fb1c31f0c1ce7b71c66bb35db6c1c2226a393b444761e38441e73\": container with ID starting with ae4057753b9fb1c31f0c1ce7b71c66bb35db6c1c2226a393b444761e38441e73 not found: ID does not exist" containerID="ae4057753b9fb1c31f0c1ce7b71c66bb35db6c1c2226a393b444761e38441e73" Jul 17 17:47:52.676146 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:52.676113 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae4057753b9fb1c31f0c1ce7b71c66bb35db6c1c2226a393b444761e38441e73"} err="failed to get container status \"ae4057753b9fb1c31f0c1ce7b71c66bb35db6c1c2226a393b444761e38441e73\": rpc error: code = NotFound desc = could not find container \"ae4057753b9fb1c31f0c1ce7b71c66bb35db6c1c2226a393b444761e38441e73\": container with ID starting with ae4057753b9fb1c31f0c1ce7b71c66bb35db6c1c2226a393b444761e38441e73 not found: ID does not exist" Jul 17 17:47:52.688632 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:52.688602 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6jpkz"] Jul 17 17:47:52.692381 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:52.692360 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6jpkz"] Jul 17 17:47:54.312810 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:47:54.312782 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="987665bd-11c5-42a1-8fe1-8abc5786cc96" path="/var/lib/kubelet/pods/987665bd-11c5-42a1-8fe1-8abc5786cc96/volumes" Jul 17 17:48:37.471630 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:48:37.471583 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-7ptrs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 17 17:48:37.472053 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:48:37.471693 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" podUID="1847e0b1-18aa-4dcf-b7de-2152913cd7d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 17 17:48:38.894622 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:48:38.894522 2563 generic.go:356] "Generic (PLEG): container finished" podID="1847e0b1-18aa-4dcf-b7de-2152913cd7d2" containerID="0cceb889e6ac361f2bdd222ee9bb991149aa6d1ddbf6ad47bc8cb1264a75db25" exitCode=0 Jul 17 17:48:38.894622 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:48:38.894597 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" event={"ID":"1847e0b1-18aa-4dcf-b7de-2152913cd7d2","Type":"ContainerDied","Data":"0cceb889e6ac361f2bdd222ee9bb991149aa6d1ddbf6ad47bc8cb1264a75db25"} Jul 17 17:48:38.895023 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:48:38.894999 2563 scope.go:117] "RemoveContainer" containerID="0cceb889e6ac361f2bdd222ee9bb991149aa6d1ddbf6ad47bc8cb1264a75db25" Jul 17 17:48:38.895974 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:48:38.895950 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 17:48:38.896071 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:48:38.896054 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 17:48:38.896120 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:48:38.896104 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 17:48:39.901751 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:48:39.901721 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" event={"ID":"1847e0b1-18aa-4dcf-b7de-2152913cd7d2","Type":"ContainerStarted","Data":"eac30a49a13bd2789cf0568f57b0f04ee85eb12ff16e502876645547c1a18d07"} Jul 17 17:48:40.827263 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:48:40.827217 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:48:40.827502 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:48:40.827352 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-7ptrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 17 17:48:40.827502 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:48:40.827400 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" podUID="1847e0b1-18aa-4dcf-b7de-2152913cd7d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 17 17:48:41.827898 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:48:41.827422 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-7ptrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 17 17:48:41.827898 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:48:41.827508 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" podUID="1847e0b1-18aa-4dcf-b7de-2152913cd7d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 17 17:48:42.827564 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:48:42.827526 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-7ptrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 17 17:48:42.827863 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:48:42.827836 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" podUID="1847e0b1-18aa-4dcf-b7de-2152913cd7d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 17 17:48:43.830720 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:48:43.830688 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:48:43.831155 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:48:43.830964 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:48:43.831596 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:48:43.831580 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7ptrs" Jul 17 17:49:06.182373 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:06.182343 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lkfst_b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c/ovn-acl-logging/0.log" Jul 17 17:49:06.182373 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:06.182355 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lkfst_b1beb1f8-14fb-49e3-b5cd-bb0b592bc32c/ovn-acl-logging/0.log" Jul 17 17:49:16.500174 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.500144 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-z5qfv"] Jul 17 17:49:16.500634 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.500518 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="987665bd-11c5-42a1-8fe1-8abc5786cc96" containerName="authorino" Jul 17 17:49:16.500634 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.500529 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="987665bd-11c5-42a1-8fe1-8abc5786cc96" containerName="authorino" Jul 17 17:49:16.500634 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.500600 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="987665bd-11c5-42a1-8fe1-8abc5786cc96" containerName="authorino" Jul 17 17:49:16.503754 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.503734 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z5qfv" Jul 17 17:49:16.507534 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.507505 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6whs9\"" Jul 17 17:49:16.507534 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.507520 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 17 17:49:16.507534 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.507530 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 17 17:49:16.507726 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.507508 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 17 17:49:16.515569 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.515547 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-z5qfv"] Jul 17 17:49:16.679789 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.679758 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfa7f1d3-b446-4be7-81aa-dd7708f72a05-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z5qfv\" (UID: \"cfa7f1d3-b446-4be7-81aa-dd7708f72a05\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z5qfv" Jul 17 17:49:16.679957 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.679801 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7n95\" (UniqueName: \"kubernetes.io/projected/cfa7f1d3-b446-4be7-81aa-dd7708f72a05-kube-api-access-q7n95\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z5qfv\" (UID: \"cfa7f1d3-b446-4be7-81aa-dd7708f72a05\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z5qfv" Jul 17 17:49:16.679957 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.679861 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfa7f1d3-b446-4be7-81aa-dd7708f72a05-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z5qfv\" (UID: \"cfa7f1d3-b446-4be7-81aa-dd7708f72a05\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z5qfv" Jul 17 17:49:16.679957 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.679912 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfa7f1d3-b446-4be7-81aa-dd7708f72a05-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z5qfv\" (UID: \"cfa7f1d3-b446-4be7-81aa-dd7708f72a05\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z5qfv" Jul 17 17:49:16.679957 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.679927 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfa7f1d3-b446-4be7-81aa-dd7708f72a05-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z5qfv\" (UID: \"cfa7f1d3-b446-4be7-81aa-dd7708f72a05\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z5qfv" Jul 17 17:49:16.679957 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.679941 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfa7f1d3-b446-4be7-81aa-dd7708f72a05-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z5qfv\" (UID: \"cfa7f1d3-b446-4be7-81aa-dd7708f72a05\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z5qfv" Jul 17 17:49:16.780916 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.780836 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7n95\" (UniqueName: \"kubernetes.io/projected/cfa7f1d3-b446-4be7-81aa-dd7708f72a05-kube-api-access-q7n95\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z5qfv\" (UID: \"cfa7f1d3-b446-4be7-81aa-dd7708f72a05\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z5qfv" Jul 17 17:49:16.780916 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.780889 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfa7f1d3-b446-4be7-81aa-dd7708f72a05-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z5qfv\" (UID: \"cfa7f1d3-b446-4be7-81aa-dd7708f72a05\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z5qfv" Jul 17 17:49:16.781104 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.780939 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfa7f1d3-b446-4be7-81aa-dd7708f72a05-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z5qfv\" (UID: \"cfa7f1d3-b446-4be7-81aa-dd7708f72a05\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z5qfv" Jul 17 17:49:16.781104 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.780956 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfa7f1d3-b446-4be7-81aa-dd7708f72a05-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z5qfv\" (UID: \"cfa7f1d3-b446-4be7-81aa-dd7708f72a05\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z5qfv" Jul 17 17:49:16.781104 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.780970 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfa7f1d3-b446-4be7-81aa-dd7708f72a05-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z5qfv\" (UID: \"cfa7f1d3-b446-4be7-81aa-dd7708f72a05\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z5qfv" Jul 17 17:49:16.781104 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.780989 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfa7f1d3-b446-4be7-81aa-dd7708f72a05-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z5qfv\" (UID: \"cfa7f1d3-b446-4be7-81aa-dd7708f72a05\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z5qfv" Jul 17 17:49:16.781359 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.781335 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfa7f1d3-b446-4be7-81aa-dd7708f72a05-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z5qfv\" (UID: \"cfa7f1d3-b446-4be7-81aa-dd7708f72a05\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z5qfv" Jul 17 17:49:16.781397 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.781354 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfa7f1d3-b446-4be7-81aa-dd7708f72a05-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z5qfv\" (UID: \"cfa7f1d3-b446-4be7-81aa-dd7708f72a05\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z5qfv" Jul 17 17:49:16.781431 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.781393 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfa7f1d3-b446-4be7-81aa-dd7708f72a05-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z5qfv\" (UID: \"cfa7f1d3-b446-4be7-81aa-dd7708f72a05\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z5qfv" Jul 17 17:49:16.783438 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.783409 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfa7f1d3-b446-4be7-81aa-dd7708f72a05-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z5qfv\" (UID: \"cfa7f1d3-b446-4be7-81aa-dd7708f72a05\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z5qfv" Jul 17 17:49:16.783694 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.783677 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfa7f1d3-b446-4be7-81aa-dd7708f72a05-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z5qfv\" (UID: \"cfa7f1d3-b446-4be7-81aa-dd7708f72a05\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z5qfv" Jul 17 17:49:16.789871 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.789851 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7n95\" (UniqueName: \"kubernetes.io/projected/cfa7f1d3-b446-4be7-81aa-dd7708f72a05-kube-api-access-q7n95\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z5qfv\" (UID: \"cfa7f1d3-b446-4be7-81aa-dd7708f72a05\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z5qfv" Jul 17 17:49:16.814522 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.814496 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z5qfv" Jul 17 17:49:16.952557 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.952487 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-z5qfv"] Jul 17 17:49:16.954843 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:49:16.954812 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfa7f1d3_b446_4be7_81aa_dd7708f72a05.slice/crio-f59da2add0ccdefd0a2cf9b687ef81b1cb1123544d0e5cb3902aaebc8e8a40bb WatchSource:0}: Error finding container f59da2add0ccdefd0a2cf9b687ef81b1cb1123544d0e5cb3902aaebc8e8a40bb: Status 404 returned error can't find the container with id f59da2add0ccdefd0a2cf9b687ef81b1cb1123544d0e5cb3902aaebc8e8a40bb Jul 17 17:49:16.956203 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:16.956183 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 17:49:17.095895 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:17.095814 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z5qfv" event={"ID":"cfa7f1d3-b446-4be7-81aa-dd7708f72a05","Type":"ContainerStarted","Data":"f59da2add0ccdefd0a2cf9b687ef81b1cb1123544d0e5cb3902aaebc8e8a40bb"} Jul 17 17:49:19.117100 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:19.117061 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z5qfv" event={"ID":"cfa7f1d3-b446-4be7-81aa-dd7708f72a05","Type":"ContainerStarted","Data":"f4aaecb9172e6bfe87c4078a39f97febcc8e48b5f88cd43916d9041bfa050bb0"} Jul 17 17:49:19.136353 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:19.136304 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z5qfv" podStartSLOduration=1.8474708180000001 podStartE2EDuration="3.136287167s" totalImagesPullingTime="1.288816349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:49:19.134936483 +0000 UTC m=+613.318994271" watchObservedRunningTime="2026-07-17 17:49:19.136287167 +0000 UTC m=+613.320344945" Jul 17 17:49:26.815715 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:26.815677 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z5qfv" Jul 17 17:49:26.816198 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:26.815734 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z5qfv" Jul 17 17:49:26.828218 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:26.828185 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z5qfv" Jul 17 17:49:27.169000 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:27.168883 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z5qfv" Jul 17 17:49:46.893362 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:46.893317 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g"] Jul 17 17:49:46.898128 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:46.898106 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g" Jul 17 17:49:46.900813 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:46.900790 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 17 17:49:46.907488 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:46.907457 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g"] Jul 17 17:49:46.959299 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:46.959266 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/723ae6e9-63c5-4b33-b598-f05545851a62-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g\" (UID: \"723ae6e9-63c5-4b33-b598-f05545851a62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g" Jul 17 17:49:46.959299 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:46.959304 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/723ae6e9-63c5-4b33-b598-f05545851a62-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g\" (UID: \"723ae6e9-63c5-4b33-b598-f05545851a62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g" Jul 17 17:49:46.959614 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:46.959377 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/723ae6e9-63c5-4b33-b598-f05545851a62-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g\" (UID: \"723ae6e9-63c5-4b33-b598-f05545851a62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g" Jul 17 17:49:46.959614 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:46.959412 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/723ae6e9-63c5-4b33-b598-f05545851a62-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g\" (UID: \"723ae6e9-63c5-4b33-b598-f05545851a62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g" Jul 17 17:49:46.959614 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:46.959490 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpp6r\" (UniqueName: \"kubernetes.io/projected/723ae6e9-63c5-4b33-b598-f05545851a62-kube-api-access-vpp6r\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g\" (UID: \"723ae6e9-63c5-4b33-b598-f05545851a62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g" Jul 17 17:49:46.959614 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:46.959576 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/723ae6e9-63c5-4b33-b598-f05545851a62-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g\" (UID: \"723ae6e9-63c5-4b33-b598-f05545851a62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g" Jul 17 17:49:47.060741 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:47.060705 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/723ae6e9-63c5-4b33-b598-f05545851a62-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g\" (UID: \"723ae6e9-63c5-4b33-b598-f05545851a62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g" Jul 17 17:49:47.060921 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:47.060750 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/723ae6e9-63c5-4b33-b598-f05545851a62-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g\" (UID: \"723ae6e9-63c5-4b33-b598-f05545851a62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g" Jul 17 17:49:47.060921 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:47.060771 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpp6r\" (UniqueName: \"kubernetes.io/projected/723ae6e9-63c5-4b33-b598-f05545851a62-kube-api-access-vpp6r\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g\" (UID: \"723ae6e9-63c5-4b33-b598-f05545851a62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g" Jul 17 17:49:47.060921 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:47.060885 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/723ae6e9-63c5-4b33-b598-f05545851a62-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g\" (UID: \"723ae6e9-63c5-4b33-b598-f05545851a62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g" Jul 17 17:49:47.061044 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:47.060987 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/723ae6e9-63c5-4b33-b598-f05545851a62-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g\" (UID: \"723ae6e9-63c5-4b33-b598-f05545851a62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g" Jul 17 17:49:47.061044 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:47.061020 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/723ae6e9-63c5-4b33-b598-f05545851a62-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g\" (UID: \"723ae6e9-63c5-4b33-b598-f05545851a62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g" Jul 17 17:49:47.061217 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:47.061191 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/723ae6e9-63c5-4b33-b598-f05545851a62-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g\" (UID: \"723ae6e9-63c5-4b33-b598-f05545851a62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g" Jul 17 17:49:47.061257 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:47.061210 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/723ae6e9-63c5-4b33-b598-f05545851a62-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g\" (UID: \"723ae6e9-63c5-4b33-b598-f05545851a62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g" Jul 17 17:49:47.061337 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:47.061317 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/723ae6e9-63c5-4b33-b598-f05545851a62-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g\" (UID: \"723ae6e9-63c5-4b33-b598-f05545851a62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g" Jul 17 17:49:47.063414 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:47.063384 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/723ae6e9-63c5-4b33-b598-f05545851a62-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g\" (UID: \"723ae6e9-63c5-4b33-b598-f05545851a62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g" Jul 17 17:49:47.063597 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:47.063580 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/723ae6e9-63c5-4b33-b598-f05545851a62-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g\" (UID: \"723ae6e9-63c5-4b33-b598-f05545851a62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g" Jul 17 17:49:47.070212 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:47.070177 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpp6r\" (UniqueName: \"kubernetes.io/projected/723ae6e9-63c5-4b33-b598-f05545851a62-kube-api-access-vpp6r\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g\" (UID: \"723ae6e9-63c5-4b33-b598-f05545851a62\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g" Jul 17 17:49:47.208723 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:47.208629 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g" Jul 17 17:49:47.355982 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:47.355954 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g"] Jul 17 17:49:47.357626 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:49:47.357594 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod723ae6e9_63c5_4b33_b598_f05545851a62.slice/crio-7d49b2b8d53e837093fb9712dc5341185192ba23af682b4a0a14209e1532c5aa WatchSource:0}: Error finding container 7d49b2b8d53e837093fb9712dc5341185192ba23af682b4a0a14209e1532c5aa: Status 404 returned error can't find the container with id 7d49b2b8d53e837093fb9712dc5341185192ba23af682b4a0a14209e1532c5aa Jul 17 17:49:48.263521 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:48.263475 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g" event={"ID":"723ae6e9-63c5-4b33-b598-f05545851a62","Type":"ContainerStarted","Data":"d491dcafc32b7bf3c5d1bfde2fee79249ba100484bff62e20081fa0d386c6a6c"} Jul 17 17:49:48.263920 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:48.263529 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g" event={"ID":"723ae6e9-63c5-4b33-b598-f05545851a62","Type":"ContainerStarted","Data":"7d49b2b8d53e837093fb9712dc5341185192ba23af682b4a0a14209e1532c5aa"} Jul 17 17:49:48.285265 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:48.285208 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g" podStartSLOduration=2.076523103 podStartE2EDuration="2.285184165s" totalImagesPullingTime="208.661062ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:49:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:49:48.28351653 +0000 UTC m=+642.467574308" watchObservedRunningTime="2026-07-17 17:49:48.285184165 +0000 UTC m=+642.469241942" Jul 17 17:49:57.209837 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:57.209802 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g" Jul 17 17:49:57.209837 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:57.209845 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g" Jul 17 17:49:57.222660 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:57.222632 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g" Jul 17 17:49:57.325434 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:49:57.325403 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g" Jul 17 17:51:04.426961 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:51:04.426747 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c4f8d7d98-gxljd"] Jul 17 17:51:04.427786 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:51:04.427739 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6c4f8d7d98-gxljd" podUID="17e81206-e118-4066-82fb-183c7bf4cbea" containerName="authorino" containerID="cri-o://59dd8c53cddafe241544eb06cf97a0da0816fad75f1e7a15ff170e562f5757cf" gracePeriod=30 Jul 17 17:51:04.663429 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:51:04.663388 2563 generic.go:356] "Generic (PLEG): container finished" podID="17e81206-e118-4066-82fb-183c7bf4cbea" containerID="59dd8c53cddafe241544eb06cf97a0da0816fad75f1e7a15ff170e562f5757cf" exitCode=0 Jul 17 17:51:04.663620 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:51:04.663433 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c4f8d7d98-gxljd" event={"ID":"17e81206-e118-4066-82fb-183c7bf4cbea","Type":"ContainerDied","Data":"59dd8c53cddafe241544eb06cf97a0da0816fad75f1e7a15ff170e562f5757cf"} Jul 17 17:51:04.687258 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:51:04.687203 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c4f8d7d98-gxljd" Jul 17 17:51:04.777579 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:51:04.777545 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/17e81206-e118-4066-82fb-183c7bf4cbea-tls-cert\") pod \"17e81206-e118-4066-82fb-183c7bf4cbea\" (UID: \"17e81206-e118-4066-82fb-183c7bf4cbea\") " Jul 17 17:51:04.777755 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:51:04.777628 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpdvd\" (UniqueName: \"kubernetes.io/projected/17e81206-e118-4066-82fb-183c7bf4cbea-kube-api-access-dpdvd\") pod \"17e81206-e118-4066-82fb-183c7bf4cbea\" (UID: \"17e81206-e118-4066-82fb-183c7bf4cbea\") " Jul 17 17:51:04.779724 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:51:04.779693 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17e81206-e118-4066-82fb-183c7bf4cbea-kube-api-access-dpdvd" (OuterVolumeSpecName: "kube-api-access-dpdvd") pod "17e81206-e118-4066-82fb-183c7bf4cbea" (UID: "17e81206-e118-4066-82fb-183c7bf4cbea"). InnerVolumeSpecName "kube-api-access-dpdvd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:51:04.789628 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:51:04.789604 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17e81206-e118-4066-82fb-183c7bf4cbea-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "17e81206-e118-4066-82fb-183c7bf4cbea" (UID: "17e81206-e118-4066-82fb-183c7bf4cbea"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:51:04.878750 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:51:04.878713 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpdvd\" (UniqueName: \"kubernetes.io/projected/17e81206-e118-4066-82fb-183c7bf4cbea-kube-api-access-dpdvd\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:51:04.878750 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:51:04.878742 2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/17e81206-e118-4066-82fb-183c7bf4cbea-tls-cert\") on node \"ip-10-0-133-127.ec2.internal\" DevicePath \"\"" Jul 17 17:51:05.668931 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:51:05.668894 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c4f8d7d98-gxljd" event={"ID":"17e81206-e118-4066-82fb-183c7bf4cbea","Type":"ContainerDied","Data":"3e75e73b6e6ef645a9773ae4b0c5516d35e039ae2617b5e29aeef3017be3f6ed"} Jul 17 17:51:05.668931 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:51:05.668927 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c4f8d7d98-gxljd" Jul 17 17:51:05.669395 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:51:05.668954 2563 scope.go:117] "RemoveContainer" containerID="59dd8c53cddafe241544eb06cf97a0da0816fad75f1e7a15ff170e562f5757cf" Jul 17 17:51:05.701536 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:51:05.701513 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c4f8d7d98-gxljd"] Jul 17 17:51:05.708192 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:51:05.708158 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6c4f8d7d98-gxljd"] Jul 17 17:51:06.311807 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:51:06.311777 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17e81206-e118-4066-82fb-183c7bf4cbea" path="/var/lib/kubelet/pods/17e81206-e118-4066-82fb-183c7bf4cbea/volumes" Jul 17 17:51:50.596913 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:51:50.596876 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-c67cg_52e9ba48-5c48-49cc-bd37-997fcdff80c4/server/0.log" Jul 17 17:51:51.119299 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:51:51.119272 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7467c84498-kv6tk_e5ca9048-fe22-45d9-8e76-706544527f39/copy-manifests/0.log" Jul 17 17:51:51.126693 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:51:51.126672 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7467c84498-kv6tk_e5ca9048-fe22-45d9-8e76-706544527f39/manager/0.log" Jul 17 17:51:53.277856 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:51:53.277828 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-z7k64_a7b65ba9-383b-48f3-986c-67362fbd2d5b/manager/0.log" Jul 17 17:51:53.544654 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:51:53.544582 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-89gfr_803e3d3d-ed4d-4284-bb57-e10c750430f4/registry-server/0.log" Jul 17 17:51:53.677516 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:51:53.677487 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-jp4mb_aac38bd7-1621-4fbb-9e6e-ff2882c12a42/manager/0.log" Jul 17 17:51:53.954898 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:51:53.954818 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7wrcc_8bf455e3-eb99-4a51-a3ca-ec56fc70416b/manager/0.log" Jul 17 17:51:54.319636 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:51:54.319609 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf44kgm2_c7fdf0f1-7d29-4ff3-a263-558589c3ce0b/istio-proxy/0.log" Jul 17 17:51:54.807638 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:51:54.807610 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7ptrs_1847e0b1-18aa-4dcf-b7de-2152913cd7d2/istio-proxy/1.log" Jul 17 17:51:55.677299 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:51:55.677259 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-z5qfv_cfa7f1d3-b446-4be7-81aa-dd7708f72a05/main/0.log" Jul 17 17:51:56.151988 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:51:56.151962 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-zd88g_723ae6e9-63c5-4b33-b598-f05545851a62/main/0.log" Jul 17 17:52:01.919537 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:01.919506 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5z966/must-gather-47vw9"] Jul 17 17:52:01.919918 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:01.919882 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17e81206-e118-4066-82fb-183c7bf4cbea" containerName="authorino" Jul 17 17:52:01.919918 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:01.919892 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="17e81206-e118-4066-82fb-183c7bf4cbea" containerName="authorino" Jul 17 17:52:01.919992 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:01.919960 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="17e81206-e118-4066-82fb-183c7bf4cbea" containerName="authorino" Jul 17 17:52:01.922967 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:01.922947 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5z966/must-gather-47vw9" Jul 17 17:52:01.926259 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:01.926233 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5z966\"/\"openshift-service-ca.crt\"" Jul 17 17:52:01.926259 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:01.926248 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5z966\"/\"kube-root-ca.crt\"" Jul 17 17:52:01.926487 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:01.926233 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5z966\"/\"default-dockercfg-hdt5b\"" Jul 17 17:52:01.932433 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:01.932409 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5z966/must-gather-47vw9"] Jul 17 17:52:02.016376 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:02.016334 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/55284220-5c4b-4f29-920a-98be0ac548ea-must-gather-output\") pod \"must-gather-47vw9\" (UID: \"55284220-5c4b-4f29-920a-98be0ac548ea\") " pod="openshift-must-gather-5z966/must-gather-47vw9" Jul 17 17:52:02.016616 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:02.016479 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvw48\" (UniqueName: \"kubernetes.io/projected/55284220-5c4b-4f29-920a-98be0ac548ea-kube-api-access-rvw48\") pod \"must-gather-47vw9\" (UID: \"55284220-5c4b-4f29-920a-98be0ac548ea\") " pod="openshift-must-gather-5z966/must-gather-47vw9" Jul 17 17:52:02.117229 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:02.117196 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvw48\" (UniqueName: \"kubernetes.io/projected/55284220-5c4b-4f29-920a-98be0ac548ea-kube-api-access-rvw48\") pod \"must-gather-47vw9\" (UID: \"55284220-5c4b-4f29-920a-98be0ac548ea\") " pod="openshift-must-gather-5z966/must-gather-47vw9" Jul 17 17:52:02.117414 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:02.117287 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/55284220-5c4b-4f29-920a-98be0ac548ea-must-gather-output\") pod \"must-gather-47vw9\" (UID: \"55284220-5c4b-4f29-920a-98be0ac548ea\") " pod="openshift-must-gather-5z966/must-gather-47vw9" Jul 17 17:52:02.117630 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:02.117610 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/55284220-5c4b-4f29-920a-98be0ac548ea-must-gather-output\") pod \"must-gather-47vw9\" (UID: \"55284220-5c4b-4f29-920a-98be0ac548ea\") " pod="openshift-must-gather-5z966/must-gather-47vw9" Jul 17 17:52:02.127709 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:02.127674 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvw48\" (UniqueName: \"kubernetes.io/projected/55284220-5c4b-4f29-920a-98be0ac548ea-kube-api-access-rvw48\") pod \"must-gather-47vw9\" (UID: \"55284220-5c4b-4f29-920a-98be0ac548ea\") " pod="openshift-must-gather-5z966/must-gather-47vw9" Jul 17 17:52:02.232355 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:02.232324 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5z966/must-gather-47vw9" Jul 17 17:52:02.370224 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:02.370181 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5z966/must-gather-47vw9"] Jul 17 17:52:02.372634 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:52:02.372606 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55284220_5c4b_4f29_920a_98be0ac548ea.slice/crio-f3ebe5ada4db4fbabebe450c9a05bfeacc0286a5c98a9e0b793ad8bb9b224740 WatchSource:0}: Error finding container f3ebe5ada4db4fbabebe450c9a05bfeacc0286a5c98a9e0b793ad8bb9b224740: Status 404 returned error can't find the container with id f3ebe5ada4db4fbabebe450c9a05bfeacc0286a5c98a9e0b793ad8bb9b224740 Jul 17 17:52:02.961977 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:02.961941 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5z966/must-gather-47vw9" event={"ID":"55284220-5c4b-4f29-920a-98be0ac548ea","Type":"ContainerStarted","Data":"f3ebe5ada4db4fbabebe450c9a05bfeacc0286a5c98a9e0b793ad8bb9b224740"} Jul 17 17:52:03.970564 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:03.970529 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5z966/must-gather-47vw9" event={"ID":"55284220-5c4b-4f29-920a-98be0ac548ea","Type":"ContainerStarted","Data":"6c62893dbec458787e278ef3d74ff833ae6e73d17a9adcdd5f5b69b4ce84ece6"} Jul 17 17:52:03.970967 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:03.970577 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5z966/must-gather-47vw9" event={"ID":"55284220-5c4b-4f29-920a-98be0ac548ea","Type":"ContainerStarted","Data":"3167427c2354aaf8dd2b4e1dffa087800a1f788641baa545dc2d7f01848c1437"} Jul 17 17:52:03.989184 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:03.989125 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5z966/must-gather-47vw9" podStartSLOduration=2.091304256 podStartE2EDuration="2.989105135s" totalImagesPullingTime="897.800879ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:52:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:52:03.987928337 +0000 UTC m=+778.171986117" watchObservedRunningTime="2026-07-17 17:52:03.989105135 +0000 UTC m=+778.173162915" Jul 17 17:52:05.116532 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:05.116504 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xxhkm_6d3cc0e8-3539-4637-b778-a4cd8663d4f2/global-pull-secret-syncer/0.log" Jul 17 17:52:05.254141 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:05.254112 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vw726_7004a1df-981b-4eb2-bb70-742617ac70e4/konnectivity-agent/0.log" Jul 17 17:52:05.309053 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:05.309024 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-127.ec2.internal_7276ebbf3e3a8cdc488397a5fe19d27c/haproxy/0.log" Jul 17 17:52:10.412182 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:10.412074 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-z7k64_a7b65ba9-383b-48f3-986c-67362fbd2d5b/manager/0.log" Jul 17 17:52:10.531372 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:10.531335 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-89gfr_803e3d3d-ed4d-4284-bb57-e10c750430f4/registry-server/0.log" Jul 17 17:52:10.570790 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:10.570762 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-jp4mb_aac38bd7-1621-4fbb-9e6e-ff2882c12a42/manager/0.log" Jul 17 17:52:10.648151 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:10.648061 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7wrcc_8bf455e3-eb99-4a51-a3ca-ec56fc70416b/manager/0.log" Jul 17 17:52:12.368873 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:12.368786 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d223849f-f51a-44c2-8088-31ec8e118084/alertmanager/0.log" Jul 17 17:52:12.396462 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:12.396412 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d223849f-f51a-44c2-8088-31ec8e118084/config-reloader/0.log" Jul 17 17:52:12.424034 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:12.424003 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d223849f-f51a-44c2-8088-31ec8e118084/kube-rbac-proxy-web/0.log" Jul 17 17:52:12.452789 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:12.452753 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d223849f-f51a-44c2-8088-31ec8e118084/kube-rbac-proxy/0.log" Jul 17 17:52:12.483999 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:12.483967 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d223849f-f51a-44c2-8088-31ec8e118084/kube-rbac-proxy-metric/0.log" Jul 17 17:52:12.514279 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:12.514254 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d223849f-f51a-44c2-8088-31ec8e118084/prom-label-proxy/0.log" Jul 17 17:52:12.545229 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:12.545187 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d223849f-f51a-44c2-8088-31ec8e118084/init-config-reloader/0.log" Jul 17 17:52:12.596554 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:12.596520 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-4sxf2_1b994728-13e4-4275-ad5f-541496a45529/cluster-monitoring-operator/0.log" Jul 17 17:52:12.733670 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:12.733644 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-58777f4675-vq66k_93ac6c26-ada3-40f6-b390-9ac217e32791/metrics-server/0.log" Jul 17 17:52:12.913675 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:12.913627 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nrwkb_7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0/node-exporter/0.log" Jul 17 17:52:12.943901 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:12.943862 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nrwkb_7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0/kube-rbac-proxy/0.log" Jul 17 17:52:12.971015 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:12.970978 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nrwkb_7e0214fe-32f1-4b89-b8b4-194fc5a0c8e0/init-textfile/0.log" Jul 17 17:52:13.410809 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:13.410767 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-zb8rr_5d6bd8db-22c5-4534-92e9-39810d189b83/prometheus-operator/0.log" Jul 17 17:52:13.432513 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:13.432420 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-zb8rr_5d6bd8db-22c5-4534-92e9-39810d189b83/kube-rbac-proxy/0.log" Jul 17 17:52:13.587680 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:13.587649 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79cd4f8576-b45ch_c1b8e8f8-197e-4a22-8585-d13cefcddd8c/thanos-query/0.log" Jul 17 17:52:13.615386 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:13.615320 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79cd4f8576-b45ch_c1b8e8f8-197e-4a22-8585-d13cefcddd8c/kube-rbac-proxy-web/0.log" Jul 17 17:52:13.639504 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:13.639476 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79cd4f8576-b45ch_c1b8e8f8-197e-4a22-8585-d13cefcddd8c/kube-rbac-proxy/0.log" Jul 17 17:52:13.667648 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:13.667600 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79cd4f8576-b45ch_c1b8e8f8-197e-4a22-8585-d13cefcddd8c/prom-label-proxy/0.log" Jul 17 17:52:13.692355 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:13.692288 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79cd4f8576-b45ch_c1b8e8f8-197e-4a22-8585-d13cefcddd8c/kube-rbac-proxy-rules/0.log" Jul 17 17:52:13.718424 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:13.718393 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79cd4f8576-b45ch_c1b8e8f8-197e-4a22-8585-d13cefcddd8c/kube-rbac-proxy-metrics/0.log" Jul 17 17:52:14.903734 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:14.903706 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-9skxw_6541a578-5d14-4e5e-99a4-2dc54bd9295d/networking-console-plugin/0.log" Jul 17 17:52:14.929462 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:14.929409 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5z966/perf-node-gather-daemonset-62bt4"] Jul 17 17:52:14.937567 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:14.937539 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5z966/perf-node-gather-daemonset-62bt4" Jul 17 17:52:14.945427 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:14.945393 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5z966/perf-node-gather-daemonset-62bt4"] Jul 17 17:52:15.062170 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:15.062126 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/710d407d-ef17-4db2-a81a-520a4211838e-proc\") pod \"perf-node-gather-daemonset-62bt4\" (UID: \"710d407d-ef17-4db2-a81a-520a4211838e\") " pod="openshift-must-gather-5z966/perf-node-gather-daemonset-62bt4" Jul 17 17:52:15.062405 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:15.062324 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/710d407d-ef17-4db2-a81a-520a4211838e-sys\") pod \"perf-node-gather-daemonset-62bt4\" (UID: \"710d407d-ef17-4db2-a81a-520a4211838e\") " pod="openshift-must-gather-5z966/perf-node-gather-daemonset-62bt4" Jul 17 17:52:15.062405 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:15.062361 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/710d407d-ef17-4db2-a81a-520a4211838e-podres\") pod \"perf-node-gather-daemonset-62bt4\" (UID: \"710d407d-ef17-4db2-a81a-520a4211838e\") " pod="openshift-must-gather-5z966/perf-node-gather-daemonset-62bt4" Jul 17 17:52:15.062610 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:15.062424 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfj7v\" (UniqueName: \"kubernetes.io/projected/710d407d-ef17-4db2-a81a-520a4211838e-kube-api-access-xfj7v\") pod \"perf-node-gather-daemonset-62bt4\" (UID: \"710d407d-ef17-4db2-a81a-520a4211838e\") " pod="openshift-must-gather-5z966/perf-node-gather-daemonset-62bt4" Jul 17 17:52:15.062610 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:15.062502 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/710d407d-ef17-4db2-a81a-520a4211838e-lib-modules\") pod \"perf-node-gather-daemonset-62bt4\" (UID: \"710d407d-ef17-4db2-a81a-520a4211838e\") " pod="openshift-must-gather-5z966/perf-node-gather-daemonset-62bt4" Jul 17 17:52:15.163928 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:15.163830 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/710d407d-ef17-4db2-a81a-520a4211838e-sys\") pod \"perf-node-gather-daemonset-62bt4\" (UID: \"710d407d-ef17-4db2-a81a-520a4211838e\") " pod="openshift-must-gather-5z966/perf-node-gather-daemonset-62bt4" Jul 17 17:52:15.164169 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:15.164146 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/710d407d-ef17-4db2-a81a-520a4211838e-podres\") pod \"perf-node-gather-daemonset-62bt4\" (UID: \"710d407d-ef17-4db2-a81a-520a4211838e\") " pod="openshift-must-gather-5z966/perf-node-gather-daemonset-62bt4" Jul 17 17:52:15.164304 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:15.164289 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfj7v\" (UniqueName: \"kubernetes.io/projected/710d407d-ef17-4db2-a81a-520a4211838e-kube-api-access-xfj7v\") pod \"perf-node-gather-daemonset-62bt4\" (UID: \"710d407d-ef17-4db2-a81a-520a4211838e\") " pod="openshift-must-gather-5z966/perf-node-gather-daemonset-62bt4" Jul 17 17:52:15.164416 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:15.164404 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/710d407d-ef17-4db2-a81a-520a4211838e-lib-modules\") pod \"perf-node-gather-daemonset-62bt4\" (UID: \"710d407d-ef17-4db2-a81a-520a4211838e\") " pod="openshift-must-gather-5z966/perf-node-gather-daemonset-62bt4" Jul 17 17:52:15.164567 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:15.164554 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/710d407d-ef17-4db2-a81a-520a4211838e-proc\") pod \"perf-node-gather-daemonset-62bt4\" (UID: \"710d407d-ef17-4db2-a81a-520a4211838e\") " pod="openshift-must-gather-5z966/perf-node-gather-daemonset-62bt4" Jul 17 17:52:15.164852 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:15.164836 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/710d407d-ef17-4db2-a81a-520a4211838e-proc\") pod \"perf-node-gather-daemonset-62bt4\" (UID: \"710d407d-ef17-4db2-a81a-520a4211838e\") " pod="openshift-must-gather-5z966/perf-node-gather-daemonset-62bt4" Jul 17 17:52:15.164993 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:15.164980 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/710d407d-ef17-4db2-a81a-520a4211838e-sys\") pod \"perf-node-gather-daemonset-62bt4\" (UID: \"710d407d-ef17-4db2-a81a-520a4211838e\") " pod="openshift-must-gather-5z966/perf-node-gather-daemonset-62bt4" Jul 17 17:52:15.165167 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:15.165154 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/710d407d-ef17-4db2-a81a-520a4211838e-podres\") pod \"perf-node-gather-daemonset-62bt4\" (UID: \"710d407d-ef17-4db2-a81a-520a4211838e\") " pod="openshift-must-gather-5z966/perf-node-gather-daemonset-62bt4" Jul 17 17:52:15.165667 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:15.165647 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/710d407d-ef17-4db2-a81a-520a4211838e-lib-modules\") pod \"perf-node-gather-daemonset-62bt4\" (UID: \"710d407d-ef17-4db2-a81a-520a4211838e\") " pod="openshift-must-gather-5z966/perf-node-gather-daemonset-62bt4" Jul 17 17:52:15.174986 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:15.174933 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfj7v\" (UniqueName: \"kubernetes.io/projected/710d407d-ef17-4db2-a81a-520a4211838e-kube-api-access-xfj7v\") pod \"perf-node-gather-daemonset-62bt4\" (UID: \"710d407d-ef17-4db2-a81a-520a4211838e\") " pod="openshift-must-gather-5z966/perf-node-gather-daemonset-62bt4" Jul 17 17:52:15.252213 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:15.252176 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5z966/perf-node-gather-daemonset-62bt4" Jul 17 17:52:15.469344 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:15.469162 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5z966/perf-node-gather-daemonset-62bt4"] Jul 17 17:52:15.471832 ip-10-0-133-127 kubenswrapper[2563]: W0717 17:52:15.471784 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod710d407d_ef17_4db2_a81a_520a4211838e.slice/crio-0649c98285cc42e362c968f84b0098870915f26c2e17c3094e0e3f07b340a663 WatchSource:0}: Error finding container 0649c98285cc42e362c968f84b0098870915f26c2e17c3094e0e3f07b340a663: Status 404 returned error can't find the container with id 0649c98285cc42e362c968f84b0098870915f26c2e17c3094e0e3f07b340a663 Jul 17 17:52:16.066681 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:16.066633 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5z966/perf-node-gather-daemonset-62bt4" event={"ID":"710d407d-ef17-4db2-a81a-520a4211838e","Type":"ContainerStarted","Data":"35c49a0e080282ed383ac00a7c77dcc9776a1f161c9402f280d6c0286bb2d89b"} Jul 17 17:52:16.067161 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:16.066710 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5z966/perf-node-gather-daemonset-62bt4" event={"ID":"710d407d-ef17-4db2-a81a-520a4211838e","Type":"ContainerStarted","Data":"0649c98285cc42e362c968f84b0098870915f26c2e17c3094e0e3f07b340a663"} Jul 17 17:52:16.067550 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:16.067524 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5z966/perf-node-gather-daemonset-62bt4" Jul 17 17:52:16.086331 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:16.086262 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5z966/perf-node-gather-daemonset-62bt4" podStartSLOduration=2.086239583 podStartE2EDuration="2.086239583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:52:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:52:16.085582892 +0000 UTC m=+790.269640670" watchObservedRunningTime="2026-07-17 17:52:16.086239583 +0000 UTC m=+790.270297361" Jul 17 17:52:18.009235 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:18.009199 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k8x8w_13be2935-6a7b-4e88-9f49-99d389d8d95a/dns/0.log" Jul 17 17:52:18.034414 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:18.034385 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k8x8w_13be2935-6a7b-4e88-9f49-99d389d8d95a/kube-rbac-proxy/0.log" Jul 17 17:52:18.093163 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:18.093137 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f97wh_d4dcc94c-110b-4b31-8a6c-dfbae393c058/dns-node-resolver/0.log" Jul 17 17:52:18.691599 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:18.691571 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-f665644df-5pp64_d5c5e35b-d118-42df-8627-5e48df3a1417/registry/0.log" Jul 17 17:52:18.719025 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:18.718986 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b2qql_85eee69e-719a-48b1-95fb-e2012eb6e31f/node-ca/0.log" Jul 17 17:52:19.911843 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:19.911763 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf44kgm2_c7fdf0f1-7d29-4ff3-a263-558589c3ce0b/istio-proxy/0.log" Jul 17 17:52:20.045111 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:20.045081 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7ptrs_1847e0b1-18aa-4dcf-b7de-2152913cd7d2/istio-proxy/0.log" Jul 17 17:52:20.045297 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:20.045226 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7ptrs_1847e0b1-18aa-4dcf-b7de-2152913cd7d2/istio-proxy/1.log" Jul 17 17:52:20.757011 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:20.756979 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-228td_0f38ee65-d199-4c5d-b8ad-4251ea4d3285/serve-healthcheck-canary/0.log" Jul 17 17:52:21.521841 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:21.521808 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-trcj8_c46ea5c6-3992-4e9d-b278-22afb27c04a4/kube-rbac-proxy/0.log" Jul 17 17:52:21.551254 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:21.551212 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-trcj8_c46ea5c6-3992-4e9d-b278-22afb27c04a4/exporter/0.log" Jul 17 17:52:21.588052 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:21.588016 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-trcj8_c46ea5c6-3992-4e9d-b278-22afb27c04a4/extractor/0.log" Jul 17 17:52:23.092238 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:23.092205 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5z966/perf-node-gather-daemonset-62bt4" Jul 17 17:52:24.054778 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:24.054752 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-c67cg_52e9ba48-5c48-49cc-bd37-997fcdff80c4/server/0.log" Jul 17 17:52:24.258188 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:24.258154 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7467c84498-kv6tk_e5ca9048-fe22-45d9-8e76-706544527f39/manager/0.log" Jul 17 17:52:24.282154 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:24.282125 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7467c84498-kv6tk_e5ca9048-fe22-45d9-8e76-706544527f39/copy-manifests/0.log" Jul 17 17:52:25.410633 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:25.410558 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf44kgm2_c7fdf0f1-7d29-4ff3-a263-558589c3ce0b/istio-proxy/0.log" Jul 17 17:52:25.525214 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:25.525152 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7ptrs_1847e0b1-18aa-4dcf-b7de-2152913cd7d2/istio-proxy/0.log" Jul 17 17:52:25.527650 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:25.527609 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7ptrs_1847e0b1-18aa-4dcf-b7de-2152913cd7d2/istio-proxy/1.log" Jul 17 17:52:25.697039 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:25.696956 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-855d9d8444-wjhnz_4c89f493-d645-4590-9aac-0f2dbadd99b7/manager/0.log" Jul 17 17:52:26.729153 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:26.729122 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf44kgm2_c7fdf0f1-7d29-4ff3-a263-558589c3ce0b/istio-proxy/0.log" Jul 17 17:52:26.819543 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:26.819510 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7ptrs_1847e0b1-18aa-4dcf-b7de-2152913cd7d2/istio-proxy/0.log" Jul 17 17:52:26.819744 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:26.819715 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7ptrs_1847e0b1-18aa-4dcf-b7de-2152913cd7d2/istio-proxy/1.log" Jul 17 17:52:33.076696 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:33.076670 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zfjf6_c3987132-0222-45e9-8c90-7a3ad682329e/kube-multus-additional-cni-plugins/0.log" Jul 17 17:52:33.104028 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:33.103998 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zfjf6_c3987132-0222-45e9-8c90-7a3ad682329e/egress-router-binary-copy/0.log" Jul 17 17:52:33.130326 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:33.130304 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zfjf6_c3987132-0222-45e9-8c90-7a3ad682329e/cni-plugins/0.log" Jul 17 17:52:33.155838 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:33.155814 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zfjf6_c3987132-0222-45e9-8c90-7a3ad682329e/bond-cni-plugin/0.log" Jul 17 17:52:33.184314 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:33.184284 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zfjf6_c3987132-0222-45e9-8c90-7a3ad682329e/routeoverride-cni/0.log" Jul 17 17:52:33.210432 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:33.210403 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zfjf6_c3987132-0222-45e9-8c90-7a3ad682329e/whereabouts-cni-bincopy/0.log" Jul 17 17:52:33.242417 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:33.242389 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zfjf6_c3987132-0222-45e9-8c90-7a3ad682329e/whereabouts-cni/0.log" Jul 17 17:52:33.325584 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:33.325514 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mhw56_29d7b457-69a2-47e0-9da5-4b88178bea9d/kube-multus/0.log" Jul 17 17:52:33.385762 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:33.385736 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-82zfd_05410b3d-9fba-454e-be26-568dbfce20f4/network-metrics-daemon/0.log" Jul 17 17:52:33.411489 ip-10-0-133-127 kubenswrapper[2563]: I0717 17:52:33.411439 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-82zfd_05410b3d-9fba-454e-be26-568dbfce20f4/kube-rbac-proxy/0.log"